Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67;
Date:   Fri, 18 Jan 2019 21:38:32 +0100
From:   Otto Sabart <ottosabart@seberm.com>
To:     linux-kernel@vger.kernel.org, linux-doc@vger.kernel.org,
        netdev@vger.kernel.org
Cc:     "David S. Miller" <davem@davemloft.net>,
        Jonathan Corbet <corbet@lwn.net>
Subject: [PATCH v2 1/1] doc: networking: integrate scaling document into doc
 tree
Message-ID: <3eddcfcf3916ef8e89230971359fc9b6bef35d20.1547843156.git.ottosabart@seberm.com>
References: <cover.1547843156.git.ottosabart@seberm.com>
MIME-Version: 1.0
Content-Type: multipart/signed; micalg=pgp-sha512;
        protocol="application/pgp-signature"; boundary="HlL+5n6rz5pIUxbD"
Content-Disposition: inline
In-Reply-To: <cover.1547843156.git.ottosabart@seberm.com>
User-Agent: Mutt/1.10.1 (2018-07-13)
Sender: linux-kernel-owner@vger.kernel.org
Precedence: bulk


--HlL+5n6rz5pIUxbD
Content-Type: text/plain; charset=utf-8
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

Convert scaling document into reStructuredText and add reference to
scaling document into main table of contents in network documentation.

There are no semantic changes.

There are no references to "scaling.txt" file. Whole kernel tree was
checked using:
$ grep -r "scaling\.txt"

Signed-off-by: Otto Sabart <ottosabart@seberm.com>
---
 Documentation/networking/index.rst            |   1 +
 .../networking/{scaling.txt =3D> scaling.rst}   | 131 ++++++++++++------
 2 files changed, 86 insertions(+), 46 deletions(-)
 rename Documentation/networking/{scaling.txt =3D> scaling.rst} (92%)

diff --git a/Documentation/networking/index.rst b/Documentation/networking/=
index.rst
index 6a47629ef8ed..47552ea410fe 100644
--- a/Documentation/networking/index.rst
+++ b/Documentation/networking/index.rst
@@ -32,6 +32,7 @@ Contents:
    alias
    bridge
    snmp_counter
+   scaling
=20
 .. only::  subproject
=20
diff --git a/Documentation/networking/scaling.txt b/Documentation/networkin=
g/scaling.rst
similarity index 92%
rename from Documentation/networking/scaling.txt
rename to Documentation/networking/scaling.rst
index b7056a8a0540..f78d7bf27ff5 100644
--- a/Documentation/networking/scaling.txt
+++ b/Documentation/networking/scaling.rst
@@ -1,4 +1,8 @@
+.. SPDX-License-Identifier: GPL-2.0
+
+=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
 Scaling in the Linux Networking Stack
+=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
=20
=20
 Introduction
@@ -10,11 +14,11 @@ multi-processor systems.
=20
 The following technologies are described:
=20
-  RSS: Receive Side Scaling
-  RPS: Receive Packet Steering
-  RFS: Receive Flow Steering
-  Accelerated Receive Flow Steering
-  XPS: Transmit Packet Steering
+- RSS: Receive Side Scaling
+- RPS: Receive Packet Steering
+- RFS: Receive Flow Steering
+- Accelerated Receive Flow Steering
+- XPS: Transmit Packet Steering
=20
=20
 RSS: Receive Side Scaling
@@ -45,7 +49,9 @@ programmable filters. For example, webserver bound TCP po=
rt 80 packets
 can be directed to their own receive queue. Such =E2=80=9Cn-tuple=E2=80=9D=
 filters can
 be configured from ethtool (--config-ntuple).
=20
-=3D=3D=3D=3D RSS Configuration
+
+RSS Configuration
+-----------------
=20
 The driver for a multi-queue capable NIC typically provides a kernel
 module parameter for specifying the number of hardware queues to
@@ -63,7 +69,9 @@ commands (--show-rxfh-indir and --set-rxfh-indir). Modify=
ing the
 indirection table could be done to give different queues different
 relative weights.
=20
-=3D=3D RSS IRQ Configuration
+
+RSS IRQ Configuration
+~~~~~~~~~~~~~~~~~~~~~
=20
 Each receive queue has a separate IRQ associated with it. The NIC triggers
 this to notify a CPU when new packets arrive on the given queue. The
@@ -77,7 +85,9 @@ affinity of each interrupt see Documentation/IRQ-affinity=
=2Etxt. Some systems
 will be running irqbalance, a daemon that dynamically optimizes IRQ
 assignments and as a result may override any manual settings.
=20
-=3D=3D Suggested Configuration
+
+Suggested Configuration
+~~~~~~~~~~~~~~~~~~~~~~~
=20
 RSS should be enabled when latency is a concern or whenever receive
 interrupt processing forms a bottleneck. Spreading load between CPUs
@@ -105,10 +115,12 @@ Whereas RSS selects the queue and hence CPU that will=
 run the hardware
 interrupt handler, RPS selects the CPU to perform protocol processing
 above the interrupt handler. This is accomplished by placing the packet
 on the desired CPU=E2=80=99s backlog queue and waking up the CPU for proce=
ssing.
-RPS has some advantages over RSS: 1) it can be used with any NIC,
-2) software filters can easily be added to hash over new protocols,
+RPS has some advantages over RSS:
+
+1) it can be used with any NIC
+2) software filters can easily be added to hash over new protocols
 3) it does not increase hardware device interrupt rate (although it does
-introduce inter-processor interrupts (IPIs)).
+   introduce inter-processor interrupts (IPIs))
=20
 RPS is called during bottom half of the receive interrupt handler, when
 a driver sends a packet up the network stack with netif_rx() or
@@ -135,21 +147,25 @@ packets have been queued to their backlog queue. The =
IPI wakes backlog
 processing on the remote CPU, and any queued packets are then processed
 up the networking stack.
=20
-=3D=3D=3D=3D RPS Configuration
+
+RPS Configuration
+-----------------
=20
 RPS requires a kernel compiled with the CONFIG_RPS kconfig symbol (on
 by default for SMP). Even when compiled in, RPS remains disabled until
 explicitly configured. The list of CPUs to which RPS may forward traffic
-can be configured for each receive queue using a sysfs file entry:
+can be configured for each receive queue using a sysfs file entry::
=20
- /sys/class/net/<dev>/queues/rx-<n>/rps_cpus
+  /sys/class/net/<dev>/queues/rx-<n>/rps_cpus
=20
 This file implements a bitmap of CPUs. RPS is disabled when it is zero
 (the default), in which case packets are processed on the interrupting
 CPU. Documentation/IRQ-affinity.txt explains how CPUs are assigned to
 the bitmap.
=20
-=3D=3D Suggested Configuration
+
+Suggested Configuration
+~~~~~~~~~~~~~~~~~~~~~~~
=20
 For a single queue device, a typical RPS configuration would be to set
 the rps_cpus to the CPUs in the same memory domain of the interrupting
@@ -163,7 +179,9 @@ and unnecessary. If there are fewer hardware queues tha=
n CPUs, then
 RPS might be beneficial if the rps_cpus for each queue are the ones that
 share the same memory domain as the interrupting CPU for that queue.
=20
-=3D=3D=3D=3D RPS Flow Limit
+
+RPS Flow Limit
+--------------
=20
 RPS scales kernel receive processing across CPUs without introducing
 reordering. The trade-off to sending all packets from the same flow
@@ -187,29 +205,33 @@ No packets are dropped when the input packet queue le=
ngth is below
 the threshold, so flow limit does not sever connections outright:
 even large flows maintain connectivity.
=20
-=3D=3D Interface
+
+Interface
+~~~~~~~~~
=20
 Flow limit is compiled in by default (CONFIG_NET_FLOW_LIMIT), but not
 turned on. It is implemented for each CPU independently (to avoid lock
 and cache contention) and toggled per CPU by setting the relevant bit
 in sysctl net.core.flow_limit_cpu_bitmap. It exposes the same CPU
-bitmap interface as rps_cpus (see above) when called from procfs:
+bitmap interface as rps_cpus (see above) when called from procfs::
=20
- /proc/sys/net/core/flow_limit_cpu_bitmap
+  /proc/sys/net/core/flow_limit_cpu_bitmap
=20
 Per-flow rate is calculated by hashing each packet into a hashtable
 bucket and incrementing a per-bucket counter. The hash function is
 the same that selects a CPU in RPS, but as the number of buckets can
 be much larger than the number of CPUs, flow limit has finer-grained
 identification of large flows and fewer false positives. The default
-table has 4096 buckets. This value can be modified through sysctl
+table has 4096 buckets. This value can be modified through sysctl::
=20
- net.core.flow_limit_table_len
+  net.core.flow_limit_table_len
=20
 The value is only consulted when a new table is allocated. Modifying
 it does not update active tables.
=20
-=3D=3D Suggested Configuration
+
+Suggested Configuration
+~~~~~~~~~~~~~~~~~~~~~~~
=20
 Flow limit is useful on systems with many concurrent connections,
 where a single connection taking up 50% of a CPU indicates a problem.
@@ -280,10 +302,10 @@ table), the packet is enqueued onto that CPU=E2=80=99=
s backlog. If they differ,
 the current CPU is updated to match the desired CPU if one of the
 following is true:
=20
-- The current CPU's queue head counter >=3D the recorded tail counter
-  value in rps_dev_flow[i]
-- The current CPU is unset (>=3D nr_cpu_ids)
-- The current CPU is offline
+  - The current CPU's queue head counter >=3D the recorded tail counter
+    value in rps_dev_flow[i]
+  - The current CPU is unset (>=3D nr_cpu_ids)
+  - The current CPU is offline
=20
 After this check, the packet is sent to the (possibly updated) current
 CPU. These rules aim to ensure that a flow only moves to a new CPU when
@@ -291,19 +313,23 @@ there are no packets outstanding on the old CPU, as t=
he outstanding
 packets could arrive later than those about to be processed on the new
 CPU.
=20
-=3D=3D=3D=3D RFS Configuration
+
+RFS Configuration
+-----------------
=20
 RFS is only available if the kconfig symbol CONFIG_RPS is enabled (on
 by default for SMP). The functionality remains disabled until explicitly
-configured. The number of entries in the global flow table is set through:
+configured. The number of entries in the global flow table is set through::
+
+  /proc/sys/net/core/rps_sock_flow_entries
=20
- /proc/sys/net/core/rps_sock_flow_entries
+The number of entries in the per-queue flow table are set through::
=20
-The number of entries in the per-queue flow table are set through:
+  /sys/class/net/<dev>/queues/rx-<n>/rps_flow_cnt
=20
- /sys/class/net/<dev>/queues/rx-<n>/rps_flow_cnt
=20
-=3D=3D Suggested Configuration
+Suggested Configuration
+~~~~~~~~~~~~~~~~~~~~~~~
=20
 Both of these need to be set before RFS is enabled for a receive queue.
 Values for both are rounded up to the nearest power of two. The
@@ -347,7 +373,9 @@ functions in the cpu_rmap (=E2=80=9CCPU affinity revers=
e map=E2=80=9D) kernel library
 to populate the map. For each CPU, the corresponding queue in the map is
 set to be one whose processing CPU is closest in cache locality.
=20
-=3D=3D=3D=3D Accelerated RFS Configuration
+
+Accelerated RFS Configuration
+-----------------------------
=20
 Accelerated RFS is only available if the kernel is compiled with
 CONFIG_RFS_ACCEL and support is provided by the NIC device and driver.
@@ -356,11 +384,14 @@ of CPU to queues is automatically deduced from the IR=
Q affinities
 configured for each receive queue by the driver, so no additional
 configuration should be necessary.
=20
-=3D=3D Suggested Configuration
+
+Suggested Configuration
+~~~~~~~~~~~~~~~~~~~~~~~
=20
 This technique should be enabled whenever one wants to use RFS and the
 NIC supports hardware acceleration.
=20
+
 XPS: Transmit Packet Steering
 =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D
=20
@@ -430,20 +461,25 @@ transport layer is responsible for setting ooo_okay a=
ppropriately. TCP,
 for instance, sets the flag when all data for a connection has been
 acknowledged.
=20
-=3D=3D=3D=3D XPS Configuration
+XPS Configuration
+-----------------
=20
 XPS is only available if the kconfig symbol CONFIG_XPS is enabled (on by
 default for SMP). The functionality remains disabled until explicitly
 configured. To enable XPS, the bitmap of CPUs/receive-queues that may
 use a transmit queue is configured using the sysfs file entry:
=20
-For selection based on CPUs map:
-/sys/class/net/<dev>/queues/tx-<n>/xps_cpus
+For selection based on CPUs map::
+
+  /sys/class/net/<dev>/queues/tx-<n>/xps_cpus
+
+For selection based on receive-queues map::
+
+  /sys/class/net/<dev>/queues/tx-<n>/xps_rxqs
=20
-For selection based on receive-queues map:
-/sys/class/net/<dev>/queues/tx-<n>/xps_rxqs
=20
-=3D=3D Suggested Configuration
+Suggested Configuration
+~~~~~~~~~~~~~~~~~~~~~~~
=20
 For a network device with a single transmission queue, XPS configuration
 has no effect, since there is no choice in this case. In a multi-queue
@@ -460,16 +496,18 @@ explicitly configured mapping receive-queue(s) to tra=
nsmit queue(s). If the
 user configuration for receive-queue map does not apply, then the transmit
 queue is selected based on the CPUs map.
=20
-Per TX Queue rate limitation:
-=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D
+
+Per TX Queue rate limitation
+=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D
=20
 These are rate-limitation mechanisms implemented by HW, where currently
-a max-rate attribute is supported, by setting a Mbps value to
+a max-rate attribute is supported, by setting a Mbps value to::
=20
-/sys/class/net/<dev>/queues/tx-<n>/tx_maxrate
+  /sys/class/net/<dev>/queues/tx-<n>/tx_maxrate
=20
 A value of zero means disabled, and this is the default.
=20
+
 Further Information
 =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
 RPS and RFS were introduced in kernel 2.6.35. XPS was incorporated into
@@ -480,5 +518,6 @@ Accelerated RFS was introduced in 2.6.35. Original patc=
hes were
 submitted by Ben Hutchings (bwh@kernel.org)
=20
 Authors:
-Tom Herbert (therbert@google.com)
-Willem de Bruijn (willemb@google.com)
+
+- Tom Herbert (therbert@google.com)
+- Willem de Bruijn (willemb@google.com)
--=20
2.17.2


--HlL+5n6rz5pIUxbD
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----

iQIzBAEBCgAdFiEEb6VOpv2s03VHGoilgjuumfi+HjwFAlxCOUgACgkQgjuumfi+
Hjy9oA/+MnCWS3cVmKjBGVrEVgqi0opfDcDJ7PQNKIyQKGtNDugegjTfz8RmqMKv
/b2dAkf8JrIKcmjiOMiUN84JQyMqUgan4Z3n86ZGAU4qtOumyYKSbKaFu0KyJryt
nvm21S9BOIAK3+H/epyaBtEZnQfgkrjPitCdSzNgSksVKvfJdyzEII17lENlHAZ8
LVY00jDVU1XYt8X5kMo64LeE6RM416U9Rj3NqYUMUm622f5tQ3YBMndqcOh1IWHS
Nhi3QZF6czfci2pEy2aXO1kg6H4OiSI+94ZSVuwZVVLvTR2bey1TXO2sXKKR4g1v
dPqAXfJmzM1LM1A7P3WD/si1qX7bRnZovEyMyGRrwwqYJlCgZzSPRs/fsoOzHAWW
FjQwT7uB5YGykpcSwc85BD3/t9XPj9HLQ9e1glkfPKZsnNJgJNA8iosrm+8lOE/Q
sTpN2zuQnDVTdNXu/d6Mw1sAngXz+y0nVREOzScj7PJXeqMeSvLKcdnzv+ss6tO5
b39noWzqTjao+RsxmB7aJGDYnmVyPLwyGLTgNmaebZazOI1kt3Nqg7XX1Q+WIr62
P7JuLXECIo/sb3LScdRYuFyDTGKBRF+sEfkVrPc1zlI2/YXdKgGSx8yAC02Etr16
/tp+/t0JxEZCEzSuJTB1HP6Gts0y9KIpqf7Dcz6kpqpEIstHNM4=
=bEX9
-----END PGP SIGNATURE-----

--HlL+5n6rz5pIUxbD--