Return-path: Received: from mail2.candelatech.com ([208.74.158.173]:37530 "EHLO mail2.candelatech.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726021AbeHTSbH (ORCPT ); Mon, 20 Aug 2018 14:31:07 -0400 Subject: Re: [PATCH v2 0/2] Change sk_pacing_shift in ieee80211_hw for best tx throughput To: =?UTF-8?Q?Toke_H=c3=b8iland-J=c3=b8rgensen?= , Arend van Spriel , Peter Oh , Wen Gong , ath10k@lists.infradead.org, johannes@sipsolutions.net References: <1533724802-30944-1-git-send-email-wgong@codeaurora.org> <4dbcc269-1f2b-b165-fe9e-8704fd77d1c5@bowerswilkins.com> <5B6C0A3C.3020908@broadcom.com> <87k1oye4ty.fsf@toke.dk> <5B6DE758.8040605@broadcom.com> <93ff2bad-5b11-0edd-16cd-a2a7c54701b8@candelatech.com> <5B6F3729.4040807@broadcom.com> <87tvnp9peg.fsf@toke.dk> Cc: linux-wireless@vger.kernel.org, Eric Dumazet From: Ben Greear Message-ID: (sfid-20180820_171507_951876_B9E01683) Date: Mon, 20 Aug 2018 08:14:51 -0700 MIME-Version: 1.0 In-Reply-To: <87tvnp9peg.fsf@toke.dk> Content-Type: text/plain; charset=utf-8; format=flowed Sender: linux-wireless-owner@vger.kernel.org List-ID: On 08/20/2018 05:46 AM, Toke Høiland-Jørgensen wrote: > Arend van Spriel writes: > >> + Eric >> >> On 8/10/2018 9:52 PM, Ben Greear wrote: >>> On 08/10/2018 12:28 PM, Arend van Spriel wrote: >>>> On 8/10/2018 3:20 PM, Toke Høiland-Jørgensen wrote: >>>>> Arend van Spriel writes: >>>>> >>>>>> On 8/8/2018 9:00 PM, Peter Oh wrote: >>>>>>> >>>>>>> >>>>>>> On 08/08/2018 03:40 AM, Wen Gong wrote: >>>>>>>> Add a field for ath10k to adjust the sk_pacing_shift, mac80211 set >>>>>>>> the default value to 8, and ath10k will change it to 6. Then mac80211 >>>>>>>> will use the changed value 6 as sk_pacing_shift since 6 is the best >>>>>>>> value for tx throughput by test result. >>>>>>> I don't think you can convince people with the numbers unless you >>>>>>> provide latency along with the numbers and also measurement result on >>>>>>> different chipsets as Michal addressed (QCA4019, QCA9984, etc.) From >>>>>>> users view point, I also agree on Toke that we cannot scarify latency >>>>>>> for the small throughput improvement. >>>>>> >>>>>> Yeah. The wireless industry (admittedly that is me too :-p ) has been >>>>>> focused on just throughput long enough. >>>>> >>>>> Tell me about it ;) >>>>> >>>>>> All the preaching about bufferbloat from Dave and others is (just) >>>>>> starting to sink in here and there. >>>>> >>>>> Yeah, I've noticed; this is good! >>>>> >>>>>> Now as for the value of the sk_pacing_shift I think we agree it >>>>>> depends on the specific device so in that sense the api makes sense, >>>>>> but I think there are a lot of variables so I was wondering if we >>>>>> could introduce a sysctl parameter for it. Does that make sense? >>>>> >>>>> I'm not sure a sysctl parameter would make sense; for one thing, it >>>>> would be global for the host, while different network interfaces will >>>>> probably need different values. And for another, I don't think it's >>>>> something a user can reasonably be expected to set correctly, and I >>>>> think it *is* actually possible to pick a value that works well at the >>>>> driver level. >>>> >>>> I not sure either. Do you think a user could come up with something >>>> like this (found here [1]): >>>> >>>> sysctl -w net.core.rmem_max=8388608 >>>> sysctl -w net.core.wmem_max=8388608 >>>> sysctl -w net.core.rmem_default=65536 >>>> sysctl -w net.core.wmem_default=65536 >>>> sysctl -w net.ipv4.tcp_rmem='4096 87380 8388608' >>>> sysctl -w net.ipv4.tcp_wmem='4096 65536 8388608' >>>> sysctl -w net.ipv4.tcp_mem='8388608 8388608 8388608' >>>> sysctl -w net.ipv4.route.flush=1 >>>> >>>> Now the page listing this config claims this is for use "on Linux 2.4+ >>>> for high-bandwidth applications". Beats me if it still is correct in >>>> 4.17. >>>> >>>> Anyway, sysctl is nice for parameterizing code that is built-in the >>>> kernel so you don't need to rebuild it. mac80211 tends to be a module >>>> in most distros so >>>> maybe sysctl is not a good fit. So lets agree on that. >>>> >>>> Picking a value at driver level may be possible, but a driver tends to >>>> support a number of different devices. So how do you see the picking >>>> work. Some static >>>> table with entries for the different devices? >>> >>> Some users are not going to care about latency, and for others, latency may >>> be absolutely important and they don't care about bandwidth. >>> >>> So, it should be tunable. sysctl can support per network-device settings, >>> right? Or, probably could use ethtool API to set a per-netdev value as >>> well. >>> That might be nice for other network devices as well, not just wifi. >> >> I was under the impression that the parameters are all global, but your >> statement made me look. I came across some references here [2] so I >> checked the kernel sources under net/ and found net/ipv4/devinet.c [3]. >> So that confirms it supports per-netdev settings. > > Yeah, I think that *if* this is to be made configurable, a per-netdev > sysctl would be the way to go, with the driver being able to set the > default. > > However, the reason I think it may not be worth it to expose this as a > setting is that it is very much a case of diminishing returns. Once the > buffer size is large enough that full aggregates can be built, > increasing it further just adds latency with very little effect on > throughput. Which means that fiddling with the parameter is not going to > have a lot of effect, so it is not very useful to expose, which makes it > not worth the added configuration complexity... If it were easy, it would already be correct. I think adding tuning knob and some documentation will allow users to more easily try different things and use what is best for them (and let the community at large know what works so maybe the defaults can be tweaked over time). Thanks, Ben -- Ben Greear Candela Technologies Inc http://www.candelatech.com