Received: by 2002:a25:8b91:0:0:0:0:0 with SMTP id j17csp1997988ybl; Thu, 5 Dec 2019 10:15:16 -0800 (PST) X-Google-Smtp-Source: APXvYqwl/BAvu/1NW+KopMEaxw0rRkBPSvdYS9RtWonwmDCkTpgiqpmXcTYf/ZpN4pRr+Q3n6gF7 X-Received: by 2002:a05:6808:b26:: with SMTP id t6mr7916391oij.123.1575569716593; Thu, 05 Dec 2019 10:15:16 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1575569716; cv=none; d=google.com; s=arc-20160816; b=z5fBqxF2eUe2eGq+nHYv4+wywD1XqlM1H4y13LoItEq8tLZua22gAW4lTx5f3niZmi 3S4Tan0iDs0vj7ccamDbcu64LerwUKjvh0aeN4uT6VyERZGXfmw7axec6UpFZJ0etuQK W6jmls38QCLrOSMCXSuYZ1uYL1fYAsAFzmMnlSIweWEaPNcnTeAf7T2qgYRuckCTObjn GX6Fy984B01/xiJd2K1KEffbkz5mKSz1d9OWMPJgMAEP0JYKhhJNAglMYTqDs12tVLeC pXMg+CFTxEEZPoMc6vi8aD+XWL2AnISWrrxvizTRXXrtoOWQXobaDgfFpEEwYgX3cBtv 9AQA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:organization:from:references:cc:to:subject :dkim-signature:dkim-filter; bh=mQuNECGcirluSchrVhf9oi+h+e5D4vwDl1RpDKHOz2w=; b=FYN6K6/f2EMN2Msp11v5dRoanLcAo2QpSB3+1AsnuxWGBog7t6mUZaV8/k4GQ9e5pz b3WKmeKduWoZ3sX25a/ksVIfgydOBW0fkGMAc1+M2WNRBOEn8VdcRpHYi5uefRyAqepV FaVpI3jqbm77N3T3BpAGTjjgzTuekvIC3+VAmM1NmNtnrMP82IrXyE1nhupi+x8nPRn+ BF4Yp8n+8K4jeRUd/Zdl3e36YTrenkkkO+deEaRDyKdXgPhyjx2ZyqNCBfzEJgVhpX3S 7wcbXZoIfrGfEuH66nnEkQTSY9tjEClqoq0927oR4BPZlr7k9hPMfM7epoQkwVnz06iA Tr0w== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@candelatech.com header.s=default header.b=KGZ+1643; spf=pass (google.com: best guess record for domain of linux-wireless-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-wireless-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=candelatech.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id u6si5732592oth.29.2019.12.05.10.15.05; Thu, 05 Dec 2019 10:15:16 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-wireless-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@candelatech.com header.s=default header.b=KGZ+1643; spf=pass (google.com: best guess record for domain of linux-wireless-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-wireless-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=candelatech.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1729793AbfLESJP (ORCPT + 99 others); Thu, 5 Dec 2019 13:09:15 -0500 Received: from mail2.candelatech.com ([208.74.158.173]:40750 "EHLO mail3.candelatech.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726028AbfLESJP (ORCPT ); Thu, 5 Dec 2019 13:09:15 -0500 Received: from [192.168.100.195] (50-251-239-81-static.hfc.comcastbusiness.net [50.251.239.81]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail3.candelatech.com (Postfix) with ESMTPSA id 0EECA137531; Thu, 5 Dec 2019 10:09:15 -0800 (PST) DKIM-Filter: OpenDKIM Filter v2.11.0 mail3.candelatech.com 0EECA137531 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=candelatech.com; s=default; t=1575569355; bh=3yG6hawqFldzQPCpVnhw/zdRxWbBO1ALa1XHuZ5hWpQ=; h=Subject:To:Cc:References:From:Date:In-Reply-To:From; b=KGZ+1643ceJ5sEm4WGi4/Ni9FDNIXhkPdHzGt8pBumkWGuXGmCCROncTDKn2xvotp hf20W+ihlVQmSEXcnbqK/escz+kOVgjHh73vlOZak8Mebm5JbGv+0XPO4iE9zFKcTB tsNeJT7a71WmlnFgWLkbBNsSXvXB4cz6R5TM2TJ4= Subject: Re: debugging TXQs being empty To: Johannes Berg , =?UTF-8?Q?Toke_H=c3=b8iland-J=c3=b8rgensen?= Cc: linux-wireless@vger.kernel.org References: <49288397-55b3-f49a-e277-5197d7c1bea3@candelatech.com> <2e01fb1d5b8ff3335220231251f893c01c6c22d3.camel@sipsolutions.net> <64a6ae15-b7be-8c27-4e60-4cb3d253f3dc@candelatech.com> From: Ben Greear Organization: Candela Technologies Message-ID: Date: Thu, 5 Dec 2019 10:09:14 -0800 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.1.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit Sender: linux-wireless-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-wireless@vger.kernel.org On 12/5/19 10:04 AM, Johannes Berg wrote: > On Thu, 2019-12-05 at 08:57 -0800, Ben Greear wrote: >> On 12/5/19 8:49 AM, Johannes Berg wrote: >>> On Thu, 2019-12-05 at 08:37 -0800, Ben Greear wrote: >>> >>>>> All this seems to mean that the TCP stack isn't feeding us fast enough, >>>>> but is that really possible? >>>> >>>> Does UDP work better? >>> >>> Somewhat, I get about 1020-1030 Mbps. But still a TON of "TXQ of STA ... >>> is now empty" messages. Say this run got about 15 per second of those. >> >> It would seem that it is not some issue with TCP stack then? > > Hmm, yeah, maybe not then. Something more general in the stack? I just > can't think of anything. Test similar setup 10g wired to 10g wired to make sure traffic generator can generate hoped for load? > >> In general, UDP uses more CPU to send from user-space than TCP >> because of TSO, etc. Sendmmsg can help a bit, but it is a bit painful >> to code against so things like iperf do not use it, at least ones I've >> looked at. > > True. > >> Can you provide some details on how you are generating this load? > > Using chariot. I don't really know it well, just the testers use it. So, you have some PC with AX200 in it, acting as station, connected to some AP, and Charriot runs on that PC and something upstream of the AP and tries to send traffic from PC to AP? If you can share the AP model, just possibly we have one and could do a similar test.... Thanks, Ben -- Ben Greear Candela Technologies Inc http://www.candelatech.com