Received: by 2002:ac0:a594:0:0:0:0:0 with SMTP id m20-v6csp1977062imm; Tue, 22 May 2018 12:30:42 -0700 (PDT) X-Google-Smtp-Source: AB8JxZoFenU+jtJq88eAx1Js9fx68seKGttcBrIvwV9mal46OPOjFIuVrQW32inQkzd33LtK/ULa X-Received: by 2002:a62:9c0d:: with SMTP id f13-v6mr25176979pfe.15.1527017442008; Tue, 22 May 2018 12:30:42 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1527017441; cv=none; d=google.com; s=arc-20160816; b=V5c97ISrCKWGP2ilyqabekYEl2f6l+Wz90POt7+n7oAaTTmiGuMn4mqrP50HOAsS3q PpGyz6/162m/UKIqeSZXQr+MJ2tE5cAgIESHqL5xDTEK4IWRc+5ui5OMR0rbUqbOm2DD RPSdmDbFzASMCbWoeahosmqH2mSXOrwCYtbWiCfZw1+87rzym31V7IZ09Oyh7m4svyQv DKdBT6l252DNJvgjuW5M1tMqUTlsaosW3LcNLtKtWoLyFK9kHAA3vuQlpBwPiKqaAmT/ f+hLdAlA1hTD8LjgWJe64WWGzRczqq1IREqLR0mJSsjjTLzKL9sD5JBr+JGStaKYcYNp MNew== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:to:references:message-id :content-transfer-encoding:cc:date:in-reply-to:from:subject :mime-version:dkim-signature:arc-authentication-results; bh=wxdWjBg5/W7sCDQVmFsRtK4ZEEVWeI1FtNvHPRI79ks=; b=GexLWApkD7NWTrpRa8o8AewOMRzxfPZRafDYHTtewdCgmPZTkcNjc3Q5mShIZpmvPk auFZoPO1wSIgH4BHAq7+XCb3PK/LFdkyW8W91xbA3Zy3lH5+YueFVRwL91qzSNq5LBRj n8Bm52yeVFDz0FmNyhsnq3vQgnPpfOYdgqvDD2V9wpG5rV4ecJI5GYgUalHGorrDWMNZ rEmh5835vJGrdq02JSxR/bZDq9Bp2akLzWrAN181TIgLCmkuUC9Itg8frHkQA+qlZ/fv JYjd0OTVm0Vf5gfIq5ki4318mIkRX1GA03IETr/EHCcYMwtQ58gSrUbZSMIAhUfuye7h oS1Q== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@oracle.com header.s=corp-2017-10-26 header.b=tE2UcQSZ; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=oracle.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id p7-v6si4418891pgn.346.2018.05.22.12.30.21; Tue, 22 May 2018 12:30:41 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@oracle.com header.s=corp-2017-10-26 header.b=tE2UcQSZ; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=oracle.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1752133AbeEVTaB (ORCPT + 99 others); Tue, 22 May 2018 15:30:01 -0400 Received: from userp2130.oracle.com ([156.151.31.86]:58484 "EHLO userp2130.oracle.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751512AbeEVTaA (ORCPT ); Tue, 22 May 2018 15:30:00 -0400 Received: from pps.filterd (userp2130.oracle.com [127.0.0.1]) by userp2130.oracle.com (8.16.0.22/8.16.0.22) with SMTP id w4MJPatw057581; Tue, 22 May 2018 19:29:56 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=content-type : mime-version : subject : from : in-reply-to : date : cc : content-transfer-encoding : message-id : references : to; s=corp-2017-10-26; bh=wxdWjBg5/W7sCDQVmFsRtK4ZEEVWeI1FtNvHPRI79ks=; b=tE2UcQSZOpcpG7YWzZ5Pw+pSfmkgSdhvyouiGkyF0uhYHHN28LgsxN3QJP8VVpjLb7cB XCweKKSThCAbN80CUK6yUuMZMBlelauZfFTZg3XdI6oYqTTS60vVC90xcczVZcPr3ig6 VV4tdc0oPdSLng+Uhoyk8Sr8tPiuNSa5MgXr4B/WWbfIqlq6fYVj75xEXKBopxnTJTzw onJxQjSt60bMsTuijnEQvHszR+bJew3x+d1cwY1D5fzzI/12SlDKvVPSlcFsMinqN3dw qDukwsM7MJFq4v9K0OF80PNnytHjHuyiA9d/l5cz8bps9qHWLBqTvSP/7m3Kg7FPvQGm nw== Received: from aserv0022.oracle.com (aserv0022.oracle.com [141.146.126.234]) by userp2130.oracle.com with ESMTP id 2j4nh7h69a-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Tue, 22 May 2018 19:29:56 +0000 Received: from aserv0121.oracle.com (aserv0121.oracle.com [141.146.126.235]) by aserv0022.oracle.com (8.14.4/8.14.4) with ESMTP id w4MJTtBF008879 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Tue, 22 May 2018 19:29:55 GMT Received: from abhmp0016.oracle.com (abhmp0016.oracle.com [141.146.116.22]) by aserv0121.oracle.com (8.14.4/8.13.8) with ESMTP id w4MJTtgf029948; Tue, 22 May 2018 19:29:55 GMT Received: from dhcp-10-154-165-23.vpn.oracle.com (/10.154.165.23) by default (Oracle Beehive Gateway v4.0) with ESMTP ; Tue, 22 May 2018 12:29:55 -0700 Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 11.4 \(3445.8.2\)) Subject: Re: Regression: Approximate 34% performance hit in receive throughput over ixgbe seen due to build_skb patch From: William Kucharski In-Reply-To: Date: Tue, 22 May 2018 13:29:53 -0600 Cc: LKML , Netdev , intel-wired-lan , Jeff Kirsher , "Duyck, Alexander H" Content-Transfer-Encoding: quoted-printable Message-Id: <4F646FBB-FE0B-4FEE-98E5-3CA2DF0598DE@oracle.com> References: To: Alexander Duyck X-Mailer: Apple Mail (2.3445.8.2) X-Proofpoint-Virus-Version: vendor=nai engine=5900 definitions=8901 signatures=668700 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 suspectscore=3 malwarescore=0 phishscore=0 bulkscore=0 spamscore=0 mlxscore=0 mlxlogscore=570 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1711220000 definitions=main-1805220202 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org > On May 22, 2018, at 12:23 PM, Alexander Duyck = wrote: >=20 > 3. There should be a private flag that can be updated via "ethtool > --set-priv-flags" called "legacy-rx" that you can enable that will > roll back to the original that did the copy-break type approach for > small packets and the headers of the frame. With legacy-rx enabled, most of the regression goes away, but it's still = present as compared to the code without the patch; the regression then drops to = about 6%: # ethtool --show-priv-flags eno1 Private flags for eno1: legacy-rx: on Socket Message Elapsed Messages =20 Size Size Time Okay Errors Throughput bytes bytes secs # # 10^6bits/sec 65536 64 60.00 35934709 0 306.64 65536 60.00 33791739 288.35 Socket Message Elapsed Messages =20 Size Size Time Okay Errors Throughput bytes bytes secs # # 10^6bits/sec 65536 64 60.00 39254351 0 334.97 65536 60.00 36761069 313.69 Is this variance to be expected, or do you think modification of the interrupt delay would achieve better results? William Kucharski