Received: by 2002:a05:6358:c692:b0:131:369:b2a3 with SMTP id fe18csp968465rwb; Wed, 26 Jul 2023 05:53:25 -0700 (PDT) X-Google-Smtp-Source: APBJJlF4H9sWt04k29hkJhhuO6Pn/RHD92zS5zrmLYyHkYS+7mbYFOBipfZHgwFLNExF4VVMrc2x X-Received: by 2002:a17:907:7808:b0:99b:b398:53b6 with SMTP id la8-20020a170907780800b0099bb39853b6mr2240907ejc.34.1690376005160; Wed, 26 Jul 2023 05:53:25 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1690376005; cv=none; d=google.com; s=arc-20160816; b=uOPA3HFE8rzjL36QPCiqU6pkbC7jnEkkM6l4+WWK0azlJIbRkkpCF9lc+NC01A4YnD 28Zl5ZzaAOrnvXg2mMCt7bK9XksgAsZhly+lRD3f5Fyz272LvgqdoZ4MW5PLBt6h8ORG Z2alIlOc731L0BicrI+9as9ZkGsABJtDvOIlukH7jPSt6aT6FZavC1uQDr0UzhA+w3cq w8boDjWnTdtilW0VBqy2jkP8fzwXOqvcorJ6iITNaf07tGzJD0qNToZOFuI7foFzSYF+ j45D50DltxPgSG5CgIj1ZUYM+VCBcq791utNOJV+ouzOqdhwK9hsKLHATXScN6SwFwqV 2Ztg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:message-id:date:content-id:mime-version:subject :cc:to:references:in-reply-to:from:organization:dkim-signature; bh=9y3yg5KgefYDIN9bSf2g3F3ifzh5J50cmp3vp0NbN6I=; fh=HwOMgwl7wHFhqWLRBLCtp7KSyG5WaHHYsTuRJD6/gOE=; b=1CISnb1GON85IIsvZuq6wwTEn87mHuzSI1DrgPd7v9GzFxNqABsxwOAPvirZecUWaB aGYg/ncUVI6XE+Ok3zqA4fDO6kL9OoDGJEr099I3KCjGcldyFW2rISkvRuHOpWaaOt8P jilDoSrBJWjkURCBsChHBTZN5OcU/AOYeZjTEkUuaTY97S4udFPahFOBjpA6jRGinm6X /2Gv39uuMTLiGuGy4XLhIXGxifRp6VXtaDuIkw0M3Gz/Zqb9K+vEpyThCT91RAeJ7bqn SGNXdoZJ5pY119WS9voF37cKG4n1OQJCPXrsUt03k7ERTVqBOjPRpobOm8FAVqymDslB LUwQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=U9Hho0QL; spf=pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-nfs-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id n25-20020a170906379900b00988994251edsi9666413ejc.258.2023.07.26.05.52.54; Wed, 26 Jul 2023 05:53:25 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=U9Hho0QL; spf=pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-nfs-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S231824AbjGZMPW (ORCPT + 99 others); Wed, 26 Jul 2023 08:15:22 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:60222 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S231939AbjGZMPV (ORCPT ); Wed, 26 Jul 2023 08:15:21 -0400 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 546D219A7 for ; Wed, 26 Jul 2023 05:14:35 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1690373674; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=9y3yg5KgefYDIN9bSf2g3F3ifzh5J50cmp3vp0NbN6I=; b=U9Hho0QLpuLnYUHDQUMeHKiTBrlev/VSRxb5m4L8EPrIFLp3CDXMt+LV4hSHf1QSWpPN6E 4yYvMr5cjBy0P/olkLME5BOMexS+/m9NIFeK3kbykh68RaIhNIoCXiwAMnZzAUWCrJLU3u zburqXOza8Ou1VM7BTRSfEpwuaT8pgc= Received: from mimecast-mx02.redhat.com (66.187.233.73 [66.187.233.73]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id us-mta-246-VAR8qLzmMzq89RhDCSTq8g-1; Wed, 26 Jul 2023 08:14:32 -0400 X-MC-Unique: VAR8qLzmMzq89RhDCSTq8g-1 Received: from smtp.corp.redhat.com (int-mx09.intmail.prod.int.rdu2.redhat.com [10.11.54.9]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx02.redhat.com (Postfix) with ESMTPS id 520162815E2A; Wed, 26 Jul 2023 12:14:32 +0000 (UTC) Received: from warthog.procyon.org.uk (unknown [10.42.28.131]) by smtp.corp.redhat.com (Postfix) with ESMTP id AE5D0492CA6; Wed, 26 Jul 2023 12:14:31 +0000 (UTC) Organization: Red Hat UK Ltd. Registered Address: Red Hat UK Ltd, Amberley Place, 107-111 Peascod Street, Windsor, Berkshire, SI4 1TE, United Kingdom. Registered in England and Wales under Company Registration No. 3798903 From: David Howells In-Reply-To: <168979148257.1905271.8311839188162164611.stgit@morisot.1015granger.net> References: <168979148257.1905271.8311839188162164611.stgit@morisot.1015granger.net> <168979108540.1905271.9720708849149797793.stgit@morisot.1015granger.net> To: Chuck Lever Cc: dhowells@redhat.com, linux-nfs@vger.kernel.org, netdev@vger.kernel.org, Chuck Lever Subject: Re: [PATCH v3 4/5] SUNRPC: Revert e0a912e8ddba MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-ID: <6617.1690373671.1@warthog.procyon.org.uk> Date: Wed, 26 Jul 2023 13:14:31 +0100 Message-ID: <6618.1690373671@warthog.procyon.org.uk> X-Scanned-By: MIMEDefang 3.1 on 10.11.54.9 X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_NONE, RCVD_IN_MSPIKE_H4,RCVD_IN_MSPIKE_WL,SPF_HELO_NONE,SPF_NONE, T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-nfs@vger.kernel.org Chuck Lever wrote: > Flamegraph analysis showed that the cork/uncork calls consume > nearly a third of the CPU time spent in svc_tcp_sendto(). The > other two consumers are mutex lock/unlock and svc_tcp_sendmsg(). > > Now that svc_tcp_sendto() coalesces RPC messages properly, there > is no need to introduce artificial delays to prevent sending > partial messages. > > After applying this change, I measured a 1.2K read IOPS increase > for 8KB random I/O (several percent) on 56Gb IP over IB. > > Signed-off-by: Chuck Lever Reviewed-by: David Howells