Received: by 2002:a05:6a10:9848:0:0:0:0 with SMTP id x8csp3494797pxf; Mon, 5 Apr 2021 13:44:38 -0700 (PDT) X-Google-Smtp-Source: ABdhPJz6lwBymfQBsP0uIiPFTXiaTGIRXNCGjhV0uQFeSN+YI2JyOao3m2yAU6G1GLGTrwcNkGTF X-Received: by 2002:a92:7d0d:: with SMTP id y13mr21871611ilc.269.1617655478016; Mon, 05 Apr 2021 13:44:38 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1617655478; cv=none; d=google.com; s=arc-20160816; b=MNWbyV/aHmM0WpgsGL7M+tcVLkDZQiyLGca7kj+Y+7am89BgiGE/GhdXZ4DwjLkByd u+HELiZSWZi1AnKkNw24WNh3FBPsLM9ZfnHvw6NUX0LLLOsVQRxpUdlYRyaJkCaWZ4s/ LgZhbdCXTwUjzpbiL/OkOXcdvK2pbOScnCc5iVKIHLVtImnijpZCYjZ3ObTYA2xIEjfO f8HktkvHwdAbknAtaYrwYsiCLJiseMeGZ2Ma22f58PBa8f//JQB3uuDhfOWo0NAvHI7N BOZSFz4V+TfSAiVCw1YBhKp7ViT2LXkmlFWKGblDprCY4GW1J2tYQ2kTOjm8aDf1eWmf wGAA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:user-agent:in-reply-to:content-disposition :mime-version:references:message-id:subject:cc:to:from:date; bh=M4Wn5bGWeWscCwPgZB3AXrvjvPGT+SKpTu2KdpJ2P7E=; b=hLoDjbP27z1RqbGvHYpkT2z/AU4rS8BkL9j+i597v+57qoRsuCgoN1B2RokPPmIL34 NWtZUmLnHz8xs0+3GmsFBqaqL+UG9WDy5tBFmaF/GU26eUkkE6b6aySqr3XAE+3aYhzG hfDQqXjpL8zpJSv2eZQVUzbbLLG8NsAFXjTedoDP79opKVMQEIOEUx+CDfgpFG5DkXW7 XrBC6YgQY0PmMHXihWHepROm+WkbSwn3NR1lXNtntYjKvkffahdb9cH5JdsFTGwdcB/W MymKLgDNlHHjOxXorTA5RtrnyHu2PXzxQ/zArLo/lHq4igug/aM6QQRXd7GmA5zWdMeS uOBw== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-nfs-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id q3si16332571jaj.22.2021.04.05.13.44.15; Mon, 05 Apr 2021 13:44:38 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-nfs-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S237380AbhDENl3 (ORCPT + 99 others); Mon, 5 Apr 2021 09:41:29 -0400 Received: from verein.lst.de ([213.95.11.211]:50764 "EHLO verein.lst.de" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S235826AbhDENl3 (ORCPT ); Mon, 5 Apr 2021 09:41:29 -0400 Received: by verein.lst.de (Postfix, from userid 2407) id C3BD068BEB; Mon, 5 Apr 2021 15:41:15 +0200 (CEST) Date: Mon, 5 Apr 2021 15:41:15 +0200 From: Christoph Hellwig To: Leon Romanovsky Cc: Doug Ledford , Jason Gunthorpe , Leon Romanovsky , Adit Ranadive , Anna Schumaker , Ariel Elior , Avihai Horon , Bart Van Assche , Bernard Metzler , Christoph Hellwig , Chuck Lever , "David S. Miller" , Dennis Dalessandro , Devesh Sharma , Faisal Latif , Jack Wang , Jakub Kicinski , "J. Bruce Fields" , Jens Axboe , Karsten Graul , Keith Busch , Lijun Ou , linux-cifs@vger.kernel.org, linux-kernel@vger.kernel.org, linux-nfs@vger.kernel.org, linux-nvme@lists.infradead.org, linux-rdma@vger.kernel.org, linux-s390@vger.kernel.org, Max Gurtovoy , Max Gurtovoy , "Md. Haris Iqbal" , Michael Guralnik , Michal Kalderon , Mike Marciniszyn , Naresh Kumar PBS , netdev@vger.kernel.org, Potnuri Bharat Teja , rds-devel@oss.oracle.com, Sagi Grimberg , samba-technical@lists.samba.org, Santosh Shilimkar , Selvin Xavier , Shiraz Saleem , Somnath Kotur , Sriharsha Basavapatna , Steve French , Trond Myklebust , VMware PV-Drivers , Weihang Li , Yishai Hadas , Zhu Yanjun Subject: Re: [PATCH rdma-next 00/10] Enable relaxed ordering for ULPs Message-ID: <20210405134115.GA22346@lst.de> References: <20210405052404.213889-1-leon@kernel.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20210405052404.213889-1-leon@kernel.org> User-Agent: Mutt/1.5.17 (2007-11-01) Precedence: bulk List-ID: X-Mailing-List: linux-nfs@vger.kernel.org On Mon, Apr 05, 2021 at 08:23:54AM +0300, Leon Romanovsky wrote: > From: Leon Romanovsky > > >From Avihai, > > Relaxed Ordering is a PCIe mechanism that relaxes the strict ordering > imposed on PCI transactions, and thus, can improve performance. > > Until now, relaxed ordering could be set only by user space applications > for user MRs. The following patch series enables relaxed ordering for the > kernel ULPs as well. Relaxed ordering is an optional capability, and as > such, it is ignored by vendors that don't support it. > > The following test results show the performance improvement achieved > with relaxed ordering. The test was performed on a NVIDIA A100 in order > to check performance of storage infrastructure over xprtrdma: Isn't the Nvidia A100 a GPU not actually supported by Linux at all? What does that have to do with storage protocols? Also if you enable this for basically all kernel ULPs, why not have an opt-out into strict ordering for the cases that need it (if there are any).