Received: by 2002:a05:6a10:9848:0:0:0:0 with SMTP id x8csp4004885pxf; Tue, 6 Apr 2021 05:56:41 -0700 (PDT) X-Google-Smtp-Source: ABdhPJz6NA7CDunwAQ1Tg+aku4IR5iHp4Ie4MWzAN+t+W4KPnZNuFZbrinR31fh7Sqy0eUYZ5rfc X-Received: by 2002:a02:6a5a:: with SMTP id m26mr28613624jaf.17.1617713801244; Tue, 06 Apr 2021 05:56:41 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1617713801; cv=none; d=google.com; s=arc-20160816; b=EDmcyoL+tXlSCV25TBMJhCyqgiQOHMVcMg/zLoOp0/lAPMxORejrZ4DNpGWLDkooI8 g/K9bx0m98hMN21sDuBHL+STtzSu75PkT97/mblK5jNitvV0CWakbY6X9Hi3pMIdWMi9 ogWlUUWP9ur7Ync3/zquQ/keS/SxWFvNqisw7AxKVmbH/zBJLTX0aSQt+k6+/AegquQ3 oSpt/VKFQOsWz+0amY2bM+HDaRHnA8Mc/B2lsB9kYwgzfj0MNjewX7VPbBID9GDF3t1m 5MCiJ547b/splOV/mV+NCBSLJ0DR8lDEvpzpC9tfxSTXHkGLjsPfmMIKKcR5PxZ7oSRh pjzg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:in-reply-to:content-disposition:mime-version :references:message-id:subject:cc:to:from:date:dkim-signature; bh=J5Y7rI+FtGX0I4XVdEnNnyzKf98zHZb+U6KjZK4yGbc=; b=chB/f7e2ucceV/ELabcORV5nQP+l9yol8mSoXQrD77iAp8cd3JefQ2AqKgRh0JLm6y LzRShjAurFkU7J17ule83dDdIJ/V1JBr6vvK76czbWNJVmkdFnG1Ob/KfReGuKLR9iI0 +56BBjAP02MLrk1676qXTwgdFcS7NMgVJpjD5iBwZS2tI4HAurcYYSZ/11MQMw3HMe8v bT+HaVjdZiwLfv3uxrvsX5zSkeVEgoiYM2dBIxEgER1s4XKTGOFhO8QRTDCuCxeyGFDm Xgup1JL9d28NB2bs9hLRNgaAqxUeFUdlrHqNa9G8tv12E/yBnwc2PWw1YwV6uLSAgH90 AvIQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=KrLXRSpQ; spf=pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-nfs-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id b5si19846901jat.99.2021.04.06.05.56.17; Tue, 06 Apr 2021 05:56:41 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=KrLXRSpQ; spf=pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-nfs-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S243420AbhDFCiE (ORCPT + 99 others); Mon, 5 Apr 2021 22:38:04 -0400 Received: from us-smtp-delivery-124.mimecast.com ([216.205.24.124]:29232 "EHLO us-smtp-delivery-124.mimecast.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S243411AbhDFCiC (ORCPT ); Mon, 5 Apr 2021 22:38:02 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1617676675; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=J5Y7rI+FtGX0I4XVdEnNnyzKf98zHZb+U6KjZK4yGbc=; b=KrLXRSpQqL5xKRQawQg5vo9gyq6NBhIrI6oWoIZcV0VH8pj2tZQXtnVZ7o3U3DnlLFJ/Bs 1GXePdCxfvrPs0swavs3DbdWumZEX07ghFDZJXc7eH/LcPThvKEfT23jKfLCDJHYIgXe13 Lc36DzraX89lHBN0IpBGqDQRX9Z3AZQ= Received: from mimecast-mx01.redhat.com (mimecast-mx01.redhat.com [209.132.183.4]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-425-SuhA5TQCNkCWqJin6rD1AA-1; Mon, 05 Apr 2021 22:37:51 -0400 X-MC-Unique: SuhA5TQCNkCWqJin6rD1AA-1 Received: from smtp.corp.redhat.com (int-mx01.intmail.prod.int.phx2.redhat.com [10.5.11.11]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx01.redhat.com (Postfix) with ESMTPS id 468601800D50; Tue, 6 Apr 2021 02:37:45 +0000 (UTC) Received: from localhost (unknown [10.66.128.72]) by smtp.corp.redhat.com (Postfix) with ESMTPS id 1E86A690F5; Tue, 6 Apr 2021 02:37:41 +0000 (UTC) Date: Tue, 6 Apr 2021 10:37:38 +0800 From: Honggang LI To: Leon Romanovsky Cc: Doug Ledford , Jason Gunthorpe , Leon Romanovsky , Adit Ranadive , Anna Schumaker , Ariel Elior , Avihai Horon , Bart Van Assche , Bernard Metzler , Christoph Hellwig , Chuck Lever , "David S. Miller" , Dennis Dalessandro , Devesh Sharma , Faisal Latif , Jack Wang , Jakub Kicinski , "J. Bruce Fields" , Jens Axboe , Karsten Graul , Keith Busch , Lijun Ou , linux-cifs@vger.kernel.org, linux-kernel@vger.kernel.org, linux-nfs@vger.kernel.org, linux-nvme@lists.infradead.org, linux-rdma@vger.kernel.org, linux-s390@vger.kernel.org, Max Gurtovoy , Max Gurtovoy , "Md. Haris Iqbal" , Michael Guralnik , Michal Kalderon , Mike Marciniszyn , Naresh Kumar PBS , netdev@vger.kernel.org, Potnuri Bharat Teja , rds-devel@oss.oracle.com, Sagi Grimberg , samba-technical@lists.samba.org, Santosh Shilimkar , Selvin Xavier , Shiraz Saleem , Somnath Kotur , Sriharsha Basavapatna , Steve French , Trond Myklebust , VMware PV-Drivers , Weihang Li , Yishai Hadas , Zhu Yanjun Subject: Re: [PATCH rdma-next 00/10] Enable relaxed ordering for ULPs Message-ID: <20210406023738.GB80908@dhcp-128-72.nay.redhat.com> References: <20210405052404.213889-1-leon@kernel.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20210405052404.213889-1-leon@kernel.org> X-Scanned-By: MIMEDefang 2.79 on 10.5.11.11 Precedence: bulk List-ID: X-Mailing-List: linux-nfs@vger.kernel.org On Mon, Apr 05, 2021 at 08:23:54AM +0300, Leon Romanovsky wrote: > From: Leon Romanovsky > > From Avihai, > > Relaxed Ordering is a PCIe mechanism that relaxes the strict ordering > imposed on PCI transactions, and thus, can improve performance. > > Until now, relaxed ordering could be set only by user space applications > for user MRs. The following patch series enables relaxed ordering for the > kernel ULPs as well. Relaxed ordering is an optional capability, and as > such, it is ignored by vendors that don't support it. > > The following test results show the performance improvement achieved Did you test this patchset with CPU does not support relaxed ordering? We observed significantly performance degradation when run perftest with relaxed ordering enabled over old CPU. https://github.com/linux-rdma/perftest/issues/116 thanks