Received: by 10.223.185.116 with SMTP id b49csp8032374wrg; Thu, 1 Mar 2018 15:53:36 -0800 (PST) X-Google-Smtp-Source: AG47ELsuzhpZU9uILpq1YO7X2wsa5nx236p3wRFj7kfUYWxk/uGuZpcCNCk+v6zWyMgMknRS12F9 X-Received: by 10.98.144.65 with SMTP id a62mr3683288pfe.96.1519948416123; Thu, 01 Mar 2018 15:53:36 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1519948416; cv=none; d=google.com; s=arc-20160816; b=CMr0v0URRT+ipLKNolLOIXUpiD1VLqG5A/WHFpp8GwQj0h4i5h2fPNlqOkSj9nW2QG u/yRUyDAmXxYjqJzsZu7nJ/003/656tBnQpVq2lE3YzpatxCVpcV5gUdTakg0wl4X7JZ 1ukGohF5ctF6lPr547qXysik+pLEzJ/E0CpfvAG6st6TiF0/Bjt4x+CXV0zE7GWOlCD8 B5UE+yF8sr57mL14z8eEPDhiZXHbnLsaUlUYNlv4tXpl7IEh0YugGKcrcvlueDkjKxsV SGCwNjd4MkczHBBlRwJg8dK/Yp4R5mPuDMFYQUfUlZobqUFC9mOCtZ/IIZhi2Zrk04sO ecZg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:subject:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:from:references:cc:to:arc-authentication-results; bh=pdrX+G6felJRUSp2jAfaoN6Sd9ABQ6uNjI6ZLHIJ2HA=; b=Ob+9PTWQFz3fqmQHTj1PHwZR4rzgO9r7fWMwX0Smepor0czL2yBNwNqijOmDor6sY6 wL4eEHnaWFUSvCAMzHIzrBvpxODE11S24f5ZeNj9lH+ceVCiwnJPc11CrLI3PvEYPY9H F0GnDev3C/B0+Myv0vuSAp/KMDAn+hi6TgXAKgktbOAoEirdcekFd/eweGGkKygEA/m4 jxz7deulD4mHNw5XpMD2dzUhVMJFEmfjfQzfocMzYCJsanmwaz+TMq8bDJWvKsAlE0P0 nVAQCpFE3FrdSvD/LVHtMCDYyCa03/b6hmnAFfD9JWla2CMxpRRPFOLcJKeG3jrmASAI guLQ== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id a62si3107759pgc.70.2018.03.01.15.53.20; Thu, 01 Mar 2018 15:53:36 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1163553AbeCAXwm (ORCPT + 99 others); Thu, 1 Mar 2018 18:52:42 -0500 Received: from ale.deltatee.com ([207.54.116.67]:39860 "EHLO ale.deltatee.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1163339AbeCAXwk (ORCPT ); Thu, 1 Mar 2018 18:52:40 -0500 Received: from guinness.priv.deltatee.com ([172.16.1.162]) by ale.deltatee.com with esmtp (Exim 4.89) (envelope-from ) id 1erXzu-0003IJ-Fw; Thu, 01 Mar 2018 16:52:27 -0700 To: Keith Busch , Stephen Bates Cc: Jason Gunthorpe , Sagi Grimberg , "linux-kernel@vger.kernel.org" , "linux-pci@vger.kernel.org" , "linux-nvme@lists.infradead.org" , "linux-rdma@vger.kernel.org" , "linux-nvdimm@lists.01.org" , "linux-block@vger.kernel.org" , Christoph Hellwig , Jens Axboe , Bjorn Helgaas , Max Gurtovoy , Dan Williams , =?UTF-8?B?SsOpcsO0bWUgR2xpc3Nl?= , Benjamin Herrenschmidt , Alex Williamson , Steve Wise References: <20180228234006.21093-1-logang@deltatee.com> <20180228234006.21093-11-logang@deltatee.com> <749e3752-4349-0bdf-5243-3d510c2b26db@grimberg.me> <40d69074-31a8-d06a-ade9-90de7712c553@deltatee.com> <5649098f-b775-815b-8b9a-f34628873ff4@grimberg.me> <20180301184249.GI19007@ziepe.ca> <20180301224540.GL19007@ziepe.ca> <77591162-4CCD-446E-A27C-1CDB4996ACB7@raithlin.com> <20180301234930.GG14799@localhost.localdomain> From: Logan Gunthorpe Message-ID: <34dc518d-b566-3e2a-8ad9-65d4f5d08a44@deltatee.com> Date: Thu, 1 Mar 2018 16:52:23 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <20180301234930.GG14799@localhost.localdomain> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-SA-Exim-Connect-IP: 172.16.1.162 X-SA-Exim-Rcpt-To: swise@opengridcomputing.com, alex.williamson@redhat.com, benh@kernel.crashing.org, jglisse@redhat.com, dan.j.williams@intel.com, maxg@mellanox.com, bhelgaas@google.com, axboe@kernel.dk, hch@lst.de, linux-block@vger.kernel.org, linux-nvdimm@lists.01.org, linux-rdma@vger.kernel.org, linux-nvme@lists.infradead.org, linux-pci@vger.kernel.org, linux-kernel@vger.kernel.org, sagi@grimberg.me, jgg@ziepe.ca, sbates@raithlin.com, keith.busch@intel.com X-SA-Exim-Mail-From: logang@deltatee.com X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on ale.deltatee.com X-Spam-Level: X-Spam-Status: No, score=-8.9 required=5.0 tests=ALL_TRUSTED,BAYES_00, GREYLIST_ISWHITE,T_RP_MATCHES_RCVD autolearn=ham autolearn_force=no version=3.4.1 Subject: Re: [PATCH v2 10/10] nvmet: Optionally use PCI P2P memory X-SA-Exim-Version: 4.2.1 (built Tue, 02 Aug 2016 21:08:31 +0000) X-SA-Exim-Scanned: Yes (on ale.deltatee.com) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 01/03/18 04:49 PM, Keith Busch wrote: > On Thu, Mar 01, 2018 at 11:00:51PM +0000, Stephen Bates wrote: >> >> P2P is about offloading the memory and PCI subsystem of the host CPU >> and this is achieved no matter which p2p_dev is used. > > Even within a device, memory attributes for its various regions may not be > the same. There's a meaningful difference between writing to an NVMe CMB > vs PMR, and a single device could have both. We don't want to lump these > all together without knowing which region you're allocating from, right? Yes, PMRs are a whole other beast. I have no idea what anyone is going to actually do with those yet. But no one is proposing to publish them as p2pmem with this code. Logan