Received: by 10.213.65.68 with SMTP id h4csp1502012imn; Mon, 26 Mar 2018 08:45:02 -0700 (PDT) X-Google-Smtp-Source: AG47ELs63GqqTiGW42hzgf4e4xOiLf19ObBX1eXsA8/atNDOtumLf9QbuiyEnRQ5abmdc/QsJcwn X-Received: by 2002:a17:902:c81:: with SMTP id 1-v6mr40752546plt.205.1522079102551; Mon, 26 Mar 2018 08:45:02 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1522079102; cv=none; d=google.com; s=arc-20160816; b=0zUW/SVOTbX3sz4G26kOZoFfygxPGzGWiUueJ4EfvMETzUGyIceUS/iNfDUL2ZK320 LR9f2lxPwHD7CI4ItLQ0ng0qo7d+NAkzVvzdQNOTR3hL6ph8er2ZAdpKtNG1v4MHtFz+ UNAns4zpod7mYpyvvQLpfmJ+4KaIIdwHeszTdud567AS8xLCAVruDjvGOVH8FuSystcr iwYgjYQ4NfyrDK8rijWBNsS7g1xosNYB/AKFOeVpoZLHODm1Ixoq0/nKKV3WHX0olFU7 hePmWY0rEYEzJ5CEehOKZPRhY8p2uRQf57xVI8CRCVD3dpzK1btedbWAWhP0Vau4rxdz 3k4g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:subject:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:from:references:cc:to:arc-authentication-results; bh=jrjHIrTMmDCeSfb6bV3+N+bfFm2XghS9pvoMZ/hjA1w=; b=RrPKvEw9+s6FOecik+BWJeRPyOhO0yoS166PSp/Yg9X7F/pEt2/K9INiOTeg/nrShM bvIczovazoNApEzOJNNHAhZDIS9VkBY+lIEyCxo56n9Y77NpadkaURbtjrHOJdsyMEQY WHbiO+mytQYMFWTmXxrVRbQlAP4ykQ02sIBvMrG8fan3dfOfR8ebUs7PY1CW/w47eG2E 346EzsI7IRZxBQW7CVClWQGbNAdyQACGBG/vgDDDOh7NTbErVnHA8IyZWNI/wBmYGK2g eRn6Mw9WrC0Gd4CEl+gOrus8DKhQ7JvKpMhVm4K1oO6MFoRMYqAN/bXLLgvKQB9I8Yzn NZfA== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id e32-v6si15728819plb.135.2018.03.26.08.44.46; Mon, 26 Mar 2018 08:45:02 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1752221AbeCZPnv (ORCPT + 99 others); Mon, 26 Mar 2018 11:43:51 -0400 Received: from ale.deltatee.com ([207.54.116.67]:58632 "EHLO ale.deltatee.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751840AbeCZPnt (ORCPT ); Mon, 26 Mar 2018 11:43:49 -0400 Received: from guinness.priv.deltatee.com ([172.16.1.162]) by ale.deltatee.com with esmtp (Exim 4.89) (envelope-from ) id 1f0UHP-0000dO-Jr; Mon, 26 Mar 2018 09:43:28 -0600 To: Stephen Bates , Bjorn Helgaas Cc: Sinan Kaya , "linux-kernel@vger.kernel.org" , "linux-pci@vger.kernel.org" , "linux-nvme@lists.infradead.org" , "linux-rdma@vger.kernel.org" , "linux-nvdimm@lists.01.org" , "linux-block@vger.kernel.org" , Christoph Hellwig , Jens Axboe , Keith Busch , Sagi Grimberg , Bjorn Helgaas , Jason Gunthorpe , Max Gurtovoy , Dan Williams , =?UTF-8?B?SsOpcsO0bWUgR2xpc3Nl?= , Benjamin Herrenschmidt , Alex Williamson References: <3ea80992-a0fc-08f2-d93d-ae0ec4e3f4ce@codeaurora.org> <4eb6850c-df1b-fd44-3ee0-d43a50270b53@deltatee.com> <757fca36-dee4-e070-669e-f2788bd78e41@codeaurora.org> <4f761f55-4e9a-dccb-d12f-c59d2cd689db@deltatee.com> <20180313230850.GA45763@bhelgaas-glaptop.roam.corp.google.com> <20180323215046.GC210003@bhelgaas-glaptop.roam.corp.google.com> <20180324034947.GE210003@bhelgaas-glaptop.roam.corp.google.com> <121026DC-40C7-4F4E-BE27-BDA652BDEB6A@raithlin.com> From: Logan Gunthorpe Message-ID: <3a25744b-daa1-84e3-fbdc-5db2e81d0540@deltatee.com> Date: Mon, 26 Mar 2018 09:43:17 -0600 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <121026DC-40C7-4F4E-BE27-BDA652BDEB6A@raithlin.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-SA-Exim-Connect-IP: 172.16.1.162 X-SA-Exim-Rcpt-To: alex.williamson@redhat.com, benh@kernel.crashing.org, jglisse@redhat.com, dan.j.williams@intel.com, maxg@mellanox.com, jgg@mellanox.com, bhelgaas@google.com, sagi@grimberg.me, keith.busch@intel.com, axboe@kernel.dk, hch@lst.de, linux-block@vger.kernel.org, linux-nvdimm@lists.01.org, linux-rdma@vger.kernel.org, linux-nvme@lists.infradead.org, linux-pci@vger.kernel.org, linux-kernel@vger.kernel.org, okaya@codeaurora.org, helgaas@kernel.org, sbates@raithlin.com X-SA-Exim-Mail-From: logang@deltatee.com X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on ale.deltatee.com X-Spam-Level: X-Spam-Status: No, score=-8.9 required=5.0 tests=ALL_TRUSTED,BAYES_00, GREYLIST_ISWHITE,T_RP_MATCHES_RCVD autolearn=ham autolearn_force=no version=3.4.1 Subject: Re: [PATCH v3 01/11] PCI/P2PDMA: Support peer-to-peer memory X-SA-Exim-Version: 4.2.1 (built Tue, 02 Aug 2016 21:08:31 +0000) X-SA-Exim-Scanned: Yes (on ale.deltatee.com) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 24/03/18 09:28 AM, Stephen Bates wrote: > 1. There is no requirement for a single function to support internal DMAs but in the case of NVMe we do have a protocol specific way for a NVMe function to indicate it supports via the CMB BAR. Other protocols may also have such methods but I am not aware of them at this time. > > 2. For multi-function end-points I think it is a requirement that DMAs *between* functions are supported via an internal path but this can be over-ridden by ACS when supported in the EP. > > 3. For multi-function end-points there is no requirement to support internal DMA within each individual function (i.e. a la point 1 but extended to each function in a MF device). Yeah, that make sense. I wasn't making a huge distinction between single and multi-function devices because from an implementation point of view it's not that different. Logan