Received: by 10.192.165.148 with SMTP id m20csp1519286imm; Thu, 10 May 2018 12:00:42 -0700 (PDT) X-Google-Smtp-Source: AB8JxZr2AIIflQy6uUukqQunibC8PLVnlr4zZ2OOBOm6Q1EqPgwHOLdytiuQAVr5EZPtHiAiryCX X-Received: by 2002:aa7:8386:: with SMTP id u6-v6mr2429142pfm.253.1525978842538; Thu, 10 May 2018 12:00:42 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1525978842; cv=none; d=google.com; s=arc-20160816; b=Z36q7r96QmP+ZtiLM5foBzpYVbrOEzlncyrKdimva9gNj22SOc2up9JJC6veJKC5KI bmc3X+YpNWH7vAl4IT+qCy1LWUVL34jpHI+BTIEsMlQ+1KYGRKz7Ix8mQd+L63qPzn8u wEFhruk8Xga7hCQ+OvH7lqoVNRx/BqkpzrarfS718Be2pwtQq7y1kW9RdcvEdHMwm71B kwRxHGQaXhKKlfnkFHc9j7pCZCU46R/VwVZ8QovcOF0NCsbkrseUPJ86xqU40XKZhj+r iVpt2oK4X/g/6LYFU41XQODQbxXBqlrQBTBDhu7R9X1nfZqXDwdDbcia7in3QLH1fRH3 bhPA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:subject:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:from:references:cc:to:arc-authentication-results; bh=/26JfKr+LwofOmQ6RRO4Kmm57XYc3luY0RrDnuG0Kyg=; b=r/e+QMo1v1Ow3O2ggUPET+jQupZmQbmWNjy/8eN4JkxuBfHgWM8JZqCunTmL11f9RZ 8fYDRvt451IaVEL71wL7Hi1Q9ZjTk0RaYPd3oNZJpupDcWTnLfIdYtJQKHkLTVael+C7 bnA7h49BfSO3LXb/ffnF5it8UhGrWdslu920xN3StLKqq0CAL9zBebqUvGwRI70cH+6I RpB0YIkTjrMgNW2wGDP1H2iTMVsGxflwy+hyp4KBhfRzoNHHg1GJvt+UIjFdlTdqxdhO 0LugQKBQx3PbB7hszamFEY5GBl8+uNDcRhB+pBTgZ8lRPFs5pYXvzIRJs0B8DhsCBbzp nutQ== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id f131-v6si1307332pfc.316.2018.05.10.12.00.27; Thu, 10 May 2018 12:00:42 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1751903AbeEJTAS (ORCPT + 99 others); Thu, 10 May 2018 15:00:18 -0400 Received: from ale.deltatee.com ([207.54.116.67]:49046 "EHLO ale.deltatee.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751207AbeEJTAQ (ORCPT ); Thu, 10 May 2018 15:00:16 -0400 Received: from guinness.priv.deltatee.com ([172.16.1.162]) by ale.deltatee.com with esmtp (Exim 4.89) (envelope-from ) id 1fGqnB-0007ac-QC; Thu, 10 May 2018 12:59:54 -0600 To: Stephen Bates , Jerome Glisse Cc: =?UTF-8?Q?Christian_K=c3=b6nig?= , Alex Williamson , Bjorn Helgaas , "linux-kernel@vger.kernel.org" , "linux-pci@vger.kernel.org" , "linux-nvme@lists.infradead.org" , "linux-rdma@vger.kernel.org" , "linux-nvdimm@lists.01.org" , "linux-block@vger.kernel.org" , Christoph Hellwig , Jens Axboe , Keith Busch , Sagi Grimberg , Bjorn Helgaas , Jason Gunthorpe , Max Gurtovoy , Dan Williams , Benjamin Herrenschmidt References: <20180508133407.57a46902@w520.home> <5fc9b1c1-9208-06cc-0ec5-1f54c2520494@deltatee.com> <20180508141331.7cd737cb@w520.home> <20180508205005.GC15608@redhat.com> <7FFB9603-DF9F-4441-82E9-46037CB6C0DE@raithlin.com> <4e0d0b96-ab02-2662-adf3-fa956efd294c@deltatee.com> <2fc61d29-9eb4-d168-a3e5-955c36e5d821@amd.com> <94C8FE12-7FC3-48BD-9DCA-E6A427E71810@raithlin.com> <20180510144137.GA3652@redhat.com> From: Logan Gunthorpe Message-ID: <3e2269ca-126e-ec13-5133-6591c45ccbf4@deltatee.com> Date: Thu, 10 May 2018 12:59:47 -0600 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.7.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-SA-Exim-Connect-IP: 172.16.1.162 X-SA-Exim-Rcpt-To: benh@kernel.crashing.org, dan.j.williams@intel.com, maxg@mellanox.com, jgg@mellanox.com, bhelgaas@google.com, sagi@grimberg.me, keith.busch@intel.com, axboe@kernel.dk, hch@lst.de, linux-block@vger.kernel.org, linux-nvdimm@lists.01.org, linux-rdma@vger.kernel.org, linux-nvme@lists.infradead.org, linux-pci@vger.kernel.org, linux-kernel@vger.kernel.org, helgaas@kernel.org, alex.williamson@redhat.com, christian.koenig@amd.com, jglisse@redhat.com, sbates@raithlin.com X-SA-Exim-Mail-From: logang@deltatee.com X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on ale.deltatee.com X-Spam-Level: X-Spam-Status: No, score=-8.9 required=5.0 tests=ALL_TRUSTED,BAYES_00, GREYLIST_ISWHITE autolearn=ham autolearn_force=no version=3.4.1 Subject: Re: [PATCH v4 04/14] PCI/P2PDMA: Clear ACS P2P flags for all devices behind switches X-SA-Exim-Version: 4.2.1 (built Tue, 02 Aug 2016 21:08:31 +0000) X-SA-Exim-Scanned: Yes (on ale.deltatee.com) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 10/05/18 12:41 PM, Stephen Bates wrote: > Hi Jerome > >> Note on GPU we do would not rely on ATS for peer to peer. Some part >> of the GPU (DMA engines) do not necessarily support ATS. Yet those >> are the part likely to be use in peer to peer. > > OK this is good to know. I agree the DMA engine is probably one of the GPU components most applicable to p2pdma. > >> We (ake GPU people aka the good guys ;)) do no want to do peer to peer >> for performance reasons ie we do not care having our transaction going >> to the root complex and back down the destination. At least in use case >> i am working on this is fine. > > If the GPU people are the good guys does that make the NVMe people the bad guys ;-). If so, what are the RDMA people??? Again good to know. The NVMe people are the Nice Neighbors, the RDMA people are the Righteous Romantics and the PCI people are the Pleasant Protagonists... Obviously. Logan