Received: by 10.213.65.68 with SMTP id h4csp5083imn; Mon, 26 Mar 2018 13:43:44 -0700 (PDT) X-Google-Smtp-Source: AG47ELtRqog4+9IFceKr2FS6yr6u8sBntj6U1c0s0JgirG177rH6HD+MGS+oT5T7ZddTfw+hrTOK X-Received: by 2002:a17:902:b943:: with SMTP id h3-v6mr20429884pls.1.1522097024754; Mon, 26 Mar 2018 13:43:44 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1522097024; cv=none; d=google.com; s=arc-20160816; b=kxg25qcPudWelW3AlwJiPygXI2CyKlmFoL+yg9R0Y/6eZuC8pXdXeOaSiVTSOEsLUl pmkTW+L9CSZHbpHAiUQEueERo39BtTVwkKkXE5cyOByHJP4Hthujx4bG/Hef7udAxZH7 6OIJJi3q2o2n09fP2H2874vQhTiphl+jyKjslWnwC7UQPOW6BkHZdvlABgX9WHGpfbuH nqSsHp59KzkYswVD+VIuWl5unLjezzAsBcC9A6jXDaibwofgPZkYgVEm1MG7mCH7dGg+ EhkFAnmaglpC/ScqR9asmRtAE3iQJFNaQn2mLCp5Z2CBSg6VEY7Oa+RRKp9G5GA0M3XQ I8gw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:subject:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:from:references:cc:to:arc-authentication-results; bh=75ZwRIW+tGFz5I5/hJ5d2/4lTeFfOb68/+dxcZyBBEg=; b=uWom4wboFKVu8/rweskyvVacRcBb24orgVKDWisGjjwC3qtb3207n7PmjlRgHxvbpU zZ40KKlbcpewlvGpWRCyGJtg+FO+lBSE+BSZEDOKnPfI57YOXwdiOTdmfKdVZY4mWJ8u 4S6uHO6GWENjNcDx9cwpW0s9LjiDdchNspflDgJJJdUI2V0IRPoJZIjzW3ctbMWPGdbb aIEqHZfn2c0JY1WYv09PKaXkMkiw9djf2b4QtQcJGEyHfxcvph1OMigqq/RKMPxUs15S JF7gQ71328RrqCbDDtYMIOHRlGfs9f1Py21ghyrfmNIWO1VcgTRwk4E/+NzyRneSNP5J QRJQ== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id k4-v6si8777309pll.176.2018.03.26.13.43.28; Mon, 26 Mar 2018 13:43:44 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1751714AbeCZUma (ORCPT + 99 others); Mon, 26 Mar 2018 16:42:30 -0400 Received: from ale.deltatee.com ([207.54.116.67]:56632 "EHLO ale.deltatee.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1750983AbeCZUm2 (ORCPT ); Mon, 26 Mar 2018 16:42:28 -0400 Received: from guinness.priv.deltatee.com ([172.16.1.162]) by ale.deltatee.com with esmtp (Exim 4.89) (envelope-from ) id 1f0YwZ-0003ST-NT; Mon, 26 Mar 2018 14:42:16 -0600 To: Jason Gunthorpe Cc: Jonathan Cameron , Sinan Kaya , linux-kernel@vger.kernel.org, linux-pci@vger.kernel.org, linux-nvme@lists.infradead.org, linux-rdma@vger.kernel.org, linux-nvdimm@lists.01.org, linux-block@vger.kernel.org, Stephen Bates , Christoph Hellwig , Jens Axboe , Keith Busch , Sagi Grimberg , Bjorn Helgaas , Max Gurtovoy , Dan Williams , =?UTF-8?B?SsOpcsO0bWUgR2xpc3Nl?= , Benjamin Herrenschmidt , Alex Williamson , Eric Wehage References: <20180312193525.2855-1-logang@deltatee.com> <20180312193525.2855-2-logang@deltatee.com> <59fd2f5d-177f-334a-a9c4-0f8a6ec7c303@codeaurora.org> <24d8e5c2-065d-8bde-3f5d-7f158be9c578@deltatee.com> <20180326121138.00005e30@huawei.com> <20180326164129.GF15530@mellanox.com> <6ead7f19-c0e5-5584-2518-1e1889a007e4@deltatee.com> <20180326193502.GI15530@mellanox.com> From: Logan Gunthorpe Message-ID: <45fcaa2d-214c-f0a9-94d4-b26692b9a5f3@deltatee.com> Date: Mon, 26 Mar 2018 14:42:05 -0600 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <20180326193502.GI15530@mellanox.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-SA-Exim-Connect-IP: 172.16.1.162 X-SA-Exim-Rcpt-To: Eric.Wehage@huawei.com, alex.williamson@redhat.com, benh@kernel.crashing.org, jglisse@redhat.com, dan.j.williams@intel.com, maxg@mellanox.com, bhelgaas@google.com, sagi@grimberg.me, keith.busch@intel.com, axboe@kernel.dk, hch@lst.de, sbates@raithlin.com, linux-block@vger.kernel.org, linux-nvdimm@lists.01.org, linux-rdma@vger.kernel.org, linux-nvme@lists.infradead.org, linux-pci@vger.kernel.org, linux-kernel@vger.kernel.org, okaya@codeaurora.org, Jonathan.Cameron@huawei.com, jgg@mellanox.com X-SA-Exim-Mail-From: logang@deltatee.com X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on ale.deltatee.com X-Spam-Level: X-Spam-Status: No, score=-8.9 required=5.0 tests=ALL_TRUSTED,BAYES_00, GREYLIST_ISWHITE,T_RP_MATCHES_RCVD autolearn=ham autolearn_force=no version=3.4.1 Subject: Re: [PATCH v3 01/11] PCI/P2PDMA: Support peer-to-peer memory X-SA-Exim-Version: 4.2.1 (built Tue, 02 Aug 2016 21:08:31 +0000) X-SA-Exim-Scanned: Yes (on ale.deltatee.com) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 26/03/18 01:35 PM, Jason Gunthorpe wrote: > I think this is another case of the HW can do it but the SW support is > missing. IOMMU configuration and maybe firmware too, for instance. Nope, not sure how you can make this leap. We've been specifically told that peer-to-peer PCIe DMA is not supported on P9. We've also been told there is a very limited (ie. store only), low performance mode designed for poking mailboxes but it is disabled by default and must be enable with some kind of special firmware calls. Logan