Received: by 2002:ac0:a5a6:0:0:0:0:0 with SMTP id m35-v6csp221709imm; Thu, 30 Aug 2018 12:21:41 -0700 (PDT) X-Google-Smtp-Source: ANB0VdZTrv+lC/EHrmTcgRC9hr2DrNywz+3ei7F1bTwzdtYc1pjdbsP3Y/ndf/nXs6W0AyW7Fgx9 X-Received: by 2002:a62:9bc9:: with SMTP id e70-v6mr11631365pfk.95.1535656901681; Thu, 30 Aug 2018 12:21:41 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1535656901; cv=none; d=google.com; s=arc-20160816; b=uZUtmTzdg9SiKKuxoePX9WdVLAFCe9TKvzbD7m/1rU+kx3xIkiE6QClWHLFH7vXyN8 ZJPFBEMJr94jjl+/vRsRs95TbBTnvLtSAOCvc4P8AwATogrxuY7drB9NpSINF0qnxhRq qE0cz2iLm4sLDP9IhmOFSHDQSR0Us5rBFRXWoRPuAnZ0Dxm25bViz8sPkJ1OQdDIkzsi WD8p88WxClEV6cM3ME0REU7mV6fM4oYMoNhDlhUNyK8Lm8gN7fbO6jAkV/BldpiW79TO cbPPumBkUfQOsvGNHOz1qVuimHc+ln4/H1EHFf9WNvpAL0lpw5kSV0g9DnymMxIOs07F bzhg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-transfer-encoding:content-disposition:mime-version :references:message-id:subject:cc:to:from:date :arc-authentication-results; bh=ApWK118MbZl0XWZujOdGyDWCfgnkGet0upFdxrAIxrs=; b=RXhOlZBEs+xQahY3XKz7rqCfySYUmibI4dE84u4qWSAmAIdkU+ZalWm73kpacTUQj8 F1S+8b52g5TE0rXRU7pRw8RmAttt1aoXCuN8bqHXLNKT/tUl5JJiZxv/+n1OGLRAh+uJ JlkRtQ1lnAr2Xtan6m3UN4lfEvVFvDPG8ZT3Ovp50aLM/aC3KcCm7tTsLSe+gU92SK2c wbYLtCS0PwRFBsPQPlAZg44yVEij8h77nTGI5CJF8H70rs4smSsVhTRgP/GhDkwVdUFo 36orL10Q4BcFE1Nxl0soFr+k5vdeL+bNnsoFif15BjRHJacz8RZDZSmzxuqF9HBvVobv +aLA== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id w8-v6si8042422pgw.647.2018.08.30.12.21.26; Thu, 30 Aug 2018 12:21:41 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727344AbeH3XX7 (ORCPT + 99 others); Thu, 30 Aug 2018 19:23:59 -0400 Received: from mx3-rdu2.redhat.com ([66.187.233.73]:41370 "EHLO mx1.redhat.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1727200AbeH3XX7 (ORCPT ); Thu, 30 Aug 2018 19:23:59 -0400 Received: from smtp.corp.redhat.com (int-mx06.intmail.prod.int.rdu2.redhat.com [10.11.54.6]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id F39EB87A7C; Thu, 30 Aug 2018 19:20:17 +0000 (UTC) Received: from redhat.com (unknown [10.20.6.215]) by smtp.corp.redhat.com (Postfix) with ESMTPS id 5D6712166BA1; Thu, 30 Aug 2018 19:20:14 +0000 (UTC) Date: Thu, 30 Aug 2018 15:20:12 -0400 From: Jerome Glisse To: Logan Gunthorpe Cc: linux-kernel@vger.kernel.org, linux-pci@vger.kernel.org, linux-nvme@lists.infradead.org, linux-rdma@vger.kernel.org, linux-nvdimm@lists.01.org, linux-block@vger.kernel.org, Stephen Bates , Christoph Hellwig , Keith Busch , Sagi Grimberg , Bjorn Helgaas , Jason Gunthorpe , Max Gurtovoy , Dan Williams , Benjamin Herrenschmidt , Alex Williamson , Christian =?iso-8859-1?Q?K=F6nig?= Subject: Re: [PATCH v5 00/13] Copy Offload in NVMe Fabrics with P2P PCI Memory Message-ID: <20180830192012.GG3529@redhat.com> References: <20180830185352.3369-1-logang@deltatee.com> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20180830185352.3369-1-logang@deltatee.com> User-Agent: Mutt/1.10.0 (2018-05-17) X-Scanned-By: MIMEDefang 2.78 on 10.11.54.6 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.11.55.1]); Thu, 30 Aug 2018 19:20:18 +0000 (UTC) X-Greylist: inspected by milter-greylist-4.5.16 (mx1.redhat.com [10.11.55.1]); Thu, 30 Aug 2018 19:20:18 +0000 (UTC) for IP:'10.11.54.6' DOMAIN:'int-mx06.intmail.prod.int.rdu2.redhat.com' HELO:'smtp.corp.redhat.com' FROM:'jglisse@redhat.com' RCPT:'' Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, Aug 30, 2018 at 12:53:39PM -0600, Logan Gunthorpe wrote: [...] > > When the PCI P2PDMA config option is selected the ACS bits in every > bridge port in the system are turned off to allow traffic to > pass freely behind the root port. At this time, the bit must be disabled > at boot so the IOMMU subsystem can correctly create the groups, though > this could be addressed in the future. There is no way to dynamically > disable the bit and alter the groups. Can you provide an example on how to test this ? Like kernel command line option, the doc patch does not have any such example. It would be nice to add. Maybe i have miss it in some of the patch. I just skimmed over for now. Cheers, J?r?me