Received: by 10.223.185.116 with SMTP id b49csp7785385wrg; Thu, 1 Mar 2018 11:02:58 -0800 (PST) X-Google-Smtp-Source: AG47ELtkRbS3DP6iMxNa5duNiLM0Qc2gCEn1TLq8sHAHDvclW0m8CHlmJds7O0xmW2r4BzjZVbpM X-Received: by 2002:a17:902:8215:: with SMTP id x21-v6mr2872800pln.164.1519930978584; Thu, 01 Mar 2018 11:02:58 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1519930978; cv=none; d=google.com; s=arc-20160816; b=fEU28JnJWpUP4Bw7o16mOGC9VjwHR5Iql7sq7XJOpzg9BUQBrz0dIfBGDrKyAOEtHr M5/KA8waopvStnIfmkm4bDutXyrTABE6i4K9j8XFaVeeAm9mzOkUhE/OQapnBQy2s++Z 9VLKudaGfdmzSUH8ve/tMXewKj0I5J76QRNPBBlSblhrfuUutPvcyBWpSVQTJ91BfiUl m9W377a+99P7Mm8dsfkvn55bf0P136Vr3GDg0J/OA+ULmvla9q3yMinE4AaG+anjSQXb 8+DEDE8JLRLnncMedLs6CbatceXT+nP+CTS2aJ6wuxiWeyLr4Eldpv7TWP9qf3iXIUYq T0IA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:mime-version:content-transfer-encoding :content-id:spamdiagnosticmetadata:spamdiagnosticoutput:user-agent :content-language:accept-language:in-reply-to:references:message-id :date:thread-index:thread-topic:subject:cc:to:from:dkim-signature :arc-authentication-results; bh=4HoCDY1d70VcHxJ/dxTqRGMtLW6US3+n5TuKENpIHZA=; b=sC9sTWweyVezA9MuyjmXbZH2X/0ivlEARVU5yd8Gvdt1AAv1S8SeCEHSXIQCtyy74t RdBhp6lDwMNmurkpOdkgoTwqedQjNujBJ2iu8unx/DiATfiRR4GQFggHqqOQvjFgLF3P oaaiK3mkzDa76jAPGdJJeFPrA7WgXUePBPAiDhVwE512cyeUbv3mRZ/N7Hz7PMGBfTe9 6KXL+qmSKFQyFtgQHvn++2BEAvN8BuOvBwdzlrNBPfGj2Hu2N9cIY/D3VD94MDJdRSKW NArExevYtn78HacH55aS0mCnMF5rmLaLco1mYKjLgV5dXSUcVNtwNetLnCzN9jgNEAqL 2f0Q== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@raithlin.onmicrosoft.com header.s=selector1-raithlin-com header.b=l2TRYZ58; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id n8si3320354pff.122.2018.03.01.11.02.42; Thu, 01 Mar 2018 11:02:58 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@raithlin.onmicrosoft.com header.s=selector1-raithlin-com header.b=l2TRYZ58; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1161100AbeCATBi (ORCPT + 99 others); Thu, 1 Mar 2018 14:01:38 -0500 Received: from mail-eopbgr670139.outbound.protection.outlook.com ([40.107.67.139]:20499 "EHLO CAN01-TO1-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1161038AbeCATBe (ORCPT ); Thu, 1 Mar 2018 14:01:34 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=raithlin.onmicrosoft.com; s=selector1-raithlin-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=4HoCDY1d70VcHxJ/dxTqRGMtLW6US3+n5TuKENpIHZA=; b=l2TRYZ5874EhNwgFgUqIOXkLGYAYWrS/PfVA9CT471hTKjuHOJrRG7LAR269XtCV9R78Z2Ot8mVhW/mOOtIRbm6rqJxNlv7kiPdc92WV+0/0mni5gwYORerLrE1QFuuegNjz+lDFBZNcf1NOPhuuK8KLZUws19qYeOsEAgaCNR0= Received: from YTXPR0101MB2045.CANPRD01.PROD.OUTLOOK.COM (52.132.39.161) by YTXPR0101MB2175.CANPRD01.PROD.OUTLOOK.COM (52.132.40.150) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.20.527.15; Thu, 1 Mar 2018 19:01:31 +0000 Received: from YTXPR0101MB2045.CANPRD01.PROD.OUTLOOK.COM ([fe80::3cd5:8402:cda5:7dff]) by YTXPR0101MB2045.CANPRD01.PROD.OUTLOOK.COM ([fe80::3cd5:8402:cda5:7dff%13]) with mapi id 15.20.0527.022; Thu, 1 Mar 2018 19:01:31 +0000 From: "Stephen Bates" To: Jason Gunthorpe , Sagi Grimberg CC: Logan Gunthorpe , "linux-kernel@vger.kernel.org" , "linux-pci@vger.kernel.org" , "linux-nvme@lists.infradead.org" , "linux-rdma@vger.kernel.org" , "linux-nvdimm@lists.01.org" , "linux-block@vger.kernel.org" , Christoph Hellwig , Jens Axboe , Keith Busch , Bjorn Helgaas , Max Gurtovoy , Dan Williams , =?utf-8?B?SsOpcsO0bWUgR2xpc3Nl?= , Benjamin Herrenschmidt , "Alex Williamson" , Steve Wise Subject: Re: [PATCH v2 10/10] nvmet: Optionally use PCI P2P memory Thread-Topic: [PATCH v2 10/10] nvmet: Optionally use PCI P2P memory Thread-Index: AQHTsO2FaiSytyZxbkuik0deJPQRE6O7N/eAgABu34CAAA+TgIAAAe2A//+P4AA= Date: Thu, 1 Mar 2018 19:01:31 +0000 Message-ID: <88ACB0F6-DE78-400B-A42C-953B49026FA2@raithlin.com> References: <20180228234006.21093-1-logang@deltatee.com> <20180228234006.21093-11-logang@deltatee.com> <749e3752-4349-0bdf-5243-3d510c2b26db@grimberg.me> <40d69074-31a8-d06a-ade9-90de7712c553@deltatee.com> <5649098f-b775-815b-8b9a-f34628873ff4@grimberg.me> <20180301184249.GI19007@ziepe.ca> In-Reply-To: <20180301184249.GI19007@ziepe.ca> Accept-Language: en-CA, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-MacOutlook/10.a.0.180210 authentication-results: spf=none (sender IP is ) smtp.mailfrom=sbates@raithlin.com; x-originating-ip: [70.65.224.121] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1;YTXPR0101MB2175;7:wk35WZxhj423mOj3ftFUYGeNdz+wFACacE4NJL/KphH0NHLrsvN6USU4oMRztxi9TbfIpQrwEbSD3Sxk2Z1H8S+7BNw1O1xQA6MG2YiaHgbkFVYsWpfAELr/LxcvC1qcEVqAls8mKvw1R9tXW8j9on6JDiNrFBZ3W+D9B4yq1wmzg090qKtYo/2b4UjbJLPvhjnFodyqpWDIThG3AovmcF62K2SVYloRmsUP/eyPXXZxGOKhPVIpmMMGA/pAs4h4 x-ms-exchange-antispam-srfa-diagnostics: SSOS; x-ms-office365-filtering-correlation-id: 4ac8ffd1-422d-4724-6ba6-08d57fa6d86f x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:(7020095)(4652020)(7021125)(4534165)(7022125)(4603075)(4627221)(201702281549075)(7048125)(7024125)(7027125)(7028125)(7023125)(5600026)(4604075)(3008032)(2017052603307)(7153060)(7193020);SRVR:YTXPR0101MB2175; x-ms-traffictypediagnostic: YTXPR0101MB2175: x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:; x-exchange-antispam-report-cfa-test: BCL:0;PCL:0;RULEID:(6040501)(2401047)(8121501046)(5005006)(10201501046)(3002001)(3231220)(944501230)(93006095)(93001095)(6041288)(20161123560045)(20161123564045)(20161123558120)(20161123562045)(2016111802025)(6072148)(6043046)(201708071742011);SRVR:YTXPR0101MB2175;BCL:0;PCL:0;RULEID:;SRVR:YTXPR0101MB2175; x-forefront-prvs: 05986C03E0 x-forefront-antispam-report: SFV:NSPM;SFS:(10019020)(979002)(39830400003)(366004)(346002)(376002)(396003)(39380400002)(199004)(189003)(478600001)(4326008)(36756003)(3280700002)(2950100002)(3660700001)(14454004)(2900100001)(5660300001)(25786009)(186003)(2906002)(83716003)(102836004)(68736007)(86362001)(3846002)(26005)(105586002)(5250100002)(82746002)(106356001)(6246003)(76176011)(58126008)(316002)(110136005)(229853002)(53936002)(66066001)(93886005)(54906003)(6436002)(8936002)(97736004)(6506007)(81156014)(81166006)(8676002)(99286004)(6116002)(6486002)(6512007)(33656002)(7416002)(7736002)(59450400001)(305945005)(969003)(989001)(999001)(1009001)(1019001);DIR:OUT;SFP:1102;SCL:1;SRVR:YTXPR0101MB2175;H:YTXPR0101MB2045.CANPRD01.PROD.OUTLOOK.COM;FPR:;SPF:None;PTR:InfoNoRecords;A:1;MX:1;LANG:en; received-spf: None (protection.outlook.com: raithlin.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: PKDg37yzkWtFKHYwa+y+I7DeirDq0xH3a/gbpLPflt9rE/sNrkAeS1vALJFX2em2Huu4F4+VArGdOtd96/gOLOIPmrKF84/RDc7irAESaBWRwcA1LvGOKi4m1rOnz4Y/5MMiCW4VbzafWHfC9R8CdN0zYrh3hPHYbCOaljxmzHY= spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="utf-8" Content-ID: <5C68F77BF855DE4FBF4EC3C4242D66B8@CANPRD01.PROD.OUTLOOK.COM> Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-OriginatorOrg: raithlin.com X-MS-Exchange-CrossTenant-Network-Message-Id: 4ac8ffd1-422d-4724-6ba6-08d57fa6d86f X-MS-Exchange-CrossTenant-originalarrivaltime: 01 Mar 2018 19:01:31.4351 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 18519031-7ff4-4cbb-bbcb-c3252d330f4b X-MS-Exchange-Transport-CrossTenantHeadersStamped: YTXPR0101MB2175 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org ICAgIA0KPiBJIGFncmVlLCBJIGRvbid0IHRoaW5rIHRoaXMgc2VyaWVzIHNob3VsZCB0YXJnZXQg YW55dGhpbmcgb3RoZXIgdGhhbg0KPiB1c2luZyBwMnAgbWVtb3J5IGxvY2F0ZWQgaW4gb25lIG9m IHRoZSBkZXZpY2VzIGV4cGVjdGVkIHRvIHBhcnRpY2lwYXRlDQo+IGluIHRoZSBwMnAgdHJhc25h Y3Rpb24gZm9yIGEgZmlyc3QgcGFzcy4uDQoNCkkgZGlzYWdyZWUuIFRoZXJlIGlzIGRlZmluaXRl bHkgaW50ZXJlc3QgaW4gdXNpbmcgYSBOVk1lIENNQiBhcyBhIGJvdW5jZSBidWZmZXIgYW5kIGlu IGRlcGxveWluZyBzeXN0ZW1zIHdoZXJlIG9ubHkgc29tZSBvZiB0aGUgTlZNZSBTU0RzIGJlbG93 IGEgc3dpdGNoICBoYXZlIGEgQ01CIGJ1dCB1c2UgUDJQIHRvIGFjY2VzcyBhbGwgb2YgdGhlbS4g QWxzbyB0aGVyZSBhcmUgc29tZSBkZXZpY2VzIHRoYXQgb25seSBleHBvc2UgbWVtb3J5IGFuZCB0 aGVpciBlbnRpcmUgcHVycG9zZSBpcyB0byBhY3QgYXMgYSBwMnAgZGV2aWNlLCBzdXBwb3J0aW5n IHRoZXNlIGRldmljZXMgd291bGQgYmUgdmFsdWFibGUuDQogICAgDQo+IGxvY2FsaXR5IGlzIHN1 cGVyIGltcG9ydGFudCBmb3IgcDJwLCBzbyBJIGRvbid0IHRoaW5rIHRoaW5ncyBzaG91bGQNCj4g IHN0YXJ0IG91dCBpbiBhIHdheSB0aGF0IG1ha2VzIHNwZWNpZnlpbmcgdGhlIGRlc2lyZWQgbG9j YWxpdHkgaGFyZC4NCg0KRW5zdXJpbmcgdGhhdCB0aGUgRVBzIGVuZ2FnZWQgaW4gcDJwIGFyZSBh bGwgZGlyZWN0bHkgY29ubmVjdGVkIHRvIHRoZSBzYW1lIFBDSWUgc3dpdGNoIGVuc3VyZXMgbG9j YWxpdHkgYW5kIChmb3IgdGhlIHN3aXRjaGVzIHdlIGhhdmUgdGVzdGVkKSBwZXJmb3JtYW5jZS4g SSBhZ3JlZSBzb2x2aW5nIHRoZSBjYXNlIHdoZXJlIHRoZSBuYW1lc3BhY2UgYXJlIENNQiBhcmUg b24gdGhlIHNhbWUgUENJZSBFUCBpcyB2YWx1YWJsZSBidXQgSSBkb24ndCBzZWUgaXQgYXMgY3Jp dGljYWwgdG8gaW5pdGlhbCBhY2NlcHRhbmNlIG9mIHRoZSBzZXJpZXMuDQogICAgDQpTdGVwaGVu DQogICAgDQoNCg==