Received: by 10.213.65.68 with SMTP id h4csp632553imn; Tue, 13 Mar 2018 15:48:05 -0700 (PDT) X-Google-Smtp-Source: AG47ELvA1lfAQ2+AUK/O+g3ayTmaDlMQfZX+tZeIZd95W0mr0Ucw3g7Qy7YxNxDq9ccAh6ZrN10j X-Received: by 10.99.126.20 with SMTP id z20mr1795836pgc.38.1520981285634; Tue, 13 Mar 2018 15:48:05 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1520981285; cv=none; d=google.com; s=arc-20160816; b=bU76rwIpa1c0Euckw5Xksw7UX7iNTt+i2Tm1dsNKsEnZxyj+4qNoormF1mVLqbqEXK aYO7AOLnh2BJDumctH2iVP5cdbEUDcNtkZIBgWwkfYtSmZXKksD2hXhFGgG199KACp8g X1z2akfw6FpHx3aAbMNRry5cJD+nd6hFPM+XjlbHF0pUMdBgEB+HSeyzEL5+rD7LXoHN v0DfpCNfNIR7Ux5rmNr2Vw/bd4rGCK4upRSUIAGuyZnk4vzw9hG2pq6KiM9/SJvK42WV mHAnew96hHctc7ugiiOmS81kWldbsc7JYXRF7KmXZeX584K6xWLFJvNQ0kRBj9X1kuXD 4WjA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:mime-version:content-transfer-encoding :content-id:spamdiagnosticmetadata:spamdiagnosticoutput:user-agent :content-language:accept-language:in-reply-to:references:message-id :date:thread-index:thread-topic:subject:cc:to:from:dkim-signature :arc-authentication-results; bh=AM7YXoyRXFNoGuYHf1xAPL/V288r/vhVX46BBfqVID8=; b=UiRgcWzwc5O+AxRhJAI79fKC/i2OURpk10HQCsPW/s7IQsDU7N/jHsemg7fB8Uc7NV 676acdMOmcV4WHkJAHL4Wfo946BnJOeMMSOWBPR1NdvGkgGi/qBVrYaCUf1dVIZrONpD QxeJy76zqSQicMFYDVrOyldYVNVj7+4BaoVSHTf3VhVE+ub5Yt3b9BxNBFbjdeQUdNne PeoIEkspBZZsVY8aN9bn/QtKurwDu/ggdWgST+hLw9Eq8DMRX1Jra9y8KoMkLDxHEcQj F9ZP+k3A+lC6gbKYu3yM5tjP29K/WZVqSHc1FZ4JfihoDTspFXEg4e6bD7Q5GPVFPSQO N4ig== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@raithlin.onmicrosoft.com header.s=selector1-raithlin-com header.b=iZliZ4Ug; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id f3-v6si871035pln.211.2018.03.13.15.47.51; Tue, 13 Mar 2018 15:48:05 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@raithlin.onmicrosoft.com header.s=selector1-raithlin-com header.b=iZliZ4Ug; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S932637AbeCMWpq (ORCPT + 99 others); Tue, 13 Mar 2018 18:45:46 -0400 Received: from mail-eopbgr660118.outbound.protection.outlook.com ([40.107.66.118]:26395 "EHLO CAN01-QB1-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S932222AbeCMWpo (ORCPT ); Tue, 13 Mar 2018 18:45:44 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=raithlin.onmicrosoft.com; s=selector1-raithlin-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=AM7YXoyRXFNoGuYHf1xAPL/V288r/vhVX46BBfqVID8=; b=iZliZ4UgjH/9hOemA4s07h1oSp0V7IaflgXCy4hGBM+GqVCgP+gKbm0K47gdvO3PcJhOOAoPjfTMYGpO+Ry8Aqs4oOW4IyniZ+OSkDMac7w3ZxFQNon2jp/9l/PIe3YPRXSE0ZVaR81ZqBA32GbR2Eg8QzN/6zCX8CPrPwSZv6Y= Received: from YTXPR0101MB2045.CANPRD01.PROD.OUTLOOK.COM (52.132.39.161) by YTXPR0101MB0719.CANPRD01.PROD.OUTLOOK.COM (52.132.33.12) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.20.548.13; Tue, 13 Mar 2018 22:45:41 +0000 Received: from YTXPR0101MB2045.CANPRD01.PROD.OUTLOOK.COM ([fe80::4049:b2c:50ca:a6f6]) by YTXPR0101MB2045.CANPRD01.PROD.OUTLOOK.COM ([fe80::4049:b2c:50ca:a6f6%13]) with mapi id 15.20.0548.021; Tue, 13 Mar 2018 22:45:41 +0000 From: "Stephen Bates" To: Sinan Kaya , Logan Gunthorpe , "linux-kernel@vger.kernel.org" , "linux-pci@vger.kernel.org" , "linux-nvme@lists.infradead.org" , "linux-rdma@vger.kernel.org" , "linux-nvdimm@lists.01.org" , "linux-block@vger.kernel.org" CC: Christoph Hellwig , Jens Axboe , Keith Busch , Sagi Grimberg , Bjorn Helgaas , Jason Gunthorpe , Max Gurtovoy , Dan Williams , =?utf-8?B?SsOpcsO0bWUgR2xpc3Nl?= , Benjamin Herrenschmidt , Alex Williamson Subject: Re: [PATCH v3 01/11] PCI/P2PDMA: Support peer-to-peer memory Thread-Topic: [PATCH v3 01/11] PCI/P2PDMA: Support peer-to-peer memory Thread-Index: AQHTujlZo8bTZRn+4ECdETRRU1rPhqPNgjSAgADeTICAABJggIAAD1YAgAAHVACAAAJxAIAACW8AgAAO3oCAAAopgIAACqIAgAAIBID//5/mAA== Date: Tue, 13 Mar 2018 22:45:41 +0000 Message-ID: <47F026DE-AFD0-4F63-8D39-375D3684C7B1@raithlin.com> References: <20180312193525.2855-1-logang@deltatee.com> <20180312193525.2855-2-logang@deltatee.com> <59fd2f5d-177f-334a-a9c4-0f8a6ec7c303@codeaurora.org> <24d8e5c2-065d-8bde-3f5d-7f158be9c578@deltatee.com> <52cbbbc4-c488-f83f-8d02-14d455b4efd7@codeaurora.org> <3e738f95-d73c-4182-2fa1-8664aafb1ab7@deltatee.com> <703aa92c-0c1c-4852-5887-6f6e6ccde0fb@codeaurora.org> <3ea80992-a0fc-08f2-d93d-ae0ec4e3f4ce@codeaurora.org> <4eb6850c-df1b-fd44-3ee0-d43a50270b53@deltatee.com> <757fca36-dee4-e070-669e-f2788bd78e41@codeaurora.org> <4f761f55-4e9a-dccb-d12f-c59d2cd689db@deltatee.com> <016dc910-f96a-8a60-4bda-fa24eea98ea5@codeaurora.org> In-Reply-To: <016dc910-f96a-8a60-4bda-fa24eea98ea5@codeaurora.org> Accept-Language: en-CA, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-MacOutlook/10.b.0.180311 authentication-results: spf=none (sender IP is ) smtp.mailfrom=sbates@raithlin.com; x-originating-ip: [70.65.224.121] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1;YTXPR0101MB0719;7:BhKBblJMypkZAS5JQ4XLlzKxS4MumcuNlcqa8e8Vvc9kXOQXXqi0F7gI429JP8qeGExFWVA8q5iS6sOtgXuqDY0HeEVxPsbm18Pxo45ciVbQupegl4Mlkzs4x1g5/Q+0TqPZk2xvBUsNsgCjreRE/ms7xKUR1b5LrCY0xLbRTO+6GGUa3UEy9qJMrSQBArpO5hltBzueWp13kG930QOSKsn2SEJiX1OOTw8iKEfiiX8Ie7KA6brG3zPHFB0we0wk x-ms-exchange-antispam-srfa-diagnostics: SSOS; x-ms-office365-filtering-correlation-id: e0f11e0e-0a7f-49c8-1209-08d58934263b x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:(7020095)(4652020)(7021125)(5600026)(4604075)(3008032)(4534165)(7022125)(4603075)(4627221)(201702281549075)(7048125)(7024125)(7027125)(7028125)(7023125)(2017052603328)(7153060)(7193020);SRVR:YTXPR0101MB0719; x-ms-traffictypediagnostic: YTXPR0101MB0719: x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:; x-exchange-antispam-report-cfa-test: BCL:0;PCL:0;RULEID:(6040522)(2401047)(8121501046)(5005006)(3002001)(10201501046)(93006095)(93001095)(3231221)(944501244)(52105095)(6041310)(20161123564045)(20161123562045)(20161123558120)(20161123560045)(2016111802025)(6043046)(6072148)(201708071742011);SRVR:YTXPR0101MB0719;BCL:0;PCL:0;RULEID:;SRVR:YTXPR0101MB0719; x-forefront-prvs: 0610D16BBE x-forefront-antispam-report: SFV:NSPM;SFS:(10019020)(346002)(376002)(366004)(39380400002)(39830400003)(396003)(199004)(189003)(6436002)(8676002)(110136005)(68736007)(6246003)(6486002)(54906003)(106356001)(316002)(229853002)(36756003)(58126008)(99286004)(81156014)(83716003)(25786009)(6506007)(53936002)(81166006)(3280700002)(4326008)(2201001)(66066001)(86362001)(102836004)(8936002)(186003)(76176011)(82746002)(305945005)(7736002)(3846002)(105586002)(97736004)(26005)(33656002)(2900100001)(14454004)(478600001)(2501003)(93886005)(6512007)(5250100002)(2906002)(7416002)(3660700001)(5660300001)(6116002)(2950100002);DIR:OUT;SFP:1102;SCL:1;SRVR:YTXPR0101MB0719;H:YTXPR0101MB2045.CANPRD01.PROD.OUTLOOK.COM;FPR:;SPF:None;PTR:InfoNoRecords;A:1;MX:1;LANG:en; received-spf: None (protection.outlook.com: raithlin.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: PQW947wsKap9m+r1Yxtu0ywGzX175D5mpm95/T9wRYcM+yBgMy2ys2UvtxlQSvL8Ces2aG94mgraCc2ffZzPUu1Yb50JcyAbXGr0vQyzOQZoSp3i14BtY5Cjxm60rDOt0RsoqKfPT043AGZNWZPT4YwFrhzZqOAUArr3j0E+RVVAwx4KXRMbqBCHII2XvPoiR+fQv3qzWiZx9hQRIHUjdyzo5Z1ackj4q/3YpX1Jog8OFCPMIR6xh2Ny2fLaOKe3bVQdJQGbCjwutG8a8vq5Iu5APpYMT0E4erQ5VX3F7laHEt1NQWZc87MpHfnqLlDQmu2ngDQlRuRbAR0N417eEw== spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="utf-8" Content-ID: Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-OriginatorOrg: raithlin.com X-MS-Exchange-CrossTenant-Network-Message-Id: e0f11e0e-0a7f-49c8-1209-08d58934263b X-MS-Exchange-CrossTenant-originalarrivaltime: 13 Mar 2018 22:45:41.4409 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 18519031-7ff4-4cbb-bbcb-c3252d330f4b X-MS-Exchange-Transport-CrossTenantHeadersStamped: YTXPR0101MB0719 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org SGkgU2luYW4NCg0KPiAgICBJZiBoYXJkd2FyZSBkb2Vzbid0IHN1cHBvcnQgaXQsIGJsYWNrbGlz dGluZyBzaG91bGQgaGF2ZSBiZWVuIHRoZSByaWdodA0KPiAgICBwYXRoIGFuZCBJIHN0aWxsIHRo aW5rIHRoYXQgeW91IHNob3VsZCByZW1vdmUgYWxsIHN3aXRjaCBidXNpbmVzcyBmcm9tIHRoZSBj b2RlLg0KPiAgICBJIGRpZCBub3QgaGVhciBlbm91Z2gganVzdGlmaWNhdGlvbiBmb3IgaGF2aW5n IGEgc3dpdGNoIHJlcXVpcmVtZW50DQo+ICAgIGZvciBQMlAuDQogIA0KV2UgZGlzYWdyZWUuIEFz IGRvZXMgdGhlIGNvbW11bml0eSBiYXNlZCBvbiBmZWVkYmFjayBvbiBwcmV2aW91cyB2ZXJzaW9u IG9mIHRoaXMgcGF0Y2ggc2V0Lg0KICANCj4gWW91IGFyZSBhbHNvIHNheWluZyB0aGF0IHJvb3Qg cG9ydHMgaGF2ZSBpc3N1ZXMgbm90IGJlY2F1c2Ugb2YgZnVuY3Rpb25hbGl0eSBidXQNCj4gYmVj YXVzZSBvZiBwZXJmb3JtYW5jZS4gDQoNCkkgaGF2ZSBzZWVuIGJvdGguICBTb21lIHN5c3RlbXMg ZmFpbCBpbiBlbnRpcmV0eSB0byByb3V0ZSBUTFBzIGFjcm9zcyByb3V0ZSBwb3J0cy4gT3RoZXJz IGRvIHJvdXRlIGJ1dCB3aXRoIHBvb3IgcGVyZm9ybWFuY2UuIEhhdmluZyBhIHJlcXVpcmVtZW50 IGZvciBhIHN3aXRjaCBpcyB0aGVyZWZvcmUgYSByZWFzb25hYmxlIGFuZCBzZW5zaWJsZSBtaW5p bXVtIGNyaXRlcmlhIGZvciBlbmFibGluZyBwMnAuDQogICAgDQo+IElmIHlvdSBrbm93IHdoYXQg aXMgYmFkLCBjcmVhdGUgYSBsaXN0IGFuZCBrZWVwIGFkZGluZyBpdC4gWW91IGNhbid0IGFzc3Vt ZQ0KPiB1bml2ZXJzYWxseSB0aGF0IGFsbCByb290IHBvcnRzIGFyZSBicm9rZW4vIGhhdmUgYmFk IHBlcmZvcm1hbmNlLg0KDQpJIGFjdHVhbGx5IHdhbnRlZCB0byBkbyBhIGJsYWNrbGlzdCBvcmln aW5hbGx5IGJ1dCB0aGF0IGlkZWEgd2FzIG5vdCBhY2NlcHRlZCBieSB0aGUgY29tbXVuaXR5LiAN CiAgICANCj4gICAgV2hhdCBpZiBJIGNvbWUgdXAgd2l0aCBhIHZlcnkgY2hlYXAvY3JhcHB5IHN3 aXRjaCAoc29tZXRoaW5nIGxpa2UgdXNlZCBpbiBkYXRhDQo+ICAgIG1pbmluZyk/DQo+IFdoYXQg Z3VhcmFudGVlcyB0aGF0IFAyUCB3aWxsIHdvcmsgd2l0aCB0aGlzIGRldmljZT8gWW91IGFyZSBt YWtpbmcgYW4NCj4gYXNzdW1wdGlvbiBoZXJlIHRoYXQgYWxsIHN3aXRjaGVzIGhhdmUgZ29vZCBw ZXJmb3JtYW5jZS4NCg0KQSBzd2l0Y2ggbXVzdCBzdXBwb3J0IFAyUCBvciBpdCBpcyBpbiB2aW9s YXRpb24gb2YgdGhlIFBDSWUgc3BlY2lmaWNhdGlvbi4NCiAgICANCj4gICAgSSBoYXZlIGJlZW4g ZG9pbmcgbXkgYmVzdCB0byBwcm92aWRlIGZlZWRiYWNrLiBJdCBmZWVscyBsaWtlIHlvdSBhcmUg dGhyb3dpbmcNCj4gICAgdGhlbSBvdmVyIHRoZSB3YWxsIHRvIGJlIGhvbmVzdC4NCg0KSSB0aGlu ayBvbmUgaXNzdWUgU2luYW4gaXMgdGhhdCBhIGxvdCBvZiB5b3VyIGlkZWFzIGhhdmUgYmVlbiBk aXNjdXNzZWQgaW4gcHJldmlvdXMgdmVyc2lvbnMgb2YgdGhlIHNlcmllcy4gU28geW91IGFyZSBh c2tpbmcgdXMgdG8gbWFrZSBjaGFuZ2VzIHdoaWNoLCBpbiBzb21lIGNhc2VzLCB3ZSBrbm93IGFy ZSBub3QgYWNjZXB0YWJsZSB0byBvdGhlcnMgaW4gdGhlIGNvbW11bml0eS4gVGhlIGlucHV0IGlz IHdlbGNvbWUgYnV0IGl0IGZsaWVzIGluIHRoZSBmYWNlIG9mIG90aGVyIGlucHV0IHdlIGhhdmUg cmVjZWl2ZWQuIA0KDQpIb3dldmVyIGlmIG90aGVyIGRldmVsb3BlcnMgZmVlbCBzdHJvbmdseSBh Ym91dCB0aGUgYmxhY2tsaXN0L3doaXRlbGlzdCBhbmQgc3dpdGNoIGNyaXRlcmlhIHBsZWFzZSBz cGVhayB1cCEgOy0pDQoNClN0ZXBoZW4NCg0KICAgIA0KDQo=