Received: by 10.223.185.116 with SMTP id b49csp7735779wrg; Thu, 1 Mar 2018 10:11:08 -0800 (PST) X-Google-Smtp-Source: AG47ELuMbtqeJmYbGNSYahesjpZ1z4M20NzBDRQkHbd6pQ4x1WM/G63Vj6bWvyre0dTLerDIc9EZ X-Received: by 10.99.110.131 with SMTP id j125mr2252634pgc.382.1519927868023; Thu, 01 Mar 2018 10:11:08 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1519927867; cv=none; d=google.com; s=arc-20160816; b=taEhQ9W89JD4PzjR1ttQuAaQRsY+9PCF8y+SERFLW866BvyhZHoDweba6LajKBA1gO LlAPqeFJ3q0u1pGD0rTGopeTbDWCrMfd5OTtVzYyrMp4tO7/rB/AnYf/N/enHjQ6PV2k b6uIt+nHQNn8NQYhtL9Cez7an1luFwrAhO/g+W+bKlPUt/kL4b29ue0w3iPm7ZvCiVmv zw789RfPJe2q4S6csVwiOVKpq+V4HPdJMss9hIjntOVTWP04RGpAMjk6qb3ug758f6wh G1mPN1nf69tXQYvjA5SP8xTlRcckIfMtgs2x7Z1dUqdvs02Wf2iNMjYFBO4zCQQKkW/U 5V5w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:mime-version:content-transfer-encoding :content-id:spamdiagnosticmetadata:spamdiagnosticoutput:user-agent :content-language:accept-language:in-reply-to:references:message-id :date:thread-index:thread-topic:subject:cc:to:from:dkim-signature :arc-authentication-results; bh=rssLrieS0BBkmtS88X+97PYzFNy5yVJQuihdDRikH1s=; b=P1KOLEtOnf/ggqzpgPyFxCRGUg/Kx+eT87Gz0Y8IKHTLgrsLLyXIkO+SA/4aAiRy3j dtoq7fyaRNilZt2LNgAqym1Mykdc5tpoDzTOT5qjHx6+DxvTdZIubLhWk9F3dKy70hy0 H5Ajta9FdFPgwPCft+csOifl9Gaamg5Vo7y3Fa2NuKnQ6wpb1Qnv6RG0KE+KTIbWtX6K 7kjvP//3cVDSeysSRG3pvDkdDMBHzw8tZjRIC8SnMd6xmjkKrKz9n98kidgXSQsR4qmd QHgVuohg6CesOy8QXv/S7IeLE7N8SNQs5SKLTIiATbygg1Ik652P5HjtKqF7w7+Ts3PX fw9A== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@raithlin.onmicrosoft.com header.s=selector1-raithlin-com header.b=juf0CgDA; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id o2si2732280pgf.658.2018.03.01.10.10.52; Thu, 01 Mar 2018 10:11:07 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@raithlin.onmicrosoft.com header.s=selector1-raithlin-com header.b=juf0CgDA; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1033816AbeCASKD (ORCPT + 99 others); Thu, 1 Mar 2018 13:10:03 -0500 Received: from mail-eopbgr670097.outbound.protection.outlook.com ([40.107.67.97]:43462 "EHLO CAN01-TO1-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1033196AbeCASKA (ORCPT ); Thu, 1 Mar 2018 13:10:00 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=raithlin.onmicrosoft.com; s=selector1-raithlin-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=rssLrieS0BBkmtS88X+97PYzFNy5yVJQuihdDRikH1s=; b=juf0CgDArKteSZmA+Gxkpz2NxAAXGpVebUIIBO7F3rwb7vqjbDwCxAD7B5c64hcc196pEjI1uBVCZVTGNqI3EvULdKXcSFQv2oG70hITBzzQabpWIXEKJnLjNjQKi6Rp2rgaZs7Lv1mOFwnlu3p0rNM1Np5b7lTSK/fts3NDS6E= Received: from YTXPR0101MB2045.CANPRD01.PROD.OUTLOOK.COM (52.132.39.161) by YTXPR0101MB1374.CANPRD01.PROD.OUTLOOK.COM (52.132.36.19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.20.527.15; Thu, 1 Mar 2018 18:09:58 +0000 Received: from YTXPR0101MB2045.CANPRD01.PROD.OUTLOOK.COM ([fe80::3cd5:8402:cda5:7dff]) by YTXPR0101MB2045.CANPRD01.PROD.OUTLOOK.COM ([fe80::3cd5:8402:cda5:7dff%13]) with mapi id 15.20.0527.022; Thu, 1 Mar 2018 18:09:58 +0000 From: "Stephen Bates" To: "benh@au1.ibm.com" , Logan Gunthorpe , "linux-kernel@vger.kernel.org" , "linux-pci@vger.kernel.org" , "linux-nvme@lists.infradead.org" , "linux-rdma@vger.kernel.org" , "linux-nvdimm@lists.01.org" , "linux-block@vger.kernel.org" CC: Christoph Hellwig , Jens Axboe , Keith Busch , Sagi Grimberg , Bjorn Helgaas , Jason Gunthorpe , Max Gurtovoy , Dan Williams , =?utf-8?B?SsOpcsO0bWUgR2xpc3Nl?= , Alex Williamson , Oliver OHalloran Subject: Re: [PATCH v2 00/10] Copy Offload in NVMe Fabrics with P2P PCI Memory Thread-Topic: [PATCH v2 00/10] Copy Offload in NVMe Fabrics with P2P PCI Memory Thread-Index: AQHTsO2GEDgA2h38ikWGpBGerXYMdKO6wDyAgAAAX4CAAHk0gA== Date: Thu, 1 Mar 2018 18:09:58 +0000 Message-ID: References: <20180228234006.21093-1-logang@deltatee.com> <1519876489.4592.3.camel@kernel.crashing.org> <1519876569.4592.4.camel@au1.ibm.com> In-Reply-To: <1519876569.4592.4.camel@au1.ibm.com> Accept-Language: en-CA, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-MacOutlook/10.a.0.180210 authentication-results: spf=none (sender IP is ) smtp.mailfrom=sbates@raithlin.com; x-originating-ip: [70.65.224.121] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1;YTXPR0101MB1374;7:ezud7qeYcBiS8K9SI1Z6b3sHPxN14JafUGh6JukL2v82G1UJ5NQTZxkd0rPMUyngUw6MjwOIkxFrCr7GMPM0ckg8aM26sepK2qycP1qJ1BpQbeIxeOL04QPvhQIyalfn254vNSOpOCR1kQfuMm2/f2aSZyhBz6hJvSKTlj2ERLH8Ybi4UJdu/pCTOeBe6w+p4jBRqwWGIFeV55JxrPkbPbzQ9US1KtGU2uhfamdqFX73ZoJJx7pdSbMVidJ8wgks x-ms-exchange-antispam-srfa-diagnostics: SSOS; x-ms-office365-filtering-correlation-id: 77d2326a-1236-42d9-ec7f-08d57f9fa4cb x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:(7020095)(4652020)(7021125)(4534165)(7022125)(4603075)(4627221)(201702281549075)(7048125)(7024125)(7027125)(7028125)(7023125)(5600026)(4604075)(3008032)(2017052603307)(7153060)(7193020);SRVR:YTXPR0101MB1374; x-ms-traffictypediagnostic: YTXPR0101MB1374: x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:; x-exchange-antispam-report-cfa-test: BCL:0;PCL:0;RULEID:(6040501)(2401047)(8121501046)(5005006)(3231220)(944501230)(52105095)(10201501046)(93006095)(93001095)(3002001)(6041288)(20161123564045)(20161123560045)(2016111802025)(20161123562045)(20161123558120)(6072148)(6043046)(201708071742011);SRVR:YTXPR0101MB1374;BCL:0;PCL:0;RULEID:;SRVR:YTXPR0101MB1374; x-forefront-prvs: 05986C03E0 x-forefront-antispam-report: SFV:NSPM;SFS:(10019020)(346002)(39830400003)(366004)(376002)(396003)(39380400002)(199004)(189003)(82746002)(66066001)(6512007)(186003)(53936002)(229853002)(6246003)(3280700002)(3660700001)(6436002)(25786009)(68736007)(2201001)(83716003)(4326008)(99286004)(5660300001)(6486002)(478600001)(8676002)(33656002)(2501003)(305945005)(81156014)(76176011)(5250100002)(58126008)(7736002)(97736004)(81166006)(316002)(8936002)(14454004)(36756003)(2900100001)(7416002)(106356001)(6116002)(102836004)(2906002)(3846002)(54906003)(105586002)(110136005)(26005)(2950100002)(6506007)(86362001);DIR:OUT;SFP:1102;SCL:1;SRVR:YTXPR0101MB1374;H:YTXPR0101MB2045.CANPRD01.PROD.OUTLOOK.COM;FPR:;SPF:None;PTR:InfoNoRecords;A:1;MX:1;LANG:en; received-spf: None (protection.outlook.com: raithlin.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: I/oGuIfdUa5qc9BeJKZHa/NWQxnfGj5gCR8oF3OUDFpq4ct91+xPSNRoOMj4HfvtR+xXmMUBWXkHSTRoea5rcY3goRy76iLB6EXxN8HEL6b5Ofp2Auj00MKgUjkUDGdaed8/rMktfOiFN9ZM9HwMsQb/6JTMStQPz33OmF30DcM= spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="utf-8" Content-ID: Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-OriginatorOrg: raithlin.com X-MS-Exchange-CrossTenant-Network-Message-Id: 77d2326a-1236-42d9-ec7f-08d57f9fa4cb X-MS-Exchange-CrossTenant-originalarrivaltime: 01 Mar 2018 18:09:58.3523 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 18519031-7ff4-4cbb-bbcb-c3252d330f4b X-MS-Exchange-Transport-CrossTenantHeadersStamped: YTXPR0101MB1374 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Pj4gU28gT2xpdmVyIChDQykgd2FzIGhhdmluZyBpc3N1ZXMgZ2V0dGluZyBhbnkgb2YgdGhhdCB0 byB3b3JrIGZvciB1cy4NCj4+IA0KPj4gVGhlIHByb2JsZW0gaXMgdGhhdCBhY2Njb3JkaW5nIHRv IGhpbSAoSSBkaWRuJ3QgZG91YmxlIGNoZWNrIHRoZSBsYXRlc3QNCj4+IHBhdGNoZXMpIHlvdSBl ZmZlY3RpdmVseSBob3RwbHVnIHRoZSBQQ0llIG1lbW9yeSBpbnRvIHRoZSBzeXN0ZW0gd2hlbg0K Pj4gY3JlYXRpbmcgc3RydWN0IHBhZ2VzLg0KPj4gDQo+PiBUaGlzIGNhbm5vdCBwb3NzaWJseSB3 b3JrIGZvciB1cy4gRmlyc3Qgd2UgY2Fubm90IG1hcCBQQ0llIG1lbW9yeSBhcw0KPj4gY2FjaGFi bGUuIChOb3RlIHRoYXQgZG9pbmcgc28gaXMgYSBiYWQgaWRlYSBpZiB5b3UgYXJlIGJlaGluZCBh IFBMWA0KPj4gc3dpdGNoIGFueXdheSBzaW5jZSB5b3UnZCBhaHZlIHRvIG1hbmFnZSBjYWNoZSBj b2hlcmVuY3kgaW4gU1cpLg0KPiAgIA0KPiAgIE5vdGU6IEkgdGhpbmsgdGhlIGFib3ZlIG1lYW5z IGl0IHdvbid0IHdvcmsgYmVoaW5kIGEgc3dpdGNoIG9uIHg4Ng0KPiAgIGVpdGhlciwgd2lsbCBp dCA/DQogDQpCZW4gDQoNCldlIGhhdmUgZG9uZSBleHRlbnNpdmUgdGVzdGluZyBvZiB0aGlzIHNl cmllcyBhbmQgaXRzIHByZWRlY2Vzc29ycyB1c2luZyBQQ0llIHN3aXRjaGVzIGZyb20gYm90aCBC cm9hZGNvbSAoUExYKSBhbmQgTWljcm9zZW1pLiBXZSBoYXZlIGFsc28gZG9uZSB0ZXN0aW5nIG9u IHg4Nl82NCwgQVJNNjQgYW5kIHBwYzY0ZWwgYmFzZWQgQVJDSCB3aXRoIHZhcnlpbmcgZGVncmVl cyBvZiBzdWNjZXNzLiBUaGUgc2VyaWVzIGFzIGl0IGN1cnJlbnRseSBzdGFuZHMgb25seSB3b3Jr cyBvbiB4ODZfNjQgYnV0IG1vZGlmaWVkIChoYWNreSkgdmVyc2lvbnMgaGF2ZSBiZWVuIG1hZGUg dG8gd29yayBvbiBBUk02NC4gVGhlIHg4Nl82NCB0ZXN0aW5nIGhhcyBiZWVuIGRvbmUgb24gYSBy YW5nZSBvZiAoSW50ZWwpIENQVXMsIHNlcnZlcnMsIFBDSSBFUHMgKGluY2x1ZGluZyBSRE1BIE5J Q3MgZnJvbSBhdCBsZWFzdCB0aHJlZSB2ZW5kb3JzLCBOVk1lIFNTRHMgZnJvbSBhdCBsZWFzdCBm b3VyIHZlbmRvcnMgYW5kIFAyUCBkZXZpY2VzIGZyb20gZm91ciB2ZW5kb3JzKSBhbmQgUENJIHN3 aXRjaGVzLg0KDQpJIGRvIGZpbmQgaXQgc2xpZ2h0bHkgb2ZmZW5zaXZlIHRoYXQgeW91IHdvdWxk IHF1ZXN0aW9uIHRoZSBzZXJpZXMgZXZlbiB3b3JraW5nLiBJIGhvcGUgeW91IGFyZSBub3Qgc3Vn Z2VzdGluZyB3ZSB3b3VsZCBzdWJtaXQgdGhpcyBmcmFtZXdvcmsgbXVsdGlwbGUgdGltZXMgd2l0 aG91dCBoYXZpbmcgZG9uZSB0ZXN0aW5nIG9uIGl0Li4uLg0KDQpTdGVwaGVuDQoNCg==