Received: by 10.223.185.116 with SMTP id b49csp3021695wrg; Mon, 5 Mar 2018 12:37:40 -0800 (PST) X-Google-Smtp-Source: AG47ELsRVSyOYWOeJIqOjWxW/LRfcTt4O2qPDZY1HkCcyE/nyER1fzn76iCe1TXCvI3w1+AjQezM X-Received: by 10.98.34.75 with SMTP id i72mr16338786pfi.165.1520282260490; Mon, 05 Mar 2018 12:37:40 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1520282260; cv=none; d=google.com; s=arc-20160816; b=cg+LCiLHyWsM/6XLPNZjtiU8hmtzhZ4Dq11hVXnTHWS4Y33Xt4W/GMZceyjth7MmAP bd0W0y1u3hhpyuGdgL/cg0gP/VkBS8TvtYCIsXjGiL8TaBKff82NMdNDxteXS3uwZIfG zKKWgYUautlNcjpOqDxxWqHHAFLfjQHLh03Pj93nqCl7sYfFcgI9IMQq4eDDEu7gy3jj O8axPVrR8XwjGrCsvXPw7gym3fFVX5XI/Hg6YHlXdgPNwOXkj8n0lD2CdQZZNmUtfJZ3 1jDzdS53b/Xc1yP1KgnR5LNyXfamysFRqwnc5YdP96i0E9BxaO4YLDE5Q2qDtsiz1rck QhBQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:mime-version:content-transfer-encoding :content-id:spamdiagnosticmetadata:spamdiagnosticoutput:user-agent :content-language:accept-language:in-reply-to:references:message-id :date:thread-index:thread-topic:subject:cc:to:from:dkim-signature :arc-authentication-results; bh=8WUCfE1t1Kkk9RDIxjEFAZ+e7gLteCwZScubyjRq/30=; b=ApQr0DT+kHX71/hTyTbYz3eUjubl1spVuRimLzfiiGRVRWZTOxiZctXJlPvQEymwfM DtQiyxDsFpoeCZHw97xLrbrHDxesXG5GRrcus1VMJKetaaUAh23Bn4er2j48itjzPP8c j2SN94yAOUjCNX38Yy55ta1B0OEFW170q2G5MoNoDquoLqre+csg+jTG4ln7Mgoc8aMA SFUc9p0+1FL8kA+LaoDVJC+wN9r6e+0HAOU9lJpJEip6unxTo/YaYwymWBrwOlKsc44o 7no/ezpHhPd5HN8Bbvh4iCf99NOWTp1XaMAm1SRJ8Q8mmRDOQoOsKs9kOZj72H9NKZ+n VP2A== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@raithlin.onmicrosoft.com header.s=selector1-raithlin-com header.b=qxhAJMXO; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id u16si8820974pgo.695.2018.03.05.12.37.26; Mon, 05 Mar 2018 12:37:40 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@raithlin.onmicrosoft.com header.s=selector1-raithlin-com header.b=qxhAJMXO; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1753140AbeCEUgJ (ORCPT + 99 others); Mon, 5 Mar 2018 15:36:09 -0500 Received: from mail-eopbgr670093.outbound.protection.outlook.com ([40.107.67.93]:22304 "EHLO CAN01-TO1-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1752861AbeCEUgG (ORCPT ); Mon, 5 Mar 2018 15:36:06 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=raithlin.onmicrosoft.com; s=selector1-raithlin-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=8WUCfE1t1Kkk9RDIxjEFAZ+e7gLteCwZScubyjRq/30=; b=qxhAJMXOV6yrqczW2HhHVhlEUolo+GN8U4GA4GgDmWUnsdzx9yDx6wTmeywe6BBiSGmGuz5XAL25V0TB2743lyHmioWuZ1frCC3SkxxS1Mg9x9tBBYlUCe04dvuS0svg+I+wHYL71z0bNKNpdIUSZTERPV8ujoH5G6SjFlhszAc= Received: from YTXPR0101MB2045.CANPRD01.PROD.OUTLOOK.COM (52.132.39.161) by YTXPR0101MB1118.CANPRD01.PROD.OUTLOOK.COM (52.132.35.160) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.20.548.13; Mon, 5 Mar 2018 20:36:03 +0000 Received: from YTXPR0101MB2045.CANPRD01.PROD.OUTLOOK.COM ([fe80::4049:b2c:50ca:a6f6]) by YTXPR0101MB2045.CANPRD01.PROD.OUTLOOK.COM ([fe80::4049:b2c:50ca:a6f6%13]) with mapi id 15.20.0548.016; Mon, 5 Mar 2018 20:36:03 +0000 From: "Stephen Bates" To: Jerome Glisse CC: Logan Gunthorpe , Benjamin Herrenschmidt , "linux-kernel@vger.kernel.org" , "linux-pci@vger.kernel.org" , "linux-nvme@lists.infradead.org" , "linux-rdma@vger.kernel.org" , "linux-nvdimm@lists.01.org" , "linux-block@vger.kernel.org" , Christoph Hellwig , Jens Axboe , Keith Busch , Sagi Grimberg , Bjorn Helgaas , Jason Gunthorpe , Max Gurtovoy , Dan Williams , Alex Williamson , Oliver OHalloran Subject: Re: [PATCH v2 00/10] Copy Offload in NVMe Fabrics with P2P PCI Memory Thread-Topic: [PATCH v2 00/10] Copy Offload in NVMe Fabrics with P2P PCI Memory Thread-Index: AQHTsO2GEDgA2h38ikWGpBGerXYMdKO6wDyAgAAAX4CAAO0JAIAAKJ+AgAAHPICAAAIhAIAAAgEAgAEk1QCAAH4NgIAEJ3AA Date: Mon, 5 Mar 2018 20:36:03 +0000 Message-ID: References: <20180228234006.21093-1-logang@deltatee.com> <1519876489.4592.3.camel@kernel.crashing.org> <1519876569.4592.4.camel@au1.ibm.com> <8e808448-fc01-5da0-51e7-1a6657d5a23a@deltatee.com> <1519936195.4592.18.camel@au1.ibm.com> <20180301205548.GA6742@redhat.com> <20180301211036.GB6742@redhat.com> <8D3B5C26-39E0-478D-B51F-A22B3F36C4D7@raithlin.com> <20180302220950.GA6148@redhat.com> In-Reply-To: <20180302220950.GA6148@redhat.com> Accept-Language: en-CA, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-MacOutlook/10.a.0.180210 authentication-results: spf=none (sender IP is ) smtp.mailfrom=sbates@raithlin.com; x-originating-ip: [70.65.224.121] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1;YTXPR0101MB1118;7:D7eOeRMNV4jYFFzBKff1YaVksDWzaf07TdIzMWlOZzKgKyuH9c94sv4I7aqXuslu/Zc552tO+nuCiDsXPj2Ep6DU/9qnqlWlIvVFCpdETzwmseXwP3W05MKMn9T507lMyk+2CIgrEuDWfD3VF+5uMGhDpK62B1MZKwd/NK/lrnMOfddAmLBIvOoJhucTPJRjGHck73xWOiTYQOJ3+kvjYm9XbAaB6FC5l/vLqErw4AoC3HsDci+u9EFMzhWhL+sr x-ms-exchange-antispam-srfa-diagnostics: SSOS; x-ms-office365-filtering-correlation-id: 0ba62dcc-6396-4c19-a1e7-08d582d8b6d7 x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:(7020095)(4652020)(7021125)(5600026)(4604075)(3008032)(4534165)(7022125)(4603075)(4627221)(201702281549075)(7048125)(7024125)(7027125)(7028125)(7023125)(2017052603307)(7153060)(7193020);SRVR:YTXPR0101MB1118; x-ms-traffictypediagnostic: YTXPR0101MB1118: x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:; x-exchange-antispam-report-cfa-test: BCL:0;PCL:0;RULEID:(6040501)(2401047)(8121501046)(5005006)(3002001)(93006095)(93001095)(10201501046)(3231220)(944501244)(52105095)(6041288)(20161123558120)(20161123560045)(20161123562045)(20161123564045)(2016111802025)(6043046)(6072148)(201708071742011);SRVR:YTXPR0101MB1118;BCL:0;PCL:0;RULEID:;SRVR:YTXPR0101MB1118; x-forefront-prvs: 06022AA85F x-forefront-antispam-report: SFV:NSPM;SFS:(10019020)(346002)(396003)(39380400002)(366004)(376002)(39830400003)(51914003)(199004)(189003)(5660300001)(7416002)(229853002)(97736004)(6916009)(3280700002)(83716003)(2950100002)(2900100001)(106356001)(68736007)(36756003)(86362001)(478600001)(6116002)(99286004)(3846002)(7736002)(14454004)(76176011)(3660700001)(26005)(66066001)(82746002)(8936002)(2906002)(81156014)(59450400001)(305945005)(105586002)(6512007)(81166006)(6506007)(6486002)(33656002)(6436002)(5250100002)(186003)(58126008)(316002)(102836004)(4326008)(54906003)(6246003)(53936002)(8676002)(93886005)(25786009);DIR:OUT;SFP:1102;SCL:1;SRVR:YTXPR0101MB1118;H:YTXPR0101MB2045.CANPRD01.PROD.OUTLOOK.COM;FPR:;SPF:None;PTR:InfoNoRecords;A:1;MX:1;LANG:en; received-spf: None (protection.outlook.com: raithlin.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: IigMF50hJYOeCB+3LnaKRTkxX8UMAWJeuiVKJ5426hKVGlMXeQmHEVcqq+Vt3r6u5oidg/2i7V0zwuu6pDRTAZ+oybFc+KEsHDDMW+cajv7x08+ynta2eezNiCqOGdA3X1/iNRDRRJ3+dU3UdXPY0bbIzPpcmvwP5AspLIc/qYCDH7MSzy5+UEBK3hU/GwaqGQTNabckGxMSyKIhvwefPFND0GPjWkR7KjOxRxN4gVnf4WM80gzjd2Sy36UfN6oM1VK8EmraZZZD+cMhFtiVVhlr4qZGzzs7tq24B4Ug2ytNN8KxXcTWeo7to4BtXtoLVUvYtIF0t0KLhcKKDTWlmg== spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="utf-8" Content-ID: <4BC9E074A4B8F34E8851DD6201B9BF2B@CANPRD01.PROD.OUTLOOK.COM> Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-OriginatorOrg: raithlin.com X-MS-Exchange-CrossTenant-Network-Message-Id: 0ba62dcc-6396-4c19-a1e7-08d582d8b6d7 X-MS-Exchange-CrossTenant-originalarrivaltime: 05 Mar 2018 20:36:03.4143 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 18519031-7ff4-4cbb-bbcb-c3252d330f4b X-MS-Exchange-Transport-CrossTenantHeadersStamped: YTXPR0101MB1118 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org PiAgICBZZXMgaSBuZWVkIHRvIGRvY3VtZW50IHRoYXQgc29tZSBtb3JlIGluIGhtbS50eHQuLi4N Cg0KSGkgSmVybW9uZSwgdGhhbmtzIGZvciB0aGUgZXhwbGFuYXRpb24uIENhbiBJIHN1Z2dlc3Qg eW91IHVwZGF0ZSBobW0udHh0IHdpdGggd2hhdCB5b3Ugc2VudCBvdXQ/DQoNCj4gIEkgYW0gYWJv dXQgdG8gc2VuZCBSRkMgZm9yIG5vdXZlYXUsIGkgYW0gc3RpbGwgd29ya2luZyBvdXQgc29tZSBi dWdzLg0KDQpHcmVhdC4gSSB3aWxsIGtlZXAgYW4gZXllIG91dCBmb3IgaXQuIEFuIGV4YW1wbGUg dXNlciBvZiBobW0gd2lsbCBiZSB2ZXJ5IGhlbHBmdWwuDQoNCj4gaSB3aWxsIGZpeCB0aGUgTUFJ TlRBSU5FUlMgYXMgcGFydCBvZiB0aG9zZS4NCiAgICANCkF3ZXNvbWUsIHRoYW5rcy4NCg0KU3Rl cGhlbg0KICAgIA0KDQo=