Received: by 10.223.185.116 with SMTP id b49csp82106wrg; Fri, 2 Mar 2018 14:05:22 -0800 (PST) X-Google-Smtp-Source: AG47ELslb6xyr01pDiVu/Xl8J+AxI7961NtxNPcRuc9wDCY4Lt71pcSJlhcTx7PrpicDoYarOGu1 X-Received: by 10.99.173.79 with SMTP id y15mr5650565pgo.136.1520028322436; Fri, 02 Mar 2018 14:05:22 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1520028322; cv=none; d=google.com; s=arc-20160816; b=cDW4R+dR1PvWS+Ce5BKFCa+FUubWpJu5x4cfaMMWhvpKvly9EXkDsTeXZYlZuQK9tf J71B8Kx1nClF5fUlrZC7zKq3GAXUrMW6S1/7kA030trs9N6Bsi5TPQ69zt2D0JKFhPep KPE+E4Xn9O4d8fuFpbSJDXSBv2azlhtW90Qn7eHfUpZG9pzi0g/m7xJvRjtj3vIT9Y/R womEFFfjoriyg/YiRIfBS1vdd0B3rf7L8EVOg7zHWv1idTId+GKwsQhJvREl5N3pETDa YSw3zA2vAFGRrAb40+zMvzE7sjv1JyZ51g8ELJX2YjxrPJrxaQzxccXyUawRVwRcmIJo exCQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:mime-version:content-transfer-encoding :content-id:spamdiagnosticmetadata:spamdiagnosticoutput:user-agent :content-language:accept-language:in-reply-to:references:message-id :date:thread-index:thread-topic:subject:cc:to:from:dkim-signature :arc-authentication-results; bh=NmgMb09jszojbI6aKBHgyWaM6cWOPQM3OpvqVdgsfzs=; b=Aw8jeCADqaTvC7hKHUrqV9bu+s3fyW70iS3+lSlEb8Ct5BBOvUhz+iDzISTovxJR7n wDVmN469xfjKso+Zj/if9PnnN5aUvrX61cpHmZkbtsUEhJZNBlnM70uIGDmM51Xv80Z1 Ex5rbytLLTnwSOKNHky4OOTKyosAsoTaSJeQOYJRxxtuhXcerGKW1oLjM2bjKwcQNsoU 3lyUA9OKi6nSJ18C0EtYgwpfbW8GjfLsaCo+C712RogAxqAwIEthH/iuS+ALMJ7pHnY6 vZFEyjl8226xG7gQBhmbD3/gED2w+mwHcCDibXWToiwQCedth6NZ8gKKGc3zfD6jJ/ON k6/w== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@raithlin.onmicrosoft.com header.s=selector1-raithlin-com header.b=hArsruM6; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id c14si4518421pgu.341.2018.03.02.14.05.07; Fri, 02 Mar 2018 14:05:22 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@raithlin.onmicrosoft.com header.s=selector1-raithlin-com header.b=hArsruM6; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S934169AbeCBViv (ORCPT + 99 others); Fri, 2 Mar 2018 16:38:51 -0500 Received: from mail-eopbgr670120.outbound.protection.outlook.com ([40.107.67.120]:34080 "EHLO CAN01-TO1-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S933995AbeCBVis (ORCPT ); Fri, 2 Mar 2018 16:38:48 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=raithlin.onmicrosoft.com; s=selector1-raithlin-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=NmgMb09jszojbI6aKBHgyWaM6cWOPQM3OpvqVdgsfzs=; b=hArsruM6pUZ72bJb4BC2HZi4f8zRpKtxyxaUi8XOTZKlkFVpggrNXdPMIQtoac3cBU3brWKEHAVrBielGv6i8PopOd1XSwaFQeCIzP4vJ5u86dK0XB+sRhf5KylJbwJ/bI+Q0r4FgSZaU+ya0tisAPnQdte/YWXizKahjaMOZrU= Received: from YTXPR0101MB2045.CANPRD01.PROD.OUTLOOK.COM (52.132.39.161) by YTXPR0101MB1312.CANPRD01.PROD.OUTLOOK.COM (52.132.34.29) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.20.527.15; Fri, 2 Mar 2018 21:38:43 +0000 Received: from YTXPR0101MB2045.CANPRD01.PROD.OUTLOOK.COM ([fe80::3cd5:8402:cda5:7dff]) by YTXPR0101MB2045.CANPRD01.PROD.OUTLOOK.COM ([fe80::3cd5:8402:cda5:7dff%13]) with mapi id 15.20.0527.023; Fri, 2 Mar 2018 21:38:43 +0000 From: "Stephen Bates" To: Jerome Glisse , Logan Gunthorpe CC: Benjamin Herrenschmidt , "linux-kernel@vger.kernel.org" , "linux-pci@vger.kernel.org" , "linux-nvme@lists.infradead.org" , "linux-rdma@vger.kernel.org" , "linux-nvdimm@lists.01.org" , "linux-block@vger.kernel.org" , Christoph Hellwig , Jens Axboe , Keith Busch , Sagi Grimberg , Bjorn Helgaas , Jason Gunthorpe , Max Gurtovoy , Dan Williams , Alex Williamson , Oliver OHalloran Subject: Re: [PATCH v2 00/10] Copy Offload in NVMe Fabrics with P2P PCI Memory Thread-Topic: [PATCH v2 00/10] Copy Offload in NVMe Fabrics with P2P PCI Memory Thread-Index: AQHTsO2GEDgA2h38ikWGpBGerXYMdKO6wDyAgAAAX4CAAO0JAIAAKJ+AgAAHPICAAAIhAIAAAgEAgAEk1QA= Date: Fri, 2 Mar 2018 21:38:43 +0000 Message-ID: <8D3B5C26-39E0-478D-B51F-A22B3F36C4D7@raithlin.com> References: <20180228234006.21093-1-logang@deltatee.com> <1519876489.4592.3.camel@kernel.crashing.org> <1519876569.4592.4.camel@au1.ibm.com> <8e808448-fc01-5da0-51e7-1a6657d5a23a@deltatee.com> <1519936195.4592.18.camel@au1.ibm.com> <20180301205548.GA6742@redhat.com> <20180301211036.GB6742@redhat.com> In-Reply-To: <20180301211036.GB6742@redhat.com> Accept-Language: en-CA, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-MacOutlook/10.a.0.180210 authentication-results: spf=none (sender IP is ) smtp.mailfrom=sbates@raithlin.com; x-originating-ip: [70.65.224.121] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1;YTXPR0101MB1312;7:3zSrt6Czejpic+k5Q1Osp99XvmT0mWXKw9GtAhfI9UWO26JtdWmqhIot/+Gsua0FKlJJN0ngEiQRgn6QkYszfsVdPtpsO/z4xgeZKlxlGXbrXb851eRNzXdtAVVzd9Rma/AiB2YwfeHtJc02OwhIXnyubfvcFIqVeNN04w2xp2LezAfsMkTi2ElVUQ8yFrew1udkWLEdgGMdT9ykyXrqG9nVC5UtTA2Umf/PNR0nrebG1twWFtttM/cSFhgThdSs x-ms-exchange-antispam-srfa-diagnostics: SSOS; x-ms-office365-filtering-correlation-id: 1e31f900-c836-4461-224f-08d58085f8de x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:(7020095)(4652020)(7021125)(4534165)(7022125)(4603075)(4627221)(201702281549075)(7048125)(7024125)(7027125)(7028125)(7023125)(5600026)(4604075)(3008032)(2017052603307)(7153060)(7193020);SRVR:YTXPR0101MB1312; x-ms-traffictypediagnostic: YTXPR0101MB1312: x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:; x-exchange-antispam-report-cfa-test: BCL:0;PCL:0;RULEID:(6040501)(2401047)(8121501046)(5005006)(3002001)(93006095)(93001095)(10201501046)(3231220)(944501244)(52105095)(6041288)(2016111802025)(20161123564045)(20161123558120)(20161123562045)(20161123560045)(6072148)(6043046)(201708071742011);SRVR:YTXPR0101MB1312;BCL:0;PCL:0;RULEID:;SRVR:YTXPR0101MB1312; x-forefront-prvs: 05991796DF x-forefront-antispam-report: SFV:NSPM;SFS:(10019020)(346002)(376002)(39380400002)(39830400003)(396003)(366004)(199004)(189003)(305945005)(6506007)(81166006)(97736004)(81156014)(4326008)(3846002)(33656002)(93886005)(8676002)(6116002)(25786009)(105586002)(59450400001)(6246003)(7416002)(102836004)(8936002)(229853002)(82746002)(5660300001)(3660700001)(99286004)(2906002)(66066001)(106356001)(3280700002)(7736002)(2950100002)(478600001)(76176011)(86362001)(68736007)(110136005)(54906003)(6436002)(5250100002)(186003)(58126008)(6512007)(316002)(83716003)(26005)(36756003)(6486002)(53936002)(2900100001)(14454004);DIR:OUT;SFP:1102;SCL:1;SRVR:YTXPR0101MB1312;H:YTXPR0101MB2045.CANPRD01.PROD.OUTLOOK.COM;FPR:;SPF:None;PTR:InfoNoRecords;A:1;MX:1;LANG:en; received-spf: None (protection.outlook.com: raithlin.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: sATQ4mfaUERoJ14bannfFllG281RUrqmAlzjO1cyLrqrQd+T2vpYrpo4Krpn1UUwkiOUPd6sswLceUFrbarf5W4hv3faTy6a5VSvwNaw1zdRICN+IJZuZHyi++oAxFw9ihOUp/8PLqKn8MzXrce1l9COaI19DTsNivUQlEIrJ8Q= spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="utf-8" Content-ID: <0AF11F09DBD48946B0DE6C3030518A52@CANPRD01.PROD.OUTLOOK.COM> Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-OriginatorOrg: raithlin.com X-MS-Exchange-CrossTenant-Network-Message-Id: 1e31f900-c836-4461-224f-08d58085f8de X-MS-Exchange-CrossTenant-originalarrivaltime: 02 Mar 2018 21:38:43.6481 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 18519031-7ff4-4cbb-bbcb-c3252d330f4b X-MS-Exchange-Transport-CrossTenantHeadersStamped: YTXPR0101MB1312 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org PiBJdCBzZWVtcyBwZW9wbGUgbWlzcy11bmRlcnN0YW5kIEhNTSA6KCANCg0KSGkgSmVyb21lDQoN CllvdXIgdW5oYXBweSBmYWNlIGVtb3RpY29uIG1hZGUgbWUgc2FkIHNvIEkgd2VudCBvZmYgdG8g KHJlKXJlYWQgdXAgb24gSE1NLiBBbG9uZyB0aGUgd2F5IEkgY2FtZSB1cCB3aXRoIGEgY291cGxl IG9mIHRoaW5ncy4NCg0KV2hpbGUgaG1tLnR4dCBpcyByZWFsbHkgbmljZSB0byByZWFkIGl0IG1h a2VzIG5vIG1lbnRpb24gb2YgREVWSUNFX1BSSVZBVEUgYW5kIERFVklDRV9QVUJMSUMuIEl0IGFs c28gZ2l2ZXMgbm8gaW5kaWNhdGlvbiB3aGVuIG9uZSBtaWdodCBjaG9vc2UgdG8gdXNlIG9uZSBv dmVyIHRoZSBvdGhlci4gV291bGQgaXQgYmUgcG9zc2libGUgdG8gdXBkYXRlIGhtbS50eHQgdG8g aW5jbHVkZSBzb21lIGRpc2N1c3Npb24gb24gdGhpcz8gSSB1bmRlcnN0YW5kIHRoYXQgREVWSUNF X1BVQkxJQyBjcmVhdGVzIGEgbWFwcGluZyBpbiB0aGUga2VybmVsJ3MgbGluZWFyIGFkZHJlc3Mg c3BhY2UgZm9yIHRoZSBkZXZpY2UgbWVtb3J5IGFuZCBERVZJQ0VfUFJJVkFURSBkb2VzIG5vdC4g SG93ZXZlciwgbGlrZSBJIHNhaWQsIEkgYW0gbm90IHN1cmUgd2hlbiB5b3Ugd291bGQgdXNlIGVp dGhlciBvbmUgYW5kIHRoZSBwcm9zIGFuZCBjb25zIG9mIGRvaW5nIHNvLiBJIGFjdHVhbGx5IGVu ZGVkIHVwIGZpbmRpbmcgc29tZSB1c2VmdWwgaW5mb3JtYXRpb24gaW4gbWVtcmVtYXAuaCBidXQg SSBkb24ndCB0aGluayBpdCBpcyBmYWlyIHRvIGV4cGVjdCBwZW9wbGUgdG8gZGlnICp0aGF0KiBk ZWVwIHRvIGZpbmQgdGhpcyBpbmZvcm1hdGlvbiA7LSkuDQoNCkEgcXVpY2sgZ3JlcCBzaG93cyBu byBkcml2ZXJzIHVzaW5nIHRoZSBITU0gQVBJIGluIHRoZSB1cHN0cmVhbSBjb2RlIHRvZGF5LiBJ cyB0aGlzIGNvcnJlY3Q/IEFyZSB0aGVyZSBhbnkgZXhhbXBsZXMgb2Ygb3V0IG9mIHRyZWUgZHJp dmVycyB0aGF0IHVzZSBITU0geW91IGNhbiBwb2ludCBtZSB0b28/IEFzIGEgZHJpdmVyIGRldmVs b3BlciB3aGF0IHJlc291cmNlcyBleGlzdCB0byBoZWxwIG1lIHdyaXRlIGEgSE1NIGF3YXJlIGRy aXZlcj8NCg0KVGhlICh2ZXJ5IG5pY2UpIGhtbS50eHQgZG9jdW1lbnQgaXMgbm90IHJlZmVyZW5j ZXMgaW4gdGhlIE1BSU5UQUlORVJTIGZpbGU/IFlvdSBtaWdodCB3YW50IHRvIGZpeCB0aGF0IHdo ZW4geW91IGhhdmUgYSBtb21lbnQuDQoNClN0ZXBoZW4NCg0KDQo=