Received: by 10.223.185.116 with SMTP id b49csp8831728wrg; Fri, 2 Mar 2018 08:40:58 -0800 (PST) X-Google-Smtp-Source: AG47ELsIts90MTrF+XCE67H8Zv+tWyFdF2PEqpRfPdV8wbvFFnRTFpB+k4mb5GEj7JJy8q+2lsXF X-Received: by 2002:a17:902:8489:: with SMTP id c9-v6mr5632494plo.439.1520008858863; Fri, 02 Mar 2018 08:40:58 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1520008858; cv=none; d=google.com; s=arc-20160816; b=xYafqAGFQlQh/Tnjr0jOC+njKghnkeNACqk6+aewLMQhZbSTjDrjZFqIWNj0u3Dvfx T8NoHa0SxkGblF391tA+8wAD4ptidnE0LCE/vBKL5W0BPN2S08SuSdFm3Qe5E2Pf7Nm8 faOFz6ugGlcNmcbqqLheKd4Jzorh0jgM0Lh/GBmgqSXp2GG4SIvk+b3jH79G5LEI/vle 5i6CKAPMTGna6VQPcBoEuv36SHbB1nDECLGTzD+azW/zZ3OpziQ4AvVE3+tBf+M6QSEv W9AmOE+MiAdQHWFdNxurxxTB1xFTg6j4P/1S3TFJZwbzgQ7t8tQPDGd1RL1j+t68GaZ1 ppKA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:mime-version:content-transfer-encoding :content-id:spamdiagnosticmetadata:spamdiagnosticoutput :content-language:accept-language:in-reply-to:references:message-id :date:thread-index:thread-topic:subject:cc:to:from :arc-authentication-results; bh=ehWVH09OFU3I1b4TYE6Tpk+L3dEbrC0dkOcne3R9T/w=; b=qfKTl3YTRk1YQvJXGGIER4nn5aY2wVViXA8eCdNTnZr9fdEpjRK9iP2PPudbAsABnL VAM0oP/1Yr5j2oKTBQONRo/4NM6F2Vwebh0MMixugtiKcoN+8UM+wPP3oVttfvXS0sPj A1GUy1X7uTGQclG9tihn3ZgJjg2/dZPdoVUqVGo8NKy8N1Vz/B14BrJb+L/ZWvQenFJv EORNtq/Lx5YuJ1HPUPr8QDcWIIcW1r3WWz2f+n48l/WqSNcD9CLYqbSDhcBCPwKO84+p GpcJBtqZ8Nl/1A7W+f5nzgs92eBODyQTddtqyXfUQspBSdQ8oj3lWD5NxJRyCvG1kNYM 4aYA== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id z72si4136442pgd.819.2018.03.02.08.40.43; Fri, 02 Mar 2018 08:40:58 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S936469AbeCBQWe (ORCPT + 99 others); Fri, 2 Mar 2018 11:22:34 -0500 Received: from g2t1383g.austin.hpe.com ([15.233.16.89]:52478 "EHLO g2t1383g.austin.hpe.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S935226AbeCBQWa (ORCPT ); Fri, 2 Mar 2018 11:22:30 -0500 Received: from g4t3426.houston.hpe.com (g4t3426.houston.hpe.com [15.241.140.75]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by g2t1383g.austin.hpe.com (Postfix) with ESMTPS id B68832512; Fri, 2 Mar 2018 16:22:29 +0000 (UTC) Received: from G9W8453.americas.hpqcorp.net (g9w8453.houston.hp.com [16.216.160.211]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (No client certificate requested) by g4t3426.houston.hpe.com (Postfix) with ESMTPS id 1EDE06C; Fri, 2 Mar 2018 16:22:28 +0000 (UTC) Received: from G4W9120.americas.hpqcorp.net (2002:10d2:150f::10d2:150f) by G9W8453.americas.hpqcorp.net (2002:10d8:a0d3::10d8:a0d3) with Microsoft SMTP Server (TLS) id 15.0.1178.4; Fri, 2 Mar 2018 16:22:28 +0000 Received: from NAM03-BY2-obe.outbound.protection.outlook.com (15.241.52.10) by G4W9120.americas.hpqcorp.net (16.210.21.15) with Microsoft SMTP Server (TLS) id 15.0.1178.4 via Frontend Transport; Fri, 2 Mar 2018 16:22:27 +0000 Received: from AT5PR8401MB1297.NAMPRD84.PROD.OUTLOOK.COM (10.169.9.143) by AT5PR8401MB0321.NAMPRD84.PROD.OUTLOOK.COM (10.169.2.135) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.548.13; Fri, 2 Mar 2018 16:22:24 +0000 Received: from AT5PR8401MB1297.NAMPRD84.PROD.OUTLOOK.COM ([fe80::4507:b23:c0d1:c9cc]) by AT5PR8401MB1297.NAMPRD84.PROD.OUTLOOK.COM ([fe80::4507:b23:c0d1:c9cc%2]) with mapi id 15.20.0527.023; Fri, 2 Mar 2018 16:22:24 +0000 From: "Kani, Toshi" To: "torvalds@linux-foundation.org" , "benh@kernel.crashing.org" CC: "linux-kernel@vger.kernel.org" , "alex.williamson@redhat.com" , "linux-block@vger.kernel.org" , "linux-rdma@vger.kernel.org" , "hch@lst.de" , "axboe@kernel.dk" , "linux-nvdimm@lists.01.org" , "jglisse@redhat.com" , "linux-nvme@lists.infradead.org" , "maxg@mellanox.com" , "linux-pci@vger.kernel.org" , "keith.busch@intel.com" , "oliveroh@au1.ibm.com" , "jgg@ziepe.ca" , "bhelgaas@google.com" Subject: Re: [PATCH v2 00/10] Copy Offload in NVMe Fabrics with P2P PCI Memory Thread-Topic: [PATCH v2 00/10] Copy Offload in NVMe Fabrics with P2P PCI Memory Thread-Index: AQHTsO2SauImX1OM+UWgCf/w5DnppaO6wDuAgAAAYICAAQJ2gIAAFIKAgAABk4CAAAOhgIAAFJIAgAAG2oCAAADQAIABNwIA Date: Fri, 2 Mar 2018 16:22:24 +0000 Message-ID: <1520010446.2693.19.camel@hpe.com> References: <20180228234006.21093-1-logang@deltatee.com> <1519876489.4592.3.camel@kernel.crashing.org> <1519876569.4592.4.camel@au1.ibm.com> <1519936477.4592.23.camel@au1.ibm.com> <1519936815.4592.25.camel@au1.ibm.com> <20180301205315.GJ19007@ziepe.ca> <1519942012.4592.31.camel@au1.ibm.com> <1519943658.4592.34.camel@kernel.crashing.org> In-Reply-To: <1519943658.4592.34.camel@kernel.crashing.org> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=toshi.kani@hpe.com; x-originating-ip: [15.219.147.8] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1;AT5PR8401MB0321;6:fmLT87FwEaQRLVIJCwUJhOXPC9WgYAWVaSA6+NcJ8QBj7blB2HGhIzpuqRZ/08sJH+rteTthGO/6PANTUKDoVPW/9PxUsgBlPiWlR+QvTJKN6+P2RVtHb5fbnAZUejW4cXiw8QfL70zJG/t6mEcfHMdCf2Pi8e1h8/BkpGCN20YcLthsfFxshCC/HxxExfjnmteatRLm2UtGGsQJ4aVYp16iusiCOIqv/UL0OMeyWZq48OhGZuecaKnmRHMR4M2cQ6p+9SqffENN4HhyLuG9gMdHX3qVDKKv9evrPcrsV3sWIDyIBCnOURqH88ceLrsY1dT2n4VaolWMXI5Tpzv+NWWhiksR87BFVG6FR20yz9qS63UA80jgbmqFqjnVWITK;5:TKBAmMkUuU8QOOjEYFvx9qAUBoWjSOhCSpTgVnGgfBUmRKHPPM9Q35WKh9QgTZHe4C422xX1cl9pqSiNIkqS2CCuyUvOEXmVn4Dtq7OFLCYjhLXxZJ0zviYkQeKn9AE/w2ylcFk85l5drglXIXbaiEB7X/vtxRVmgxlf5R+1HLk=;24:RjHSNA9Q3fIsvzG457YmuPF/APZEpDX63Ctz+g3MU96ha7F/CE1DScEFQzK9qJcMIs6AQp3ZMnv3R8A2oQ4v6RSE7apsnLHCgnZQGa9PzyQ=;7:IBQERLjDc9DqGflai94z3mmyekSXRl508hp/HwKHCtqPvuynwYVI/DpcFlfaxh1r7jHnYl0Ua2v0e/9bT7lUUDruABBHeo8CC7UUZ5lJdzORBroTPP9Ll4Up2ubWb/JMz7ZL+trsTFBWle5f+A6pdA7cXadza4ze1agxUELSt2mEtlpnfhaoAzQYAOUBaOmMzPhBQOpBV0XdXKKcYNk1yxkVFpi30x8Z3qGdAatY968qaXOauObmV1xug54TYPvx x-ms-exchange-antispam-srfa-diagnostics: SSOS; x-ms-office365-filtering-ht: Tenant x-ms-office365-filtering-correlation-id: 7d0127cb-c29b-4277-172b-08d58059c86f x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:(7020095)(4652020)(8989060)(4534165)(4627221)(201703031133081)(201702281549075)(8990040)(48565401081)(5600026)(4604075)(3008032)(2017052603307)(7153060)(7193020);SRVR:AT5PR8401MB0321; x-ms-traffictypediagnostic: AT5PR8401MB0321: x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(104084551191319)(17755550239193); x-exchange-antispam-report-cfa-test: BCL:0;PCL:0;RULEID:(8211001083)(6040501)(2401047)(5005006)(8121501046)(3002001)(93006095)(93001095)(3231220)(944501241)(52105095)(10201501046)(6055026)(6041288)(20161123562045)(20161123564045)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123558120)(20161123560045)(6072148)(201708071742011);SRVR:AT5PR8401MB0321;BCL:0;PCL:0;RULEID:;SRVR:AT5PR8401MB0321; x-forefront-prvs: 05991796DF x-forefront-antispam-report: SFV:NSPM;SFS:(10019020)(396003)(346002)(366004)(39860400002)(39380400002)(376002)(189003)(199004)(377424004)(36756003)(3280700002)(81166006)(14454004)(81156014)(5660300001)(86362001)(103116003)(8936002)(229853002)(4326008)(97736004)(6116002)(25786009)(478600001)(66066001)(3846002)(105586002)(2906002)(7736002)(8676002)(305945005)(53936002)(6486002)(26005)(186003)(6506007)(5250100002)(2950100002)(110136005)(3660700001)(6512007)(54906003)(106356001)(6436002)(76176011)(316002)(102836004)(6246003)(93886005)(68736007)(2501003)(99286004)(53546011)(7416002)(2900100001);DIR:OUT;SFP:1102;SCL:1;SRVR:AT5PR8401MB0321;H:AT5PR8401MB1297.NAMPRD84.PROD.OUTLOOK.COM;FPR:;SPF:None;PTR:InfoNoRecords;MX:1;A:1;LANG:en; received-spf: None (protection.outlook.com: hpe.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: L3qO7sRC+r6w34tDfjN+S4Tk29TKWz0ffUWJSWqMjmPaQ+6QDENH3rF+yDcIUYerwrzg1TgtptS3PKUGX9yofvSeI90IpV0yMpHWo7tiULmNtNDdkZWpzaLhgTDvjuiGS4sykOkhXW3lT3UmRiggF4QZskDb4bboYnv9ea4f+c0= spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="utf-8" Content-ID: Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-MS-Exchange-CrossTenant-Network-Message-Id: 7d0127cb-c29b-4277-172b-08d58059c86f X-MS-Exchange-CrossTenant-originalarrivaltime: 02 Mar 2018 16:22:24.5024 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 105b2061-b669-4b31-92ac-24d304d195dc X-MS-Exchange-Transport-CrossTenantHeadersStamped: AT5PR8401MB0321 X-OriginatorOrg: hpe.com Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org T24gRnJpLCAyMDE4LTAzLTAyIGF0IDA5OjM0ICsxMTAwLCBCZW5qYW1pbiBIZXJyZW5zY2htaWR0 IHdyb3RlOg0KPiBPbiBUaHUsIDIwMTgtMDMtMDEgYXQgMTQ6MzEgLTA4MDAsIExpbnVzIFRvcnZh bGRzIHdyb3RlOg0KPiA+IE9uIFRodSwgTWFyIDEsIDIwMTggYXQgMjowNiBQTSwgQmVuamFtaW4g SGVycmVuc2NobWlkdCA8YmVuaEBhdTEuaWJtLmNvbT4gd3JvdGU6DQo+ID4gPiANCj4gPiA+IENv dWxkIGJlIHRoYXQgeDg2IGhhcyB0aGUgc21hcnRzIHRvIGRvIHRoZSByaWdodCB0aGluZywgc3Rp bGwgdHJ5aW5nIHRvDQo+ID4gPiB1bnRhbmdsZSB0aGUgY29kZSA6LSkNCj4gPiANCj4gPiBBZmFp aywgeDg2IHdpbGwgbm90IGNhY2hlIFBDSSB1bmxlc3MgdGhlIHN5c3RlbSBpcyBtaXNjb25maWd1 cmVkLCBhbmQNCj4gPiBldmVuIHRoZW4gaXQncyBtb3JlIGxpa2VseSB0byBqdXN0IHJhaXNlIGEg bWFjaGluZSBjaGVjayBleGNlcHRpb24NCj4gPiB0aGFuIGNhY2hlIHRoaW5ncy4NCj4gPiANCj4g PiBUaGUgbGFzdC1sZXZlbCBjYWNoZSBpcyBnb2luZyB0byBkbyBmaWxscyBhbmQgc3BpbGxzIGRp cmVjdGx5IHRvIHRoZQ0KPiA+IG1lbW9yeSBjb250cm9sbGVyLCBub3QgdG8gdGhlIFBDSWUgc2lk ZSBvZiB0aGluZ3MuDQo+ID4gDQo+ID4gKEkgZ3Vlc3MgeW91ICpjYW4qIGRvIHRoaW5ncyBkaWZm ZXJlbnRseSwgYW5kIEkgd291bGRuJ3QgYmUgc3VycHJpc2VkDQo+ID4gaWYgc29tZSBwZW9wbGUg aW5zaWRlIEludGVsIGRpZCB0cnkgdG8gZG8gdGhpbmdzIGRpZmZlcmVudGx5IHdpdGgNCj4gPiB0 cnlpbmcgbnZyYW0gb3ZlciBQQ0llLCBidXQgaW4gZ2VuZXJhbCBJIHRoaW5rIHRoZSBhYm92ZSBp cyB0cnVlKQ0KPiA+IA0KPiA+IFlvdSB3b24ndCBmaW5kIGl0IGluIHRoZSBrZXJuZWwgY29kZSBl aXRoZXIuIEl0J3MgaW4gaGFyZHdhcmUgd2l0aA0KPiA+IGZpcm13YXJlIGNvbmZpZ3VyYXRpb24g b2Ygd2hhdCBhZGRyZXNzZXMgYXJlIG1hcHBlZCB0byB0aGUgbWVtb3J5DQo+ID4gY29udHJvbGxl cnMgKGFuZCBfaG93XyB0aGV5IGFyZSBtYXBwZWQpIGFuZCB3aGljaCBhcmUgbm90Lg0KPiANCj4g QWggdGhhbmtzICEgVGhhbmtzIGV4cGxhaW5zLiBXZSBjYW4gZml4IHRoYXQgb24gcHBjNjQgaW4g b3VyIGxpbmVhcg0KPiBtYXBwaW5nIGNvZGUgYnkgY2hlY2tpbmcgdGhlIGFkZHJlc3MgdnMuIG1l bWJsb2NrcyB0byBjaG9zZSB0aGUgcmlnaHQNCj4gcGFnZSB0YWJsZSBhdHRyaWJ1dGVzLg0KDQpG V0lXLCB0aGlzIHRoaW5nIGlzIGNhbGxlZCBNVFJScyBvbiB4ODYsIHdoaWNoIGFyZSBpbml0aWFs aXplZCBieSBCSU9TLg0KVGhlc2UgcmVnaXN0ZXJzIGVmZmVjdGl2ZWx5IG92ZXJ3cml0ZSBwYWdl IHRhYmxlIHNldHVwcy4gIEludGVsIFNETQ0KZGVmaW5lcyB0aGUgZWZmZWN0IGFzIGZvbGxvd3Mu ICAnUEFUIEVudHJ5IFZhbHVlJyBpcyB0aGUgcGFnZSB0YWJsZQ0Kc2V0dXAuDQoNCk1UUlIgTWVt b3J5IFR5cGUgIFBBVCBFbnRyeSBWYWx1ZSAgRWZmZWN0aXZlIE1lbW9yeSBUeXBlDQotLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLQ0KVUMgICAg ICAgICAgICAgICAgVUMgICAgICAgICAgICAgICBVQw0KVUMgICAgICAgICAgICAgICAgV0MgICAg ICAgICAgICAgICBXQw0KVUMgICAgICAgICAgICAgICAgV1QgICAgICAgICAgICAgICBVQw0KVUMg ICAgICAgICAgICAgICAgV0IgICAgICAgICAgICAgICBVQw0KVUMgICAgICAgICAgICAgICAgV1Ag ICAgICAgICAgICAgICBVQyANCg0KT24gbXkgc3lzdGVtLCBCSU9TIHNldHMgTVRSUnMgdG8gY292 ZXIgdGhlIGVudGlyZSBNTUlPIHJhbmdlcyB3aXRoIFVDLg0KT3RoZXIgQklPU2VzIG1heSBzaW1w bHkgc2V0IHRoZSBNVFJSIGRlZmF1bHQgdHlwZSB0byBVQywgaS5lLiB1bmNvdmVyZWQNCnJhbmdl cyBiZWNvbWUgVUMuDQoNCiMgY2F0IC9wcm9jL210cnINCiA6DQpyZWcwMTogYmFzZT0weGMwMDAw MDAwMDAwICgxMjU4MjkxMk1CKSwgc2l6ZT0yMDk3MTUyTUIsIGNvdW50PTE6DQp1bmNhY2hhYmxl DQogOg0KDQojIGNhdCAvcHJvYy9pb21lbSB8IGdyZXAgJ1BDSSBCdXMnDQogOg0KYzAwMDAwMDAw MDAtYzNmZmZmZmZmZmYgOiBQQ0kgQnVzIDAwMDA6MDANCmM0MDAwMDAwMDAwLWM3ZmZmZmZmZmZm IDogUENJIEJ1cyAwMDAwOjExDQpjODAwMDAwMDAwMC1jYmZmZmZmZmZmZiA6IFBDSSBCdXMgMDAw MDozNg0KY2MwMDAwMDAwMDAtY2ZmZmZmZmZmZmYgOiBQQ0kgQnVzIDAwMDA6NWINCmQwMDAwMDAw MDAwLWQzZmZmZmZmZmZmIDogUENJIEJ1cyAwMDAwOjgwDQpkNDAwMDAwMDAwMC1kN2ZmZmZmZmZm ZiA6IFBDSSBCdXMgMDAwMDo4NQ0KZDgwMDAwMDAwMDAtZGJmZmZmZmZmZmYgOiBQQ0kgQnVzIDAw MDA6YWUNCmRjMDAwMDAwMDAwLWRmZmZmZmZmZmZmIDogUENJIEJ1cyAwMDAwOmQ3DQoNCi1Ub3No aQ0KDQoNCg==