Received: by 10.223.185.116 with SMTP id b49csp8022846wrg; Thu, 1 Mar 2018 15:39:17 -0800 (PST) X-Google-Smtp-Source: AG47ELvNrg+WmHhSBN1HUPbqUhyE/HeJT/we6/fihN2SMqEIVUPFZ9DP6foXHRnZqFDBw0oHpIZd X-Received: by 2002:a17:902:12e:: with SMTP id 43-v6mr3423059plb.77.1519947557493; Thu, 01 Mar 2018 15:39:17 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1519947557; cv=none; d=google.com; s=arc-20160816; b=qC4uYaqDwnMlYxXp7qzuXGcn5GUbvYLyEkeZs2ZMXHf3Jk9jaQ+bmUolYZl4gqv4d3 cStfu1gFoyX9JKbYZjKvDD2iB3r62xUU8xMRRKY+2otKJRaNQGQAysvgIB6anwo6700h yXD5CWvSlYvOTbpQlVesV+26BDoiK9SGpYf8EXSoziMQL4Cso5B1cpZDQ8CenJgecfW3 0FpsxaTcMx2CIvsNUMcG0nQ56XpzTusF8LYZa2oZKTFRiVGsqfmqPc7LgNag7e3uw88v 8sW1wVQFd13gL5onqnkjqMEuL2rPC5FzxsAZPZYJ8ko+QW8BC8En3C0RWQtWY41wBE5j tTEg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:mime-version:content-transfer-encoding :content-id:spamdiagnosticmetadata:spamdiagnosticoutput:user-agent :content-language:accept-language:in-reply-to:references:message-id :date:thread-index:thread-topic:subject:cc:to:from:dkim-signature :arc-authentication-results; bh=pc4cDUzwf1kX1+SO/nTC1I+YyymCqx1paW2rCGJyBLI=; b=m2H7eaxT7vjcGs+2/VaaIym7jsVkTFhHdAZmHZqsSWoZE9+IuEJVhNbka6o1ke+LRl UCXEJPGmgD5nn6JCxlbPsytDWkC7b8FLtj3Oyf3zzhPHQ+u9wixs6iz59u9Ia4rY63F6 4kqTK7w5wmn3a+iuXGLyzmboETqSVm2H+E49PbpQo0MytmTf63nDM+rblzFD9vAk/b+t XlHcF74QfmYtg+wEwg3uR3DvvM6lZlyi0uBle2XePIBYj458juuK/0eG8LCcsvm3OYEV 8E+XVIoKMkN396xT+pxSkj3BQGSoc2s6cq/f6LK1wW9UY6VPPw8DcV2IOloM075VW+pH r9cA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@raithlin.onmicrosoft.com header.s=selector1-raithlin-com header.b=RdDFtjJ6; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id x3-v6si1098730pll.681.2018.03.01.15.39.01; Thu, 01 Mar 2018 15:39:17 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@raithlin.onmicrosoft.com header.s=selector1-raithlin-com header.b=RdDFtjJ6; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1163295AbeCAXc4 (ORCPT + 99 others); Thu, 1 Mar 2018 18:32:56 -0500 Received: from mail-eopbgr660114.outbound.protection.outlook.com ([40.107.66.114]:55373 "EHLO CAN01-QB1-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1163266AbeCAXcu (ORCPT ); Thu, 1 Mar 2018 18:32:50 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=raithlin.onmicrosoft.com; s=selector1-raithlin-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=pc4cDUzwf1kX1+SO/nTC1I+YyymCqx1paW2rCGJyBLI=; b=RdDFtjJ6lDyS1x3vgTn9WJQzguQw9W7PlIJs0zpkKRgopNs65bmoyoYTvGExoJ0UkQZ0dqLF8+QKFNqQNrluVp8izLYmG2oYHaMBSO+tIEzw68M7HRknmXW84UUj/oB5vtpT7+pcHig9LEC8dMtWscKcWjerHDp2qyqC5mluhjM= Received: from YTXPR0101MB2045.CANPRD01.PROD.OUTLOOK.COM (52.132.39.161) by YTXPR0101MB1070.CANPRD01.PROD.OUTLOOK.COM (52.132.35.148) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.20.527.15; Thu, 1 Mar 2018 23:32:46 +0000 Received: from YTXPR0101MB2045.CANPRD01.PROD.OUTLOOK.COM ([fe80::3cd5:8402:cda5:7dff]) by YTXPR0101MB2045.CANPRD01.PROD.OUTLOOK.COM ([fe80::3cd5:8402:cda5:7dff%13]) with mapi id 15.20.0527.022; Thu, 1 Mar 2018 23:32:46 +0000 From: "Stephen Bates" To: Jason Gunthorpe CC: Logan Gunthorpe , Sagi Grimberg , "linux-kernel@vger.kernel.org" , "linux-pci@vger.kernel.org" , "linux-nvme@lists.infradead.org" , "linux-rdma@vger.kernel.org" , "linux-nvdimm@lists.01.org" , "linux-block@vger.kernel.org" , "Christoph Hellwig" , Jens Axboe , Keith Busch , Bjorn Helgaas , Max Gurtovoy , Dan Williams , =?utf-8?B?SsOpcsO0bWUgR2xpc3Nl?= , Benjamin Herrenschmidt , Alex Williamson , Steve Wise Subject: Re: [PATCH v2 10/10] nvmet: Optionally use PCI P2P memory Thread-Topic: [PATCH v2 10/10] nvmet: Optionally use PCI P2P memory Thread-Index: AQHTsO2FaiSytyZxbkuik0deJPQRE6O7N/eAgABu34CAAA+TgIAAAe2AgAAMXICAADd+AP//juQAgAB64QD//44KgA== Date: Thu, 1 Mar 2018 23:32:46 +0000 Message-ID: <2F4ADC7B-0A78-4FA3-9DE3-B20FB0C537E7@raithlin.com> References: <20180228234006.21093-1-logang@deltatee.com> <20180228234006.21093-11-logang@deltatee.com> <749e3752-4349-0bdf-5243-3d510c2b26db@grimberg.me> <40d69074-31a8-d06a-ade9-90de7712c553@deltatee.com> <5649098f-b775-815b-8b9a-f34628873ff4@grimberg.me> <20180301184249.GI19007@ziepe.ca> <20180301224540.GL19007@ziepe.ca> <77591162-4CCD-446E-A27C-1CDB4996ACB7@raithlin.com> <20180301232038.GO19007@ziepe.ca> In-Reply-To: <20180301232038.GO19007@ziepe.ca> Accept-Language: en-CA, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-MacOutlook/10.a.0.180210 authentication-results: spf=none (sender IP is ) smtp.mailfrom=sbates@raithlin.com; x-originating-ip: [70.65.224.121] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1;YTXPR0101MB1070;7:Gupy1R+cHWyyoOE4eqe5WsKKbFDEL0PI1xTBvG6Yhgy7mRTvl9GY5toHNJ29SH+MFgU7P7TA5KrlEdEDK6D7oxsqnmz3UiSdKwSy7XR1u96CuDq81i1Eul6n73C7kCDdG8uUv5phiDAgT2n3Ez1iZClfyrvyG8MfxSYnQT2PT5HkDlyFmfxSiyciszkgREdqqUkwIY7i5gED8v1lSaetp16mUExyQSRFfbi34I8+LTYoS9sA0y81T1KCXSQssjPm x-ms-exchange-antispam-srfa-diagnostics: SSOS; x-ms-office365-filtering-correlation-id: 6854f350-5661-48d0-0980-08d57fccbd16 x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:(7020095)(4652020)(7021125)(4534165)(7022125)(4603075)(4627221)(201702281549075)(7048125)(7024125)(7027125)(7028125)(7023125)(5600026)(4604075)(3008032)(2017052603307)(7153060)(7193020);SRVR:YTXPR0101MB1070; x-ms-traffictypediagnostic: YTXPR0101MB1070: x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:; x-exchange-antispam-report-cfa-test: BCL:0;PCL:0;RULEID:(6040501)(2401047)(5005006)(8121501046)(10201501046)(93006095)(93001095)(3002001)(3231220)(944501232)(52105095)(6041288)(20161123558120)(20161123562045)(2016111802025)(20161123564045)(20161123560045)(6072148)(6043046)(201708071742011);SRVR:YTXPR0101MB1070;BCL:0;PCL:0;RULEID:;SRVR:YTXPR0101MB1070; x-forefront-prvs: 05986C03E0 x-forefront-antispam-report: SFV:NSPM;SFS:(10019020)(366004)(39380400002)(39830400003)(346002)(376002)(396003)(189003)(199004)(82746002)(5250100002)(99286004)(3280700002)(66066001)(8936002)(8676002)(81166006)(81156014)(105586002)(305945005)(4326008)(3846002)(6116002)(83716003)(229853002)(68736007)(86362001)(6506007)(102836004)(7736002)(3660700001)(2906002)(26005)(186003)(106356001)(14454004)(6486002)(36756003)(7416002)(76176011)(53936002)(25786009)(2950100002)(6916009)(6436002)(6246003)(93886005)(5660300001)(2900100001)(54906003)(6512007)(316002)(551934003)(58126008)(33656002)(97736004)(478600001);DIR:OUT;SFP:1102;SCL:1;SRVR:YTXPR0101MB1070;H:YTXPR0101MB2045.CANPRD01.PROD.OUTLOOK.COM;FPR:;SPF:None;PTR:InfoNoRecords;MX:1;A:1;LANG:en; received-spf: None (protection.outlook.com: raithlin.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: bOj4TVTBC+q+tt7lVmslLrdj9w5TK0wYPikp+H8uwZWwli0U+bMZFnxz2j3k93NMOlWY8EJUM/uDMzJ4xb7+oxJYnzex7rQXbH86ZDGkDcTVr8IU0jQljTYFTofhn9rsj0OfCWbv4VdL46Tm3ISEJVGjKcKHVUR3hfOvPNJ3uOU= spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="utf-8" Content-ID: Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-OriginatorOrg: raithlin.com X-MS-Exchange-CrossTenant-Network-Message-Id: 6854f350-5661-48d0-0980-08d57fccbd16 X-MS-Exchange-CrossTenant-originalarrivaltime: 01 Mar 2018 23:32:46.4562 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 18519031-7ff4-4cbb-bbcb-c3252d330f4b X-MS-Exchange-Transport-CrossTenantHeadersStamped: YTXPR0101MB1070 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org PiAgIE5vLCBsb2NhbGl0eSBtYXR0ZXJzLiBJZiB5b3UgaGF2ZSBhIGJ1bmNoIG9mIE5JQ3MgYW5k IGJ1bmNoIG9mIGRyaXZlcw0KPiAgIGFuZCB0aGUgYWxsb2NhdG9yIGNob29zZXMgdG8gcHV0IGFs bCBQMlAgbWVtb3J5IG9uIGEgc2luZ2xlIGRyaXZlIHlvdXINCj4gICBwZXJmb3JtYW5jZSB3aWxs IHN1Y2sgaG9ycmlibHkgZXZlbiBpZiBhbGwgdGhlIHRyYWZmaWMgaXMgb2ZmbG9hZGVkLg0KICAg IA0KU2FnaSBicm91Z2h0IHRoaXMgdXAgZWFybGllciBpbiBoaXMgY29tbWVudHMgYWJvdXQgdGhl IF9maW5kXyBmdW5jdGlvbi4gV2UgYXJlIHBsYW5uaW5nIHRvIGRvIHNvbWV0aGluZyBhYm91dCB0 aGlzIGluIHRoZSBuZXh0IHZlcnNpb24uIFRoaXMgbWlnaHQgYmUgYSByYW5kb21pemF0aW9uIG9y IGEgInVzZXItcGljayIgYW5kIGluY2x1ZGUgYSBydWxlIGFyb3VuZCB1c2luZyB0aGUgcDJwX2Rl diBvbiB0aGUgRVAgaWYgdGhhdCBFUCBpcyBwYXJ0IG9mIHRoZSB0cmFuc2FjdGlvbi4NCg0KU3Rl cGhlbg0KDQoNCiAgICANCg0K