Received: by 10.223.185.116 with SMTP id b49csp7924079wrg; Thu, 1 Mar 2018 13:40:17 -0800 (PST) X-Google-Smtp-Source: AG47ELupW6qoWNQ1QDnn6Ugcx9uk/IG0xXOnKocqtSoSFEIaV5ioJQOnkheCEtU27io759SKCsjw X-Received: by 2002:a17:902:4381:: with SMTP id j1-v6mr3109695pld.297.1519940417083; Thu, 01 Mar 2018 13:40:17 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1519940417; cv=none; d=google.com; s=arc-20160816; b=Bwt1gXbRffyEUDhb3PxUdrQITXCfs7t7Ct8GwKDUGl0wbkaGKJEImHbPMJDmF1QAg3 QC8mi9RGKLgS/P5ncYJU+66jN56wLx+X9JPZV8O7pdiI0NbYPfvQ33DL1dt+gz3KTHVP S46pVyo+Yi0Np5Y8Q3CGolRX167hmTUqsUsnKpEeCf86oxKvTk7Ny5WsiK9h7yxkbEGz enIKXM6zblc9ducTcA6FAt2hF9w6IgF4soIIcx5B0rh/7Ls1uJGNbhP/dbwxShDZ81uR tKfl/rhgIUh8Wd/sV5rCgp2L/1/ZO1Nk5DRftNtnl9uVoLc41InOmBrk18AdmN0eXFzY R+xg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:mime-version:content-transfer-encoding :content-id:spamdiagnosticmetadata:spamdiagnosticoutput:user-agent :content-language:accept-language:in-reply-to:references:message-id :date:thread-index:thread-topic:subject:cc:to:from:dkim-signature :arc-authentication-results; bh=iE9qbvT2JmpaCi85ZnM9DKPQZZdtZnctJ+P5cnuwYHA=; b=z7jeM3ArwVGywYIqj9s+rpBfJMLN8f+iDas6HfTwZn+sjKIWtpKtWyJOdW3DDlewcM 4ImGVrcxqiFSiGQ7OqGCvaiI+woVUHzoEH0tVZLQSnKua6xhffq80zIDVVN6duTWuqzZ DHoAdpM+XV6gt9yWHzWN+hoCzYQ7WphpyR+kf7kqojY0psRyMY1FqhZbrMocaQjHjOmt N86+ip6anIFpYiunUDD20Ut0WpmzoLyT0XnNQNBTtpENdVF5oNkOdCLVirBxOcvw3z70 o2IhCvLDvQKuj+NcL9Wg4cVH4+n6xxoJyH21FvJ4pNR+upHB36ySVzNnmh2+yqvVQgl2 HtKw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@raithlin.onmicrosoft.com header.s=selector1-raithlin-com header.b=gTYGLS0S; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id m10si2975902pgs.523.2018.03.01.13.40.02; Thu, 01 Mar 2018 13:40:17 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@raithlin.onmicrosoft.com header.s=selector1-raithlin-com header.b=gTYGLS0S; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1162288AbeCAVho (ORCPT + 99 others); Thu, 1 Mar 2018 16:37:44 -0500 Received: from mail-eopbgr670106.outbound.protection.outlook.com ([40.107.67.106]:13629 "EHLO CAN01-TO1-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1162063AbeCAVhC (ORCPT ); Thu, 1 Mar 2018 16:37:02 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=raithlin.onmicrosoft.com; s=selector1-raithlin-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=iE9qbvT2JmpaCi85ZnM9DKPQZZdtZnctJ+P5cnuwYHA=; b=gTYGLS0SDjUHoLVh82U2xPOOURpF/O3kaNjUVlB9RmhBELBIfDHJQHK3HIDJT6dlut0ayoE7QXJtjz5KiJkoRGhWgS7SpWGz71iKcFF8rdAIGXe0OP5VZuhxbnVcxAfsOOaPxh+X+vPs+3EcWb+/kAOyb2COEF/5c1/Fg8msg3g= Received: from YTXPR0101MB2045.CANPRD01.PROD.OUTLOOK.COM (52.132.39.161) by YTXPR0101MB1968.CANPRD01.PROD.OUTLOOK.COM (52.132.39.143) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.20.527.15; Thu, 1 Mar 2018 21:37:00 +0000 Received: from YTXPR0101MB2045.CANPRD01.PROD.OUTLOOK.COM ([fe80::3cd5:8402:cda5:7dff]) by YTXPR0101MB2045.CANPRD01.PROD.OUTLOOK.COM ([fe80::3cd5:8402:cda5:7dff%13]) with mapi id 15.20.0527.022; Thu, 1 Mar 2018 21:37:00 +0000 From: "Stephen Bates" To: Jerome Glisse , Logan Gunthorpe CC: Benjamin Herrenschmidt , "linux-kernel@vger.kernel.org" , "linux-pci@vger.kernel.org" , "linux-nvme@lists.infradead.org" , "linux-rdma@vger.kernel.org" , "linux-nvdimm@lists.01.org" , "linux-block@vger.kernel.org" , Christoph Hellwig , Jens Axboe , Keith Busch , Sagi Grimberg , Bjorn Helgaas , Jason Gunthorpe , Max Gurtovoy , Dan Williams , Alex Williamson , Oliver OHalloran Subject: Re: [PATCH v2 00/10] Copy Offload in NVMe Fabrics with P2P PCI Memory Thread-Topic: [PATCH v2 00/10] Copy Offload in NVMe Fabrics with P2P PCI Memory Thread-Index: AQHTsO2GEDgA2h38ikWGpBGerXYMdKO6wDyAgAAAX4CAAO0JAIAAKJ+AgAAHPICAAAIhAIAAAgEA//+SBoA= Date: Thu, 1 Mar 2018 21:37:00 +0000 Message-ID: References: <20180228234006.21093-1-logang@deltatee.com> <1519876489.4592.3.camel@kernel.crashing.org> <1519876569.4592.4.camel@au1.ibm.com> <8e808448-fc01-5da0-51e7-1a6657d5a23a@deltatee.com> <1519936195.4592.18.camel@au1.ibm.com> <20180301205548.GA6742@redhat.com> <20180301211036.GB6742@redhat.com> In-Reply-To: <20180301211036.GB6742@redhat.com> Accept-Language: en-CA, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-MacOutlook/10.a.0.180210 authentication-results: spf=none (sender IP is ) smtp.mailfrom=sbates@raithlin.com; x-originating-ip: [70.65.224.121] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1;YTXPR0101MB1968;7:+J6bCT3U93BZdIXne+joUdvzWcN9ItMtWlSBtT41Tr0UohGy4PrflTuB9RytGDham5FdGeurwVqZ4ffd3rtqZdR+ATZzV7F45JQizLYLi+9Ebnr17G5imI77kLI9l16JLGWdFcybDylndNYFZm2PoWxdvKfEKPpxP6XHDBCF9enhiC3hShU9MoO/fttV5KvMu0fiC1Rx77qxwUd4Fpb3cAqtZ+wOCvKt3MlZ5qW3cRDspPnMLhXUqlfihYY0/Jt7 x-ms-exchange-antispam-srfa-diagnostics: SSOS; x-ms-office365-filtering-correlation-id: 691d0294-f40f-4ae1-d29c-08d57fbc90e1 x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:(7020095)(4652020)(7021125)(4534165)(7022125)(4603075)(4627221)(201702281549075)(7048125)(7024125)(7027125)(7028125)(7023125)(5600026)(4604075)(3008032)(2017052603307)(7153060)(7193020);SRVR:YTXPR0101MB1968; x-ms-traffictypediagnostic: YTXPR0101MB1968: x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:; x-exchange-antispam-report-cfa-test: BCL:0;PCL:0;RULEID:(6040501)(2401047)(5005006)(8121501046)(3002001)(3231220)(944501231)(52105095)(93006095)(93001095)(10201501046)(6041288)(20161123560045)(20161123564045)(20161123562045)(2016111802025)(20161123558120)(6043046)(6072148)(201708071742011);SRVR:YTXPR0101MB1968;BCL:0;PCL:0;RULEID:;SRVR:YTXPR0101MB1968; x-forefront-prvs: 05986C03E0 x-forefront-antispam-report: SFV:NSPM;SFS:(10019020)(39380400002)(366004)(39830400003)(346002)(376002)(396003)(199004)(189003)(25786009)(6116002)(76176011)(3846002)(4326008)(99286004)(26005)(6506007)(14454004)(186003)(2906002)(83716003)(66066001)(229853002)(478600001)(8936002)(305945005)(7736002)(93886005)(110136005)(316002)(58126008)(54906003)(33656002)(7416002)(8676002)(81166006)(81156014)(5660300001)(3280700002)(97736004)(105586002)(6512007)(53936002)(6486002)(6436002)(106356001)(5250100002)(2950100002)(86362001)(82746002)(6246003)(68736007)(102836004)(2900100001)(36756003)(3660700001);DIR:OUT;SFP:1102;SCL:1;SRVR:YTXPR0101MB1968;H:YTXPR0101MB2045.CANPRD01.PROD.OUTLOOK.COM;FPR:;SPF:None;PTR:InfoNoRecords;A:1;MX:1;LANG:en; received-spf: None (protection.outlook.com: raithlin.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: vEFh54r4JerWq8IoCm7URUhIH9k/QPv5kBn9b6bAJCBAMZmwZPDZwQLEpMmdU2j2voJg/oPLQ17mczJNP3OvMO2Rs+9rizfxteDS62uVQ8Nh0rAvIHsMYakCLl65Su1zyDBkVtTtqpax4jbgrqX7BEvhXTTfTr9vtcm9VgNP5lQ= spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="utf-8" Content-ID: <39F1AEAE53F44B4493149DAB944FFFF2@CANPRD01.PROD.OUTLOOK.COM> Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-OriginatorOrg: raithlin.com X-MS-Exchange-CrossTenant-Network-Message-Id: 691d0294-f40f-4ae1-d29c-08d57fbc90e1 X-MS-Exchange-CrossTenant-originalarrivaltime: 01 Mar 2018 21:37:00.2997 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 18519031-7ff4-4cbb-bbcb-c3252d330f4b X-MS-Exchange-Transport-CrossTenantHeadersStamped: YTXPR0101MB1968 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org PiBUaGUgaW50ZW50aW9uIG9mIEhNTSBpcyB0byBiZSB1c2VmdWwgZm9yIGFsbCBkZXZpY2UgbWVt b3J5IHRoYXQgd2lzaA0KPiB0byBoYXZlIHN0cnVjdCBwYWdlIGZvciB2YXJpb3VzIHJlYXNvbnMu DQoNCkhpIEplcm1vbmUgYW5kIHRoYW5rcyBmb3IgeW91ciBpbnB1dCEgVW5kZXJzdG9vZC4gV2Ug aGF2ZSBsb29rZWQgYXQgSE1NIGluIHRoZSBwYXN0IGFuZCBsb25nIHRlcm0gSSBkZWZpbml0ZWx5 IHdvdWxkIGxpa2UgdG8gY29uc2lkZXIgaG93IHdlIGNhbiBhZGQgUDJQIGZ1bmN0aW9uYWxpdHkg dG8gSE1NIGZvciBib3RoIERFVklDRV9QUklWQVRFIGFuZCBERVZJQ0VfUFVCTElDIHNvIHdlIGNh biBwYXNzIGFkZHJlc3NhYmxlIGFuZCBub24tYWRkcmVzc2FibGUgYmxvY2tzIG9mIGRhdGEgYmV0 d2VlbiBkZXZpY2VzLiBIb3dldmVyIHRoYXQgaXMgd2VsbCBiZXlvbmQgdGhlIGludGVudGlvbnMg b2YgdGhpcyBzZXJpZXMgOy0pLg0KDQpTdGVwaGVuDQogICAgDQoNCg==