Received: by 2002:a25:4158:0:0:0:0:0 with SMTP id o85csp970894yba; Fri, 3 May 2019 13:37:21 -0700 (PDT) X-Google-Smtp-Source: APXvYqy6ltaT7yta+qBQiqaeKEt1wbpnXlho+Be3nQRL3VYniujtVJwaTye4qXp8TvlGcc5pw2Wv X-Received: by 2002:a65:648c:: with SMTP id e12mr13249219pgv.346.1556915841159; Fri, 03 May 2019 13:37:21 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1556915841; cv=none; d=google.com; s=arc-20160816; b=RRFbqXtAd2s/V2lV1gHd54DT/W3nZwL6zXb+OZOicVa5lRiio/+Q+Xk6WMHOYuG8li j7VSI6YqpOj9SGl94fsMZ05Zr8BiBG3dS8ZdEqC1CHxwB75HWclq5nwMa/SNwXtw+HuD dRwm/nCuZ1scR2Rc26R59q38uVut4QZ5B59Uy/w7cAKXt6FwNg50fHcJ42u9xHETvexE d8Ql6EkRsRw9St/EduV6zSDXTWi3Ub0QkIXY2ogKDc7JeBRT2kKWQUeXyinAuyw+UNKA 9ypvLzESIjEUsjRFXjYpvRyYHULB6oDKL4XVEEillB85O842KdNroU2uu79QGG32AFR7 Kwgg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-language :content-transfer-encoding:in-reply-to:mime-version:user-agent:date :message-id:from:references:cc:to:subject:dkim-signature; bh=G5rmKY/ryyqvCzcofiGq32JWwfZXN1f8sSMf9ymEfmQ=; b=GVeJtyL2gYZO6opOLJbfi60Kr3OoXrzwj5BYQ4YpjMLnh3nwNQFvyU1x9lPhx9HzXF fxCmdyUe6D47adzAqem2OXewGZNblAx7or0+SR7cylgzVqcYMB0P7HcRJkRjJkYtSBQk 1BUan6cK2DnTs9+tOK5nLRIBzUh9Fih+vqaFjeINJdakMFs5+wgQwyQ5tlwxr9piRDiQ CZMp5OsrTPfMWpQXqiYHrE7y4fVIVCCTyyrQsZnVIkC98rpJJJbNQA+dMT3PgoKYT3m6 w7M+J+NWy4Ujte4+mTw61+CNyUM7Omr7xHQLvk7hmKXkFSNCnOd/bfukblD1RF6hxOQh 3tRw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@Mellanox.com header.s=selector2 header.b="VRpg/Yqh"; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=mellanox.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id x15si3921002pln.135.2019.05.03.13.37.05; Fri, 03 May 2019 13:37:21 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@Mellanox.com header.s=selector2 header.b="VRpg/Yqh"; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=mellanox.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726883AbfECTBY (ORCPT + 99 others); Fri, 3 May 2019 15:01:24 -0400 Received: from mail-eopbgr30049.outbound.protection.outlook.com ([40.107.3.49]:12494 "EHLO EUR03-AM5-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1726776AbfECTBY (ORCPT ); Fri, 3 May 2019 15:01:24 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=G5rmKY/ryyqvCzcofiGq32JWwfZXN1f8sSMf9ymEfmQ=; b=VRpg/Yqh0hd9jbFvpjeuTHFZufDbSnOGTlAloIDMqI5ZLBH9lFqgQ52ZqrHREBMR0otCUlK6Iv0+9cFk47KChyXKdwPPhnNuQ/549GcFxaZ8JMBLNJeNK86ereqXm4d8QyN1p4kPiLSggtgrYadcRTaVHtNJqRfzp2LwOcHZjOc= Received: from VI1PR0501CA0016.eurprd05.prod.outlook.com (2603:10a6:800:92::26) by VI1PR0502MB4061.eurprd05.prod.outlook.com (2603:10a6:803:25::21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1856.11; Fri, 3 May 2019 19:01:16 +0000 Received: from VE1EUR03FT023.eop-EUR03.prod.protection.outlook.com (2a01:111:f400:7e09::201) by VI1PR0501CA0016.outlook.office365.com (2603:10a6:800:92::26) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.1856.11 via Frontend Transport; Fri, 3 May 2019 19:01:16 +0000 Authentication-Results: spf=pass (sender IP is 193.47.165.134) smtp.mailfrom=mellanox.com; davemloft.net; dkim=none (message not signed) header.d=none;davemloft.net; dmarc=pass action=none header.from=mellanox.com; Received-SPF: Pass (protection.outlook.com: domain of mellanox.com designates 193.47.165.134 as permitted sender) receiver=protection.outlook.com; client-ip=193.47.165.134; helo=mtlcas13.mtl.com; Received: from mtlcas13.mtl.com (193.47.165.134) by VE1EUR03FT023.mail.protection.outlook.com (10.152.18.133) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.1856.11 via Frontend Transport; Fri, 3 May 2019 19:01:14 +0000 Received: from MTLCAS13.mtl.com (10.0.8.78) by mtlcas13.mtl.com (10.0.8.78) with Microsoft SMTP Server (TLS) id 15.0.1178.4; Fri, 3 May 2019 22:01:13 +0300 Received: from MTLCAS01.mtl.com (10.0.8.71) by MTLCAS13.mtl.com (10.0.8.78) with Microsoft SMTP Server (TLS) id 15.0.1178.4 via Frontend Transport; Fri, 3 May 2019 22:01:13 +0300 Received: from [172.16.0.54] (172.16.0.54) by MTLCAS01.mtl.com (10.0.8.71) with Microsoft SMTP Server (TLS) id 14.3.301.0; Fri, 3 May 2019 22:00:59 +0300 Subject: Re: [PATCH v2 06/10] nvme/core: add mdev interfaces To: Christoph Hellwig , Maxim Levitsky CC: Fam Zheng , , Wolfram Sang , , , Keith Busch , "Kirti Wankhede" , Mauro Carvalho Chehab , "Paul E . McKenney" , Christoph Hellwig , Sagi Grimberg , "Liang Cunming" , Jens Axboe , "Alex Williamson" , John Ferlan , Liu Changpeng , Jens Axboe , "Greg Kroah-Hartman" , Nicolas Ferre , Paolo Bonzini , "Amnon Ilan" , "David S . Miller" References: <20190502114801.23116-1-mlevitsk@redhat.com> <20190502114801.23116-7-mlevitsk@redhat.com> <20190503122902.GA5081@infradead.org> From: Max Gurtovoy Message-ID: Date: Fri, 3 May 2019 22:00:54 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.6.1 MIME-Version: 1.0 In-Reply-To: <20190503122902.GA5081@infradead.org> Content-Type: text/plain; charset="utf-8"; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US X-Originating-IP: [172.16.0.54] X-EOPAttributedMessage: 0 X-MS-Office365-Filtering-HT: Tenant X-Forefront-Antispam-Report: CIP:193.47.165.134;IPV:NLI;CTRY:IL;EFV:NLI;SFV:NSPM;SFS:(10009020)(136003)(39860400002)(346002)(396003)(376002)(2980300002)(199004)(189003)(31686004)(26005)(77096007)(230700001)(6246003)(229853002)(67846002)(53546011)(2906002)(186003)(305945005)(16526019)(6306002)(50466002)(64126003)(70586007)(966005)(7736002)(478600001)(70206006)(11346002)(446003)(110136005)(58126008)(486006)(2616005)(54906003)(476003)(126002)(316002)(16576012)(336012)(6116002)(4326008)(86362001)(81166006)(5660300002)(76176011)(106002)(31696002)(81156014)(356004)(6666004)(2486003)(23676004)(65956001)(47776003)(7416002)(8676002)(4744005)(8936002)(65826007)(3846002)(36756003)(65806001)(3940600001);DIR:OUT;SFP:1101;SCL:1;SRVR:VI1PR0502MB4061;H:mtlcas13.mtl.com;FPR:;SPF:Pass;LANG:en;PTR:mail13.mellanox.com;A:1;MX:1; X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: ff93b9a1-2b4e-495b-0884-08d6cff9b7b8 X-Microsoft-Antispam: BCL:0;PCL:0;RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600141)(711020)(4605104)(4709054)(2017052603328)(7193020);SRVR:VI1PR0502MB4061; X-MS-TrafficTypeDiagnostic: VI1PR0502MB4061: X-MS-Exchange-PUrlCount: 1 X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:8273; X-Forefront-PRVS: 0026334A56 X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam-Message-Info: DGddPswefKoHsVgWtC7pnM5lSpWMOv75Oc/NluAwqS56HkPDM/c2drjGZroZ6m91Z7v5SRzJ7rt+UflzPbm3hHC9sgrdGgH1KJAddQ1cP/QLwBogeN947+AA3opIcmlLuvwvU1DHlEdBNmtvXtQ6FT/+q6vDC5QjFm0KtykIPVlomZEloPWrfaktmYBsqJq8VIA1iYmdTaBD9PxZ4Otr6fk/WoHefeaJaaIRPOfbTjrPIkmcYAZEprdxaPRdhm0I5rw5MqaDqLJuYKM+uFlqA7niMIv+Pmo65jGy3ebUDrAT/CIvwYmrjNIpzg5tIHUiv+jGygEVhGcWaSVh/zSuG/t7ruG03SONQnBGb5Lgx8DelSixm/MJGnAvcQ9rEz+PBBlm/nBXGvQctY6glxtT4hRuovmcYcVtHTDAUzTP5VM= X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 03 May 2019 19:01:14.9096 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: ff93b9a1-2b4e-495b-0884-08d6cff9b7b8 X-MS-Exchange-CrossTenant-Id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=a652971c-7d2e-4d9b-a6a4-d149256f461b;Ip=[193.47.165.134];Helo=[mtlcas13.mtl.com] X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: VI1PR0502MB4061 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 5/3/2019 3:29 PM, Christoph Hellwig wrote: > On Thu, May 02, 2019 at 02:47:57PM +0300, Maxim Levitsky wrote: >> If the mdev device driver also sets the >> NVME_F_MDEV_DMA_SUPPORTED, the mdev core will >> dma map all the guest memory into the nvme device, >> so that nvme device driver can use dma addresses as passed >> from the mdev core driver > We really need a proper block layer interface for that so that > uring or the nvme target can use pre-mapping as well. I think we can also find a way to use nvme-mdev for the target offload p2p feature. Don't see a big difference of taking NVMe queue and namespace/partition to guest OS or to P2P since IO is issued by external entity and pooled outside the pci driver. thoughts ? > > _______________________________________________ > Linux-nvme mailing list > Linux-nvme@lists.infradead.org > http://lists.infradead.org/mailman/listinfo/linux-nvme