Received: by 2002:a25:e74b:0:0:0:0:0 with SMTP id e72csp1751023ybh; Thu, 23 Jul 2020 17:20:12 -0700 (PDT) X-Google-Smtp-Source: ABdhPJzFZzSp/DKvImzMYotp4gCbmj9LNhmCol9/fgd86/hzZshF7/T36ZPHtPaENOzwuSo2BDoj X-Received: by 2002:a17:906:8688:: with SMTP id g8mr6660731ejx.505.1595550012500; Thu, 23 Jul 2020 17:20:12 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1595550012; cv=pass; d=google.com; s=arc-20160816; b=a/gCCohQ9fn2+G9Y+fUK0DhdA2YAdFQg+etW4eNRum1JrhLnRL3+y/dqUHqmXIumXx jcfsyEqLM7EkkdVWrmAgJnLEQM1KvcYTE6ILrNILe4NIUX+zHK27wvqk80t1half/5UA Us/ZZPLvH1pJtyCXXUp4VFvjwzl4S1hKEIC0dUfbG7qNU1zOgi6/GTV1yHZIVZLyl6dI 8Xlyni5RhdqeixyVDvSTFy4OqnQwHKK2aeZDZAsZs+n+eUU0mhFoMIWKFrnBq+2/6DER AKMkt1VXRidrNCTPGUumaOvp0z+ptQcLDw14Tf+nS8bVZXiTbyFtC8HmyT0eMzvANnRb QHpg== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:mime-version:in-reply-to :content-disposition:references:message-id:subject:cc:to:from:date :dkim-signature; bh=IKgXeUQzsksGmCUNsr44CK5LbZB3qab0NdBc27SSk2A=; b=PARydYpSZRfwudTObyax15C9mKdlaCDge+vMfGawXmPKbJZMTP6NN7wB3v+4D4agUp L8UA/ao5G5+IuC4NQU31pXtBxer03PBtni9xYoLyNjdfmCNFmOph24+YpkCzhfzZnH+5 KJV4hwpc2KXHQIYkYPtoXDwtynh5RlYLpduSM5pxIu0pD0JCEu4uRvCEZ+qKkrJmMU4C 0BqD3ByhMJf/E3k48lwEKvqk4Gy+Jigcoa6fjtjSsbygUDCdw+4VXvAH7nsdiXmgOGp9 sWb1DtOK/RyhgIJVf2TLGces2792GpBXGHz7Xi6c5IppbmFQ6wotthlEmpgDJVt3zxaD CCQA== ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@Mellanox.com header.s=selector1 header.b=XYAEOz8B; arc=pass (i=1 spf=pass spfdomain=mellanox.com dkim=pass dkdomain=mellanox.com dmarc=pass fromdomain=mellanox.com); spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=mellanox.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id i2si1544877edu.549.2020.07.23.17.19.49; Thu, 23 Jul 2020 17:20:12 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@Mellanox.com header.s=selector1 header.b=XYAEOz8B; arc=pass (i=1 spf=pass spfdomain=mellanox.com dkim=pass dkdomain=mellanox.com dmarc=pass fromdomain=mellanox.com); spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=mellanox.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728328AbgGXATk (ORCPT + 99 others); Thu, 23 Jul 2020 20:19:40 -0400 Received: from mail-eopbgr70077.outbound.protection.outlook.com ([40.107.7.77]:35832 "EHLO EUR04-HE1-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1728187AbgGXATk (ORCPT ); Thu, 23 Jul 2020 20:19:40 -0400 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=CIxAfDKrmELHkQ37Yx/pxYpFMm7XdktPaJDURJNRIWS588Q0mnNd8qocOGAqpvBarU+LU3Vyb5J065i7rTHhzKXgh7gcS86DZ8kSZYj7qy9l/IO5GWpE7z8/tduG5048973ksFx0Nr6Jt0HcQ8Bc3e8svaArYhI4QNSuY6cueXUFF/PLPv5i1eErvI+BePmFJ8JDzIInTJTdpG1ueN8KlpDnS3zRPiKjlbgZqYtl1Pyz850ezRpUVFluj5NRgD3dwSJlFMuzD/PAA5jmE4N2RZR+Js0j91GR8jK7a4DJuqsZONFG4jtUXVAdT7nOUi3JZ1mfeZKu55wzzfZXFl1ptA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=IKgXeUQzsksGmCUNsr44CK5LbZB3qab0NdBc27SSk2A=; b=kdpHJo0LC9bhjuY6pQGYgy4hf3N/+HdkpkZi6TO+4SFE/8Zh0ocnEJ2X8NBQLLViKRUhEmHra9Fwg+Sb0WzwXSOkAp3hyjLYRlDriOYVAouoJyLM2tb+ixxQhceMvaCr5u3FG253XQM/fGn1cY1ZNexRZfO3+stbzzfOTtxdcq8EHoNxINFJKufmNo8744k/mD/3asdWJrk3bVrmIDcODilQ2D6COtPp5VD+bJ4P55Ir9saCdCe68B4fRMyTUy6VlET10N5D85HuZWIIcT3VwhYsq+ycCp9OOsIciJGZ1GmR3VR2TOG083iUsjpoCtLAfavpgfB+tTphSCfmgxsYWQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=mellanox.com; dmarc=pass action=none header.from=mellanox.com; dkim=pass header.d=mellanox.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=IKgXeUQzsksGmCUNsr44CK5LbZB3qab0NdBc27SSk2A=; b=XYAEOz8BxMr0eFMYwD5pMjTikc6lzoyRtPTkwXT9lRWX+osryR7ENpaGNIb6brFao1PIb2ZO+kq0CFcTk/nKgbkSY2yOgQd/x63MEc8dX0eO6VWMXszm33AY0c0uH52auTx6eZbslmLVsQkT6RMNuvVv38Rw/zoXSnvLEsCeU2E= Authentication-Results: intel.com; dkim=none (message not signed) header.d=none;intel.com; dmarc=none action=none header.from=mellanox.com; Received: from VI1PR05MB4141.eurprd05.prod.outlook.com (2603:10a6:803:44::15) by VI1PR0502MB3951.eurprd05.prod.outlook.com (2603:10a6:803:17::26) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3216.24; Fri, 24 Jul 2020 00:19:35 +0000 Received: from VI1PR05MB4141.eurprd05.prod.outlook.com ([fe80::252e:52c7:170b:35d]) by VI1PR05MB4141.eurprd05.prod.outlook.com ([fe80::252e:52c7:170b:35d%5]) with mapi id 15.20.3195.028; Fri, 24 Jul 2020 00:19:35 +0000 Date: Thu, 23 Jul 2020 21:19:30 -0300 From: Jason Gunthorpe To: "Tian, Kevin" Cc: "Jiang, Dave" , "vkoul@kernel.org" , "Dey, Megha" , "maz@kernel.org" , "bhelgaas@google.com" , "rafael@kernel.org" , "gregkh@linuxfoundation.org" , "tglx@linutronix.de" , "hpa@zytor.com" , "alex.williamson@redhat.com" , "Pan, Jacob jun" , "Raj, Ashok" , "Liu, Yi L" , "Lu, Baolu" , "Kumar, Sanjay K" , "Luck, Tony" , "Lin, Jing" , "Williams, Dan J" , "kwankhede@nvidia.com" , "eric.auger@redhat.com" , "parav@mellanox.com" , "Hansen, Dave" , "netanelg@mellanox.com" , "shahafs@mellanox.com" , "yan.y.zhao@linux.intel.com" , "pbonzini@redhat.com" , "Ortiz, Samuel" , "Hossain, Mona" , "dmaengine@vger.kernel.org" , "linux-kernel@vger.kernel.org" , "x86@kernel.org" , "linux-pci@vger.kernel.org" , "kvm@vger.kernel.org" Subject: Re: [PATCH RFC v2 00/18] Add VFIO mediated device support and DEV-MSI support for the idxd driver Message-ID: <20200724001930.GS2021248@mellanox.com> References: <159534667974.28840.2045034360240786644.stgit@djiang5-desk3.ch.intel.com> <20200721164527.GD2021248@mellanox.com> Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-ClientProxiedBy: YT1PR01CA0065.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:2e::34) To VI1PR05MB4141.eurprd05.prod.outlook.com (2603:10a6:803:44::15) MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 Received: from mlx.ziepe.ca (156.34.48.30) by YT1PR01CA0065.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:2e::34) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3216.23 via Frontend Transport; Fri, 24 Jul 2020 00:19:34 +0000 Received: from jgg by mlx with local (Exim 4.94) (envelope-from ) id 1jylQw-00Eb6F-EQ; Thu, 23 Jul 2020 21:19:30 -0300 X-Originating-IP: [156.34.48.30] X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-HT: Tenant X-MS-Office365-Filtering-Correlation-Id: 806467bc-1a4b-4a0a-a658-08d82f673e69 X-MS-TrafficTypeDiagnostic: VI1PR0502MB3951: X-MS-Exchange-Transport-Forked: True X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:10000; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: kn+1XU7PKTZVibxyduX59TPZGAoBiXIRju/TovbE96He8qJHDj80MZt1uRIs4e6U595f4h79TZn0qgk4RC3zAeLkpz5hF8SNqQ8iksfagpukJCZXs+P3lwHJVuQUy37PvOQ2uDet8IOuu2jnlqCH2+AetwERtBVaZjuFXL8iRF0ibbCYecgWu5DA8TA2ENMK9dKF0Z1O5sC+22CI/Mk5XvfHNvb9KgnPY1g/dOdDiXd7mpsPPmqXxoWfzd8xhqvVReUUPNI6Y7fPWyfOKsbNpuq0yhmWbFYIoEotvKUBuAQ7tPsvK/Gh0FhEkcAL6j0B9MLFgAB4pyHKVf3H96R3OA== X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:VI1PR05MB4141.eurprd05.prod.outlook.com;PTR:;CAT:NONE;SFTY:;SFS:(4636009)(376002)(396003)(366004)(346002)(136003)(39860400002)(33656002)(26005)(6916009)(5660300002)(4326008)(36756003)(9746002)(9786002)(1076003)(7406005)(66476007)(186003)(7416002)(478600001)(2906002)(2616005)(426003)(86362001)(8676002)(66946007)(54906003)(66556008)(316002)(8936002);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData: pqhcNQMSuLcBz0D1S/zT5wggPgEbWSbmN4ICtH/pXZ3e6nw6HDQGe3XNxLiALdRG/d3qQMfzsjGoa/SkjwjHhPjbhlCsQi/qmyWfOg4MRXataK9h76zcdAHdsUTcB3Q2DLQ3BIjoFnGq4Co2P0A4b3CKPga9dig3+ECLE+8f7VMCE+8fgFhK5DnrZKIC9Uq24OCV21P6cFAyEYuhl+SxDlvOQEhFxj6pyNyVi11eLbnqk9gpqHGEnxcSFj3aPPPrpWp+4lN4iUR3w8JizdwDPAMyCxTYQFw7Gm2ZJiZbHJdRg6rTiwmsL/kiZJ9551Cd5rv9ri/k78GvVvUp22Mmk/E2DDAopL6ngESoqHohcklnZ9t+n+ONFFnJgdkY+4EdScCI4pWo3UDB645PnUKrFbOVnOfA41SNs9tkgLeVy/kl6KbjDCjQx2WvusIJSDmavYsRJ9L7uCgWpWkJ+FT22aAwdS87Yp6sj2j0UyEvYX8= X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-Network-Message-Id: 806467bc-1a4b-4a0a-a658-08d82f673e69 X-MS-Exchange-CrossTenant-AuthSource: VI1PR05MB4141.eurprd05.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 24 Jul 2020 00:19:35.1871 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: 9UHQLJZXe5XZN5s7IhMkNzkltN0nXje4Fgdkes6OT0LvBJQPNOvVoYs7zRc/YhIWh8NZks6c4LU2+eFPmdRvoQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: VI1PR0502MB3951 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Tue, Jul 21, 2020 at 11:54:49PM +0000, Tian, Kevin wrote: > In a nutshell, applications don't require raw WQ controllability as guest > kernel drivers may expect. Extending DSA user space interface to be another > passthrough interface just for virtualization needs is less compelling than > leveraging established VFIO/mdev framework (with the major merit that > existing user space VMMs just work w/o any change as long as they already > support VFIO uAPI). Sure, but the above is how the cover letter should have summarized that discussion, not as "it is not much code difference" > In last review you said that you didn't hard nak this approach and would > like to hear opinion from virtualization guys. In this version we CCed KVM > mailing list, Paolo (VFIO/Qemu), Alex (VFIO), Samuel (Rust-VMM/Cloud > hypervisor), etc. Let's see how they feel about this approach. Yes, the VFIO community should decide. If we are doing emulation tasks in the kernel now, then I can think of several nice semi-emulated mdevs to propose. This will not be some one off, but the start of a widely copied pattern. Jason