Received: by 2002:a05:6a10:a0d1:0:0:0:0 with SMTP id j17csp3221464pxa; Tue, 18 Aug 2020 09:31:37 -0700 (PDT) X-Google-Smtp-Source: ABdhPJy9wqctd9NCKQp0CcqLa7Na6WJCoJsc0v0OZMKBsni8oNkFiBQkYvZYiQKE/ZOpGklbGg7F X-Received: by 2002:a50:de04:: with SMTP id z4mr20999761edk.10.1597768296993; Tue, 18 Aug 2020 09:31:36 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1597768296; cv=none; d=google.com; s=arc-20160816; b=rT+fUoNvm4rCt/JnuQjLWL8c0zbO6F4AKpkGdtdCBh5zG5lJ+gogkuQGyX0bJv6DvS zVvTruLgHV2UpCahiihBZZaFZBYrj3hwzh2KiEF9FLTfeYp/lXQi5TF/GwGy3Qn1khqa I98ogwGAwwP40Ke/emaaGKuzLUlnqRkrzZgg36F6eRGjX21DHR0v55R51QhPSx1koTgM r5AE+7slmiwt/poIyX5OD3nhtGI4kKu6FDBNriZiNo79EepMe8S+tK7/7NNwF99Dtgbg +cWislFuBRQh5rqjp5mn5T47hRoYz1U4TFvy75MDl2DBhm2dX1CIPdsp5eKtkhtTM5FF kJhw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:from:references:cc:to:subject:dkim-signature; bh=if9LpYICK0NhGXF5AA8XXB22L0fg+m6z8gcS1Q79zUU=; b=B01YbsmYjaaf3MUtcoUSxNXXAR4cW3SrtL9iH2WjVsxssEJoS7/sNi0gz7ZJaSZjCH wAKTMVOWnlS3QIHTp5WmqQWmLEslMoqJxQyr74EgGIwp19jHXYCkbsJj0qiCMtd8lFPR b7AQ5M4meH9hgqd7zQbP3jcY4Wa7pmLsEcTj5LFjkg+6cK+2atj1P97Z/SRkOsfn24od ZRZrktzLg8mKgS0KFHxE1WFlFqc1gAxXHpspFWuoA/uiKLjV26hIes6G6DJyq2euvBkj UzVVAuEoATJCObM3G3mcWyPV7t1wo6C9l5hpFU6pdNfjAEHQHlRKZtHrQGrWI1w1++R5 47eQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=c7TB2s4n; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id u21si14084892ejr.295.2020.08.18.09.31.12; Tue, 18 Aug 2020 09:31:36 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=c7TB2s4n; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727875AbgHRQ23 (ORCPT + 99 others); Tue, 18 Aug 2020 12:28:29 -0400 Received: from us-smtp-2.mimecast.com ([205.139.110.61]:30217 "EHLO us-smtp-delivery-1.mimecast.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1728254AbgHRQ1h (ORCPT ); Tue, 18 Aug 2020 12:27:37 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1597768047; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=if9LpYICK0NhGXF5AA8XXB22L0fg+m6z8gcS1Q79zUU=; b=c7TB2s4nJZZtfxADyn2lGRVDOg1erPbexqz5JyHkRdT+GVyKZIv8FYzpmAr1N2W1yhNfBo WFTatipZ0ZxQuqde/DYFHWPh92se4d5i4khHQXSet1JybgZOjiQGC79wTJbqnebvWdl6oo EAHIc2eh+REJPofVh8YIU9MWgLr50Bk= Received: from mail-wm1-f72.google.com (mail-wm1-f72.google.com [209.85.128.72]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-496-Zoh9695HN-WCqpbPCsQrtA-1; Tue, 18 Aug 2020 12:27:25 -0400 X-MC-Unique: Zoh9695HN-WCqpbPCsQrtA-1 Received: by mail-wm1-f72.google.com with SMTP id p23so6300665wmc.2 for ; Tue, 18 Aug 2020 09:27:25 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=if9LpYICK0NhGXF5AA8XXB22L0fg+m6z8gcS1Q79zUU=; b=CBRkvoqnIfNEkSSrpZQnxLsqAjH+383SiLud0NfnffSV/LXVvG4FVu1x4yAjZNuwWj Pa5JVOXg56Gz8aa8FxisMbmb+MG0ORKzrohiHsKD9jpbvji9uVgKa9Q20AgqZ+Pcc8Bk naWCI5UwEK0HJq9bsCjzYUjkrCXVqvLplk0UPuP6pKwoC4yXQ8Ob+P/bV4I+RIlHVFEi R1oNLvVZNHCsOTqo6IAkTWuVUOc7/U7KQkU2x8OTkIfBCM92V4P/4Ot6ibbDbffLmSy5 uuANZT3UYYJTfB0nsCNe6RXgr8LuGERnuBKA5fVWDtCxiD/9FEigXkNS7MUwMvEfH4f3 1mAg== X-Gm-Message-State: AOAM531uqP5RbTZRCeViDNDZDK7UN/q+o/h4nHXK82z63Oo/piSfY4SM Z48mTneWBayeL/ulpC60fGNKR71IeqnlWzz6oEUfWsL6SdPJJpGNLVo9m7eW2xH2Qti4L8BkOuj CgAdzbSxOvQEZVDpekPxSP1nH X-Received: by 2002:a7b:cf29:: with SMTP id m9mr692508wmg.88.1597768044065; Tue, 18 Aug 2020 09:27:24 -0700 (PDT) X-Received: by 2002:a7b:cf29:: with SMTP id m9mr692461wmg.88.1597768043853; Tue, 18 Aug 2020 09:27:23 -0700 (PDT) Received: from ?IPv6:2001:b07:6468:f312:38e0:ccf8:ca85:3d9b? ([2001:b07:6468:f312:38e0:ccf8:ca85:3d9b]) by smtp.gmail.com with ESMTPSA id e5sm37696385wrc.37.2020.08.18.09.27.21 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Tue, 18 Aug 2020 09:27:23 -0700 (PDT) Subject: Re: [PATCH RFC v2 00/18] Add VFIO mediated device support and DEV-MSI support for the idxd driver To: Jason Gunthorpe , "Tian, Kevin" Cc: Alex Williamson , "Jiang, Dave" , "vkoul@kernel.org" , "Dey, Megha" , "maz@kernel.org" , "bhelgaas@google.com" , "rafael@kernel.org" , "gregkh@linuxfoundation.org" , "tglx@linutronix.de" , "hpa@zytor.com" , "Pan, Jacob jun" , "Raj, Ashok" , "Liu, Yi L" , "Lu, Baolu" , "Kumar, Sanjay K" , "Luck, Tony" , "Lin, Jing" , "Williams, Dan J" , "kwankhede@nvidia.com" , "eric.auger@redhat.com" , "parav@mellanox.com" , "Hansen, Dave" , "netanelg@mellanox.com" , "shahafs@mellanox.com" , "yan.y.zhao@linux.intel.com" , "Ortiz, Samuel" , "Hossain, Mona" , "dmaengine@vger.kernel.org" , "linux-kernel@vger.kernel.org" , "x86@kernel.org" , "linux-pci@vger.kernel.org" , "kvm@vger.kernel.org" References: <20200721164527.GD2021248@mellanox.com> <20200724001930.GS2021248@mellanox.com> <20200805192258.5ee7a05b@x1.home> <20200807121955.GS16789@nvidia.com> <20200814133522.GE1152540@nvidia.com> <20200818004343.GG1152540@nvidia.com> <20200818115003.GM1152540@nvidia.com> From: Paolo Bonzini Message-ID: <0711a4ce-1e64-a0cb-3e6d-f6653284e2e3@redhat.com> Date: Tue, 18 Aug 2020 18:27:21 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.9.0 MIME-Version: 1.0 In-Reply-To: <20200818115003.GM1152540@nvidia.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 18/08/20 13:50, Jason Gunthorpe wrote: > For instance, what about suspend/resume of containers using idxd? > Wouldn't you want to have the same basic approach of controlling the > wq from userspace that virtualization uses? The difference is that VFIO more or less standardizes the approach you use for live migration. With another interface you'd have to come up with something for every driver, and add support in CRIU for every driver as well. Paolo