Received: by 2002:a05:6a10:9afc:0:0:0:0 with SMTP id t28csp70199pxm; Tue, 22 Feb 2022 16:58:27 -0800 (PST) X-Google-Smtp-Source: ABdhPJzqysaYbGqiY0OGYlLYyWyI+af0H21MGwev1SYrHc+0UnJw8X6eJe0ywy938vY7gnJ7pMVE X-Received: by 2002:a17:90b:e89:b0:1b8:e8ca:483f with SMTP id fv9-20020a17090b0e8900b001b8e8ca483fmr6673348pjb.22.1645577907631; Tue, 22 Feb 2022 16:58:27 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1645577907; cv=none; d=google.com; s=arc-20160816; b=qwDFFXR8RtLaR1DLZ+dDAKduqhPIDwmjiOwicvJ+XS83eL6RZ950IboBPXSrt2XyGB oRwfB10XOWA0fo/nIZ2+KeY7gNf79CgptmmVbaPLTIiarL/fIuuf7xoe14/KcXAnA99G bt0wYuMAEC8EpO7tsxYi/dkK7IKKCjiMsZdJ8NCd10XH4VpfIsUAN/8NU+43I76OOA/R KVmCAliCKGrJOJtLjKgIHbaqjkORJLWxTLcu8iHgM8vFnUe1pQr0q/wBBGEOmgHxzAhi 4ZqsWye87P/qyIYXSxptqbb16wheSQBT/63QyrByYlc/AMqov+FrsOgWBKtUwGogkV1b 1clQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :organization:references:in-reply-to:message-id:subject:cc:to:from :date:dkim-signature; bh=P/Jd5qPSi0YoZ3kqzdTLt1xOvKYnU22Qo00BT9erdYs=; b=KD9Qms+zkMIKGiqAznw2kHgtt3X1hsZDxkEd49HinMY1xmQ8W4rZc4DWHH8CYuRy4l DXc0Inc/gg7N/V6sOsJlfFTfsWBBgPLJBeqJHQFCqG+eBV3VsBBgmhubuxcazilMF1mF GDeV5wba2TSMmYk02S68UvuhTtAwLzt9eZiXqut22l1DQNX6Sk5/JHEAhBEd/CixCHN1 DfDRwKGiYabU9wtBvTeor9r9LI8YVDNV2TBGmTfh6plc47/6mzAt39KvIe5v/NjW2pyI yQnom/u0SRwOzFil2MQ8/Rd9wn9UWwaPLReCtooZAco9nldwChhn9cTYctPJS9aZHSZo 7ewQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=cWUvuzIE; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id i1si175145pgd.706.2022.02.22.16.58.11; Tue, 22 Feb 2022 16:58:27 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=cWUvuzIE; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S235202AbiBVTaL (ORCPT + 99 others); Tue, 22 Feb 2022 14:30:11 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:34956 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S234928AbiBVTaK (ORCPT ); Tue, 22 Feb 2022 14:30:10 -0500 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.129.124]) by lindbergh.monkeyblade.net (Postfix) with ESMTP id 9EDA8140F6 for ; Tue, 22 Feb 2022 11:29:44 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1645558183; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=P/Jd5qPSi0YoZ3kqzdTLt1xOvKYnU22Qo00BT9erdYs=; b=cWUvuzIEBCRxeeVM6AfOwHjb9u8ay8CZawKb0WI4zLT+y0FksHRjgIinwaJaUgBVJYACSU q8b2tsQN93vogykVhE6Qx8Oh0wQ3vpRSxtDHg3Y4T2/RENNK257eLvYx3O0YFZ2lvNIPcl LBxXov9IYlWJ4S/yxrz8BVpn29obpQE= Received: from mail-ot1-f69.google.com (mail-ot1-f69.google.com [209.85.210.69]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id us-mta-35-BjQ6rLSwO5qHrSq6Urw6Pw-1; Tue, 22 Feb 2022 14:29:42 -0500 X-MC-Unique: BjQ6rLSwO5qHrSq6Urw6Pw-1 Received: by mail-ot1-f69.google.com with SMTP id l23-20020a056830239700b005ad40210ca2so8794736ots.3 for ; Tue, 22 Feb 2022 11:29:42 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:date:from:to:cc:subject:message-id:in-reply-to :references:organization:mime-version:content-transfer-encoding; bh=P/Jd5qPSi0YoZ3kqzdTLt1xOvKYnU22Qo00BT9erdYs=; b=QbL2Xcpr+N1iYiCCy4Hcx25sfx1C8On46FXqkJ74p09ZYdrnErX5OhLIxAyJ2t0Jy5 rvkLoAAiUxR+m+4jwrFilnMGghAAdclcrmBluP07XHsoPkcq2prmic0dhHg+0/Rp87zR 92dCjcs19AOz+8ponQUtwbLi3ak461+YNkJZNfwRglULDPriwlu0qy6NB8fTAEPh+3jb I8K97bXKDReBgXHwvRysG6nKih6g0kC/A731QF1SwcHq7CNRkA4dur+oiMVjopxrmdq/ ptik31Pbf4teWYEuw3dr87OwxAYA3CPgOiU8pSLIMpcizEBZw0Ga3XfTdhZ6869oqV41 39OA== X-Gm-Message-State: AOAM5307UuxrMrbz9+U/2mZJiJwrlDkN72xna2dXMO/Om4TK96Vwaj5Q bWd+qQ6o2wEjabusZ8YtF+5fFCPImxuJ7q+s+liwkzBVuW0WiqyPhlYO5oP+/SjZAna4j1wcEKj t6SDVIrEaZ8ssedfZXEvXZGza X-Received: by 2002:a05:6808:2228:b0:2cf:f102:b72b with SMTP id bd40-20020a056808222800b002cff102b72bmr2831422oib.286.1645558181759; Tue, 22 Feb 2022 11:29:41 -0800 (PST) X-Received: by 2002:a05:6808:2228:b0:2cf:f102:b72b with SMTP id bd40-20020a056808222800b002cff102b72bmr2831418oib.286.1645558181540; Tue, 22 Feb 2022 11:29:41 -0800 (PST) Received: from redhat.com ([38.15.36.239]) by smtp.gmail.com with ESMTPSA id g34sm6632626ooi.48.2022.02.22.11.29.40 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 22 Feb 2022 11:29:40 -0800 (PST) Date: Tue, 22 Feb 2022 12:29:39 -0700 From: Alex Williamson To: Jason Gunthorpe Cc: Shameer Kolothum , kvm@vger.kernel.org, linux-kernel@vger.kernel.org, linux-crypto@vger.kernel.org, cohuck@redhat.com, mgurtovoy@nvidia.com, yishaih@nvidia.com, linuxarm@huawei.com, liulongfang@huawei.com, prime.zeng@hisilicon.com, jonathan.cameron@huawei.com, wangzhou1@hisilicon.com Subject: Re: [PATCH v5 0/8] vfio/hisilicon: add ACC live migration driver Message-ID: <20220222122939.0394d152.alex.williamson@redhat.com> In-Reply-To: <20220222004943.GF193956@nvidia.com> References: <20220221114043.2030-1-shameerali.kolothum.thodi@huawei.com> <20220222004943.GF193956@nvidia.com> Organization: Red Hat MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Spam-Status: No, score=-2.8 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_LOW, RCVD_IN_MSPIKE_H5,RCVD_IN_MSPIKE_WL,SPF_HELO_NONE,SPF_NONE, T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Mon, 21 Feb 2022 20:49:43 -0400 Jason Gunthorpe wrote: > On Mon, Feb 21, 2022 at 11:40:35AM +0000, Shameer Kolothum wrote: > >=20 > > Hi, > >=20 > > This series attempts to add vfio live migration support for > > HiSilicon ACC VF devices based on the new v2 migration protocol > > definition and mlx5 v8 series discussed here[0]. > >=20 > > RFCv4 --> v5 > > - Dropped RFC tag as v2 migration APIs are more stable now. > > - Addressed review comments from Jason and Alex (Thanks!). > >=20 > > This is sanity tested on a HiSilicon platform using the Qemu branch > > provided here[1]. > >=20 > > Please take a look and let me know your feedback. > >=20 > > Thanks, > > Shameer > > [0] https://lore.kernel.org/kvm/20220220095716.153757-1-yishaih@nvidia.= com/ > > [1] https://github.com/jgunthorpe/qemu/commits/vfio_migration_v2 > >=20 > >=20 > > v3 --> RFCv4 > > -Based on migration v2 protocol and mlx5 v7 series. > > -Added RFC tag again as migration v2 protocol is still under discussion. > > -Added new patch #6 to retrieve the PF QM data. > > -PRE_COPY compatibility check is now done after the migration data > > =C2=A0transfer. This is not ideal and needs discussion. =20 >=20 > Alex, do you want to keep the PRE_COPY in just for acc for now? Or do > you think this is not a good temporary use for it? >=20 > We have some work toward doing the compatability more generally, but I > think it will be a while before that is all settled. In the original migration protocol I recall that we discussed that using the pre-copy phase for compatibility testing, even without additional device data, as a valid use case. The migration driver of course needs to account for the fact that userspace is not required to perform a pre-copy, and therefore cannot rely on that exclusively for compatibility testing, but failing a migration earlier due to detection of an incompatibility is generally a good thing. If the ACC driver wants to re-incorporate this behavior into a non-RFC proposed series and we could align accepting them into the same kernel release, that sounds ok to me. Thanks, Alex