Received-SPF: pass (google.com: domain of linux-crypto+bounces-1946-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.48.161 as permitted sender) client-ip=147.75.48.161;
From: "Zeng, Xin" <xin.zeng@intel.com>
To: Alex Williamson <alex.williamson@redhat.com>
CC: "herbert@gondor.apana.org.au" <herbert@gondor.apana.org.au>,
	"jgg@nvidia.com" <jgg@nvidia.com>, "yishaih@nvidia.com" <yishaih@nvidia.com>,
	"shameerali.kolothum.thodi@huawei.com"
	<shameerali.kolothum.thodi@huawei.com>, "Tian, Kevin" <kevin.tian@intel.com>,
	"linux-crypto@vger.kernel.org" <linux-crypto@vger.kernel.org>,
	"kvm@vger.kernel.org" <kvm@vger.kernel.org>, qat-linux <qat-linux@intel.com>,
	"Cao, Yahui" <yahui.cao@intel.com>
Subject: RE: [PATCH 10/10] vfio/qat: Add vfio_pci driver for Intel QAT VF
 devices
Thread-Topic: [PATCH 10/10] vfio/qat: Add vfio_pci driver for Intel QAT VF
 devices
Thread-Index: AQHaVSVFJ9K0TVMQD0C9btTtb+JmirD92LoAgAOwfQA=
Date: Fri, 9 Feb 2024 16:16:54 +0000
Message-ID: <DM4PR11MB5502F171A3CC886E78DD9496884B2@DM4PR11MB5502.namprd11.prod.outlook.com>
References: <20240201153337.4033490-1-xin.zeng@intel.com>
	<20240201153337.4033490-11-xin.zeng@intel.com>
 <20240206141446.3547e4a9.alex.williamson@redhat.com>
In-Reply-To: <20240206141446.3547e4a9.alex.williamson@redhat.com>
Accept-Language: en-US
Content-Language: en-US
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?RPP2dLu7Z2rYTEWh9s24dZf0syn6WTF3QFXmvskvq0zow6WVgt4m44NxdPae?=
 =?us-ascii?Q?gosbXCHnQ7yqdySYb5sIF592PkrI0N/ABVUPwgfDjwKd5JY639/zQtsja2wc?=
 =?us-ascii?Q?n1r7rfrSdcQvokwaTAxLQH679qX71vSiX/yarFLvHKkfuz3IQzfEHsEHj+v3?=
 =?us-ascii?Q?6uy5hFXea3VjKHWI/PxcEjX/q5HTf0JB8TKiTT1qDw/hFZWDTap6AkxsLoPP?=
 =?us-ascii?Q?qgtIAPoLdraK3nUBcYgbFHbMxMClIr8tMJ6K1wNpPOylAfcgJsHX4UA9079x?=
 =?us-ascii?Q?xqU+po9jKzE00YOmqBXOSWSbnsoxH/bpwY1BM56DG7OlAIHa0gMV+zLAvZ9q?=
 =?us-ascii?Q?KTtGUV7QxFOmrGo4gaSy1trG7INpIWAO+jaW1+wbjZhqSf+QRLr6+isUQWyN?=
 =?us-ascii?Q?BNu0T1EEh2Da2gM5cwWHuEewsfo5oxoBOc2qFuGPfMvEylAOb8RAxtZSMQKW?=
 =?us-ascii?Q?eu1ROtTLzC5j7svUhGJBu3kiA8RJDBFkiM5l2cx5fp5FxlOwaEu6F9EroJEq?=
 =?us-ascii?Q?rUNew9VheAWmtH4V+51MKzb6XImT3njauyaZrZrTBIijcfnc75GTldslzkeh?=
 =?us-ascii?Q?32q/2/8uSbA2uy7LVYVCg72u8ev0ucDZz8U5kZBDspz2i2gmjr6s1lp/UFpI?=
 =?us-ascii?Q?9EnOGph77vsya4xwbZ73DqFA9jj8cnvFXWrlLlXb931i2mxkQ6MN2s6ILvDJ?=
 =?us-ascii?Q?ORHZd4nVLC3+Mv7cigiMJWleIyUC1FgzlIZZLf+/3moMkWBdx7zqm3tWHPPN?=
 =?us-ascii?Q?xeRREvM5QjMZJXrLwJOqpQEg4Yp1SrTPsrm69eercM6Lr2IHL+NNDbgp2xzH?=
 =?us-ascii?Q?nD2DLB04zyr9UDJBejH5jWF/gSUPuyb7cwJySSSGXiW3PilW0nEQ43kBdcq3?=
 =?us-ascii?Q?8RLio8Li/xUq5Tjpev0tw7jk2zYOw37CNu9BSZ/oyuUBEzob49jSQh4lArSd?=
 =?us-ascii?Q?4thgI7/PB5BFXJgCRzvUZHH4SmVhOv1G/+sI9zOaFsdZm4p5MBrP8uNwYpWj?=
 =?us-ascii?Q?gQqbvYIOYYKix+nIuBEDjpmRujJKi1/1KXvqIifzKrPyn3z/PxLhviJ/v9TD?=
 =?us-ascii?Q?hrgWCJdzgID6xB+PidNGOSAhSWLFT5QuuwQep6iaKPP0kFbVMtG0MaII3Tk6?=
 =?us-ascii?Q?ei759tVvFu0InCs1wmRhSTa6Y6jcv4UBIWEuHoFEJlp0FU1UZNldOwVBP8gl?=
 =?us-ascii?Q?63VrgLk7ISqPYuzc6LcqGQCmsPGHKglWDDsP+g2Viha60sXK01FAlcta7JyU?=
 =?us-ascii?Q?vJ9jWLrWSMyWv3eg8KbV8EOQhNKhpJKibL7poPVizcdmutEIVV59laoT42Ik?=
 =?us-ascii?Q?3OmMkTLWaxfye7JAvCpuJejtagK8EuiytxHeRGR22BvOIAG5UT1Ce0/FOmQk?=
 =?us-ascii?Q?e4vJBlCsmwQsv03QbchvGKyqzZ9ZQMbsK5i0k3wyBdt2DNYYjSNlxAOkEC64?=
 =?us-ascii?Q?BXApN10BBxLw/sZcLT1Jonscoj7PZ7aoGYXVDdpcZ4/qFiFQ9LaljOjlXNqy?=
 =?us-ascii?Q?IWwv+ZDCU4SPcaRBhLuO/P6qE7pns3izIWUefgTmA3CpdH5gh3jw84jj4Y02?=
 =?us-ascii?Q?sf3Bu0t9lNrdOk6/NhDkyVGkQDSinEOFvar57yK2?=
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
Precedence: bulk
X-Mailing-List: linux-crypto@vger.kernel.org
List-Id: <linux-crypto.vger.kernel.org>
List-Subscribe: <mailto:linux-crypto+subscribe@vger.kernel.org>
List-Unsubscribe: <mailto:linux-crypto+unsubscribe@vger.kernel.org>
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: DM4PR11MB5502.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: dbb2b264-e2ff-4f4d-bc3f-08dc298a8866
X-MS-Exchange-CrossTenant-originalarrivaltime: 09 Feb 2024 16:16:55.0054
 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: P6ZwFUeUcBSG6fXXZ1JeaelN745NHtFjrbu1uTUgdhzNBt4IJ8hEKG3lN8xNnLuoJi9cdH3rKMvWxeQ3udR3Ww==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SA1PR11MB6735
X-OriginatorOrg: intel.com

Thanks for your comments, Alex.
On Wednesday, February 7, 2024 5:15 AM, Alex Williamson <alex.williamson@re=
dhat.com> wrote:
> > diff --git a/drivers/vfio/pci/intel/qat/Kconfig
> b/drivers/vfio/pci/intel/qat/Kconfig
> > new file mode 100644
> > index 000000000000..71b28ac0bf6a
> > --- /dev/null
> > +++ b/drivers/vfio/pci/intel/qat/Kconfig
> > @@ -0,0 +1,13 @@
> > +# SPDX-License-Identifier: GPL-2.0-only
> > +config QAT_VFIO_PCI
> > +	tristate "VFIO support for QAT VF PCI devices"
> > +	select VFIO_PCI_CORE
> > +	depends on CRYPTO_DEV_QAT
> > +	depends on CRYPTO_DEV_QAT_4XXX
>=20
> CRYPTO_DEV_QAT_4XXX selects CRYPTO_DEV_QAT, is it necessary to depend
> on CRYPTO_DEV_QAT here?

You are right, we don't need it, will update it in next version.

>=20
> > +	help
> > +	  This provides migration support for Intel(R) QAT Virtual Function
> > +	  using the VFIO framework.
> > +
> > +	  To compile this as a module, choose M here: the module
> > +	  will be called qat_vfio_pci. If you don't know what to do here,
> > +	  say N.
> > diff --git a/drivers/vfio/pci/intel/qat/Makefile
> b/drivers/vfio/pci/intel/qat/Makefile
> > new file mode 100644
> > index 000000000000..9289ae4c51bf
> > --- /dev/null
> > +++ b/drivers/vfio/pci/intel/qat/Makefile
> > @@ -0,0 +1,4 @@
> > +# SPDX-License-Identifier: GPL-2.0-only
> > +obj-$(CONFIG_QAT_VFIO_PCI) +=3D qat_vfio_pci.o
> > +qat_vfio_pci-y :=3D main.o
> > +
>=20
> Blank line at end of file.

Good catch, will update it in next version.

>=20
> > diff --git a/drivers/vfio/pci/intel/qat/main.c
> b/drivers/vfio/pci/intel/qat/main.c
> > new file mode 100644
> > index 000000000000..85d0ed701397
> > --- /dev/null
> > +++ b/drivers/vfio/pci/intel/qat/main.c
> > @@ -0,0 +1,572 @@
> ...
> > +static int qat_vf_pci_init_dev(struct vfio_device *core_vdev)
> > +{
> > +	struct qat_vf_core_device *qat_vdev =3D container_of(core_vdev,
> > +			struct qat_vf_core_device, core_device.vdev);
> > +	struct qat_migdev_ops *ops;
> > +	struct qat_mig_dev *mdev;
> > +	struct pci_dev *parent;
> > +	int ret, vf_id;
> > +
> > +	core_vdev->migration_flags =3D VFIO_MIGRATION_STOP_COPY |
> VFIO_MIGRATION_P2P;
>=20
> AFAICT it's always good practice to support VFIO_MIGRATION_PRE_COPY,
> even if only to leave yourself an option to mark an incompatible ABI
> change in the data stream that can be checked before the stop-copy
> phase of migration.  See for example the mtty sample driver.  Thanks,
> Alex

If the good practice is to check migration stream compatibility, then
we do incorporate additional information as part of device state for ABI
compatibility testing such as magic,  version and device capability in stop
copy phase. Can we ignore the optional VFIO_MIGRATION_PRE_COPY support?
Thanks,
Xin