Received: by 2002:a05:6a10:8c0a:0:0:0:0 with SMTP id go10csp80252pxb; Mon, 1 Feb 2021 23:04:34 -0800 (PST) X-Google-Smtp-Source: ABdhPJyhdYJeZdZp1QwTsYa7l6EV7AQ3lPqzjAAouzEt5/n/ivIXX7k+UYxeYtXeTSMmhkIK5ULK X-Received: by 2002:aa7:cb8f:: with SMTP id r15mr22662087edt.130.1612249473842; Mon, 01 Feb 2021 23:04:33 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1612249473; cv=none; d=google.com; s=arc-20160816; b=j8C+S5bqX2+JEPVSwXLG5WaQYuG9K+msCpdwT3DVPxqImeHQBCnB7v2riHEjGszjWY MX3nxxompGXY8rvA7HZspjoL/ero6l3e3SWgJkR2k9/j++kk3IokMKiirEkETVgaJu2B lCmMZCy1mb924ot9qK+xU3ow+EqBv9iJotUgMDm+psAIL9gT+SUSX/GURJnF1zkE/Li5 6VwoWPimJP5/t50h6wXZBUEBvcHvfsnW7zcBEV1sNx6lv8n2r0eaT2He5OvvlpVnTmSo lvejVmz0Wb0Ue8/lxlmadPq8CuwfTqN/c7nNsfQvd6WlW94PxJUc0uHG6U36zwyttIJU NSLQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:dkim-signature:user-agent:in-reply-to :content-transfer-encoding:content-disposition:mime-version :references:message-id:subject:cc:to:from:date; bh=6VZwgQ5u3PAwcypr5uHxbAICip6Ya6OQVqDFF76fbsU=; b=aBslbYiMeP3ekpWbwIVm7EtGtghxv7lFmPBsLvOx/F/CoO454tpF3aFZ/+4A5EIXBn 9NUln7W1xvBTTWwpc0/GiMfsZobwp1yPD0E8DNsjfoGgbcc/q9hsnZhid/ijSaf+3kAp 7hlb38/Fp+/n3PLv83AdMQab0j51IoBOET3YZ5ow+lFLbxSijIce9zlCcpX7H8eaEjZ9 c66PXIWyoeR7Mbdqk2PJhSJzY1ushetsAO9yUXTEFRNuxVz95p09MrmO67U3d5kYMBOd V3G/ITNP1uFhRfs4CaWC0mNw5rc8xL9L/Z5gHlWYCF+Y77KrMe9pr5hybmnVDGGz7YJK 0/VQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@nvidia.com header.s=n1 header.b=NyOMvRUR; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=nvidia.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id b11si250830edz.246.2021.02.01.23.04.08; Mon, 01 Feb 2021 23:04:33 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@nvidia.com header.s=n1 header.b=NyOMvRUR; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=nvidia.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232315AbhBBHCu (ORCPT + 99 others); Tue, 2 Feb 2021 02:02:50 -0500 Received: from hqnvemgate26.nvidia.com ([216.228.121.65]:13413 "EHLO hqnvemgate26.nvidia.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S232200AbhBBHCr (ORCPT ); Tue, 2 Feb 2021 02:02:47 -0500 Received: from hqmail.nvidia.com (Not Verified[216.228.121.13]) by hqnvemgate26.nvidia.com (using TLS: TLSv1.2, AES256-SHA) id ; Mon, 01 Feb 2021 23:01:01 -0800 Received: from mtl-vdi-166.wap.labs.mlnx (172.20.145.6) by HQMAIL107.nvidia.com (172.20.187.13) with Microsoft SMTP Server (TLS) id 15.0.1473.3; Tue, 2 Feb 2021 07:00:58 +0000 Date: Tue, 2 Feb 2021 09:00:55 +0200 From: Eli Cohen To: Si-Wei Liu CC: Jason Wang , , , , , , Si-Wei Liu Subject: Re: [PATCH 1/2] vdpa/mlx5: Avoid unnecessary query virtqueue Message-ID: <20210202070055.GB232587@mtl-vdi-166.wap.labs.mlnx> References: <20210128134130.3051-1-elic@nvidia.com> <20210128134130.3051-2-elic@nvidia.com>

<9d6058d6-5ce1-0442-8fd9-5a6fe6a0bc6b@redhat.com> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Disposition: inline Content-Transfer-Encoding: quoted-printable In-Reply-To: User-Agent: Mutt/1.9.5 (bf161cf53efb) (2018-04-13) X-Originating-IP: [172.20.145.6] X-ClientProxiedBy: HQMAIL105.nvidia.com (172.20.187.12) To HQMAIL107.nvidia.com (172.20.187.13) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nvidia.com; s=n1; t=1612249261; bh=6VZwgQ5u3PAwcypr5uHxbAICip6Ya6OQVqDFF76fbsU=; h=Date:From:To:CC:Subject:Message-ID:References:MIME-Version: Content-Type:Content-Disposition:Content-Transfer-Encoding: In-Reply-To:User-Agent:X-Originating-IP:X-ClientProxiedBy; b=NyOMvRURyvdEVDeT2TVbwA9qAV9iDwE3gCIRM0hyVQ2nfPtrCGI3TbwhDXhEnBMAG 24Lpk733exvBrbcoTUy/Db08xHcU7Zrh+rzxSU+S532W6HKvMa8AYDTTUFVhyYQ+mX 28Q/0ta42SxsBfTB0geGSyifsUbn80RB518A8n4Oio6ulwNoDKuuQxhUVn0jTVm6VY a5QiJi8lcRv4vGf6rKkQxyrwwOeo5WKP4dfZiwuVJMdGWDxkKqpFntXSdJ/+jPShQk ni/Plx0gkeYbp8K7CCr1m0Ur5NiYi/2ChJYXRvVfxDQ5AIOdTby5DuiDzElDzUX5b/ lPswNtGmY21KA== Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Mon, Feb 01, 2021 at 08:15:29PM -0800, Si-Wei Liu wrote: > On Mon, Feb 1, 2021 at 7:13 PM Jason Wang wrote: > > > > > > On 2021/2/2 =E4=B8=8A=E5=8D=883:17, Si-Wei Liu wrote: > > > On Mon, Feb 1, 2021 at 10:51 AM Si-Wei Liu = wrote: > > >> On Thu, Jan 28, 2021 at 5:46 AM Eli Cohen wrote: > > >>> suspend_vq should only suspend the VQ on not save the current avail= able > > >>> index. This is done when a change of map occurs when the driver cal= ls > > >>> save_channel_info(). > > >> Hmmm, suspend_vq() is also called by teardown_vq(), the latter of > > >> which doesn't save the available index as save_channel_info() doesn'= t > > >> get called in that path at all. How does it handle the case that > > >> aget_vq_state() is called from userspace (e.g. QEMU) while the > > >> hardware VQ object was torn down, but userspace still wants to acces= s > > >> the queue index? > > >> > > >> Refer to https://lore.kernel.org/netdev/1601583511-15138-1-git-send-= email-si-wei.liu@oracle.com/ > > >> > > >> vhost VQ 0 ring restore failed: -1: Resource temporarily unavailable= (11) > > >> vhost VQ 1 ring restore failed: -1: Resource temporarily unavailable= (11) > > >> > > >> QEMU will complain with the above warning while VM is being rebooted > > >> or shut down. > > >> > > >> Looks to me either the kernel driver should cover this requirement, = or > > >> the userspace has to bear the burden in saving the index and not cal= l > > >> into kernel if VQ is destroyed. > > > Actually, the userspace doesn't have the insights whether virt queue > > > will be destroyed if just changing the device status via set_status()= . > > > Looking at other vdpa driver in tree i.e. ifcvf it doesn't behave lik= e > > > so. Hence this still looks to me to be Mellanox specifics and > > > mlx5_vdpa implementation detail that shouldn't expose to userspace. > > > > > > So I think we can simply drop this patch? >=20 > Yep, I think so. To be honest I don't know why it has anything to do > with the memory hotplug issue. No relation. That's why I put them in two different patches. Only the second one is the fix as I stated in the cover letter. Anyway, let's just take the second patch. Michael, do you need me to send PATCH 2 again as a single patch or can you just take it? >=20 > -Siwei >=20 > > > > Thanks > > > > > > >> -Siwei > > >> > > >> > > >>> Signed-off-by: Eli Cohen > > >>> --- > > >>> drivers/vdpa/mlx5/net/mlx5_vnet.c | 8 -------- > > >>> 1 file changed, 8 deletions(-) > > >>> > > >>> diff --git a/drivers/vdpa/mlx5/net/mlx5_vnet.c b/drivers/vdpa/mlx5/= net/mlx5_vnet.c > > >>> index 88dde3455bfd..549ded074ff3 100644 > > >>> --- a/drivers/vdpa/mlx5/net/mlx5_vnet.c > > >>> +++ b/drivers/vdpa/mlx5/net/mlx5_vnet.c > > >>> @@ -1148,8 +1148,6 @@ static int setup_vq(struct mlx5_vdpa_net *nde= v, struct mlx5_vdpa_virtqueue *mvq) > > >>> > > >>> static void suspend_vq(struct mlx5_vdpa_net *ndev, struct mlx5_vd= pa_virtqueue *mvq) > > >>> { > > >>> - struct mlx5_virtq_attr attr; > > >>> - > > >>> if (!mvq->initialized) > > >>> return; > > >>> > > >>> @@ -1158,12 +1156,6 @@ static void suspend_vq(struct mlx5_vdpa_net = *ndev, struct mlx5_vdpa_virtqueue *m > > >>> > > >>> if (modify_virtqueue(ndev, mvq, MLX5_VIRTIO_NET_Q_OBJECT_S= TATE_SUSPEND)) > > >>> mlx5_vdpa_warn(&ndev->mvdev, "modify to suspend fa= iled\n"); > > >>> - > > >>> - if (query_virtqueue(ndev, mvq, &attr)) { > > >>> - mlx5_vdpa_warn(&ndev->mvdev, "failed to query virtq= ueue\n"); > > >>> - return; > > >>> - } > > >>> - mvq->avail_idx =3D attr.available_index; > > >>> } > > >>> > > >>> static void suspend_vqs(struct mlx5_vdpa_net *ndev) > > >>> -- > > >>> 2.29.2 > > >>> > >