Received: by 2002:a05:6a10:8c0a:0:0:0:0 with SMTP id go10csp9947pxb; Mon, 1 Feb 2021 20:20:52 -0800 (PST) X-Google-Smtp-Source: ABdhPJwN04GInrTt2CiLFXfdGgEh9htZHPNDYgmNEQuYhq9RuOFp+g6vyK3ZikcjAcbWiOjdkjrK X-Received: by 2002:aa7:d803:: with SMTP id v3mr21648016edq.153.1612239652056; Mon, 01 Feb 2021 20:20:52 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1612239652; cv=none; d=google.com; s=arc-20160816; b=RNkS12mSb2+XldyF396RF75mOjn98KZ202u4+FApAPqwbMV8vwc9lktNbnfTlbL15E E5Qv+vQsGs6fNMslS8c2KaY7peSdjiDUuJ/mtZFrmvq4wSPbT0/37Y7SRzpFnPSruoVP JueZbzSlBWqkBs+RQ7IrbUlW7c2kXc9rHaUlcB/b9E+ypPC0nVUubP/xJclwuL2v8Fjr k3gOEX2qf4jh2tkaFzIvpDeXII6l7fhBVMiilopUHHUmhyuGvanRLK1ipTUYAwosYPdL rA5rNMydafxV2o+OG9A/azzb8dpVnmaNKq4dbMaYlsp6jTUdYX3HfWupfW9pjR9tTnu3 14xA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:cc:to:subject :message-id:date:from:in-reply-to:references:mime-version :dkim-signature; bh=H+NesHjdhPYkx2/ro7wCQ8JwDxI6uAdbGh+UgZkxW2k=; b=ShJfYz9NM2GXeTSVV8davSIo8TZNTvrXr9N4/muT2WtX/yCBsBf+v34GFaHFB/hzHy TZPrpCFODcyhntjy0MEpUzgVeDwf/IAydX3uhy9Tml+ZGRii7SFxjON46G+m/elos9K8 NI7gNoCx5uxjZUavVDhEiPcMVaJkIAti9hBUZCv2ns6Ex2Q4t8pku65tqV0AqJW2433X vSYgeQYR5Tetk96BAbGyy9+MkwXbegE6SJeqnHJUkqwnuz5XqqU6pkkcHXqD4JXOleRl NLsUnH3RgxX5nP73olxO0CawuA8a8D9zVV2WXw4JuT1nbNC9dFChcrfwedJ8PzL0hTqI uG+w== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b="U5J/0VCk"; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id s21si11646144ejq.650.2021.02.01.20.20.08; Mon, 01 Feb 2021 20:20:52 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b="U5J/0VCk"; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S231671AbhBBEQf (ORCPT + 99 others); Mon, 1 Feb 2021 23:16:35 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:36962 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S231680AbhBBEQY (ORCPT ); Mon, 1 Feb 2021 23:16:24 -0500 Received: from mail-wm1-x342.google.com (mail-wm1-x342.google.com [IPv6:2a00:1450:4864:20::342]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 50C6FC061573; Mon, 1 Feb 2021 20:15:44 -0800 (PST) Received: by mail-wm1-x342.google.com with SMTP id i9so1111111wmq.1; Mon, 01 Feb 2021 20:15:44 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=H+NesHjdhPYkx2/ro7wCQ8JwDxI6uAdbGh+UgZkxW2k=; b=U5J/0VCktRTFSFZClgQ/qNH4PY5lN79/8UDqEPb8+d+wC5E2MxodJfQt83Sx1f/kkD mwg0G9wLZDSwCeMXAE8G5SysrPQJ4CxYdmNIaaBRcKhdisHD89xS99uZLgM5u+jC+kd/ 47S/LMzvvWpw5lpefzF+K+yeQwYQGFS/aiXl2pwaFfotYUAZdhMcJRX4v4COMfrL0szw TvjMkSlmYkYKM/AR7ED3zoRpzfieXQ49FovwWKzSBKpp9lAPgV9iFIMkfTtzpUNae8AW T2HpqRBb56k3/fHScfd9S4OmzdfwyOC+7AhE6h8ZYDkQ7XxO87GHLl3+Vj1AoY9Ulpdd zZ5g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=H+NesHjdhPYkx2/ro7wCQ8JwDxI6uAdbGh+UgZkxW2k=; b=Q4olOenRqqUvLfNnR6uK2xI096ODIjkD175UhEdqX1jjHay2BYzeXcTY0KIOM339dV oQZbZxQFLVDuaZzObzlcL47mrZkwfy03C4h7meI6pqSasuUmRiDVlSkX6QEfjVthaVGZ z6xZZK8/9ZRcHCsRE++CoxvZfKbh5C12HdF7VJZcq2zmqvY8vp4TbPWhE+S6my1x0yKD lBnyGfw8N/5TyMlxL/DLqt5r7y3WWIgZOgLgWsXxZ5L2ffQguDxJWZSiVQy7syvhHpHN Gph7l9ERwEomKKsducIIumaxFZlnDTMroskmnFjSXsQxsk52oM9UAzTUjAalqcjglWWq 2mDg== X-Gm-Message-State: AOAM532881jTy/uAbLaWmBjiLQ5mO8Mwdbm+iqbyH0f4V9HBfjXS+eP/ kE1cj9rZWez310tZHQUhzZ1VpA+20P4AHDqvLqw= X-Received: by 2002:a1c:4c01:: with SMTP id z1mr1693390wmf.159.1612239341255; Mon, 01 Feb 2021 20:15:41 -0800 (PST) MIME-Version: 1.0 References: <20210128134130.3051-1-elic@nvidia.com> <20210128134130.3051-2-elic@nvidia.com> <9d6058d6-5ce1-0442-8fd9-5a6fe6a0bc6b@redhat.com> In-Reply-To: <9d6058d6-5ce1-0442-8fd9-5a6fe6a0bc6b@redhat.com> From: Si-Wei Liu Date: Mon, 1 Feb 2021 20:15:29 -0800 Message-ID: Subject: Re: [PATCH 1/2] vdpa/mlx5: Avoid unnecessary query virtqueue To: Jason Wang Cc: Eli Cohen , mst@redhat.com, virtualization@lists.linux-foundation.org, netdev@vger.kernel.org, linux-kernel@vger.kernel.org, lulu@redhat.com, Si-Wei Liu Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Mon, Feb 1, 2021 at 7:13 PM Jason Wang wrote: > > > On 2021/2/2 =E4=B8=8A=E5=8D=883:17, Si-Wei Liu wrote: > > On Mon, Feb 1, 2021 at 10:51 AM Si-Wei Liu wr= ote: > >> On Thu, Jan 28, 2021 at 5:46 AM Eli Cohen wrote: > >>> suspend_vq should only suspend the VQ on not save the current availab= le > >>> index. This is done when a change of map occurs when the driver calls > >>> save_channel_info(). > >> Hmmm, suspend_vq() is also called by teardown_vq(), the latter of > >> which doesn't save the available index as save_channel_info() doesn't > >> get called in that path at all. How does it handle the case that > >> aget_vq_state() is called from userspace (e.g. QEMU) while the > >> hardware VQ object was torn down, but userspace still wants to access > >> the queue index? > >> > >> Refer to https://lore.kernel.org/netdev/1601583511-15138-1-git-send-em= ail-si-wei.liu@oracle.com/ > >> > >> vhost VQ 0 ring restore failed: -1: Resource temporarily unavailable (= 11) > >> vhost VQ 1 ring restore failed: -1: Resource temporarily unavailable (= 11) > >> > >> QEMU will complain with the above warning while VM is being rebooted > >> or shut down. > >> > >> Looks to me either the kernel driver should cover this requirement, or > >> the userspace has to bear the burden in saving the index and not call > >> into kernel if VQ is destroyed. > > Actually, the userspace doesn't have the insights whether virt queue > > will be destroyed if just changing the device status via set_status(). > > Looking at other vdpa driver in tree i.e. ifcvf it doesn't behave like > > so. Hence this still looks to me to be Mellanox specifics and > > mlx5_vdpa implementation detail that shouldn't expose to userspace. > > > So I think we can simply drop this patch? Yep, I think so. To be honest I don't know why it has anything to do with the memory hotplug issue. -Siwei > > Thanks > > > >> -Siwei > >> > >> > >>> Signed-off-by: Eli Cohen > >>> --- > >>> drivers/vdpa/mlx5/net/mlx5_vnet.c | 8 -------- > >>> 1 file changed, 8 deletions(-) > >>> > >>> diff --git a/drivers/vdpa/mlx5/net/mlx5_vnet.c b/drivers/vdpa/mlx5/ne= t/mlx5_vnet.c > >>> index 88dde3455bfd..549ded074ff3 100644 > >>> --- a/drivers/vdpa/mlx5/net/mlx5_vnet.c > >>> +++ b/drivers/vdpa/mlx5/net/mlx5_vnet.c > >>> @@ -1148,8 +1148,6 @@ static int setup_vq(struct mlx5_vdpa_net *ndev,= struct mlx5_vdpa_virtqueue *mvq) > >>> > >>> static void suspend_vq(struct mlx5_vdpa_net *ndev, struct mlx5_vdpa= _virtqueue *mvq) > >>> { > >>> - struct mlx5_virtq_attr attr; > >>> - > >>> if (!mvq->initialized) > >>> return; > >>> > >>> @@ -1158,12 +1156,6 @@ static void suspend_vq(struct mlx5_vdpa_net *n= dev, struct mlx5_vdpa_virtqueue *m > >>> > >>> if (modify_virtqueue(ndev, mvq, MLX5_VIRTIO_NET_Q_OBJECT_STA= TE_SUSPEND)) > >>> mlx5_vdpa_warn(&ndev->mvdev, "modify to suspend fail= ed\n"); > >>> - > >>> - if (query_virtqueue(ndev, mvq, &attr)) { > >>> - mlx5_vdpa_warn(&ndev->mvdev, "failed to query virtque= ue\n"); > >>> - return; > >>> - } > >>> - mvq->avail_idx =3D attr.available_index; > >>> } > >>> > >>> static void suspend_vqs(struct mlx5_vdpa_net *ndev) > >>> -- > >>> 2.29.2 > >>> >