Received: by 2002:a05:7412:e794:b0:fa:551:50a7 with SMTP id o20csp2037836rdd; Thu, 11 Jan 2024 18:28:46 -0800 (PST) X-Google-Smtp-Source: AGHT+IHPGy20ptIEgAY4SjAa0TrQgkAcokOIe+w4Rc+7CLi/kWu9wOU8S9r5Pt7vgis+byiWC9JU X-Received: by 2002:a17:902:6845:b0:1d4:7373:3401 with SMTP id f5-20020a170902684500b001d473733401mr273718pln.3.1705026526390; Thu, 11 Jan 2024 18:28:46 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1705026526; cv=none; d=google.com; s=arc-20160816; b=A/2l1bCqRZ9RHIncUTbsQUqbnfYFe+VwXMG5GPbd9mDrXCQEEHkHH29DdECAsHuMJU RhGLMp690SoZgB3RCxs7QaOt02z2v31P/H3Dqq3ijEGDxKllm50VmpD5DKSCZNQRMGGr BjvSwOA2e6IsBLI3MgHNCVCLBiQjcbE5Ia3I7KXUhz9eHuMj42Pn/JiJwXQfwVYGZYRS 7m2Ps45Ums+DAAsdg3mzuHGuyfwe/F+1wuCCZuMO0dupZT70stsOqRw7/IEV7FWcHu+e +e1vasBYCvLAqL/O03oT+keP0J9f/nlBzmeS+nOM5hH+qV/TQIgE5ZsVLJmdy9UbQs6y j13w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:list-unsubscribe:list-subscribe :list-id:precedence:dkim-signature; bh=TeTVuqKhv2fZpIVKNAyi6YXBAGL4wvIDq7FTTj/zUOY=; fh=5abNssZ1CPKOlD1JjbcmlAR9mVcRlUJ0JgfVauggGsY=; b=dVK+CHBU91pFbPj9tXswbEmdf3kd/0ZJn2Sq/HGZpQeh/oCf1bN4pg7UG/PovgZN6A Br7mE7TSf/cP3ad1sj5TKtJqz7dkKRy+YiuZRqD4AtpDeCYcFEetTjnC6gZxPqaPvSn7 4tgGofC3M/RZbyr1RQevMYfxSPdHYKpj5pizHEchI0WP9fCal6d9KBjU3e07Y6y9lPUY mo0SVLMjmiqp6T02atYxJf26kzay6gZOH/7LfGxKJHUCPgk6uoYCHx0xbt2ZfqixGmh+ qps2HTmn15ELFA/7qxg8X2pcaSizQjeE5opzMdZTMd9UqTdnBCOC+9yA7m8VXGLb74rq uReA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=KDWPUS54; spf=pass (google.com: domain of linux-kernel+bounces-24233-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.48.161 as permitted sender) smtp.mailfrom="linux-kernel+bounces-24233-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from sy.mirrors.kernel.org (sy.mirrors.kernel.org. [147.75.48.161]) by mx.google.com with ESMTPS id w13-20020a170902d3cd00b001d3f285561asi2257049plb.29.2024.01.11.18.28.45 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 11 Jan 2024 18:28:46 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel+bounces-24233-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.48.161 as permitted sender) client-ip=147.75.48.161; Authentication-Results: mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=KDWPUS54; spf=pass (google.com: domain of linux-kernel+bounces-24233-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.48.161 as permitted sender) smtp.mailfrom="linux-kernel+bounces-24233-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by sy.mirrors.kernel.org (Postfix) with ESMTPS id BC182B22AB1 for ; Fri, 12 Jan 2024 02:28:43 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id D0F0F139E; Fri, 12 Jan 2024 02:28:36 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=redhat.com header.i=@redhat.com header.b="KDWPUS54" Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 47D671117 for ; Fri, 12 Jan 2024 02:28:33 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=redhat.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=redhat.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1705026513; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=TeTVuqKhv2fZpIVKNAyi6YXBAGL4wvIDq7FTTj/zUOY=; b=KDWPUS54N/ajjRS5+kJ5msgxkjX/hqRhIYeB5uJz6CkRzkMhKup85fbuw1rRFqO0Ie9IVl MCDoeQweYehnNUaWzYt5kaRUNmoFU68rePjdfmhysjid39+yqxY1bI9t1OnxNEisEPyYrf s6j1LppVLBxfoLyeb53vZJToH6SKmHI= Received: from mail-oo1-f72.google.com (mail-oo1-f72.google.com [209.85.161.72]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-632-Z3Tsw2fDPhKLrHj7HEcTxQ-1; Thu, 11 Jan 2024 21:28:31 -0500 X-MC-Unique: Z3Tsw2fDPhKLrHj7HEcTxQ-1 Received: by mail-oo1-f72.google.com with SMTP id 006d021491bc7-5984ac4bab4so5671275eaf.0 for ; Thu, 11 Jan 2024 18:28:31 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1705026511; x=1705631311; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=TeTVuqKhv2fZpIVKNAyi6YXBAGL4wvIDq7FTTj/zUOY=; b=o90izke2s1NiTKpOpKMZN6F7Nf28ZYxeP0hOsGHxdvJy5M1rHgbepsPlp8XYRiuClE P/kDPH2zOvigFT5yu7IEKhYI4T3dOgBSh2ZGltbBW8LkgyAog29bmKcaxgTMFobHCUW+ YAmOq4ujOeFANUKVeGBtV5aZi8id475jm9O5Td4j+xhbVa2FaUNwMkTLsA+fs8NQog4c 46nbO8qcpHoOU3/1a4Do98rJjfHlk1EacmQ1YVAb4FxKzjtS4LMArtOKqXLCkFP3KYDS qF7fefRGo102954/Xz7XzHX0Wae3K7CMNHyPj6Hmitq6oUIpaoZaBGIpmUAY063HaZg8 dCSA== X-Gm-Message-State: AOJu0Yz5NHzD4k3S6y6djClPu+QxvcOqXISCSfNADZBrD9XeWyZXPfjR w8tScW0FgD5PwjeY4FYsh1tSzKt7WIsu+Oq1wsVbLQZmcJlyOsYlRSDN6/FSYvEPBZb7/cPgQ2L bYlkcSyA0YsiXjpUC4oW153AOW8jy88l2z7ltnFesWbgpOKS5 X-Received: by 2002:a05:6359:6405:b0:175:73dd:ee6 with SMTP id sh5-20020a056359640500b0017573dd0ee6mr834034rwb.16.1705026511026; Thu, 11 Jan 2024 18:28:31 -0800 (PST) X-Received: by 2002:a05:6359:6405:b0:175:73dd:ee6 with SMTP id sh5-20020a056359640500b0017573dd0ee6mr834029rwb.16.1705026510741; Thu, 11 Jan 2024 18:28:30 -0800 (PST) Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 References: <1704919215-91319-1-git-send-email-steven.sistare@oracle.com> <1704919215-91319-8-git-send-email-steven.sistare@oracle.com> <11ebc73f-6469-4c97-9da0-0728edfb283a@oracle.com> In-Reply-To: <11ebc73f-6469-4c97-9da0-0728edfb283a@oracle.com> From: Jason Wang Date: Fri, 12 Jan 2024 10:28:19 +0800 Message-ID: Subject: Re: [RFC V1 07/13] vhost-vdpa: flush workers on suspend To: Mike Christie Cc: Steve Sistare , virtualization@lists.linux-foundation.org, linux-kernel@vger.kernel.org, "Michael S. Tsirkin" , Si-Wei Liu , Eugenio Perez Martin , Xuan Zhuo , Dragos Tatulea , Eli Cohen , Xie Yongji Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Fri, Jan 12, 2024 at 12:18=E2=80=AFAM Mike Christie wrote: > > On 1/10/24 9:09 PM, Jason Wang wrote: > > On Thu, Jan 11, 2024 at 4:40=E2=80=AFAM Steve Sistare wrote: > >> > >> To pass ownership of a live vdpa device to a new process, the user > >> suspends the device, calls VHOST_NEW_OWNER to change the mm, and calls > >> VHOST_IOTLB_REMAP to change the user virtual addresses to match the ne= w > >> mm. Flush workers in suspend to guarantee that no worker sees the new > >> mm and old VA in between. > >> > >> Signed-off-by: Steve Sistare > >> --- > >> drivers/vhost/vdpa.c | 4 ++++ > >> 1 file changed, 4 insertions(+) > >> > >> diff --git a/drivers/vhost/vdpa.c b/drivers/vhost/vdpa.c > >> index 8fe1562d24af..9673e8e20d11 100644 > >> --- a/drivers/vhost/vdpa.c > >> +++ b/drivers/vhost/vdpa.c > >> @@ -591,10 +591,14 @@ static long vhost_vdpa_suspend(struct vhost_vdpa= *v) > >> { > >> struct vdpa_device *vdpa =3D v->vdpa; > >> const struct vdpa_config_ops *ops =3D vdpa->config; > >> + struct vhost_dev *vdev =3D &v->vdev; > >> > >> if (!ops->suspend) > >> return -EOPNOTSUPP; > >> > >> + if (vdev->use_worker) > >> + vhost_dev_flush(vdev); > > > > It looks to me like it's better to check use_woker in vhost_dev_flush. > > > > You can now just call vhost_dev_flush and it will do the right thing. > The xa_for_each loop will only flush workers if they have been setup, > so for vdpa it will not find/flush anything. Right. Thanks > > >