Received: by 2002:a05:7412:b10a:b0:f3:1519:9f41 with SMTP id az10csp2245649rdb; Sun, 3 Dec 2023 08:27:28 -0800 (PST) X-Google-Smtp-Source: AGHT+IFWDYopSvIGw7bOYRYNZHxb1oUhKv3QBFrjcPGN0+WLxt+DlDAEH8v3umLqVoFV7LQKc+Ne X-Received: by 2002:a92:c24b:0:b0:35d:6c24:f5f6 with SMTP id k11-20020a92c24b000000b0035d6c24f5f6mr983400ilo.14.1701620848158; Sun, 03 Dec 2023 08:27:28 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1701620848; cv=none; d=google.com; s=arc-20160816; b=swwzRNZz5TLNlvaPWbGFXjR5Rrkz6UjKKYT+iZugD+vpE+COBxAkwLXOLPRQhFUyU8 OWxTFcTq4/yVimnrrU8hibdeYLBveJ/ca0Ll4Ee0szPSnMejTIU2A5m/nh/VG3iiLzd+ OjV8GVyY8y+a+JYpEaOyUEs9SXFAvcHrTfSVR8QBdBuNjESiPAjcELvv7O3iL/0lhhtc cUNqVjSeYvQpyxX1dNOhhz08nRqyosf5gKclv0yJEYHagNyZo3oZWvq/LewhyRkExwEz Yo8iJbSjVxPBa+CDLihg21cLBnQFgfOBcnXQixhMD/swgHESCOYuYHxlDhlQNcArq9hv LxPw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:in-reply-to:content-disposition:mime-version :references:message-id:subject:cc:to:from:date:dkim-signature; bh=lnZvOG5O1XML8m5bdEgP0BLaNE6m6L+TFl+VYXFF/Gc=; fh=0kmTFnPlG/GNoLYMCCIN3KOT4TBmUDux9S4HzQlJph4=; b=j+NzcxRgkZiHdj4YLUiEqGaW9WuPP68z3yu6bJ7YazcfDQSqcyeLu4sW/c+tWBKtIe 0Dl8rjo2yHP7SdoOgG0/f41sBdKvbELL5wjtrTaWEF8c34gpLKVrPP5Cup7Y9KpFrRTC bDBuusIX1hsfHFqqZbLDup1+hZzgHY3+2mWMhyhG5enlpCKRQ2YdWU/dZIvLkF90PzTp 8upRm1GV/n9RtUd7tapDczubeeWJefAcGRBfPJohjD3H0U5eLA66aN9JZDqPk30SS4G/ sSUm1v2WOXV6PM94CQzvcKtK/Hy6VGr1+3eOM8tTYvoo8PxNCE9mXVfOZkbRhiT16qMd vhaw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=ab++o12s; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:7 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from snail.vger.email (snail.vger.email. [2620:137:e000::3:7]) by mx.google.com with ESMTPS id y184-20020a638ac1000000b005c668dc242asi1969098pgd.162.2023.12.03.08.27.27 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 03 Dec 2023 08:27:28 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:7 as permitted sender) client-ip=2620:137:e000::3:7; Authentication-Results: mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=ab++o12s; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:7 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: from out1.vger.email (depot.vger.email [IPv6:2620:137:e000::3:0]) by snail.vger.email (Postfix) with ESMTP id 65091806CF49; Sun, 3 Dec 2023 08:27:13 -0800 (PST) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.11 at snail.vger.email Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S233711AbjLCQXx (ORCPT + 99 others); Sun, 3 Dec 2023 11:23:53 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:37856 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S233694AbjLCQXw (ORCPT ); Sun, 3 Dec 2023 11:23:52 -0500 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.129.124]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 2EB22B0 for ; Sun, 3 Dec 2023 08:23:59 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1701620638; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=lnZvOG5O1XML8m5bdEgP0BLaNE6m6L+TFl+VYXFF/Gc=; b=ab++o12sFhMNsdMoEG4uQ5u68DU26VUfNwal9n72Ha1HHZzQcX+pqEZeIRXOOTvuCxacFp +7wxOTfJJ/tWbbHEKtMEwsot2inc7rh+w0jzTGhaa1YMLt39WicG7ammZP6PKAtPs/GQQy cOlI/lx0+AVZ731IGC/GxjCpicsPCoY= Received: from mail-wr1-f71.google.com (mail-wr1-f71.google.com [209.85.221.71]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-687-ChLXa-OBNW-NblGto0vqdQ-1; Sun, 03 Dec 2023 11:23:57 -0500 X-MC-Unique: ChLXa-OBNW-NblGto0vqdQ-1 Received: by mail-wr1-f71.google.com with SMTP id ffacd0b85a97d-33334e370d3so1308119f8f.2 for ; Sun, 03 Dec 2023 08:23:56 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1701620636; x=1702225436; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=lnZvOG5O1XML8m5bdEgP0BLaNE6m6L+TFl+VYXFF/Gc=; b=fBhe5DPTiCW4IKjkeYxGz4jcuHpvHdl9tkJgWFo10thtdZ1mJqOMzzpYXdopyvpL4J SfkxnWQOXgyB0csBtxbvbH2Op/4oJDD0bD3FwPDffwY67ErG4BLS9oYQIi6D7eXw2mUw bTYZnrzFXxJKftevOA4TjoHiJgSfkGKLxc+srlzC6TxdLrZeYl9Cl9oUuyOHdEFCxzud TGDl72SgjP0+7YlQx/06VB0dZXndMP7omLGxE+4OvSrJ3zVIN8YZseh3Nyupbo4gxL+p QAYUn2A8IoCgq+eKUo5Fuji/2RwikUuoJ72RbcwnaXA3mgC4MHk3o2xUHWf1odq3b792 KlGg== X-Gm-Message-State: AOJu0YynCtNSQgQrqBmA1IAGVw6gVrvQamiD48jl6Kb00AEmasI7ll9u +KU/J7LRcUmcaiy/yS5/fIp+yxtCxG88WkNYmstfOo3wSJjyXuntMPJALA/b8sTJNRycTENhpMg b8s/kcaDGSHVCrqLw8jUKj+4Q X-Received: by 2002:a05:600c:705:b0:40b:5e21:dd4f with SMTP id i5-20020a05600c070500b0040b5e21dd4fmr1874536wmn.125.1701620635913; Sun, 03 Dec 2023 08:23:55 -0800 (PST) X-Received: by 2002:a05:600c:705:b0:40b:5e21:dd4f with SMTP id i5-20020a05600c070500b0040b5e21dd4fmr1874523wmn.125.1701620635528; Sun, 03 Dec 2023 08:23:55 -0800 (PST) Received: from redhat.com ([2.55.11.133]) by smtp.gmail.com with ESMTPSA id jg23-20020a05600ca01700b0040b30be6244sm12148007wmb.24.2023.12.03.08.23.52 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 03 Dec 2023 08:23:54 -0800 (PST) Date: Sun, 3 Dec 2023 11:23:50 -0500 From: "Michael S. Tsirkin" To: Dragos Tatulea Cc: "xuanzhuo@linux.alibaba.com" , Parav Pandit , "virtualization@lists.linux-foundation.org" , "eperezma@redhat.com" , "linux-kernel@vger.kernel.org" , "si-wei.liu@oracle.com" , "kvm@vger.kernel.org" , "jasowang@redhat.com" , Saeed Mahameed , "galp@nvidia.com" , "leon@kernel.org" Subject: Re: [PATCH vhost 0/7] vdpa/mlx5: Add support for resumable vqs Message-ID: <20231203112324-mutt-send-email-mst@kernel.org> References: <20231201104857.665737-1-dtatulea@nvidia.com> <20231202152523-mutt-send-email-mst@kernel.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF, RCVD_IN_DNSWL_BLOCKED,RCVD_IN_MSPIKE_H4,RCVD_IN_MSPIKE_WL, SPF_HELO_NONE,SPF_NONE,T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (snail.vger.email [0.0.0.0]); Sun, 03 Dec 2023 08:27:13 -0800 (PST) On Sun, Dec 03, 2023 at 03:21:01PM +0000, Dragos Tatulea wrote: > On Sat, 2023-12-02 at 15:26 -0500, Michael S. Tsirkin wrote: > > On Fri, Dec 01, 2023 at 12:48:50PM +0200, Dragos Tatulea wrote: > > > Add support for resumable vqs in the driver. This is a firmware feature > > > that can be used for the following benefits: > > > - Full device .suspend/.resume. > > > - .set_map doesn't need to destroy and create new vqs anymore just to > > > update the map. When resumable vqs are supported it is enough to > > > suspend the vqs, set the new maps, and then resume the vqs. > > > > > > The first patch exposes the relevant bits in mlx5_ifc.h. That means it > > > needs to be applied to the mlx5-vhost tree [0] first. > > > > I didn't get this. Why does this need to go through that tree? > > Is there a dependency on some other commit from that tree? > > > To avoid merge issues in Linus's tree in mlx5_ifc.h. The idea is the same as for > the "vq descriptor mappings" patchset [1]. > > Thanks, > Dragos Are there other changes in that area that will cause non-trivial merge conflicts? > > > Once applied > > > there, the change has to be pulled from mlx5-vhost into the vhost tree > > > and only then the remaining patches can be applied. Same flow as the vq > > > descriptor mappings patchset [1]. > > > > > > To be able to use resumable vqs properly, support for selectively modifying > > > vq parameters was needed. This is what the middle part of the series > > > consists of. > > > > > > [0] https://git.kernel.org/pub/scm/linux/kernel/git/mellanox/linux.git/log/?h=mlx5-vhost > > > [1] https://lore.kernel.org/virtualization/20231018171456.1624030-2-dtatulea@nvidia.com/ > > > > > > Dragos Tatulea (7): > > > vdpa/mlx5: Expose resumable vq capability > > > vdpa/mlx5: Split function into locked and unlocked variants > > > vdpa/mlx5: Allow modifying multiple vq fields in one modify command > > > vdpa/mlx5: Introduce per vq and device resume > > > vdpa/mlx5: Mark vq addrs for modification in hw vq > > > vdpa/mlx5: Mark vq state for modification in hw vq > > > vdpa/mlx5: Use vq suspend/resume during .set_map > > > > > > drivers/vdpa/mlx5/core/mr.c | 31 +++--- > > > drivers/vdpa/mlx5/net/mlx5_vnet.c | 172 +++++++++++++++++++++++++---- > > > include/linux/mlx5/mlx5_ifc.h | 3 +- > > > include/linux/mlx5/mlx5_ifc_vdpa.h | 4 + > > > 4 files changed, 174 insertions(+), 36 deletions(-) > > > > > > -- > > > 2.42.0 > > >