Received: by 2002:a05:7412:b10a:b0:f3:1519:9f41 with SMTP id az10csp2770944rdb; Mon, 4 Dec 2023 07:10:01 -0800 (PST) X-Google-Smtp-Source: AGHT+IGmlfSr02kzHMr3kyfcM2ooiPK6LozSDKF1XZB+LCGUW117QdIV38h2A7kJTKQjGfwNhMgJ X-Received: by 2002:a17:90a:d142:b0:286:6cc0:cac6 with SMTP id t2-20020a17090ad14200b002866cc0cac6mr2881468pjw.61.1701702601631; Mon, 04 Dec 2023 07:10:01 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1701702601; cv=pass; d=google.com; s=arc-20160816; b=Vf7AFsogHOoWd4qzUdZDbvsBoLn0v7b04wKPsOMW4TQl5mzuRSOQRdxpielfe3wBlu V6ZpKo2sdn2mrXb4jhLZiqUi6So7eMw2DQQQyqRqwA+Z69VG1Nmn1E92xpfSWRkfIht+ qBZdO8HD9cZaff5pjMJ1IweOajIJfMz4bepWe04Dg772EcyOS2vW60r75ic5NjwaQm8q 5iTP6CTWZFQwNx/5TmJF76WKMeyYMFvxV2NhWvZGhmUHc8o/Twjf3LQFr7Gu9EScXj2e 1lgq4WkkbDjMYk1oK2OmJipxrk16k1iPXFBP37PK3rBRAaaaWzG2vcMzDDqBDItB1zPo k/jg== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:mime-version:in-reply-to:content-disposition :references:message-id:subject:cc:to:from:date:dkim-signature; bh=Nxac5h4CRgVuVmgAxO2EgTP8skxMtasLUbyOZ6SDHbA=; fh=nz0/pvu/SNgvzH8zh0J/tYEoUo/8+e0QDLft1x8Jy6A=; b=wQa/4YgSCu78QO3zA9FWyanURZ+32MD7YPS+aPXejruuD2STM9YuySK2wpsa7wyqFf DFxxc9XCg1O/sDqRCwE6f1SW+gHkclIc5v1VlMG/iogzMDAjrAS03MZPfmDtzSIYQ1Qg 4wy8HNkqkdHx5Wtzew9uMXb1AG4ZX7sJvzUIJwmNKjxTQ605vYlqkBuE+ZmNf3xeGmG/ 9x1ouJwIeChePYd39LWVh784z/pW5LnZegAczBhe0Fl3f386a7KEX6+UKN++1lZ1dcpx 4aLq7hHwyYOevo7rDfjWfCXywK7o7xkGt45aM9hM0dPv8SFAMJG/mNPCjbvdQoIn83WP eQ6w== ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@Nvidia.com header.s=selector2 header.b=RQOBz0ev; arc=pass (i=1 spf=pass spfdomain=nvidia.com dkim=pass dkdomain=nvidia.com dmarc=pass fromdomain=nvidia.com); spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.34 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=nvidia.com Return-Path: Received: from howler.vger.email (howler.vger.email. [23.128.96.34]) by mx.google.com with ESMTPS id k7-20020a17090a9d8700b0028666a9b556si4556783pjp.143.2023.12.04.07.10.01 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 04 Dec 2023 07:10:01 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.34 as permitted sender) client-ip=23.128.96.34; Authentication-Results: mx.google.com; dkim=pass header.i=@Nvidia.com header.s=selector2 header.b=RQOBz0ev; arc=pass (i=1 spf=pass spfdomain=nvidia.com dkim=pass dkdomain=nvidia.com dmarc=pass fromdomain=nvidia.com); spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.34 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=nvidia.com Received: from out1.vger.email (depot.vger.email [IPv6:2620:137:e000::3:0]) by howler.vger.email (Postfix) with ESMTP id B29E7804C553; Mon, 4 Dec 2023 07:09:58 -0800 (PST) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.11 at howler.vger.email Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S233714AbjLDPJo (ORCPT + 99 others); Mon, 4 Dec 2023 10:09:44 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:41752 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S231594AbjLDPJn (ORCPT ); Mon, 4 Dec 2023 10:09:43 -0500 Received: from NAM12-MW2-obe.outbound.protection.outlook.com (mail-mw2nam12on2069.outbound.protection.outlook.com [40.107.244.69]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 09D02B2; Mon, 4 Dec 2023 07:09:49 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=IyQxsBnXMKiLzELL8iPbSeiGQ6JGLeI/H4LhQE1U2Oj1OPaIgtnlh8qpXXHYUcrJcfStyveA9s1jIW1X+TidQ9KiCJX9zBd3qOAxhy/3CeBIhvumslm2bgG16OuzJPE6pf5luPOHH8rLCngRqOpFZldQwmT5aLPFvY6jtD0NdCB6ueNg60RFSNVhJRjVi1z+pGb3ibnWTaSC8L3QENX8AxdXgufxEiN80by8b1GflTrgLGTEX7fmjmecry6PjeSpWWe2TPomhYrYuPULjiGWzw8jUYrY79YvZRB8n7tHCrsNvYbceglGtMqkODCxMP2YMhaAvoj5W61vOgdUEa7Z0w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=Nxac5h4CRgVuVmgAxO2EgTP8skxMtasLUbyOZ6SDHbA=; b=Hszx30Quip6RnxzJlMCTcbU1L3lFPg+BYwrxrOgRp3n5rwlE+lMDu8eH9oimmG+t9jqmp039K3FcYEEpGUv9KJqxpTMoUKXPHoN3CApmZg1/RXoXPtxPiK5YUbSTuhGwoQ7OAcq4MqRFKfp5zYr6/4uI19eq+WXpXkueLGmr1BfPE8GbzL2OgH773R4GvoyKASUBQckqazCpR7T2qAFGRoM0rvmYWIr07DzN86hOQeiIvaQusdqksR6V/CkmMepIXBzhdoQdmRmAXZzXA0oX1NDwclSaBIWUc5mp5tWwNf4IZk/x3GVqTirST9VPIPvO9VTIr3JPBccZEy46tmqb9Q== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nvidia.com; dmarc=pass action=none header.from=nvidia.com; dkim=pass header.d=nvidia.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Nxac5h4CRgVuVmgAxO2EgTP8skxMtasLUbyOZ6SDHbA=; b=RQOBz0ev79+cHcb4QbGBFKEb+JSn/kExjOYzpexrn0TUSu/B5R+Ct6R0iaAEWyYXLVqpR7kN6oCnOuWtX1cG9nDpoLU9JVAR+U7YzW7FihodF3D4hW53QjVFcXoipyLFTNIG3IXLKlRsnREhlY47VO37kP7k2CduZYPcg2auY3hJrHlwVr1zGpRS6JA9DCE6ecMvkOAEwaMKyNw7O2NH8lsK9TeHIFFDbZIvRkgiTGEKci/FaCZ4UrTOxl9QEbc0Wt6xzozg2oE4kJpqtHJIWaoJe2k+N16Fm+iwp5mKPqBBcjXEQZWuj2VH71lj8cNI0tY7PrmTcRpPQSLai4KWlg== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=nvidia.com; Received: from LV2PR12MB5869.namprd12.prod.outlook.com (2603:10b6:408:176::16) by PH7PR12MB7113.namprd12.prod.outlook.com (2603:10b6:510:1ec::8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7046.33; Mon, 4 Dec 2023 15:09:46 +0000 Received: from LV2PR12MB5869.namprd12.prod.outlook.com ([fe80::60d4:c1e3:e1aa:8f93]) by LV2PR12MB5869.namprd12.prod.outlook.com ([fe80::60d4:c1e3:e1aa:8f93%4]) with mapi id 15.20.7046.033; Mon, 4 Dec 2023 15:09:46 +0000 Date: Mon, 4 Dec 2023 11:09:45 -0400 From: Jason Gunthorpe To: Yan Zhao Cc: iommu@lists.linux.dev, kvm@vger.kernel.org, linux-kernel@vger.kernel.org, alex.williamson@redhat.com, pbonzini@redhat.com, seanjc@google.com, joro@8bytes.org, will@kernel.org, robin.murphy@arm.com, kevin.tian@intel.com, baolu.lu@linux.intel.com, dwmw2@infradead.org, yi.l.liu@intel.com Subject: Re: [RFC PATCH 11/42] iommu: Add new domain op cache_invalidate_kvm Message-ID: <20231204150945.GF1493156@nvidia.com> References: <20231202091211.13376-1-yan.y.zhao@intel.com> <20231202092041.14084-1-yan.y.zhao@intel.com> Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20231202092041.14084-1-yan.y.zhao@intel.com> X-ClientProxiedBy: MN2PR14CA0026.namprd14.prod.outlook.com (2603:10b6:208:23e::31) To LV2PR12MB5869.namprd12.prod.outlook.com (2603:10b6:408:176::16) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: LV2PR12MB5869:EE_|PH7PR12MB7113:EE_ X-MS-Office365-Filtering-Correlation-Id: 5de207a8-7848-438c-24da-08dbf4db0d6c X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 7D3+Mtd2VawevYtxgfNoCL6tAIwenzwTh0t/RS72BNKBBuVk4iTznhi0/dY7srEP2eRX5CM21GgtonZDSejHluLwWoOAmtEn0owCYygffBNNBqhLUbao5y3fAEEBbM736p0pAYL6NCq7rukYJdeY0SGeI0RZNbuOGN0jAFnth/l75DP01pHFgWH9fb2eTwKUDejDEVKIw4xhxuXEZBc2LGr+K0VzmhoQEbH72E9K3MoTrHjqjYJlIteI3zN8CajQ9ubfrbNi7LfaOqZQ50DavUQc1c9LX7JSdbLETWy1fw22QwaHeOvCrdCRjZtjLL0RXuPHhBaS2NSKAz0zKryd06MmkkQQaPykTC0iBEz5yCnTml8hzIsENyo9k5fgRFMIW9gADuqR+fWcOdz5vZw/W28mzlzUNx9jtecoDrFgmIyN4MQHuPI5NGQeC8F+ydh6uge5fmmd6qHG8PnaVxIjlYkLwp3mTvo6RpJ1avNSLVfYHO6wjuuoNVMzYeksHHaGJdyEAuD0ywJnokLZP4CwhXLCbP2/VT5DrQu+ZTW+cN0t6Iv0HRbfx841oHz80LmW X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:LV2PR12MB5869.namprd12.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230031)(346002)(376002)(396003)(366004)(39860400002)(136003)(230922051799003)(186009)(451199024)(64100799003)(1800799012)(38100700002)(33656002)(4744005)(5660300002)(2906002)(7416002)(83380400001)(6512007)(26005)(6506007)(1076003)(2616005)(478600001)(6486002)(36756003)(41300700001)(66946007)(66556008)(6916009)(4326008)(316002)(8936002)(66476007)(86362001)(8676002);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?4MRwM/DtMtWT0c4vh7pNitcXu7Pdl9JnIJl7e6Dl047h0WCc5JEeSqe0PaxF?= =?us-ascii?Q?jGrG04IeomlNA/UEDTczlKHKPiqEyhYjuF0lrrJAucaQ9vGyC5Tovv4WzZR4?= =?us-ascii?Q?sGpDa2VjD9H4tWMPJI9bTBrmrxrbDkzwagxcggrq3II3m6CrxH/QwUsyA1JN?= =?us-ascii?Q?zkZHNySyHo5BC7ws6hUuId5ONJELAdpdcJkyylFuruYB7kRRzM6LOffy+6/5?= =?us-ascii?Q?fdz9RmWUnCC/9Me6/R2RkUjwe5ONyeIC/t5VPP8iq4DbmAK9TobnW1mj0sB5?= =?us-ascii?Q?mGRB+NDEe9VTXajvw26XwUNFjllVh7M/RHGwYjafspNZGriej9qbWhFdZu96?= =?us-ascii?Q?boYj+i50cNdl4rsDn1LqoX5a1GVrwI7pQydzJKorIv2Dx0HmJVGSNOwbh4zt?= =?us-ascii?Q?8XkDYtNidDYkoZuVe0cYJXrxU2zO5AvcFr/f880V6H6QEOJutXcIWGdJv5K2?= =?us-ascii?Q?fwbsRp9hJR3Dc0gdTIRWO0Hgai7RrUdh4eWlzhOhWnlKbhdJePLk2+xIaokL?= =?us-ascii?Q?grDZk8+S9oFUZ3KO5vNsusqkhi69gHJmSbpP7DORA7p9MEUOURSB6rHqGfPL?= =?us-ascii?Q?RDaUV7T7W7FDDQzQMf5ZtIANBoKQoAUOO8ZE4QEDWHMWc8cTpl4odLdfeL/L?= =?us-ascii?Q?6311/umVA2qx8CwgSB+1jq0a/sAo/ddBtVawVNFmFgQAnvZfpvoTjwFuURtq?= =?us-ascii?Q?diyQmW8HgdMY+Z+sTvfbkOtxbHYa/OLh4VZUO0T8rZY6Q/70lY3ViNbdIr6X?= =?us-ascii?Q?uqsTJMJZdOrcdzsz/LYYoYSigtprtj0Ky9EmaXuAKKowo/nCT3zZwjW7oRRL?= =?us-ascii?Q?6FU0Pql3xi/w7v0hGVA+v8V6McKaxSsEu2kLH6ORqwRXP7a2YocPGpdpJjuI?= =?us-ascii?Q?W+2jfjjlRp+/DhXP2jCvpkufO5StAImLpcY3AJ0uCw8+q5KbVyzbe5cY3KCR?= =?us-ascii?Q?IbyeLbbC2a3zep90IUMuysgyvATakF7QVt0aM8sbFNt9ZnPn59GA9nbby/Ms?= =?us-ascii?Q?RByXhOAjtbZZHQM5whZluyQa6VgYr0/AtXCNxE5WnGFujR9pVxtoAscEHC7a?= =?us-ascii?Q?fFS42Xsz8lHm3IMoMdkwBMgor7se+MQdD2e/iYBAZH79CC3d3sP5nOIHpHdI?= =?us-ascii?Q?65vb8yEGmO6ptA8pKaPAVt+vmoMBWfmdlsXJZb/3cDkkTVaGPi/jfQ+Dpe/r?= =?us-ascii?Q?SlJs7xuMAhoL06tDx/b8t2AR6PDcCKq3pO0j+CaeA87hgbIL3TCounmuzRM/?= =?us-ascii?Q?cl3BrrFQ/zQsfQqlZALhYT3TK51rfagFsqUPfyJDJNnWQfSzBzE1icVis5Mm?= =?us-ascii?Q?VdWgfBj1bTC7h+n7LnVzmZMIW+ce7mq7a/8POjmSpy7tgOYRZ79rYf5D+tWh?= =?us-ascii?Q?6SVXHbMXcblF8CPlsePdHAjFEf7lGNU3u4BqZzHcGSa51MJU7SJ4LL3o/dkX?= =?us-ascii?Q?gs6MIQn7Kh1e2PuADWUseSVBwtgxLA1ro4MTVxKZb0pVbnDg/+5lN8jNfQqZ?= =?us-ascii?Q?Un+espzRQ533p7xnVrU4YhoxaMqCqB2Oid07IH01lkBN/2Xqormi917inyyR?= =?us-ascii?Q?F9uazMRjDwsW3DZr5DvpNOpdB3qqubFelPI1cQln?= X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-Network-Message-Id: 5de207a8-7848-438c-24da-08dbf4db0d6c X-MS-Exchange-CrossTenant-AuthSource: LV2PR12MB5869.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 04 Dec 2023 15:09:46.4544 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: g8ttZteJsigb0HdONx/WStg/sR9Sx556zA/z6s/iTDPCLf51ZbWOdE3umsF0PYR2 X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH7PR12MB7113 X-Spam-Status: No, score=-0.9 required=5.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on howler.vger.email Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (howler.vger.email [0.0.0.0]); Mon, 04 Dec 2023 07:09:59 -0800 (PST) On Sat, Dec 02, 2023 at 05:20:41PM +0800, Yan Zhao wrote: > On KVM invalidates mappings that are shared to IOMMU stage 2 paging > structures, IOMMU driver needs to invalidate hardware TLBs accordingly. > > The new op cache_invalidate_kvm is called from IOMMUFD to invalidate > hardware TLBs upon receiving invalidation notifications from KVM. Why? SVA hooks the invalidation directly to the mm, shouldn't KVM also hook the invalidation directly from the kvm? Why do we need to call a chain of function pointers? iommufd isn't adding any value in the chain here. Jason