Received: by 2002:a05:6359:c8b:b0:c7:702f:21d4 with SMTP id go11csp720115rwb; Thu, 22 Sep 2022 05:44:23 -0700 (PDT) X-Google-Smtp-Source: AMsMyM7Edu+LB5gts8qn6URsiM3ADw4Ep3pTVVMEEcPBSQCXjxPJJLP508FC0iNgr4Kdwlmx79IP X-Received: by 2002:a50:9e8f:0:b0:453:d22d:f1d1 with SMTP id a15-20020a509e8f000000b00453d22df1d1mr3153128edf.31.1663850663575; Thu, 22 Sep 2022 05:44:23 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1663850663; cv=pass; d=google.com; s=arc-20160816; b=lWypmlI+9pJlFusGywSesUgtrfq/ZG/yxao+Zw3uDf05OAcf1y/XbiK3841OFrYMJp MZK34ORiBh+0CEVV2VUW9e99L2fsyJ3koPYVl6lujlKlyXpxwoWpRFr1P9eTEFgtgPmB QH894lbaS7HwG7GJVS1qWbgPRTWFrYfk9zZJ6UFE6Z4JZeqnyGHN2tEzNa7SND117hK7 157drVgfllkUI2RQ4nB3sxgjWiWNEJ3KnRCc/zIQzTNe5bjQfRxrjCFxczHqJaY0lPyW htu+FO6QuqPWmkpZuafi9J8pyJh/4wfYzpib0dPfEmDYZ3ZTmiKG1rE0QzV8FmeDyO6P DBww== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:mime-version:in-reply-to:content-disposition :references:message-id:subject:cc:to:from:date:dkim-signature; bh=PaJEpL1/Zj9LAtviUDDcpjg9E9bqj5gJITCV/xzQn0U=; b=kP7c1Ijg3B8HYhQf53LNR4StyzfsS6WNa0gOZqVJo/OasVGWu0/6rFOK72hf7cvBBe h8YPifDd3lvTpndj/ciHc2Z0R707ln208t0Tzvd0uP37e/XR96conxmNNRU/ykLu5d3Z 9bwCmSo4uk55lAFXZX5e4W3cq0h5oFUX5mb6ZiJJTDNiO8/2WBWVDHRRzij9b3ynwV4G h2NMNAUgylaTt2OkbzYMQiAytksOQHUNQ9K3HN2Qxu7YZKEsmLu/3prrVUTDJjm/wrZm TkgyHbSOcm75jOLgsOhuP/UGyPYIQllwLd6oHXqrIvFg/nmXS39+yr+CliCmQd0tLuSl HYaw== ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@Nvidia.com header.s=selector2 header.b=LIB9efER; arc=pass (i=1 spf=pass spfdomain=nvidia.com dkim=pass dkdomain=nvidia.com dmarc=pass fromdomain=nvidia.com); spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=nvidia.com Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id eb10-20020a0564020d0a00b0044de197f1ddsi5570161edb.550.2022.09.22.05.43.55; Thu, 22 Sep 2022 05:44:23 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@Nvidia.com header.s=selector2 header.b=LIB9efER; arc=pass (i=1 spf=pass spfdomain=nvidia.com dkim=pass dkdomain=nvidia.com dmarc=pass fromdomain=nvidia.com); spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=nvidia.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S231240AbiIVMN6 (ORCPT + 99 others); Thu, 22 Sep 2022 08:13:58 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:58202 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230321AbiIVMN4 (ORCPT ); Thu, 22 Sep 2022 08:13:56 -0400 Received: from NAM11-BN8-obe.outbound.protection.outlook.com (mail-bn8nam11on2041.outbound.protection.outlook.com [40.107.236.41]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 5B73CC8885; Thu, 22 Sep 2022 05:13:55 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=ATA7vSn2LL1UdSQ+dtFUpDgHPuyMyHuN+R47iAFDZ36T1NzBBohGlimsRkrL4oaLoDQPK8zenJUU4UE28hku51NX1/dORDWCiH9gWuzmGFPwSqOWUk0Rfw5pNLrha4vI+XUhgLLGbTAmLS0RrEsEPFl3vKAc1paGtSeYLP1T9kmygNv0B7Q/3O2Bj+pyvRLMuJAKOVxBZXpn6c2jgR9+cofHvK/mlKxr6zQJmWdPozvoFMOfYxvdF7pFVS/H8mlk6eCFY27wLS9tyQKtnr398EqItoHy5CxEoEBqYHm55cDExzDVgVDZN9eO1Gu7qfxhl0VikqjGlBtBnIeXBrZrYQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=PaJEpL1/Zj9LAtviUDDcpjg9E9bqj5gJITCV/xzQn0U=; b=Mk5kE0zO9xJFMn+q1O04ofOeh++bN4VXQL+O+ZbYmJ7s8mUgy45Jx3O54d+EjubtHTAg/rvztqDaPcP4cB4NkaoRK8AJMTr6cYjVRcUd2O7BQWg3WhPzuyhG36UVpI7BMqjt94+p6mgzhk6Yjb7jsCPvbBEOCisNjXZAKimZ/ycRH5XbBOLdioRBQRPwehZTIsXBLY0d6Htfh0bARoNyFOWYfL3PuZfGcg4uVjKM8PexHjv+34Iqc23FRAc6aDymbV3hKqI94YKpZ/rKqYBbq7oVzaSpyy8M946sM472+Flws77IrlTAr8eJZkyf3oyCiJgTAuOMUfIH1OfRxzp2Pw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nvidia.com; dmarc=pass action=none header.from=nvidia.com; dkim=pass header.d=nvidia.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=PaJEpL1/Zj9LAtviUDDcpjg9E9bqj5gJITCV/xzQn0U=; b=LIB9efERYVxmgIVDmnEb4/TsrgCuLuBNvaCFweHGAjUtYJT1DftyDYxhrcU+mzQlPYRWPe/IKYqfwvJczOxqnwf5MEOn9lA7M+8ebwKcVkfOD/VecSCIS75nMs9fIfN0f0OEGvf7tb+HTtDuRzHGIyHp2hcQhnSBt77FVg32pJCdNUuECcGXj/uaSvWHeB7n1jZFHM/HTXapiepevIrTT1wwyROiT4XAxgS160hhM/yocCvk6iTxfzVs13QnkNqJeFxAgkd2Dp/qAWLsxPaESM700CVr4DJ29m+V8q6jIW0Y2AceuLpKohcdFz69LjjnwFQrvsoMDWJLBQFoXcw2xg== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=nvidia.com; Received: from MN2PR12MB4192.namprd12.prod.outlook.com (2603:10b6:208:1d5::15) by DM6PR12MB4880.namprd12.prod.outlook.com (2603:10b6:5:1bc::10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5654.19; Thu, 22 Sep 2022 12:13:53 +0000 Received: from MN2PR12MB4192.namprd12.prod.outlook.com ([fe80::462:7fe:f04f:d0d5]) by MN2PR12MB4192.namprd12.prod.outlook.com ([fe80::462:7fe:f04f:d0d5%7]) with mapi id 15.20.5654.019; Thu, 22 Sep 2022 12:13:53 +0000 Date: Thu, 22 Sep 2022 09:13:51 -0300 From: Jason Gunthorpe To: "Tian, Kevin" Cc: Thomas Gleixner , "Chatre, Reinette" , "Jiang, Dave" , Logan Gunthorpe , LKML , Bjorn Helgaas , Marc Zygnier , Alex Williamson , "Dey, Megha" , "Raj, Ashok" , "linux-pci@vger.kernel.org" , Greg Kroah-Hartman , Jon Mason , Allen Hubbe , "linux-ntb@googlegroups.com" , "linux-s390@vger.kernel.org" , Heiko Carstens , Christian Borntraeger , "x86@kernel.org" , "Rodel, Jorg" , "iommu@lists.linux-foundation.org" Subject: Re: [patch 21/32] NTB/msi: Convert to msi_on_each_desc() Message-ID: References: <87fsr0xp31.ffs@tglx> <875yrvwavf.ffs@tglx> <87fsqxv8zf.ffs@tglx> Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-ClientProxiedBy: BL1PR13CA0096.namprd13.prod.outlook.com (2603:10b6:208:2b9::11) To MN2PR12MB4192.namprd12.prod.outlook.com (2603:10b6:208:1d5::15) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: MN2PR12MB4192:EE_|DM6PR12MB4880:EE_ X-MS-Office365-Filtering-Correlation-Id: 99581549-f978-4684-a9ae-08da9c93ea3e X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 9ckJwHEcC72BEJDftp89fd9dhEKzUx6tIyXQwqOT2WLIY8OdD7hn+0+j2Si8HiLNeoJIhYKW79n6O/9WvDFGa0AslKCHQvG+00WABvJW+pvtCeGi/kA4hmx6kK/IncAeRmlubutARSSD+/JceW8b3JR/EXvL7vlI810DokPjoBoKovzuP+7AVLlysKlBAdcRiDtc5MJGCocOcdN0XWxl/tgbnNbPuCfCtGVnJ+mtiyGgEUHZla93R3LEtkah6Y/eIiMLyPlVp7VF/Giee/VOUNr4AfifW7EpBcI0UN+GYEugpQadIA3Ao4z/nnJqrRST1FQqoNw1YhExbulpDic3B3BdAJefrcynfVmZs/UYKXOl1tfpv0qQDoSgh04B2mR138sKKslc6OBcCBBcGqe5WwTGEZmlsnmr3uRPhovKLvN8d9HWXTiA15QXpkHr/t/a88uBNEjVTc29pSO71TSaz23TytBge7tymIyLiKFit8Q/QoqdWF7pQger4/xNc9ny9y18ON9QXxRTtNaxDxruIX7MDt/hkykdabjjeeLA/IYlYZNEFxETCVsavB9ORTwUwgN1eVnEIESbHHWiLnaEG3BP7l0yc0jjcZd5Uykg/WG9pxbR5tLUOLmPeiPuT9t9kYxIl2v7vfyqNhH9H/Kvi413XLMIvyyDco8Onr6WqGWcuN6BqYlIN+jHG98TRHmo X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:MN2PR12MB4192.namprd12.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230022)(4636009)(346002)(39860400002)(366004)(376002)(396003)(136003)(451199015)(6486002)(478600001)(66899012)(41300700001)(6916009)(6506007)(6512007)(26005)(316002)(186003)(8676002)(2616005)(54906003)(38100700002)(7416002)(5660300002)(4744005)(66476007)(2906002)(86362001)(36756003)(66946007)(66556008)(4326008)(8936002);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?zXOVp5l3SCESHfBvnikb3afj51zvvZ8iqfkP/SYcZNDT1mqUgta9NwMWikXb?= =?us-ascii?Q?y6uC0ZSOt+ODTCQz5q/tIVHOo5rDkYkTMtE5M5xTK3zq9Hu/5f92ZiaGhQei?= =?us-ascii?Q?XduNGHVuwH23cNQ9UqWCioCOnhBJbvyt+feHUIPGV0b8ae5AhAW8draw2BDQ?= =?us-ascii?Q?GXWbt6amZTt9SVLMRc6MDWGJvmUwXszDp1rdK2+GQx4V6oa+rp/Hj5euhfmP?= =?us-ascii?Q?/SjlQ5+8Y3Fw4xwlSoSk3kaPn+BUxr9GaP5hStEQGHMsEAyvV6Zrg36QyIvk?= =?us-ascii?Q?K2UZzdZdHIy3Au1btrlEe4RlU9YCB2SwQjuRRwuOJYkf3ey3Eox20hukmq7P?= =?us-ascii?Q?0S+jHaoppivkMC8PiSlx4g0BbIdVWAcD2SI91oiuZgJedCrZvINjoDdCccY5?= =?us-ascii?Q?QGG2IgQtK9GNq2tUnt0MoYFBEJZnGHCBxkHljICuVDaAe0W3KE6qlDUpcUTj?= =?us-ascii?Q?OlrqYyotmDbk3ELAkJWZbS8gCvDS0X35D1846aepyltOn5Sb+StGjAkzdD/k?= =?us-ascii?Q?cmi3y89XdM7tGJQw2K95LYcj99cKqrmTc36xE74p7zJCj0mUkGapfSnPpzBa?= =?us-ascii?Q?ZY1zMKEZSO0HQK88p19FF67N0Dhdmb9kdj/V+sx9jI+4s7b3kYXQa5DV+LrS?= =?us-ascii?Q?eCcJzlSyos6kZUjZJRLd1RtO9F6UZqg+mnn0B/4EVd18/DBQdR7mPxHIdU5y?= =?us-ascii?Q?/VJ8e3Bhk4Ic+ZLwdArYLEARwrFFRJ2EVkwDQzRp8lDNgMnb7ZsT0Wri6s3Q?= =?us-ascii?Q?6kjHSeI4o7SCxeR0ebBdOBtyaSLGHSuVx40JchFwBEbJ4450w7bnTDLvEEZS?= =?us-ascii?Q?ewqMiNLKINCHb2bTLq2p+JKUleC4n0c1IxLzAwLGbE49Wn6w9ZVaWlPFK1Ub?= =?us-ascii?Q?3XiM8AtK9JjdK5QlYPpd6qoHskQuOxeDNpdsLsPJIYtlRFOOPrjHfBdRUZan?= =?us-ascii?Q?w9TRyV6RposT3Hs1fJ7V1v9HUDbaHU7yf0RW7U8hNXh1pQy6EdcVA4vxdaiU?= =?us-ascii?Q?GwQbyopHOHjm5hRNb/JKbWUXFIgycU5E1fR60gw8gIuzJD/JP9EFaZcN1FTD?= =?us-ascii?Q?hSS66v7wBMtHI6G5da69sDRz32uFmL9etIgTD2vwzoTWRzd0TQcj0gQDKAW9?= =?us-ascii?Q?rNwTvdtOufUIee/s5H+0vUpIrm6BFI+hYnio2eb368kSi/OrjlFGzTJsxymT?= =?us-ascii?Q?2XT8iTVDZsiH6MHnLoEyPrdASrjAwQhcymMLQ5X8Agpvcq1K5nzd6F6Js4fC?= =?us-ascii?Q?0sgikE9AZvsoxw0bHSb5djBW0ytN6LUdA2sZXDiiIDNqQ1inKVmU94Fy4Bcx?= =?us-ascii?Q?n66X1XS/z7JDzRL39dg4y1Sh9NWYFYR2n4qMmamUv0LUI/UaBxcTgI/9VTM0?= =?us-ascii?Q?j7wNQYVt6/2qmapGVd/nWsr0aBEsHDdJaMVbFm3pfQa1vgSH+raBE7N0GL+D?= =?us-ascii?Q?tascqZram9MsyEGi+J3U57eq/jQ+6Y0AS5iA7rWVN+szmwHM5Aze7mL5RCmN?= =?us-ascii?Q?8d94rtg0IfXcxigOcYBgzjIsZ4KZ/mF6rr6f64jirrfuExvUIkxw0mWYs/HH?= =?us-ascii?Q?KMLEK3Z3NyAYZoPLN9jKlVUINvg79fiZQt1Tcn0S?= X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-Network-Message-Id: 99581549-f978-4684-a9ae-08da9c93ea3e X-MS-Exchange-CrossTenant-AuthSource: MN2PR12MB4192.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 22 Sep 2022 12:13:53.4196 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: Ug3NWnV/NabCpBHNVASbcUr7KwpjBT9MJmpQROqHDzXALBP7TWi1KBCGpE04bvqG X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6PR12MB4880 X-Spam-Status: No, score=-1.1 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FORGED_SPF_HELO, RCVD_IN_DNSWL_NONE,RCVD_IN_MSPIKE_H2,SPF_HELO_PASS,SPF_NONE autolearn=no autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, Sep 22, 2022 at 05:11:00AM +0000, Tian, Kevin wrote: > > Thinking of the interrupt routing as a host resource is the problem - > > it is a device resource and just like PASID the ideal design would > > have each RID have its own stable numberspace scoped within it. The > > entire RID and all its stable numberspace would be copied over. > > > > Unfortunately it is not the case at least on Intel VT-d. The interrupt > remapping table is per VT-d instead of per RID. Doesn't that just turn it into a SW problem how it manages it? Jason