Received: by 2002:a05:6a10:17d3:0:0:0:0 with SMTP id hz19csp557887pxb; Fri, 16 Apr 2021 12:07:57 -0700 (PDT) X-Google-Smtp-Source: ABdhPJwfR8kEQvvIBrqz+CQZsb5GNE3hcduC/AAV8+IWPlerC+Z3LbDC4HGgtSwi71GObvI0qnnm X-Received: by 2002:a17:906:b6c5:: with SMTP id ec5mr9810365ejb.290.1618600077451; Fri, 16 Apr 2021 12:07:57 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1618600077; cv=pass; d=google.com; s=arc-20160816; b=iX+p2CvejTXm29mCm36umMR6jbTfoDWdNAT28yVOja0Q8yF2dinTHFGnaAWwM9kvrc 1Wzkoi7zYtiKsjI3RmYTAvmI2SRcFcb1rSlP+HewhNqJqI4Erwuc85nPjhLbz28IhsjP mIPtqmjjWZy1BD/uZ4ukByJDv2zhhFCpwwGPAu4KLV0U1e2CmzSdIXkfg9ot37FMyu5o LJ3r1Q9/x9oEA9AMQfSWaYNN5Hwm0T0WRbWaESiMfbRB7nGtOFFQsR7fcWkIhSugrUoG oOaIb0viSoB4ntrxe9vQ5faB9flIn4LvyawLaWdxHspjMSllu6dbivE5bdZ0tLMDnjMT 9Pcg== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:mime-version:in-reply-to:content-disposition :references:message-id:subject:cc:to:from:date:dkim-signature; bh=exTf1vmaA8iWNEXKuEBLaKxFXzU0i9L1AHzrVzENucU=; b=EspYqY0oMjYNO/zvU88kDvZeFHD9HNSz6FCBW2CIOXVUXL0YRstZzPnabQYbjjEwWp /CalrM0XfpJfPQvMvEUSu5G2KvXJvvaG34agkBjbsSx030qU2d2RV9rLCX314E2EE6fu mSH7Lg0HJ7u1mXZehtzRfOf96ANvxhRnzMDR84Q+bQwGA5TH4gotpkpt7o88D/Wywfzl HLsUXPp9DJoQdggmoKk5IlHHIVkspAJ9HEf6d3l+mkK1mbxBkE3GOLywt1MOE11P9GV9 Je4wptjZvCTeXP8iOlOlUmJVs/YzF082etoI1sDmLQFW+4RVDUrvT7bmxcUnNqquFKGs e3Uw== ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@Nvidia.com header.s=selector2 header.b=c5fyxwl8; arc=pass (i=1 spf=pass spfdomain=nvidia.com dkim=pass dkdomain=nvidia.com dmarc=pass fromdomain=nvidia.com); spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=nvidia.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id v5si5147089edi.123.2021.04.16.12.07.34; Fri, 16 Apr 2021 12:07:57 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@Nvidia.com header.s=selector2 header.b=c5fyxwl8; arc=pass (i=1 spf=pass spfdomain=nvidia.com dkim=pass dkdomain=nvidia.com dmarc=pass fromdomain=nvidia.com); spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=nvidia.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S243975AbhDPRzH (ORCPT + 99 others); Fri, 16 Apr 2021 13:55:07 -0400 Received: from mail-eopbgr680083.outbound.protection.outlook.com ([40.107.68.83]:41730 "EHLO NAM04-BN3-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S243956AbhDPRzH (ORCPT ); Fri, 16 Apr 2021 13:55:07 -0400 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=BPToqQIc9h3ctfxOVtzWiqIgpXAvTqcgMFZen3kmg/J0zc1FgEXerHa3UeDuM51dTyYRJYyFqJ77qHzqbcJ3WvGxHqzkx8PAc5jSil3nzgcTn2DAFNkZzKWlpGKjpZpNbTAV6n727pFtdV/i3WK5Pw+sDqhwja3Npmcw7PMenAjjOL76OkxZoaCEzYLOvqXNB2KU9LbE/FaXGq+VmCMaD+iW6UmnrLldHAklUTbpAUlR4JsBcS5azMvXEbtHsZ86uKUefWo6/va/mDMvtY5DvKLEGqeE3psKzZsLaA674JLCWi3cRklDj39AS7ggpjZJLsILUVUeYzwRbK/U1b2s1w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=exTf1vmaA8iWNEXKuEBLaKxFXzU0i9L1AHzrVzENucU=; b=jA/BtFwQhK81hmhbnF4E7Muvo9u7fPdkwx+/HAt3wJWM+MJboXwzG6HQTRhSmQGlm/LoK6hTrGc/tLJHfeKWqJqaUxg6Ttw11W/G6pI7Ny/PJMYOsl57d2htTkf9zMKtStC9J6mJ+9rJRohvYhpTdr75gfz7tKfi7VvjNtUlPsdtXOt0iB73WUtiNkdFfW/oxzwR6Ktc4ZXZA0McCNj7Wn7DB1yu3yi+B2Q0INEwFVv7zrNINWS6SE7AZbLTD9tBTBYHxxR8hP5QkCBo3Pt4iEsWppBbc3Wh8UeisMgyYnQrcIRFJ9X249utG2Gx+332W7OaM06Li5ElG3K/kQa2dw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nvidia.com; dmarc=pass action=none header.from=nvidia.com; dkim=pass header.d=nvidia.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=exTf1vmaA8iWNEXKuEBLaKxFXzU0i9L1AHzrVzENucU=; b=c5fyxwl8tyabtzGMB5jd6JiH2EV0FZbkdK+blNGm/AsdtNnOZttMkve3d0fV/kiCyIy5Prz0lSLdBR49U60IE1SGZPdwUKHe4AKwuMSYeGuOMPkAxvWJ4XI2rQOmAzKvIU0ykx5mLZiOMgydL3HlBFORhjNwA6qxcfdqbvlHLjWvnXaQte0bVbOYJxIoCvCwl3LLOIAIp2YmkTeNou6iV1ATP2DR6MQNjqdg4E9gcmTShbeo7yO3p0cIZ7oBZy/T06sBqlstFp8fqwL0cQgyWsjYFZ3S6Ge+KSUqy2lz/6XB60IBv6EpslaC75O0/GfqBjVU+u7bai57vwFk5n9SmQ== Authentication-Results: linux.intel.com; dkim=none (message not signed) header.d=none;linux.intel.com; dmarc=none action=none header.from=nvidia.com; Received: from DM6PR12MB3834.namprd12.prod.outlook.com (2603:10b6:5:14a::12) by DM6PR12MB4842.namprd12.prod.outlook.com (2603:10b6:5:1fe::27) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4042.19; Fri, 16 Apr 2021 17:54:40 +0000 Received: from DM6PR12MB3834.namprd12.prod.outlook.com ([fe80::1c62:7fa3:617b:ab87]) by DM6PR12MB3834.namprd12.prod.outlook.com ([fe80::1c62:7fa3:617b:ab87%6]) with mapi id 15.20.4020.024; Fri, 16 Apr 2021 17:54:40 +0000 Date: Fri, 16 Apr 2021 14:54:38 -0300 From: Jason Gunthorpe To: Jacob Pan Cc: Alex Williamson , Auger Eric , "Liu, Yi L" , Jean-Philippe Brucker , "Tian, Kevin" , LKML , Joerg Roedel , Lu Baolu , David Woodhouse , "iommu@lists.linux-foundation.org" , "cgroups@vger.kernel.org" , Tejun Heo , Li Zefan , Johannes Weiner , Jean-Philippe Brucker , Jonathan Corbet , "Raj, Ashok" , "Wu, Hao" , "Jiang, Dave" Subject: Re: [PATCH V4 05/18] iommu/ioasid: Redefine IOASID set and allocation APIs Message-ID: <20210416175438.GM1370958@nvidia.com> References: <20210401134236.GF1463678@nvidia.com> <20210401160337.GJ1463678@nvidia.com> <4bea6eb9-08ad-4b6b-1e0f-c97ece58a078@redhat.com> <20210415230732.GG1370958@nvidia.com> <20210416061258.325e762e@jacob-builder> <20210416094547.1774e1a3@redhat.com> <20210416102332.6f71e53e@jacob-builder> Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20210416102332.6f71e53e@jacob-builder> X-Originating-IP: [142.162.115.133] X-ClientProxiedBy: BL1PR13CA0281.namprd13.prod.outlook.com (2603:10b6:208:2bc::16) To DM6PR12MB3834.namprd12.prod.outlook.com (2603:10b6:5:14a::12) MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 Received: from mlx.ziepe.ca (142.162.115.133) by BL1PR13CA0281.namprd13.prod.outlook.com (2603:10b6:208:2bc::16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4065.6 via Frontend Transport; Fri, 16 Apr 2021 17:54:39 +0000 Received: from jgg by mlx with local (Exim 4.94) (envelope-from ) id 1lXSfu-007NlT-R3; Fri, 16 Apr 2021 14:54:38 -0300 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 8962f20e-72eb-473d-c7f2-08d90100b51a X-MS-TrafficTypeDiagnostic: DM6PR12MB4842: X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:3826; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 8TwyFifkj3mQMqAAVrHElNYoTpXqoaKkh12tiM2J3WjHTDcn0cIae+7IxIUxC0zXaQw6Lao6vywjC4ID1cZDUkV1jPjT0OiUl4EoUn3PbeHR6l/PMgpkLX7LS7NV0pn341+tSioeKawHvev9beBpBcETByAg3bMjfDm1IN+9qvy5h6VGEEtJpZawYNMJmhpGPwAuBtwpz66TkasAXgAUwyWH2xarh3qcDjTfWqwWgV7dtbdPR6RghBao5d/R8W7iWjVJLboVh4ABXuphwWEQJqQRljjVVyLXZSyFMECvFty2HE/cacPb+KniG1dhYkn/SkxNhmo+n43MO0/7sVUHO7iLhl12rLun8Dc5tDspP874wz0YCbcxZep8lr0ESVFURzyeQDYvmNz2aqsVI4yaLJgqWy+XeM1MFqj3x1HgqeeGNSmgo5euCe7ZBcmHMyoyvsf37k2BJO8j1U+5I41IR8iCXcoDSggMpVccyR1rHQZWnXh7AYi50kZLmILMOmL82aABRVffUrQTJHIfvlffQVFF11e0fHX/DMDMwz/OJZjLWnEOzMlF6g+IGjUGlOe6XG2WiRrG4+hpra0aKuD504Aphea6R7pUHVZ+kdjKy2M= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DM6PR12MB3834.namprd12.prod.outlook.com;PTR:;CAT:NONE;SFS:(4636009)(396003)(346002)(136003)(376002)(39860400002)(366004)(5660300002)(38100700002)(1076003)(6916009)(4744005)(8676002)(54906003)(478600001)(66946007)(316002)(426003)(2616005)(8936002)(7416002)(66476007)(86362001)(33656002)(186003)(4326008)(83380400001)(36756003)(2906002)(66556008)(9746002)(9786002)(26005);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData: =?us-ascii?Q?CZwHdFmklKQN874JiSQFzgc6QV9CEQh/jd6ZjZZG3S9DhZjtLo2n8WJqFJsF?= =?us-ascii?Q?MBZUF6q9C0RpkqmrmZ7O8iZyrl0rkY470xXq9mve7imhr47QojonZdRgOcBv?= =?us-ascii?Q?/9ztHzQ2Oqg4hJkM3R8SE1pOr52o9BUMCXY9JRkKOFPy+rFpB4NhKHOcbFJW?= =?us-ascii?Q?CeYhCYy9eAgi9TuqBtB5txT3/czi2Xv6/rv3X7Lr2GMCNdLzdvoAsowP5Hiy?= =?us-ascii?Q?PwhJERtLJIci7teMDEK8lh4ItMiQD+XTe2cTRJphHeoylj3k+hrOEL+/YFx7?= =?us-ascii?Q?AlC5KqGZpCdRrLhQ0viNTAGfbJHffPe09L4GqGj6+FFmERWt3GsIzLpPqJTR?= =?us-ascii?Q?PDeoM3ZQ6PZr3fkEKFQMRTqQ03+qkRQk8mGlxnaID+V718JmqvLIWTkamluo?= =?us-ascii?Q?IHPwfonswxZHl8V9/yVgpr6qszoB60+XrV5rDUTBAA355YBxWHlGsF/YKofx?= =?us-ascii?Q?7b7myQDRBmH2r52hvUtPOl6LoGqE40/PAYT7J+jrkhHquU9rbwEWQBLhGYJQ?= =?us-ascii?Q?yZFUOShrucCSOMUTUQ/nqa2oP/d8LokbFm5j8ywN4rUOoBXqbziJGhb258xs?= =?us-ascii?Q?pjRRzJCTRt9BLGCxi39rZ/p84eJK1tSRiYC8fjc93SHSEB3EC/ziUQrJdN91?= =?us-ascii?Q?cl7Drg7gfjpxbLSaMJuubF1T4YXn5/INcE0h9Liw3NSlJvPlzHtNJrOHYZBG?= =?us-ascii?Q?89e4Roe8uGztXxpggxoGN4ivYjseSsJYIviGaeXA9cxaiomoHR+QZqNzw+50?= =?us-ascii?Q?wQM150Xqq2yL4q2wV1B2ZuEXppVa+J4pntqOF5/bB/FgkO40IhA9yHXYI945?= =?us-ascii?Q?bEVAsD/JhkIXiJHV99NnfuYD/xfs6PXLWMGw9LC4OkIa4qNn2VgHlUYaMsdk?= =?us-ascii?Q?Nhuo0Ocu9+/mOBYFwtDLccqn57LlgZf0vMA1irKnheFQ03e01SHxo+lduX9m?= =?us-ascii?Q?0ptexfcMbvEG87DQP2/+iIgK18tTCZcxTIHiNGlKB5Y0w5hmSZ1d+YCOqbkA?= =?us-ascii?Q?FqxNMQs7WUzN3kq0oYsQd3WWwA1J5BBNo7e93fBkHhjp/H8d8KtOXE1eaFay?= =?us-ascii?Q?HEtH9S40Iju5Y+UJvNTbGvNPZSiqJp5yVVtEeASVNXJgn/t5bVJ200BAFi6q?= =?us-ascii?Q?ekK9axIHsAj97QOf4nQKCE1BGNRDSfzJSyG8lbL7F+xMnW6ZKeQeOP7CjAl/?= =?us-ascii?Q?M4OjBVdMAKmCfCpUmROu1OHn/7nLCuxlvpWl892x6pF+bWNjFpX8D2TjKmhJ?= =?us-ascii?Q?eGDe4Livdihq6AaTFXI5If8cf+fQlzsIpzQOKS/KQ4XClv+M26MAYGhBe3Fr?= =?us-ascii?Q?MkyhrF9gkXiDrJ3OkR4cMui9Mo/0mx7lLdv/day7pCHWLg=3D=3D?= X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-Network-Message-Id: 8962f20e-72eb-473d-c7f2-08d90100b51a X-MS-Exchange-CrossTenant-AuthSource: DM6PR12MB3834.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 16 Apr 2021 17:54:40.1423 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: 2VM1URiudA+/RO80pFxTB2PYik65LjVMWEPb35ShU83jHkRALLEqs9Q1JE/sRmvC X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6PR12MB4842 Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Fri, Apr 16, 2021 at 10:23:32AM -0700, Jacob Pan wrote: > Perhaps similar to cgroup v1 vs v2, it took a long time and with known > limitations in v1. cgroup v2 is still having transition problems, if anything it is a cautionary tale to think really hard about uAPI because transitioning can be really hard. It might be very wise to make /dev/ioasid and /dev/vfio ioctl compatible in some way so existing software has a smoother upgrade path. For instance by defining a default IOASID Jason