Received: by 2002:a05:6a10:9848:0:0:0:0 with SMTP id x8csp875990pxf; Wed, 7 Apr 2021 13:55:06 -0700 (PDT) X-Google-Smtp-Source: ABdhPJzQ6JwN7JBl5NXmKDA8i60KkKxEyia4mZPMky25iYri4gpNPzgLPg8HwpaUgcgCqol9zvZ5 X-Received: by 2002:a05:6e02:b41:: with SMTP id f1mr4390680ilu.297.1617828906110; Wed, 07 Apr 2021 13:55:06 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1617828906; cv=pass; d=google.com; s=arc-20160816; b=S9o51Hf20VzCExkiJXgKR/VinxYYrxfXg46ByAU0VUbSmPV07ZBPMVh38QhHDFHklL LOOjNWCr+7Vt7vcIeL/FzBdrAKu+/MguJUKOWiqO17tqhwfaokjJYzTLPKjKLeta7fb6 Oya6hWPN09G+6HNxbsGJumLUFcDm8WdpVyfQ41tiZUe72hkt90OQCs70GGZCtzzojE2j gQxvOKWId8zsoMuXDtDuIf+LgwqUIXD7G7Z6TfhduwMmFprx2P2XTApqa27uhxeXDE9p iO7/E86LVVA3U6PFt+axi4i95nliTWpMLMqAVecL3biisLFmffP6B1mSv9wAaqnYkr3w eq4A== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:mime-version:in-reply-to:content-disposition :references:message-id:subject:cc:to:from:date:dkim-signature; bh=hTE/I1FoqNFwGgf2GMebSWF7jMj8jQ/k763okdShQGM=; b=vPslhkGkh+2DXl2oylEQx45taN3tmHF9D3V4gDcrSPXmfg6o0JmWU3zwJY0dVCQJtn eD8rMSojBZCotiSX9FxcB0pZlPK1Zv+C/WKGJNUI3kqDaJO1nXXL9GWEr9qamvwJk7xI 7dt23lWFWGqIbWUsasYkUz/S1MHtLjnufXppqMuOJa7oN+jQMyLdEGMgwh8HIHogyU6z oNDZtbjZxravX7/NSr0PcO8Tn/+fBzSOVw1/H+t5/P0ZKju5YzbYESsunxEsndQirUIo KT3kIDnFp/5t5F0vUhnPckSnErJfQMexwjh0RE0hxC1a+X8vMdCtLWlZ944eVR6Ljmq7 UlIg== ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@Nvidia.com header.s=selector2 header.b=di0RshBP; arc=pass (i=1 spf=pass spfdomain=nvidia.com dkim=pass dkdomain=nvidia.com dmarc=pass fromdomain=nvidia.com); spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=nvidia.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id u1si7342428ilg.31.2021.04.07.13.54.53; Wed, 07 Apr 2021 13:55:06 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@Nvidia.com header.s=selector2 header.b=di0RshBP; arc=pass (i=1 spf=pass spfdomain=nvidia.com dkim=pass dkdomain=nvidia.com dmarc=pass fromdomain=nvidia.com); spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=nvidia.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1351789AbhDGLe5 (ORCPT + 99 others); Wed, 7 Apr 2021 07:34:57 -0400 Received: from mail-dm6nam11on2084.outbound.protection.outlook.com ([40.107.223.84]:22369 "EHLO NAM11-DM6-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1343965AbhDGLet (ORCPT ); Wed, 7 Apr 2021 07:34:49 -0400 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=YSnkXUtSoqUMazR92SPaQNtqS4sLgJHKmVlXpvDxLrsGm5IBZMF9KA+EH23+d5WkYKMO6mMUno+LXvFArni8tp4OfZlxqJYie980JQesEiM23TdG8xY8GL6Xw4DrxBZRy/XdST2B4txbf31j2+gpsOAadIG2KAIIoUt6iYXgM8TNZwlC/JbFGsm5WI5tz0bZagnArzVWbwO/rB3qG9gu4Ge4JLbmbC4gbLlNCymq44xtT1jD4quFvLjFmW1pM3qW6FK1V5Mmae3h6LFmRM6iyhu7kT+Mt/1gQH4iTTuq+Erqdzyf6NXcNB7N+EQEBebjbVslJekYndNkZPcINsFlcQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=hTE/I1FoqNFwGgf2GMebSWF7jMj8jQ/k763okdShQGM=; b=iPk2J6hkEHATyBs7lqMiB4StlcGcj+x/6QtVEcajOZMqFW/LUGJYOZ6iAQNS0JeDgubFfhU5tcljqtwd+LVyJ258wts5KT7poTrZgX40013FRiy5aO/pIzdhWVUEw5Nls5uvuZnU++T29lTMKEZ39OCXnuuJ5tuKmnWcqjCcl5HhlNyo4BhY40gdkbfuOhb55+69MrJYgmdClubXDuFkDQKMuFuhceoLiaZohu8IrLWXxiVyXBbbtgaubBbhEj91wM2XkZn5437q10qkfyTmWlrc/CFPdP5xiiJSci1UMxAN7BEMJ/7aaL8zAfKfC2pkc5VkpjeIeVc+xSOY189PlQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nvidia.com; dmarc=pass action=none header.from=nvidia.com; dkim=pass header.d=nvidia.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=hTE/I1FoqNFwGgf2GMebSWF7jMj8jQ/k763okdShQGM=; b=di0RshBPmjpMbgTNJyxCe44dW4GNvm0SAYmWXWnP1x0PqNn381wdbwL9BRQiMaG2FlF1FKEgg1HmcR3oG6kUt8sUBtj9o53ktYaZF6UtvVKAnK+zuBW/7eCe/KG5PAPJWQ4vn6cfUS6/M1zfBholghpl8Bq8u3GfjxWkbuAxem/xFCJzVdBMlpsvHi6YvU9KGdaKf9A+brN/5nj3ZvrN+hNx2HMgXMV+B2r7XO/1dl+0ew9c+lRqU6P3BiqcCygS3eWQRNH5LI5vFo+s3zRXK0xX7jOyLpYjaEyG56goJnFFYyI0DF+q7xxUkq9LQ4ufiDk3HjEVl28s3tv/cFvX+g== Authentication-Results: linux.intel.com; dkim=none (message not signed) header.d=none;linux.intel.com; dmarc=none action=none header.from=nvidia.com; Received: from DM6PR12MB3834.namprd12.prod.outlook.com (2603:10b6:5:14a::12) by DM5PR12MB1339.namprd12.prod.outlook.com (2603:10b6:3:70::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3999.29; Wed, 7 Apr 2021 11:34:38 +0000 Received: from DM6PR12MB3834.namprd12.prod.outlook.com ([fe80::1c62:7fa3:617b:ab87]) by DM6PR12MB3834.namprd12.prod.outlook.com ([fe80::1c62:7fa3:617b:ab87%6]) with mapi id 15.20.3999.032; Wed, 7 Apr 2021 11:34:38 +0000 Date: Wed, 7 Apr 2021 08:34:36 -0300 From: Jason Gunthorpe To: Lu Baolu Cc: Christoph Hellwig , Joerg Roedel , David Woodhouse , Alex Williamson , Kirti Wankhede , ashok.raj@intel.com, sanjay.k.kumar@intel.com, jacob.jun.pan@intel.com, kevin.tian@intel.com, Jean-Philippe Brucker , yi.l.liu@intel.com, yi.y.sun@intel.com, peterx@redhat.com, tiwei.bie@intel.com, xin.zeng@intel.com, iommu@lists.linux-foundation.org, kvm@vger.kernel.org, linux-kernel@vger.kernel.org, Jacob Pan Subject: Re: [PATCH v8 7/9] vfio/mdev: Add iommu related member in mdev_device Message-ID: <20210407113436.GD7405@nvidia.com> References: <20190325013036.18400-1-baolu.lu@linux.intel.com> <20190325013036.18400-8-baolu.lu@linux.intel.com> <20210406200030.GA425310@nvidia.com> <1cbe97fb-5595-8cf5-9e0c-1a2edf8c5d9a@linux.intel.com> Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1cbe97fb-5595-8cf5-9e0c-1a2edf8c5d9a@linux.intel.com> X-Originating-IP: [142.162.115.133] X-ClientProxiedBy: BLAPR03CA0061.namprd03.prod.outlook.com (2603:10b6:208:329::6) To DM6PR12MB3834.namprd12.prod.outlook.com (2603:10b6:5:14a::12) MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 Received: from mlx.ziepe.ca (142.162.115.133) by BLAPR03CA0061.namprd03.prod.outlook.com (2603:10b6:208:329::6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4020.17 via Frontend Transport; Wed, 7 Apr 2021 11:34:37 +0000 Received: from jgg by mlx with local (Exim 4.94) (envelope-from ) id 1lU6SC-001zjj-8v; Wed, 07 Apr 2021 08:34:36 -0300 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 817c05ba-8fe0-43c8-00f4-08d8f9b92026 X-MS-TrafficTypeDiagnostic: DM5PR12MB1339: X-MS-Exchange-Transport-Forked: True X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:2449; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 5CrrcKOkFD7TewxUs9YE9kMREI+olBm04yYyGxL1lhBZYJcIh1aPzRkVKDC3RNNExCVvI7UdMHCoQNC5FVjY6MZwYmknQtFRj7rgM/WklBkHIlqUeVgMPdsF8/g4FG1BU2EZ99RQaQPj4ch+pPBp/7R4oOyIBgkFLWP/AVOCU5hCPthJreJDWS7u+n5YhWBZOS61rsPNp17+Y8Tr+BkKjDv1SjIUshtGpsV+MlpbcW2g9/2J6anVVlBuRBJtN5RnSVXIotttxOWeRPLuOh+zB/OtvuuHxFK/iozdEQ665NZNYrt2uBooH8NQjfigQ7lKjVMFgvkLAT3OvLSO4XdMPn788VOCeIYVLKsfta4znYkDSPXM06IAGh8fK8UF67WDdRn1N6UBUKkyFy5Mu2gbsNwsaRB5JnYTRpeT6A71zd3Rb+0Efm73JdvYXDSVdhnuPS+JOBPBidJpDqkVArE0fO8gQbfdC2026P8puYzfnGRwIcX4kT/0w0jfGJ9bV10zyQXvh64XF9+9Mpy9kpQokWWx9GBPDmPNU3kf8skIs4qMorUM7RnqLBbSfgjf16YQ21pTq7KmKPz278BLeomiRoPgP5yfAyTnJPqqXyK37sKFD4+7aqw77MjKQ3i04X76qmy3kpn4co84SGd/qrNwBctrBPOON3CAWNYHvs1yBSGaXjVIuquxJKqoUwlSkeP7KEYyx56Q3SCeRwGAOk//zGekj7LiNEduTqA581rgofW3i6kdiCoVqFxF+ZskNA18 X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DM6PR12MB3834.namprd12.prod.outlook.com;PTR:;CAT:NONE;SFS:(4636009)(366004)(346002)(136003)(396003)(376002)(39860400002)(33656002)(426003)(2616005)(7416002)(86362001)(2906002)(66946007)(8936002)(38100700001)(966005)(66476007)(26005)(186003)(66556008)(9786002)(8676002)(5660300002)(1076003)(54906003)(478600001)(4744005)(6916009)(316002)(9746002)(4326008)(36756003);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData: =?us-ascii?Q?+kY+NIFRyas285mA+wO2KmJcEZ7yGWL4+pYKi39x5g+GLAC2zlgG0IzO7c1p?= =?us-ascii?Q?CjUHDjxnZywWaMuJuM8KvUWW9ESo6ZhV3fqoXsCEqWkVsFUWy6mplysnJUJq?= =?us-ascii?Q?EcVAEn+Xi09YkVzWRzMVZQ7lgTb4F2B/HUR1CJkrzxL+T+Sm5LdS1JXJcBaU?= =?us-ascii?Q?5JMStS9BfPIzxYXWAIkN8bYw6VOBe3IYy//GwhktZQcw5G7tcoM7/VX1pAlb?= =?us-ascii?Q?0mPld9OXd2AF8FpOVulm1FgMw90EjeWButtpZaqMIrSUDAOWxcAmor3GViAu?= =?us-ascii?Q?KwuXJAP8nCkhKIy09fO5KN4qeackrnblDQBapDrMItqUVcM6W0P3rfsarBF1?= =?us-ascii?Q?nQ5nHhMZ/cwFJdkMCQEraOmBjDwHVYwkBa+ZF3ZLd3aZaKj/bAYETTfhkOE8?= =?us-ascii?Q?j1e71Kem6Yu9VirP6b9bQChVzmDbQhYiw79Pd/0dZey1f0nRCUtnNiMXbNZk?= =?us-ascii?Q?yG773pZSrOB4CbPofADB2FjGQuQChdwg2uaCyiTg4LZQrPJYz02AwPI3NXkX?= =?us-ascii?Q?1VqnnnqjgYcgD+fLOMoUpu1cdHfGdZk7MKXlyWfy76u+1+G65xj7vWdMhpyo?= =?us-ascii?Q?+Y7/LFv8gqkMV/txeEt0BSrAahakReFmG3Gx+tP/rP3HJfZ8/S2EIEOG9WAv?= =?us-ascii?Q?3eFDqFNZkLCDIo4QwTFfxpjkWOxJQfbv47BrFSgRzq7xbrZsHTNKEXh6tHYH?= =?us-ascii?Q?JGZMP6D++HlVbLXlU2M80ZMa4m9UaUZhAKr6ut0Qw1yKFACvvkS+RWLOp0ha?= =?us-ascii?Q?tsmt6fAtRpOf3ZzrKaTiFceAyyLHRSIus9w5QMLRzOwwOU8j+6UJq5X8jnUN?= =?us-ascii?Q?7FpczQN7X3RO0RMiyu1aLJ2KRtQbn4bs1ymgti2AvtGWAbV8VTORkc3GMb9/?= =?us-ascii?Q?Ed71chD3y97DQy/PUIKwGzWJF8uO+StuwaFpQ4RjIJpHvLBv+CRpwhD8RmrJ?= =?us-ascii?Q?S21pKNFft4yIzFtgcnLFig7VOfsZypjFnQGPX/8ILVulpkiapfa1prDuCSni?= =?us-ascii?Q?koFXWNO9OUMyn6qO3ARKeZh5xdm8qH50ghqmXUCGJvj3ZngYvf2UchZmc7J9?= =?us-ascii?Q?vvQNBXSABCb9mtenDgoWuzKOgynEckx8xsfjw9VLvZwf+nQHOfvvj7Cw6B5+?= =?us-ascii?Q?qBy+edC21vL+fQ0DH7TDBOpbB5/VVqpswAH9cNCdvsytd6KO3D8+vl2GAZEW?= =?us-ascii?Q?ac4abPniQ+gZtAoYGesJx7DC9Qr2lqZnfIqa2mYerD5YpW1xUuoj3bersRKO?= =?us-ascii?Q?B2B7mFapgOsCOrzaMkB6m0lWiO7VpTzjr8llsnCdj0DLsD0b+WEmB4gW6AWa?= =?us-ascii?Q?K3bcRSDQhMeh4XkMnck6n0xW8CO1ycvWEFkDP8vyAdQdgw=3D=3D?= X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-Network-Message-Id: 817c05ba-8fe0-43c8-00f4-08d8f9b92026 X-MS-Exchange-CrossTenant-AuthSource: DM6PR12MB3834.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 07 Apr 2021 11:34:37.9690 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: vRmIyPBbLyHWEW4YLbgUhxDs3jpN0KS+vjIjb3Bv50vjNllQqvpPdBg6SJF33NE7 X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM5PR12MB1339 Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Wed, Apr 07, 2021 at 09:58:05AM +0800, Lu Baolu wrote: > I've ever tried to implement a bus iommu_ops for mdev devices. > > https://lore.kernel.org/lkml/20201030045809.957927-1-baolu.lu@linux.intel.com/ > > Any comments? You still have the symbol_get, so something continues to be wrong with that series: + mdev_bus = symbol_get(mdev_bus_type); + if (mdev_bus) { + if (bus == mdev_bus && !iommu_present(bus)) { + symbol_put(mdev_bus_type); Jason