Received: by 2002:a25:1985:0:0:0:0:0 with SMTP id 127csp429945ybz; Tue, 21 Apr 2020 11:48:29 -0700 (PDT) X-Google-Smtp-Source: APiQypKijBA2OFvBrleAr6pQnWK/TMFNleI3Kkg62jaA7sSHpIsgSxRssMgb08kEpwvUQYoq59cr X-Received: by 2002:a17:906:4a94:: with SMTP id x20mr22918182eju.306.1587494909108; Tue, 21 Apr 2020 11:48:29 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1587494909; cv=none; d=google.com; s=arc-20160816; b=tVBqwOGXgynh6dw9JbNkGDHRwIbryyEMczxR9Ve1RmQK2GN1gTyYl4OjvvEXuPdTQ0 Bb23A4UaGxi5aZiP+vRbd4KNK0hPdaqsDZGHOBaRKlUcAPWaMDe8xA1pgYV5NfPb+hmz TAjhlzmGukcE+kGdqAfnkvUuxIuKUh5LB41Mf1tDgxykLHxRvjaT8cPhOBU7y+HZaz0V 3UFZq8OL+96gKKqUJ83FVgE07E7DyR7lxoCg5outPzDqH67z/6DmXiJ+mDo8tfNWD4ab aBjDYpjVIt5Qg3t65bEH1ecMMM8V8YTfYdr4c1K2V+iJfEQkTywDb7pvgt/PGj+pZ/RY RlbA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:message-id:date:subject:cc:to:from :ironport-sdr:ironport-sdr; bh=jJPShlXQVcfuwsocnuaYCXg4EQjsZ78CAHBABDb5F9k=; b=KjZDQHQsgL9USabdmq2xZDTeVYGeQodcV/5SfLBxDL/9JNOSQYBWGsVV0FrKcoh+Mz FkKdqvq/jdSvZF7VHUHCg1BA1Q0kJ6AoHNO2PAEk5IsZz1NAaWnj/1PQ+yG8szXWuNyL Un9UbSrdvaZRBaRB0o+/ekLyEeuoiYZJwr92rKocmzCCB+YbxTAG/6rVkiJajqyhD4jN ijIESX4TSxgAHjK4rL3hkRmDdfSQ4rsvJPYVr7ZLmZjV4jGo30LGh4lCBcaEEUEqJ6UW 91wXT0+JUHRXUR4L9dOItoYLCU2GCppeEQWP2HoYiuZ9fA4p1G33+yXgPxQS16oqX46r fKGg== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id o13si2257638edz.352.2020.04.21.11.48.06; Tue, 21 Apr 2020 11:48:29 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726372AbgDUSrG (ORCPT + 99 others); Tue, 21 Apr 2020 14:47:06 -0400 Received: from mga04.intel.com ([192.55.52.120]:22250 "EHLO mga04.intel.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1725886AbgDUSrF (ORCPT ); Tue, 21 Apr 2020 14:47:05 -0400 IronPort-SDR: v6q5zadySag1mZAZAR9Q89x8umrul83xBbZabk+etWSZSoKE1xdzwcWqrAU31XtDFcbgrUbQ7G AhltwOZ9keRg== X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from orsmga001.jf.intel.com ([10.7.209.18]) by fmsmga104.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 21 Apr 2020 11:46:48 -0700 IronPort-SDR: 0QmsZMol2UineBPjnJLcnI3Ht6x5MX1mZ16KJtDN+aMETxOpMG0zx7HB+0Ys7gp3S2h+k023rM cu0dgEx7gZ5Q== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.72,411,1580803200"; d="scan'208";a="334367858" Received: from jacob-builder.jf.intel.com ([10.7.199.155]) by orsmga001.jf.intel.com with ESMTP; 21 Apr 2020 11:46:47 -0700 From: Jacob Pan To: "Lu Baolu" , iommu@lists.linux-foundation.org, LKML , Joerg Roedel , David Woodhouse , Jean-Philippe Brucker , Eric Auger Cc: "Yi Liu" , "Tian, Kevin" , Raj Ashok , Alex Williamson , "Christoph Hellwig" , Jonathan Cameron , Jacob Pan Subject: [PATCH v12 0/8] Nested Shared Virtual Address (SVA) VT-d support Date: Tue, 21 Apr 2020 11:52:37 -0700 Message-Id: <1587495165-80096-1-git-send-email-jacob.jun.pan@linux.intel.com> X-Mailer: git-send-email 2.7.4 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Shared virtual address (SVA), a.k.a, Shared virtual memory (SVM) on Intel platforms allow address space sharing between device DMA and applications. SVA can reduce programming complexity and enhance security. This series is intended to enable SVA virtualization, i.e. enable use of SVA within a guest user application. This is the remaining portion of the original patchset that is based on Joerg's x86/vt-d branch. The preparatory and cleanup patches are merged here. (git://git.kernel.org/pub/scm/linux/kernel/git/joro/iommu.git) Only IOMMU portion of the changes are included in this series. Additional support is needed in VFIO and QEMU (will be submitted separately) to complete this functionality. To make incremental changes and reduce the size of each patchset. This series does not inlcude support for page request services. In VT-d implementation, PASID table is per device and maintained in the host. Guest PASID table is shadowed in VMM where virtual IOMMU is emulated. .-------------. .---------------------------. | vIOMMU | | Guest process CR3, FL only| | | '---------------------------' .----------------/ | PASID Entry |--- PASID cache flush - '-------------' | | | V | | CR3 in GPA '-------------' Guest ------| Shadow |--------------------------|-------- v v v Host .-------------. .----------------------. | pIOMMU | | Bind FL for GVA-GPA | | | '----------------------' .----------------/ | | PASID Entry | V (Nested xlate) '----------------\.------------------------------. | | |SL for GPA-HPA, default domain| | | '------------------------------' '-------------' Where: - FL = First level/stage one page tables - SL = Second level/stage two page tables This is the remaining VT-d only portion of V5 since the uAPIs and IOASID common code have been applied to Joerg's IOMMU core branch. (https://lkml.org/lkml/2019/10/2/833) The complete set with VFIO patches are here: https://github.com/jacobpan/linux.git:siov_sva The complete nested SVA upstream patches are divided into three phases: 1. Common APIs and PCI device direct assignment 2. Page Request Services (PRS) support 3. Mediated device assignment With this set and the accompanied VFIO code, we will achieve phase #1. Thanks, Jacob ChangeLog: - v12 - Fixed IA64 cross compile error - Squashed two patches that add macros with its users - Use ratelimited prints for all user called APIs - Check domain nesting attr for vSVA APIs. - Misc style improvements - v11 Misc fixes and improvements based on review by Kevin & Eric - Fixed devTLB granularity conversion - Simplified VT-d granulairy lookup by replacing 2D map array with invalid entries. - Fixed locking in bind guest PASID - Added nesting domain attr check - Squashed agaw checking patch with user - Use rate limitted error message for all user originated calls - v10 - Addressed Eric's review in v7 and v9. Most fixes are in 3/10 and 6/10. Extra condition checks and consolidation of duplicated codes. - v9 - Addressed Baolu's comments for v8 for IOTLB flush consolidation, bug fixes - Removed IOASID notifier code which will be submitted separately to address PASID life cycle management with multiple users. - v8 - Extracted cleanup patches from V7 and accepted into maintainer's tree (https://lkml.org/lkml/2019/12/2/514). - Added IOASID notifier and VT-d handler for termination of PASID IOMMU context upon free. This will ensure success of VFIO IOASID free API regardless PASID is in use. (https://lore.kernel.org/linux-iommu/1571919983-3231-1-git-send-email-yi.l.liu@intel.com/) - V7 - Respect vIOMMU PASID range in virtual command PASID/IOASID allocator - Caching virtual command capabilities to avoid runtime checks that could cause vmexits. - V6 - Rebased on top of Joerg's core branch (git://git.kernel.org/pub/scm/linux/kernel/git/joro/iommu.git core) - Adapt to new uAPIs and IOASID allocators - V5 Rebased on v5.3-rc4 which has some of the IOMMU fault APIs merged. Addressed v4 review comments from Eric Auger, Baolu Lu, and Jonathan Cameron. Specific changes are as follows: - Refined custom IOASID allocator to support multiple vIOMMU, hotplug cases. - Extracted vendor data from IOMMU guest PASID bind data, for VT-d will support all necessary guest PASID entry fields for PASID bind. - Support non-identity host-guest PASID mapping - Exception handling in various cases - V4 - Redesigned IOASID allocator such that it can support custom allocators with shared helper functions. Use separate XArray to store IOASIDs per allocator. Took advice from Eric Auger to have default allocator use the generic allocator structure. Combined into one patch in that the default allocator is just "another" allocator now. Can be built as a module in case of driver use without IOMMU. - Extended bind guest PASID data to support SMMU and non-identity guest to host PASID mapping https://lkml.org/lkml/2019/5/21/802 - Rebased on Jean's sva/api common tree, new patches starts with [PATCH v4 10/22] - V3 - Addressed thorough review comments from Eric Auger (Thank you!) - Moved IOASID allocator from driver core to IOMMU code per suggestion by Christoph Hellwig (https://lkml.org/lkml/2019/4/26/462) - Rebased on top of Jean's SVA API branch and Eric's v7[1] (git://linux-arm.org/linux-jpb.git sva/api) - All IOMMU APIs are unmodified (except the new bind guest PASID call in patch 9/16) - V2 - Rebased on Joerg's IOMMU x86/vt-d branch v5.1-rc4 - Integrated with Eric Auger's new v7 series for common APIs (https://github.com/eauger/linux/tree/v5.1-rc3-2stage-v7) - Addressed review comments from Andy Shevchenko and Alex Williamson on IOASID custom allocator. - Support multiple custom IOASID allocators (vIOMMUs) and dynamic registration. Jacob Pan (7): iommu/vt-d: Move domain helper to header iommu/vt-d: Use a helper function to skip agaw for SL iommu/vt-d: Add nested translation helper function iommu/vt-d: Add bind guest PASID support iommu/vt-d: Support flushing more translation cache types iommu/vt-d: Add svm/sva invalidate function iommu/vt-d: Add custom allocator for IOASID Lu Baolu (1): iommu/vt-d: Enlightened PASID allocation drivers/iommu/dmar.c | 40 ++++++ drivers/iommu/intel-iommu.c | 295 +++++++++++++++++++++++++++++++++---- drivers/iommu/intel-pasid.c | 344 ++++++++++++++++++++++++++++++++++++++++++-- drivers/iommu/intel-pasid.h | 23 ++- drivers/iommu/intel-svm.c | 204 ++++++++++++++++++++++++++ include/linux/intel-iommu.h | 71 ++++++++- include/linux/intel-svm.h | 17 +++ include/uapi/linux/iommu.h | 5 + 8 files changed, 948 insertions(+), 51 deletions(-) -- 2.7.4