Received: by 2002:a25:6193:0:0:0:0:0 with SMTP id v141csp779787ybb; Fri, 3 Apr 2020 11:39:22 -0700 (PDT) X-Google-Smtp-Source: APiQypJRBsflAz45Klp9n2CZFbhdmJlzqs7W08ZogPbN/Tjv9KYX+/0/lD7u9PmIaa9pyjuCKSr6 X-Received: by 2002:a9d:7452:: with SMTP id p18mr7231344otk.122.1585939162047; Fri, 03 Apr 2020 11:39:22 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1585939162; cv=none; d=google.com; s=arc-20160816; b=AX3EhymFYmByna879mHfU9NL0pyFxOClRFQOZ9+XCBeGhsszjLeic6cyxd1SHSwarR wVzSyoGgEZYHRTjpTaXsW1e3nPbUYcdMwcRH5P+R6OFM20QsF/OvpAun6Ic+BnsUYaIF 3r5uiSrlBS9WKgqrn9qKztWyM+VBKhZa2gTyzFPb9JlYEBm6wCsO1R6vUZGeQ1QWUFeL kMcv7qOyIOFZb+YxCinL3iB4Kv/qNHpCurg68RxQfVKYh+7Uzgf++S+jd6kAqErLUeLA EVZrtFajUxd7WYDeLSSOaTn1YTL7f4QEBgaa8GNx1/lH/w67VJLwxycnMwsX0k9XTpb5 11ZQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:message-id:date:subject:cc:to:from :ironport-sdr:ironport-sdr; bh=/kbuzuF4CjSqmI76v703RorOgBFiHPDh6b5UxRLP8ZE=; b=D/F7KmQkStsltla5ldz/w8JwJpNizqf0P3GG+UNBKC1/xDevSXYwOBjKtSFD/WmHqd +dzZfd7R1J32SunaPcFE8+rfaIvOe5zGDA/O9Pb0eOKGJgBaJ7uFkxbKJ9G+A/JT2aRH Payq4NHrFusj4agPNJDrYpWoL6F+d+gkc+mvjOz7+o930tvHmcqrfwRCMAAerDQgb1EH 7Pk5wNhYVMC2CnabXFQ1xGWLVafHplCOSSjTUZ4sVfihGB69Ji7q1DimkPjLEl+tBOfB CfoOVAupHOTsiD+gpzGs+wyOE5KH4z7SlKpPaUsexC15k7OjYQysqf0P5Z4tU8zjhjyp xRIg== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id g2si4078148otr.13.2020.04.03.11.39.09; Fri, 03 Apr 2020 11:39:22 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S2404122AbgDCSg2 (ORCPT + 99 others); Fri, 3 Apr 2020 14:36:28 -0400 Received: from mga17.intel.com ([192.55.52.151]:4672 "EHLO mga17.intel.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1728066AbgDCSg1 (ORCPT ); Fri, 3 Apr 2020 14:36:27 -0400 IronPort-SDR: xcQjVXWohWLBEVxt883Fi5405qyujURHVWiZNgFCBp0zUbpIpS5SrvqLkL9wBsy10LWahFwO0H zIurmKGG4FmQ== X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from orsmga002.jf.intel.com ([10.7.209.21]) by fmsmga107.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 03 Apr 2020 11:36:27 -0700 IronPort-SDR: miaWFJZnZ7svohocQv3RMDcQmjUNraHfVhuJGa7NDJLGtcHr2RCCYiPU/yhuVRMOXY5PJmqdux i2iT3pxaaLLg== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.72,340,1580803200"; d="scan'208";a="268439804" Received: from jacob-builder.jf.intel.com ([10.7.199.155]) by orsmga002.jf.intel.com with ESMTP; 03 Apr 2020 11:36:26 -0700 From: Jacob Pan To: "Lu Baolu" , iommu@lists.linux-foundation.org, LKML , Joerg Roedel , David Woodhouse , Jean-Philippe Brucker , Eric Auger Cc: "Yi Liu" , "Tian, Kevin" , Raj Ashok , Alex Williamson , "Christoph Hellwig" , Jonathan Cameron , Jacob Pan Subject: [PATCH v11 00/10] Nested Shared Virtual Address (SVA) VT-d support Date: Fri, 3 Apr 2020 11:42:04 -0700 Message-Id: <1585939334-21396-1-git-send-email-jacob.jun.pan@linux.intel.com> X-Mailer: git-send-email 2.7.4 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Shared virtual address (SVA), a.k.a, Shared virtual memory (SVM) on Intel platforms allow address space sharing between device DMA and applications. SVA can reduce programming complexity and enhance security. This series is intended to enable SVA virtualization, i.e. enable use of SVA within a guest user application. This is the remaining portion of the original patchset that is based on Joerg's x86/vt-d branch. The preparatory and cleanup patches are merged here. (git://git.kernel.org/pub/scm/linux/kernel/git/joro/iommu.git) Only IOMMU portion of the changes are included in this series. Additional support is needed in VFIO and QEMU (will be submitted separately) to complete this functionality. To make incremental changes and reduce the size of each patchset. This series does not inlcude support for page request services. In VT-d implementation, PASID table is per device and maintained in the host. Guest PASID table is shadowed in VMM where virtual IOMMU is emulated. .-------------. .---------------------------. | vIOMMU | | Guest process CR3, FL only| | | '---------------------------' .----------------/ | PASID Entry |--- PASID cache flush - '-------------' | | | V | | CR3 in GPA '-------------' Guest ------| Shadow |--------------------------|-------- v v v Host .-------------. .----------------------. | pIOMMU | | Bind FL for GVA-GPA | | | '----------------------' .----------------/ | | PASID Entry | V (Nested xlate) '----------------\.------------------------------. | | |SL for GPA-HPA, default domain| | | '------------------------------' '-------------' Where: - FL = First level/stage one page tables - SL = Second level/stage two page tables This is the remaining VT-d only portion of V5 since the uAPIs and IOASID common code have been applied to Joerg's IOMMU core branch. (https://lkml.org/lkml/2019/10/2/833) The complete set with VFIO patches are here: https://github.com/jacobpan/linux.git:siov_sva The complete nested SVA upstream patches are divided into three phases: 1. Common APIs and PCI device direct assignment 2. Page Request Services (PRS) support 3. Mediated device assignment With this set and the accompanied VFIO code, we will achieve phase #1. Thanks, Jacob ChangeLog: - v11 Misc fixes and improvements based on review by Kevin & Eric - Fixed devTLB granularity conversion - Simplified VT-d granulairy lookup by replacing 2D map array with invalid entries. - Fixed locking in bind guest PASID - Added nesting domain attr check - Squashed agaw checking patch with user - Use rate limitted error message for all user originated calls - v10 - Addressed Eric's review in v7 and v9. Most fixes are in 3/10 and 6/10. Extra condition checks and consolidation of duplicated codes. - v9 - Addressed Baolu's comments for v8 for IOTLB flush consolidation, bug fixes - Removed IOASID notifier code which will be submitted separately to address PASID life cycle management with multiple users. - v8 - Extracted cleanup patches from V7 and accepted into maintainer's tree (https://lkml.org/lkml/2019/12/2/514). - Added IOASID notifier and VT-d handler for termination of PASID IOMMU context upon free. This will ensure success of VFIO IOASID free API regardless PASID is in use. (https://lore.kernel.org/linux-iommu/1571919983-3231-1-git-send-email-yi.l.liu@intel.com/) - V7 - Respect vIOMMU PASID range in virtual command PASID/IOASID allocator - Caching virtual command capabilities to avoid runtime checks that could cause vmexits. - V6 - Rebased on top of Joerg's core branch (git://git.kernel.org/pub/scm/linux/kernel/git/joro/iommu.git core) - Adapt to new uAPIs and IOASID allocators - V5 Rebased on v5.3-rc4 which has some of the IOMMU fault APIs merged. Addressed v4 review comments from Eric Auger, Baolu Lu, and Jonathan Cameron. Specific changes are as follows: - Refined custom IOASID allocator to support multiple vIOMMU, hotplug cases. - Extracted vendor data from IOMMU guest PASID bind data, for VT-d will support all necessary guest PASID entry fields for PASID bind. - Support non-identity host-guest PASID mapping - Exception handling in various cases - V4 - Redesigned IOASID allocator such that it can support custom allocators with shared helper functions. Use separate XArray to store IOASIDs per allocator. Took advice from Eric Auger to have default allocator use the generic allocator structure. Combined into one patch in that the default allocator is just "another" allocator now. Can be built as a module in case of driver use without IOMMU. - Extended bind guest PASID data to support SMMU and non-identity guest to host PASID mapping https://lkml.org/lkml/2019/5/21/802 - Rebased on Jean's sva/api common tree, new patches starts with [PATCH v4 10/22] - V3 - Addressed thorough review comments from Eric Auger (Thank you!) - Moved IOASID allocator from driver core to IOMMU code per suggestion by Christoph Hellwig (https://lkml.org/lkml/2019/4/26/462) - Rebased on top of Jean's SVA API branch and Eric's v7[1] (git://linux-arm.org/linux-jpb.git sva/api) - All IOMMU APIs are unmodified (except the new bind guest PASID call in patch 9/16) - V2 - Rebased on Joerg's IOMMU x86/vt-d branch v5.1-rc4 - Integrated with Eric Auger's new v7 series for common APIs (https://github.com/eauger/linux/tree/v5.1-rc3-2stage-v7) - Addressed review comments from Andy Shevchenko and Alex Williamson on IOASID custom allocator. - Support multiple custom IOASID allocators (vIOMMUs) and dynamic registration. Jacob Pan (9): iommu/vt-d: Move domain helper to header iommu/uapi: Define a mask for bind data iommu/vt-d: Use a helper function to skip agaw for SL iommu/vt-d: Add nested translation helper function iommu/vt-d: Add bind guest PASID support iommu/vt-d: Support flushing more translation cache types iommu/vt-d: Add svm/sva invalidate function iommu/vt-d: Cache virtual command capability register iommu/vt-d: Add custom allocator for IOASID Lu Baolu (1): iommu/vt-d: Enlightened PASID allocation drivers/iommu/dmar.c | 37 +++++ drivers/iommu/intel-iommu.c | 277 ++++++++++++++++++++++++++++++++---- drivers/iommu/intel-pasid.c | 340 ++++++++++++++++++++++++++++++++++++++++++-- drivers/iommu/intel-pasid.h | 25 +++- drivers/iommu/intel-svm.c | 206 +++++++++++++++++++++++++++ include/linux/intel-iommu.h | 70 ++++++++- include/linux/intel-svm.h | 17 +++ include/uapi/linux/iommu.h | 5 +- 8 files changed, 925 insertions(+), 52 deletions(-) -- 2.7.4