Received: by 2002:a05:6a10:5bc5:0:0:0:0 with SMTP id os5csp1682202pxb; Wed, 20 Oct 2021 09:42:56 -0700 (PDT) X-Google-Smtp-Source: ABdhPJwgrN6JDz+tBV2Ds0k34+GLLEIvCscs+V7yxSMBLxdf+RmSe/dH39cjQDvhAVu1Eo6RTpiY X-Received: by 2002:a63:8c19:: with SMTP id m25mr297471pgd.164.1634748176050; Wed, 20 Oct 2021 09:42:56 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1634748176; cv=none; d=google.com; s=arc-20160816; b=EM67rtmtrzSvOt4+HSirHCvmCYyRi5eVWt61CKkGN+BW+mWDvqgn+ixMg8S7l0yBj1 EoAQZFYW94nJbvn4RibSLFPiY7sGtUt3ludLviQRY1qgvwvv7m9UdI28BSSePtbFHUT4 53GsWgyo7/pN/tX3c4bgm6kmn5sMZLyMqFNmbAocNkfyvc9HCVJif1D0CkOGjfc7/z5d 1ihz4oJxsM5mcOHUtpBFxb0acljqazD5vbH4OCgKzvjzSZzEYW4T1FrsHNvASlTyueil bf8YbH/lajWzgF092nZUVSg73Dj+awvgDADS+oSr+Gp0ICe0+xqpF5BYUVVLt68pWQww 4HSA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:content-language :in-reply-to:mime-version:user-agent:date:message-id:from:references :cc:to:subject; bh=ssZBQc1CjwwmKTGLGDzh74Dges2auWkEUDVNxXj5eMM=; b=DLpLLYWX3kKRiNsTfIERw4vYKw9QY3LvbMbOe+eRZPZQfjTVMj68gWwhMJnmrV6aoS OHaRAeI/NBPB//4RsFUmC1LPsDnl16FL+ClVcKZX+fdx6NUGB58tqQyCRP6qnEhdpUZj tVm17iDVRT5JYVtN3aX86hp0h0996wuL+uSJL2umJXrdYRT8SHyu13265mBd8jrfYniM Ac86s3RacTrghdl5lN4g3d2rlDbbrh9ANP7N470EmL+SZ+9fVAXKOvSOIGQHZYKaH71L tWNypAdTL7+33q39MO6zbVcF7BHJyZ4MRu4tX1QqAWhYfjEMnmkcV8efewxaLif8odGR j/Sw== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id k191si3326868pgd.86.2021.10.20.09.42.40; Wed, 20 Oct 2021 09:42:56 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230213AbhJTQns (ORCPT + 99 others); Wed, 20 Oct 2021 12:43:48 -0400 Received: from mga06.intel.com ([134.134.136.31]:40127 "EHLO mga06.intel.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229771AbhJTQnr (ORCPT ); Wed, 20 Oct 2021 12:43:47 -0400 X-IronPort-AV: E=McAfee;i="6200,9189,10143"; a="289674242" X-IronPort-AV: E=Sophos;i="5.87,167,1631602800"; d="scan'208";a="289674242" Received: from fmsmga005.fm.intel.com ([10.253.24.32]) by orsmga104.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 20 Oct 2021 09:41:32 -0700 X-IronPort-AV: E=Sophos;i="5.87,167,1631602800"; d="scan'208";a="720484565" Received: from yakasaka-mobl1.gar.corp.intel.com (HELO skuppusw-desk1.amr.corp.intel.com) ([10.254.9.165]) by fmsmga005-auth.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 20 Oct 2021 09:41:30 -0700 Subject: Re: [PATCH v5 04/16] x86/tdx: Make pages shared in ioremap() To: Tom Lendacky , Thomas Gleixner , Ingo Molnar , Borislav Petkov , Peter Zijlstra , Andy Lutomirski , Bjorn Helgaas , Richard Henderson , Thomas Bogendoerfer , James E J Bottomley , Helge Deller , "David S . Miller" , Arnd Bergmann , Jonathan Corbet , "Michael S . Tsirkin" , Paolo Bonzini , David Hildenbrand , Andrea Arcangeli , Josh Poimboeuf Cc: Peter H Anvin , Dave Hansen , Tony Luck , Dan Williams , Andi Kleen , Kirill Shutemov , Sean Christopherson , Kuppuswamy Sathyanarayanan , x86@kernel.org, linux-kernel@vger.kernel.org, linux-pci@vger.kernel.org, linux-alpha@vger.kernel.org, linux-mips@vger.kernel.org, linux-parisc@vger.kernel.org, sparclinux@vger.kernel.org, linux-arch@vger.kernel.org, linux-doc@vger.kernel.org, virtualization@lists.linux-foundation.org References: <20211009003711.1390019-1-sathyanarayanan.kuppuswamy@linux.intel.com> <20211009003711.1390019-5-sathyanarayanan.kuppuswamy@linux.intel.com> <8c5074f7-5456-e628-5a09-a3a4b4f381fb@amd.com> From: Sathyanarayanan Kuppuswamy Message-ID: Date: Wed, 20 Oct 2021 09:41:29 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Firefox/78.0 Thunderbird/78.13.0 MIME-Version: 1.0 In-Reply-To: <8c5074f7-5456-e628-5a09-a3a4b4f381fb@amd.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 10/20/21 9:03 AM, Tom Lendacky wrote: > On 10/8/21 7:36 PM, Kuppuswamy Sathyanarayanan wrote: >> From: "Kirill A. Shutemov" >> >> All ioremap()ed pages that are not backed by normal memory (NONE or >> RESERVED) have to be mapped as shared. >> >> Reuse the infrastructure from AMD SEV code. >> >> Note that DMA code doesn't use ioremap() to convert memory to shared as >> DMA buffers backed by normal memory. DMA code make buffer shared with >> set_memory_decrypted(). >> >> Signed-off-by: Kirill A. Shutemov >> Reviewed-by: Andi Kleen >> Reviewed-by: Tony Luck >> Signed-off-by: Kuppuswamy Sathyanarayanan >> >> --- >> >> Changes since v4: >>   * Renamed "protected_guest" to "cc_guest". >>   * Replaced use of prot_guest_has() with cc_guest_has() >>   * Modified the patch to adapt to latest version cc_guest_has() >>     changes. >> >> Changes since v3: >>   * Rebased on top of Tom Lendacky's protected guest >>     changes (https://lore.kernel.org/patchwork/cover/1468760/) >> >> Changes since v1: >>   * Fixed format issues in commit log. >> >>   arch/x86/include/asm/pgtable.h |  4 ++++ >>   arch/x86/mm/ioremap.c          |  8 ++++++-- >>   include/linux/cc_platform.h    | 13 +++++++++++++ >>   3 files changed, 23 insertions(+), 2 deletions(-) >> >> diff --git a/arch/x86/include/asm/pgtable.h >> b/arch/x86/include/asm/pgtable.h >> index 448cd01eb3ec..ecefccbdf2e3 100644 >> --- a/arch/x86/include/asm/pgtable.h >> +++ b/arch/x86/include/asm/pgtable.h >> @@ -21,6 +21,10 @@ >>   #define pgprot_encrypted(prot)    __pgprot(__sme_set(pgprot_val(prot))) >>   #define pgprot_decrypted(prot)    __pgprot(__sme_clr(pgprot_val(prot))) >> +/* Make the page accesable by VMM for confidential guests */ >> +#define pgprot_cc_guest(prot) __pgprot(pgprot_val(prot) |    \ >> +                          tdx_shared_mask()) > > So this is only for TDX guests, so maybe a name that is less generic. > > Alternatively, you could create pgprot_private()/pgprot_shared() > functions that check for SME/SEV or TDX and do the proper thing. > > Then you can redefine pgprot_encrypted()/pgprot_decrypted() to the new > functions? Make sense. It will be a better abstraction. I will make this change in next version. > >> + >>   #ifndef __ASSEMBLY__ >>   #include >>   #include >> diff --git a/arch/x86/mm/ioremap.c b/arch/x86/mm/ioremap.c >> index 026031b3b782..83daa3f8f39c 100644 >> --- a/arch/x86/mm/ioremap.c >> +++ b/arch/x86/mm/ioremap.c >> @@ -17,6 +17,7 @@ >>   #include >>   #include >>   #include >> +#include >>   #include >>   #include >> @@ -26,6 +27,7 @@ >>   #include >>   #include >>   #include >> +#include >>   #include "physaddr.h" >> @@ -87,8 +89,8 @@ static unsigned int __ioremap_check_ram(struct >> resource *res) >>   } >>   /* >> - * In a SEV guest, NONE and RESERVED should not be mapped encrypted >> because >> - * there the whole memory is already encrypted. >> + * In a SEV or TDX guest, NONE and RESERVED should not be mapped >> encrypted (or >> + * private in TDX case) because there the whole memory is already >> encrypted. >>    */ >>   static unsigned int __ioremap_check_encrypted(struct resource *res) >>   { >> @@ -246,6 +248,8 @@ __ioremap_caller(resource_size_t phys_addr, >> unsigned long size, >>       prot = PAGE_KERNEL_IO; >>       if ((io_desc.flags & IORES_MAP_ENCRYPTED) || encrypted) >>           prot = pgprot_encrypted(prot); >> +    else if (cc_platform_has(CC_ATTR_GUEST_SHARED_MAPPING_INIT)) >> +        prot = pgprot_cc_guest(prot); > > And if you do the new functions this could be: > >     if ((io_desc.flags & IORES_MAP_ENCRYPTED) || encrypted) >         prot = pgprot_private(prot); >     else >         prot = pgprot_shared(prot); Yes. I will make this change in next version. > > Thanks, > Tom > >>       switch (pcm) { >>       case _PAGE_CACHE_MODE_UC: >> diff --git a/include/linux/cc_platform.h b/include/linux/cc_platform.h >> index 7728574d7783..edb1d7a2f6af 100644 >> --- a/include/linux/cc_platform.h >> +++ b/include/linux/cc_platform.h >> @@ -81,6 +81,19 @@ enum cc_attr { >>        * Examples include TDX Guest. >>        */ >>       CC_ATTR_GUEST_UNROLL_STRING_IO, >> + >> +    /** >> +     * @CC_ATTR_GUEST_SHARED_MAPPING_INIT: IO Remapped memory is marked >> +     *                       as shared. >> +     * >> +     * The platform/OS is running as a guest/virtual machine and >> +     * initializes all IO remapped memory as shared. >> +     * >> +     * Examples include TDX Guest (SEV marks all pages as shared by >> default >> +     * so this feature cannot be enabled for it). >> +     */ >> +    CC_ATTR_GUEST_SHARED_MAPPING_INIT, >> + >>   }; >>   #ifdef CONFIG_ARCH_HAS_CC_PLATFORM >> -- Sathyanarayanan Kuppuswamy Linux Kernel Developer