Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18;
From:   Ross Philipson <ross.philipson@oracle.com>
To:     linux-kernel@vger.kernel.org, x86@kernel.org,
        iommu@lists.linux-foundation.org, linux-integrity@vger.kernel.org,
        linux-doc@vger.kernel.org
Cc:     ross.philipson@oracle.com, dpsmith@apertussolutions.com,
        tglx@linutronix.de, mingo@redhat.com, bp@alien8.de, hpa@zytor.com,
        luto@amacapital.net, kanth.ghatraju@oracle.com,
        trenchboot-devel@googlegroups.com
Subject: [PATCH v4 11/14] kexec: Secure Launch kexec SEXIT support
Date:   Fri, 27 Aug 2021 09:28:34 -0400
Message-Id: <1630070917-9896-12-git-send-email-ross.philipson@oracle.com>
In-Reply-To: <1630070917-9896-1-git-send-email-ross.philipson@oracle.com>
References: <1630070917-9896-1-git-send-email-ross.philipson@oracle.com>
Content-Type: text/plain
MIME-Version: 1.0
X-MS-Exchange-MessageSentRepresentingType: 1
Received: from lateralus.us.oracle.com (209.17.40.45) by SN6PR05CA0011.namprd05.prod.outlook.com (2603:10b6:805:de::24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4478.8 via Frontend Transport; Fri, 27 Aug 2021 13:20:53 +0000
X-MS-PublicTrafficType: Email
X-MS-Office365-Filtering-Correlation-Id: 9b763bbd-5f22-4c64-7701-08d9695d802b
X-MS-TrafficTypeDiagnostic: BYAPR10MB3237:
X-MS-Exchange-Transport-Forked: True
X-Microsoft-Antispam-PRVS: <BYAPR10MB323712B8F7541DF92F933B1EE6C89@BYAPR10MB3237.namprd10.prod.outlook.com>
X-MS-Oob-TLC-OOBClassifiers: OLM:7691;
X-MS-Exchange-SenderADCheck: 1
X-MS-Exchange-AntiSpam-Relay: 0
X-Microsoft-Antispam: BCL:0;
X-Microsoft-Antispam-Message-Info: KADy/+0lObOIhxu6H49w4+eeyBMiq8VxtVxsV/r/WgStdrFLJwEKMnuofY9Fb8Eea7Gmvf7wJXqiMV3siT2UIZVOBkgzlxf7NbjfzXKjZayWQsP0c3VOTBfJfxAr8x0z9OuQr4hxtjXIz+DdmNLexlCAr5CziYGnZbg5Gi0lr/nWH0IRiEzF9HN/s/PqC5ktwfxjF+PlUgTXBO/D9pdRVSlpboFnBPo2wXp08YbCDvX6WXaln9GyXOdWpLZQWBJnSsys9dO698o7j8M2JWrRgDAxM8jAbRzkHwT//ZWH2Q5/Azs2rHLlMEdLSq5j1BS21QdjLM1D5Jg8ikfldMi5AmWmrzIwB1lSqEiFwVx4f5FzueKnft7fQp//iDdOKMt2I8gjAzkfuu6V4h0r6Y5jYpderktQToMVNg4PlkG4x90hHHgWsHmt69riMRlG9YZZPcrh65REJLw7bojGgo/1pMW+N5FVSZgSlY3ibJGBiMM+hwjI6tYyJ0hq+76y2EKyJDuY1rhx0m/GSOd1ujFLG/PKnw/qBt/nGVhv7sW4Wv7TlGHd3bhl7wM2Pum6cw90EHjWJZjF0HKQ138EZxgJzGJC3dFnJwREqLZrlMaXavkKJu+8hKZiN68WeZD+vhAs0Dffc8P9ifC2YVscR02YHrSDnJrfK75n/NPpLFc6p8XsllOELdQhdqazNpmoqHS01NClA5wAgk9160UXkdJguQ==
X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:BY5PR10MB3793.namprd10.prod.outlook.com;PTR:;CAT:NONE;SFS:(136003)(39860400002)(366004)(346002)(376002)(396003)(956004)(44832011)(2616005)(2906002)(52116002)(26005)(7696005)(478600001)(38350700002)(38100700002)(6486002)(36756003)(186003)(83380400001)(6666004)(86362001)(8936002)(8676002)(316002)(66946007)(66556008)(4326008)(66476007)(7416002)(5660300002);DIR:OUT;SFP:1101;
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?PDlEbimDgYiBNAGNoW6Gr5mRh/Ex/9v8XflNEA2Tq9DWeRYZfq+/Y84N8tnY?=
 =?us-ascii?Q?9EYy/zGggdu8epPez0NDpQ48MrUKEqfMpGioCcHh9SrsGA14KQMsGmC6hLgm?=
 =?us-ascii?Q?DteykmBzF6pyTeYPTjO6GxW5Z1tktrzsQmacbweUiDeL3Dqoo2QrIC0tCGxX?=
 =?us-ascii?Q?nvB72HGuu8tXx5WJWiCWB705Auvd0L4yiIFWkVc1pfb5pmtKie1cB7k898Sv?=
 =?us-ascii?Q?pqXEgaBA3Bo2WwyHAyuyN7B1JzCp8APirIAGrEdN5mVzsE3ds+R+rv8+U2vo?=
 =?us-ascii?Q?zvT+MyxN0jFOquiMkKXNkSBGekoy5mYkx0FpRYLpVxUtTo8X8EUH5kKL3lLZ?=
 =?us-ascii?Q?5GqGYJuoHnshwzfcRXqupioR+7d08GCfeU29qvFw6jzolzNk3MQzVtSiSIiX?=
 =?us-ascii?Q?pf3buX5vAf95jKlgLW18iRXISuchoiv2nBzXgo1z8/MhGyuOu8tPCdK+nuGp?=
 =?us-ascii?Q?iemgQPNKr2R4QVcOExxOqeNpO/tRAgVKENL8y1a0oEdkr0I3RDvflPQztf1g?=
 =?us-ascii?Q?IRohW53TIW4FkWlEhT0Je43sMw7NQcNdmd91mIXToMoGPPBCfjhP2VYcjtKy?=
 =?us-ascii?Q?DlVTB+dp5PqV1XZZ5PRw5CR+o2ijC9nOpmlR7u5NPpDbgwOQu/9EWNsPtn+h?=
 =?us-ascii?Q?ojS5XBKQQ2zNx83FASH42SQs+GJOD9DEf7V64glie9skFsueTVKLad2Nd312?=
 =?us-ascii?Q?bDHu2F1gDqXtsfBQh8hQ/So/ENRga1fMuaZMWyYnpwsfR0idiiGB3do0wTnC?=
 =?us-ascii?Q?VEcajSRmrai9UL2BX83SzmrOCECFXgoMQzSWpSuWgqP6hQ3jn1V/+6oUa9/n?=
 =?us-ascii?Q?yUtj9Jk6Ea1obSzPGWAsNr0oW3ZRaQehqPumqO3/JFxou8gjoxjE4h5NSnCc?=
 =?us-ascii?Q?7JgTBFsW4bYyDldx3ugWVsD0xGQ0CpZ0kq1gTGYd5ECuPJQJziofDuhGdtQp?=
 =?us-ascii?Q?gOhOifC7RKfvhLgoCkEte5wxSOFv8R1oYEeEvmxWsu8PMrTpi/81gS3tTVF2?=
 =?us-ascii?Q?MPlW0cDF7QuxO0T2FAAmFb0hXK94SxduqMBW5Kir6DgVISSWkjhK8Dmcfjt4?=
 =?us-ascii?Q?KRRcnp5aotjOD8PmaaaohozS1iM13TQpDCJUZ6lO2xalaO9OyIQkK7BFNFaD?=
 =?us-ascii?Q?YLWk9kFKQq8fdFvjPzJwimKs/VFr6hVjPeINhNtu7e/yQMtQh/6MbVXUghUK?=
 =?us-ascii?Q?fYMCsgWlCtgjbtCR7rsWH62SzMZ50t05A3JW8FMx86xMnNO25LFJ+7OGCbIm?=
 =?us-ascii?Q?Ff8yUWiERWws6Kwq249/PGTl+OxmtBGOhxJUbdu2LapetCEokdz1Ti5yZ1o5?=
 =?us-ascii?Q?B8eor7b00ihQOH7Eqv31dRJP?=
X-OriginatorOrg: oracle.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 9b763bbd-5f22-4c64-7701-08d9695d802b
X-MS-Exchange-CrossTenant-AuthSource: BY5PR10MB3793.namprd10.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 27 Aug 2021 13:20:55.4641
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: yEW8RnwzChflC1br30dcnn3MZKQlkKSRfxaaF2NHO0MbxHDjvFtpj20oSw3yEQYHfE3q7pUYgJMxRp5LyW7vIuvvFPCJIJgrL2M7O0GQ9DY=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BYAPR10MB3237
X-Proofpoint-Virus-Version: vendor=nai engine=6300 definitions=10088 signatures=668682
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 spamscore=0 phishscore=0 malwarescore=0
 mlxscore=0 bulkscore=0 mlxlogscore=999 suspectscore=0 adultscore=0
 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2107140000
 definitions=main-2108270086
X-Proofpoint-GUID: hUd0dv83F_AmsnfDGA1yGWht2-UMLYbx
X-Proofpoint-ORIG-GUID: hUd0dv83F_AmsnfDGA1yGWht2-UMLYbx
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

Prior to running the next kernel via kexec, the Secure Launch code
closes down private SMX resources and does an SEXIT. This allows the
next kernel to start normally without any issues starting the APs etc.

Signed-off-by: Ross Philipson <ross.philipson@oracle.com>
---
 arch/x86/kernel/slaunch.c | 71 +++++++++++++++++++++++++++++++++++++++++++++++
 kernel/kexec_core.c       |  4 +++
 2 files changed, 75 insertions(+)

diff --git a/arch/x86/kernel/slaunch.c b/arch/x86/kernel/slaunch.c
index f91f0b5..60a193a 100644
--- a/arch/x86/kernel/slaunch.c
+++ b/arch/x86/kernel/slaunch.c
@@ -458,3 +458,74 @@ void __init slaunch_setup_txt(void)
 
 	pr_info("Intel TXT setup complete\n");
 }
+
+static inline void smx_getsec_sexit(void)
+{
+	asm volatile (".byte 0x0f,0x37\n"
+		      : : "a" (SMX_X86_GETSEC_SEXIT));
+}
+
+void slaunch_finalize(int do_sexit)
+{
+	void __iomem *config;
+	u64 one = TXT_REGVALUE_ONE, val;
+
+	if ((slaunch_get_flags() & (SL_FLAG_ACTIVE|SL_FLAG_ARCH_TXT)) !=
+	    (SL_FLAG_ACTIVE|SL_FLAG_ARCH_TXT))
+		return;
+
+	config = ioremap(TXT_PRIV_CONFIG_REGS_BASE, TXT_NR_CONFIG_PAGES *
+			 PAGE_SIZE);
+	if (!config) {
+		pr_emerg("Error SEXIT failed to ioremap TXT private reqs\n");
+		return;
+	}
+
+	/* Clear secrets bit for SEXIT */
+	memcpy_toio(config + TXT_CR_CMD_NO_SECRETS, &one, sizeof(one));
+	memcpy_fromio(&val, config + TXT_CR_E2STS, sizeof(val));
+
+	/* Unlock memory configurations */
+	memcpy_toio(config + TXT_CR_CMD_UNLOCK_MEM_CONFIG, &one, sizeof(one));
+	memcpy_fromio(&val, config + TXT_CR_E2STS, sizeof(val));
+
+	/* Close the TXT private register space */
+	memcpy_toio(config + TXT_CR_CMD_CLOSE_PRIVATE, &one, sizeof(one));
+	memcpy_fromio(&val, config + TXT_CR_E2STS, sizeof(val));
+
+	/*
+	 * Calls to iounmap are not being done because of the state of the
+	 * system this late in the kexec process. Local IRQs are disabled and
+	 * iounmap causes a TLB flush which in turn causes a warning. Leaving
+	 * thse mappings is not an issue since the next kernel is going to
+	 * completely re-setup memory management.
+	 */
+
+	/* Map public registers and do a final read fence */
+	config = ioremap(TXT_PUB_CONFIG_REGS_BASE, TXT_NR_CONFIG_PAGES *
+			 PAGE_SIZE);
+	if (!config) {
+		pr_emerg("Error SEXIT failed to ioremap TXT public reqs\n");
+		return;
+	}
+
+	memcpy_fromio(&val, config + TXT_CR_E2STS, sizeof(val));
+
+	pr_emerg("TXT clear secrets bit and unlock memory complete.");
+
+	if (!do_sexit)
+		return;
+
+	if (smp_processor_id() != 0) {
+		pr_emerg("Error TXT SEXIT must be called on CPU 0\n");
+		return;
+	}
+
+	/* Disable SMX mode */
+	cr4_set_bits(X86_CR4_SMXE);
+
+	/* Do the SEXIT SMX operation */
+	smx_getsec_sexit();
+
+	pr_emerg("TXT SEXIT complete.");
+}
diff --git a/kernel/kexec_core.c b/kernel/kexec_core.c
index 4b34a9a..fdf0a27 100644
--- a/kernel/kexec_core.c
+++ b/kernel/kexec_core.c
@@ -39,6 +39,7 @@
 #include <linux/hugetlb.h>
 #include <linux/objtool.h>
 #include <linux/kmsg_dump.h>
+#include <linux/slaunch.h>
 
 #include <asm/page.h>
 #include <asm/sections.h>
@@ -1179,6 +1180,9 @@ int kernel_kexec(void)
 		cpu_hotplug_enable();
 		pr_notice("Starting new kernel\n");
 		machine_shutdown();
+
+		/* Finalize TXT registers and do SEXIT */
+		slaunch_finalize(1);
 	}
 
 	kmsg_dump(KMSG_DUMP_SHUTDOWN);
-- 
1.8.3.1