Received: by 2002:a05:6a10:8c0a:0:0:0:0 with SMTP id go10csp608236pxb; Wed, 27 Jan 2021 16:36:44 -0800 (PST) X-Google-Smtp-Source: ABdhPJyX+k1T15AI5RAnZm69bFVlYog6Ab9TBvO81QRnBPhtdrBtEMERWtXS6IxWa0VmoHrzeVse X-Received: by 2002:a17:906:2407:: with SMTP id z7mr8838144eja.219.1611794204624; Wed, 27 Jan 2021 16:36:44 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1611794204; cv=none; d=google.com; s=arc-20160816; b=OmvDR8rn6Y1Iq05fzzbJy+SyGcV4pKqkREbFipL/K8dRoYH7/OqZJFdOSx/XH2nYQX 18gflWZBZftsz6OnjIs3/tgAzTHcI9jAAi04m6iF0qk42gOC7sEjSRW1ImCm6E6vCYZZ LYsjZ1agRq3V0hP+pb5JhH6ZGJhd3uoI6Y8GcXGGwc4p7mjpe5gAh7SbWfouuBCO+A3X 0Hm40YME1oXuIDwkpNdMjog2u0h6DKwRMe13YbMBa8yCVHv/i1HHShrOA5jJvDqZAC3/ jykQ1RRC2DOOLbi0faTzp88oxWt/T+17CTsgmfsPXnoZ50aP/fYUnAwMus63l3FHfpsM 9XtA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from :ironport-sdr:ironport-sdr; bh=bxiutzrtjfq6SPnwIWXYimf0q1A9D87cnrv/P9SzROc=; b=PP7+Yq76Lenld8mebrTL9nJGyexsIhfXZfWxsWMo26I9VsBXZEEhjaxJn9wTlJf6UM pmZQowO2WYyjWsyoQcjb3raocZJF+tfodfzl2h7qkpfGnzlZlYaTEMUNluo7ebIUWtT4 y0S9P5J6uw6m3kDYYcBKq3F4ugidUpoRgLiKYDVcdm51naGxk8y60gIIhXREJqpae2vn ZAUoCLn12M1yVujLEtDSr1RG/KnBvq3EDPX0LzclVrFv8FQk72J0NIjgK8FTNOSLhCoy NmexLB2Qol88DRWmSOGbnV+wpaiShphnztHBLTBkze47iMyU5EMOIKnqpuiqfNj259AD 2HmQ== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id t12si1871643edc.228.2021.01.27.16.36.20; Wed, 27 Jan 2021 16:36:44 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232770AbhA0V3v (ORCPT + 99 others); Wed, 27 Jan 2021 16:29:51 -0500 Received: from mga04.intel.com ([192.55.52.120]:48891 "EHLO mga04.intel.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1344285AbhA0V12 (ORCPT ); Wed, 27 Jan 2021 16:27:28 -0500 IronPort-SDR: U1XKW2Lw1qg8k+hyU8TmEsHJSQ80vM7PMEXsurp0Povk+jgmkxoQUrxevKHHN2TOgTDp2nWRSu 64nJ5+4uEwaA== X-IronPort-AV: E=McAfee;i="6000,8403,9877"; a="177573134" X-IronPort-AV: E=Sophos;i="5.79,380,1602572400"; d="scan'208";a="177573134" Received: from orsmga003.jf.intel.com ([10.7.209.27]) by fmsmga104.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 27 Jan 2021 13:25:55 -0800 IronPort-SDR: 7OfuPe+bJU/EVaAYje34Mx5S9LUx0D2bvw1RtAkApRtxVet1nWOztObpgs+URWSghNHj9+n4ue /V4uDKO2LqJQ== X-IronPort-AV: E=Sophos;i="5.79,380,1602572400"; d="scan'208";a="353948225" Received: from yyu32-desk.sc.intel.com ([143.183.136.146]) by orsmga003-auth.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 27 Jan 2021 13:25:55 -0800 From: Yu-cheng Yu To: x86@kernel.org, "H. Peter Anvin" , Thomas Gleixner , Ingo Molnar , linux-kernel@vger.kernel.org, linux-doc@vger.kernel.org, linux-mm@kvack.org, linux-arch@vger.kernel.org, linux-api@vger.kernel.org, Arnd Bergmann , Andy Lutomirski , Balbir Singh , Borislav Petkov , Cyrill Gorcunov , Dave Hansen , Eugene Syromiatnikov , Florian Weimer , "H.J. Lu" , Jann Horn , Jonathan Corbet , Kees Cook , Mike Kravetz , Nadav Amit , Oleg Nesterov , Pavel Machek , Peter Zijlstra , Randy Dunlap , "Ravi V. Shankar" , Vedvyas Shanbhogue , Dave Martin , Weijiang Yang , Pengfei Xu Cc: Yu-cheng Yu Subject: [PATCH v18 12/25] mm: Introduce VM_SHSTK for shadow stack memory Date: Wed, 27 Jan 2021 13:25:11 -0800 Message-Id: <20210127212524.10188-13-yu-cheng.yu@intel.com> X-Mailer: git-send-email 2.21.0 In-Reply-To: <20210127212524.10188-1-yu-cheng.yu@intel.com> References: <20210127212524.10188-1-yu-cheng.yu@intel.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org A shadow stack PTE must be read-only and have _PAGE_DIRTY set. However, read-only and Dirty PTEs also exist for copy-on-write (COW) pages. These two cases are handled differently for page faults. Introduce VM_SHSTK to track shadow stack VMAs. Signed-off-by: Yu-cheng Yu Reviewed-by: Kees Cook --- arch/x86/mm/mmap.c | 2 ++ fs/proc/task_mmu.c | 3 +++ include/linux/mm.h | 8 ++++++++ 3 files changed, 13 insertions(+) diff --git a/arch/x86/mm/mmap.c b/arch/x86/mm/mmap.c index c90c20904a60..a22c6b6fc607 100644 --- a/arch/x86/mm/mmap.c +++ b/arch/x86/mm/mmap.c @@ -165,6 +165,8 @@ unsigned long get_mmap_base(int is_legacy) const char *arch_vma_name(struct vm_area_struct *vma) { + if (vma->vm_flags & VM_SHSTK) + return "[shadow stack]"; return NULL; } diff --git a/fs/proc/task_mmu.c b/fs/proc/task_mmu.c index 602e3a52884d..59623dcd92bb 100644 --- a/fs/proc/task_mmu.c +++ b/fs/proc/task_mmu.c @@ -661,6 +661,9 @@ static void show_smap_vma_flags(struct seq_file *m, struct vm_area_struct *vma) [ilog2(VM_PKEY_BIT4)] = "", #endif #endif /* CONFIG_ARCH_HAS_PKEYS */ +#ifdef CONFIG_X86_CET + [ilog2(VM_SHSTK)] = "ss", +#endif }; size_t i; diff --git a/include/linux/mm.h b/include/linux/mm.h index ecdf8a8cd6ae..7be5f8b874aa 100644 --- a/include/linux/mm.h +++ b/include/linux/mm.h @@ -312,11 +312,13 @@ extern unsigned int kobjsize(const void *objp); #define VM_HIGH_ARCH_BIT_2 34 /* bit only usable on 64-bit architectures */ #define VM_HIGH_ARCH_BIT_3 35 /* bit only usable on 64-bit architectures */ #define VM_HIGH_ARCH_BIT_4 36 /* bit only usable on 64-bit architectures */ +#define VM_HIGH_ARCH_BIT_5 37 /* bit only usable on 64-bit architectures */ #define VM_HIGH_ARCH_0 BIT(VM_HIGH_ARCH_BIT_0) #define VM_HIGH_ARCH_1 BIT(VM_HIGH_ARCH_BIT_1) #define VM_HIGH_ARCH_2 BIT(VM_HIGH_ARCH_BIT_2) #define VM_HIGH_ARCH_3 BIT(VM_HIGH_ARCH_BIT_3) #define VM_HIGH_ARCH_4 BIT(VM_HIGH_ARCH_BIT_4) +#define VM_HIGH_ARCH_5 BIT(VM_HIGH_ARCH_BIT_5) #endif /* CONFIG_ARCH_USES_HIGH_VMA_FLAGS */ #ifdef CONFIG_ARCH_HAS_PKEYS @@ -332,6 +334,12 @@ extern unsigned int kobjsize(const void *objp); #endif #endif /* CONFIG_ARCH_HAS_PKEYS */ +#ifdef CONFIG_X86_CET +# define VM_SHSTK VM_HIGH_ARCH_5 +#else +# define VM_SHSTK VM_NONE +#endif + #if defined(CONFIG_X86) # define VM_PAT VM_ARCH_1 /* PAT reserves whole VMA at once (x86) */ #elif defined(CONFIG_PPC) -- 2.21.0