Received: by 2002:a05:6a10:9848:0:0:0:0 with SMTP id x8csp837183pxf; Thu, 1 Apr 2021 15:13:14 -0700 (PDT) X-Google-Smtp-Source: ABdhPJyCL2xKMqvOi0yEgot0wiFpVIcym9oZn5mh5lbNTGPJYE4UNdkjjvSzGoZNearyTWVrL6vq X-Received: by 2002:a05:6402:1a4f:: with SMTP id bf15mr12296929edb.304.1617315194187; Thu, 01 Apr 2021 15:13:14 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1617315194; cv=none; d=google.com; s=arc-20160816; b=IMXBl8bakb33Dbf+j1QNR6DfbGXkjhVCpN/f8ZW+TuKnNayr4CcuN2dxmXUIlcombg kaNUpLq1R8sLTvVdAA0fRjM5HAuNiwqfMKeAfagpzwMK2g84MBi7HH0b8z5a86g5AxtN xk7ajRyV/7zoWAKJaqVnX4Xih+auctlTuAFcVHiX91zZnZPRUYJxDv9rBJ72he6gAVhD mqfwALUphdnO48f+U2dtAQSCAm3sxVZB62GNG980+BieJgtjkANj6RnF+WXadg+6m4Jt OOZuMsGPa8aRC/gQwL50fXRPV5kIMYonpl7R9maM56Tg7WyJf0KWWuPGHUzKX7GHHTji ehzA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from :ironport-sdr:ironport-sdr; bh=1H9i9lTn289BVJkLjr7s+QDj01No00PJUdO+RoZkLi0=; b=0jT2U4xSCui1QxVaZz+bpncPTGrODNPVY9PjSQ1WNYzZ/Z3Z0FcmUA51MKITb+JjkA DYAPiIkB+IvgMDpSzEkxveDPuxKTZmJNDN7m05fyzBC0YM7otsJLZZ9qyf2EcZTJLnTv +TnR+6UQGGznVXY2+bQXWisnxMwm6YSznnt94eYifwIqt25QCFYDmYItL38nbVVsas6W ErPI+3d+8iVA/doDzGJXATjROb7e18lmRnBPhHUXW5EiO8Sj/KHF8EXTSUcoqkizIXMS eOfxZqctnb4aB8H+LsaksmmThDDF1erfAv3Ox3qTdGnGzHiSgvtA+uX1KK/MrGtrETOH pj4A== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id j19si4994769ejs.516.2021.04.01.15.12.51; Thu, 01 Apr 2021 15:13:14 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S234548AbhDAWMF (ORCPT + 99 others); Thu, 1 Apr 2021 18:12:05 -0400 Received: from mga11.intel.com ([192.55.52.93]:34674 "EHLO mga11.intel.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S234719AbhDAWLd (ORCPT ); Thu, 1 Apr 2021 18:11:33 -0400 IronPort-SDR: LS2sTBB8c8BQokEEb2XP0+MU1SEq7jyrEXT0uZYBUx8Tq6DAFvLe3iof6jQWHclUu2Z1RKhdJo oYYEFJD+/IpQ== X-IronPort-AV: E=McAfee;i="6000,8403,9941"; a="189084563" X-IronPort-AV: E=Sophos;i="5.81,296,1610438400"; d="scan'208";a="189084563" Received: from fmsmga001.fm.intel.com ([10.253.24.23]) by fmsmga102.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 01 Apr 2021 15:11:23 -0700 IronPort-SDR: 01ZLiSSK9pHOWotGnhwjUpG1WlhFXMcoOyniXoZfLseCkjifVT0hGt1nt7abI1BfaWNNUvp7BW uspdFrJ/IIfA== X-IronPort-AV: E=Sophos;i="5.81,296,1610438400"; d="scan'208";a="517513903" Received: from yyu32-desk.sc.intel.com ([143.183.136.146]) by fmsmga001-auth.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 01 Apr 2021 15:11:23 -0700 From: Yu-cheng Yu To: x86@kernel.org, "H. Peter Anvin" , Thomas Gleixner , Ingo Molnar , linux-kernel@vger.kernel.org, linux-doc@vger.kernel.org, linux-mm@kvack.org, linux-arch@vger.kernel.org, linux-api@vger.kernel.org, Arnd Bergmann , Andy Lutomirski , Balbir Singh , Borislav Petkov , Cyrill Gorcunov , Dave Hansen , Eugene Syromiatnikov , Florian Weimer , "H.J. Lu" , Jann Horn , Jonathan Corbet , Kees Cook , Mike Kravetz , Nadav Amit , Oleg Nesterov , Pavel Machek , Peter Zijlstra , Randy Dunlap , "Ravi V. Shankar" , Vedvyas Shanbhogue , Dave Martin , Weijiang Yang , Pengfei Xu , Haitao Huang Cc: Yu-cheng Yu , "Kirill A . Shutemov" Subject: [PATCH v24 13/30] mm: Introduce VM_SHADOW_STACK for shadow stack memory Date: Thu, 1 Apr 2021 15:10:47 -0700 Message-Id: <20210401221104.31584-14-yu-cheng.yu@intel.com> X-Mailer: git-send-email 2.21.0 In-Reply-To: <20210401221104.31584-1-yu-cheng.yu@intel.com> References: <20210401221104.31584-1-yu-cheng.yu@intel.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org A shadow stack PTE must be read-only and have _PAGE_DIRTY set. However, read-only and Dirty PTEs also exist for copy-on-write (COW) pages. These two cases are handled differently for page faults. Introduce VM_SHADOW_STACK to track shadow stack VMAs. Signed-off-by: Yu-cheng Yu Cc: Kees Cook Cc: Kirill A. Shutemov --- v24: - Change VM_SHSTK to VM_SHADOW_STACK. - Change CONFIG_X86_CET to CONFIG_X86_SHADOW_STACK to reflect Kconfig changes. Documentation/filesystems/proc.rst | 1 + arch/x86/mm/mmap.c | 2 ++ fs/proc/task_mmu.c | 3 +++ include/linux/mm.h | 8 ++++++++ 4 files changed, 14 insertions(+) diff --git a/Documentation/filesystems/proc.rst b/Documentation/filesystems/proc.rst index 48fbfc336ebf..5d8a2d75c799 100644 --- a/Documentation/filesystems/proc.rst +++ b/Documentation/filesystems/proc.rst @@ -549,6 +549,7 @@ encoded manner. The codes are the following: mg mergable advise flag bt arm64 BTI guarded page mt arm64 MTE allocation tags are enabled + ss shadow stack page == ======================================= Note that there is no guarantee that every flag and associated mnemonic will diff --git a/arch/x86/mm/mmap.c b/arch/x86/mm/mmap.c index c90c20904a60..f3f52c5e2fd6 100644 --- a/arch/x86/mm/mmap.c +++ b/arch/x86/mm/mmap.c @@ -165,6 +165,8 @@ unsigned long get_mmap_base(int is_legacy) const char *arch_vma_name(struct vm_area_struct *vma) { + if (vma->vm_flags & VM_SHADOW_STACK) + return "[shadow stack]"; return NULL; } diff --git a/fs/proc/task_mmu.c b/fs/proc/task_mmu.c index e862cab69583..0aa57de9dfab 100644 --- a/fs/proc/task_mmu.c +++ b/fs/proc/task_mmu.c @@ -661,6 +661,9 @@ static void show_smap_vma_flags(struct seq_file *m, struct vm_area_struct *vma) [ilog2(VM_PKEY_BIT4)] = "", #endif #endif /* CONFIG_ARCH_HAS_PKEYS */ +#ifdef CONFIG_ARCH_HAS_SHADOW_STACK + [ilog2(VM_SHADOW_STACK)]= "ss", +#endif }; size_t i; diff --git a/include/linux/mm.h b/include/linux/mm.h index 8ba434287387..08282eb2f195 100644 --- a/include/linux/mm.h +++ b/include/linux/mm.h @@ -312,11 +312,13 @@ extern unsigned int kobjsize(const void *objp); #define VM_HIGH_ARCH_BIT_2 34 /* bit only usable on 64-bit architectures */ #define VM_HIGH_ARCH_BIT_3 35 /* bit only usable on 64-bit architectures */ #define VM_HIGH_ARCH_BIT_4 36 /* bit only usable on 64-bit architectures */ +#define VM_HIGH_ARCH_BIT_5 37 /* bit only usable on 64-bit architectures */ #define VM_HIGH_ARCH_0 BIT(VM_HIGH_ARCH_BIT_0) #define VM_HIGH_ARCH_1 BIT(VM_HIGH_ARCH_BIT_1) #define VM_HIGH_ARCH_2 BIT(VM_HIGH_ARCH_BIT_2) #define VM_HIGH_ARCH_3 BIT(VM_HIGH_ARCH_BIT_3) #define VM_HIGH_ARCH_4 BIT(VM_HIGH_ARCH_BIT_4) +#define VM_HIGH_ARCH_5 BIT(VM_HIGH_ARCH_BIT_5) #endif /* CONFIG_ARCH_USES_HIGH_VMA_FLAGS */ #ifdef CONFIG_ARCH_HAS_PKEYS @@ -332,6 +334,12 @@ extern unsigned int kobjsize(const void *objp); #endif #endif /* CONFIG_ARCH_HAS_PKEYS */ +#ifdef CONFIG_X86_SHADOW_STACK +# define VM_SHADOW_STACK VM_HIGH_ARCH_5 +#else +# define VM_SHADOW_STACK VM_NONE +#endif + #if defined(CONFIG_X86) # define VM_PAT VM_ARCH_1 /* PAT reserves whole VMA at once (x86) */ #elif defined(CONFIG_PPC) -- 2.21.0