Received: by 2002:a05:6a10:206:0:0:0:0 with SMTP id 6csp1465272pxj; Fri, 21 May 2021 15:16:10 -0700 (PDT) X-Google-Smtp-Source: ABdhPJwicA80NlzH2qSfHqcBWHt0C/rA+75YGxUdLCg/Lb3EGkMSzBWTXWheivm9ficOtq+GkD3U X-Received: by 2002:a17:906:5049:: with SMTP id e9mr11986159ejk.30.1621635370205; Fri, 21 May 2021 15:16:10 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1621635370; cv=none; d=google.com; s=arc-20160816; b=vG7R/lQYYxACkJuNA1JQ9sXCDrBe2mkjSEcgPw1FNpO9rmhOo2aqSEj7xJ8xvAV9nR 04dPGMlc2rx92rH8bWQ52wBM2FxfST84RI2VHepi4fVrSiSO+ooacVoCXXAv4haQImIG hvVxBObSfv/6r5atJGQvuEjlKiNXPBgoy38QGt+bVrmVbvnY/gOS86qgLp3lPkxoOSeX sR8C5x/TB4xDZOfbh45TaRESeqv7KdTIQvQ+Sfqpnc2fMT1RVQOA1nbn0rYn70Zcy4nG C6wPmztfkUk3BTeIOnn9rEZY+yiiAp1erxDjKpqydfVKrRMWHhCvH53gmtYwP5KV9ag/ 544Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from :ironport-sdr:ironport-sdr; bh=mu9T6P3dfYs685WhwVFeX1GTue4q/agmwjW3f04S9o0=; b=SRrP7zrHK6yz4YlECQ7OucyZ1GYGL8faHMXNXfP3m7fqW39vNnxFl0sZl3HEyiycvy WWsLG00Qha/NJuykjNuB6+7Ad4f7aFaNJSPcH4Y7UPBwJU4EhTFsXKBucfcYb88xDdsr 0bVt3tOgw7gYho6Wgn0hBr20EKN5+CVyLETSPd33t/hvP7c70vJSI96q3KMZ7siDtX87 3YXery/eUr6GSiTQuGsPjpyDZcoq6XXiriCyNcDMk60Ek4fs80VEr75DRpMUJ2RxBDA3 YuBUEWK1MP74XDorRaaQXSx0SIPTe0Oiamk9mgu2meQ7J/7gMFXA4jyqc/y0xiqrGjxn Rzzg== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id q18si7701635edi.189.2021.05.21.15.15.47; Fri, 21 May 2021 15:16:10 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229535AbhEUWPl (ORCPT + 99 others); Fri, 21 May 2021 18:15:41 -0400 Received: from mga17.intel.com ([192.55.52.151]:65511 "EHLO mga17.intel.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230157AbhEUWOs (ORCPT ); Fri, 21 May 2021 18:14:48 -0400 IronPort-SDR: 6LLD6R7fsAYbwD2rThIPsLl9Mu7T60kSswPS4IwYjCC4C5x3EJPgtbTYtbRrg5VQ8NfL2GrGGN 0cb/DvMiGeNw== X-IronPort-AV: E=McAfee;i="6200,9189,9991"; a="181874418" X-IronPort-AV: E=Sophos;i="5.82,319,1613462400"; d="scan'208";a="181874418" Received: from orsmga008.jf.intel.com ([10.7.209.65]) by fmsmga107.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 21 May 2021 15:13:13 -0700 IronPort-SDR: 4kIU/Z6SUTfJoFsYD9FZ7ztdevkfSd+KRmZSGFHnxal9OpoOQfNQu+os5kdP+6N19NuYfCNZw2 flI/NUfIyZ7A== X-IronPort-AV: E=Sophos;i="5.82,319,1613462400"; d="scan'208";a="441116177" Received: from yyu32-desk.sc.intel.com ([143.183.136.146]) by orsmga008-auth.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 21 May 2021 15:13:13 -0700 From: Yu-cheng Yu To: x86@kernel.org, "H. Peter Anvin" , Thomas Gleixner , Ingo Molnar , linux-kernel@vger.kernel.org, linux-doc@vger.kernel.org, linux-mm@kvack.org, linux-arch@vger.kernel.org, linux-api@vger.kernel.org, Arnd Bergmann , Andy Lutomirski , Balbir Singh , Borislav Petkov , Cyrill Gorcunov , Dave Hansen , Eugene Syromiatnikov , Florian Weimer , "H.J. Lu" , Jann Horn , Jonathan Corbet , Kees Cook , Mike Kravetz , Nadav Amit , Oleg Nesterov , Pavel Machek , Peter Zijlstra , Randy Dunlap , "Ravi V. Shankar" , Vedvyas Shanbhogue , Dave Martin , Weijiang Yang , Pengfei Xu , Haitao Huang Cc: Yu-cheng Yu , "Kirill A . Shutemov" Subject: [PATCH v27 14/31] mm: Introduce VM_SHADOW_STACK for shadow stack memory Date: Fri, 21 May 2021 15:11:54 -0700 Message-Id: <20210521221211.29077-15-yu-cheng.yu@intel.com> X-Mailer: git-send-email 2.21.0 In-Reply-To: <20210521221211.29077-1-yu-cheng.yu@intel.com> References: <20210521221211.29077-1-yu-cheng.yu@intel.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org A shadow stack PTE must be read-only and have _PAGE_DIRTY set. However, read-only and Dirty PTEs also exist for copy-on-write (COW) pages. These two cases are handled differently for page faults. Introduce VM_SHADOW_STACK to track shadow stack VMAs. Signed-off-by: Yu-cheng Yu Reviewed-by: Kirill A. Shutemov Cc: Kees Cook --- Documentation/filesystems/proc.rst | 1 + arch/x86/mm/mmap.c | 2 ++ fs/proc/task_mmu.c | 3 +++ include/linux/mm.h | 8 ++++++++ 4 files changed, 14 insertions(+) diff --git a/Documentation/filesystems/proc.rst b/Documentation/filesystems/proc.rst index 81bfe3c800cc..46e3ab2da9c6 100644 --- a/Documentation/filesystems/proc.rst +++ b/Documentation/filesystems/proc.rst @@ -553,6 +553,7 @@ encoded manner. The codes are the following: mt arm64 MTE allocation tags are enabled um userfaultfd missing tracking uw userfaultfd wr-protect tracking + ss shadow stack page == ======================================= Note that there is no guarantee that every flag and associated mnemonic will diff --git a/arch/x86/mm/mmap.c b/arch/x86/mm/mmap.c index c90c20904a60..f3f52c5e2fd6 100644 --- a/arch/x86/mm/mmap.c +++ b/arch/x86/mm/mmap.c @@ -165,6 +165,8 @@ unsigned long get_mmap_base(int is_legacy) const char *arch_vma_name(struct vm_area_struct *vma) { + if (vma->vm_flags & VM_SHADOW_STACK) + return "[shadow stack]"; return NULL; } diff --git a/fs/proc/task_mmu.c b/fs/proc/task_mmu.c index fc9784544b24..4f9f6e188be9 100644 --- a/fs/proc/task_mmu.c +++ b/fs/proc/task_mmu.c @@ -664,6 +664,9 @@ static void show_smap_vma_flags(struct seq_file *m, struct vm_area_struct *vma) #ifdef CONFIG_HAVE_ARCH_USERFAULTFD_MINOR [ilog2(VM_UFFD_MINOR)] = "ui", #endif /* CONFIG_HAVE_ARCH_USERFAULTFD_MINOR */ +#ifdef CONFIG_ARCH_HAS_SHADOW_STACK + [ilog2(VM_SHADOW_STACK)]= "ss", +#endif }; size_t i; diff --git a/include/linux/mm.h b/include/linux/mm.h index 923f89b9f1b5..587f7399847b 100644 --- a/include/linux/mm.h +++ b/include/linux/mm.h @@ -322,11 +322,13 @@ extern unsigned int kobjsize(const void *objp); #define VM_HIGH_ARCH_BIT_2 34 /* bit only usable on 64-bit architectures */ #define VM_HIGH_ARCH_BIT_3 35 /* bit only usable on 64-bit architectures */ #define VM_HIGH_ARCH_BIT_4 36 /* bit only usable on 64-bit architectures */ +#define VM_HIGH_ARCH_BIT_5 37 /* bit only usable on 64-bit architectures */ #define VM_HIGH_ARCH_0 BIT(VM_HIGH_ARCH_BIT_0) #define VM_HIGH_ARCH_1 BIT(VM_HIGH_ARCH_BIT_1) #define VM_HIGH_ARCH_2 BIT(VM_HIGH_ARCH_BIT_2) #define VM_HIGH_ARCH_3 BIT(VM_HIGH_ARCH_BIT_3) #define VM_HIGH_ARCH_4 BIT(VM_HIGH_ARCH_BIT_4) +#define VM_HIGH_ARCH_5 BIT(VM_HIGH_ARCH_BIT_5) #endif /* CONFIG_ARCH_USES_HIGH_VMA_FLAGS */ #ifdef CONFIG_ARCH_HAS_PKEYS @@ -342,6 +344,12 @@ extern unsigned int kobjsize(const void *objp); #endif #endif /* CONFIG_ARCH_HAS_PKEYS */ +#ifdef CONFIG_X86_SHADOW_STACK +# define VM_SHADOW_STACK VM_HIGH_ARCH_5 +#else +# define VM_SHADOW_STACK VM_NONE +#endif + #if defined(CONFIG_X86) # define VM_PAT VM_ARCH_1 /* PAT reserves whole VMA at once (x86) */ #elif defined(CONFIG_PPC) -- 2.21.0