Received: by 10.192.165.148 with SMTP id m20csp2212311imm; Thu, 26 Apr 2018 07:33:41 -0700 (PDT) X-Google-Smtp-Source: AIpwx48D3+/wdr5lF4h43+crIIkDXhgIG3+76s9kbvAWdpPmQO3a0cUiFombY/OLSWdehCQJEdSP X-Received: by 10.98.139.7 with SMTP id j7mr32634030pfe.28.1524753221811; Thu, 26 Apr 2018 07:33:41 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1524753221; cv=none; d=google.com; s=arc-20160816; b=JwdY4Ap0JkFTvVOlOHTU/WauxSvVjo39sPc/J0cjprWKXGWQUkjs12kCnhiSt8znPj opvUOIXSkcN4jrXECrpsSB00Datajj1QS4mb5BhkKgKH8ZQCkjX1aKtHxRUHGs7lyOoX VIWWvHlxgxsvUMIA8wnKcmnQ/yVGPAr+4w8kKmAUfW3nVZ9VC8NeMGIkssbo5LHapC+c DOBVtgi7bikXYjruveu96fmQCJfGl5t5BCvIPeiYYvMJ3hojkJUd9UZ0rzLVTMZLPRpm 5kPVFDRtFTMsn5BcZH0bE+1a3XrLPb+dWuCJcaxX5ZKcEBhkJf8zcTqf1JNyGyJiKb+m 6WOg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:references:in-reply-to:message-id:date :subject:cc:to:from:dkim-signature:dkim-signature :arc-authentication-results; bh=Vs6h/FXwmC/ZemDkg6BllSD/iPIPYBxFm6GunQ/1FCI=; b=un1eeHf4Oh57vT/JwKN/eBXTN7qDkomqJzneIIRjqCrKwhImOPlGNpSNH61hvhX1zO 6nAroV+dTOH0+RBa3Rf2KQWEZelvRpplkLFvJGkR3T6c3eH8sNh1ARibJX77uMJuddxV HYl3d1OO2a+u92QHs4Axnw4STq5SpJ1u7B3PqfqLd2iz3u7IF0Vv5ZtTdFFvGa59QWxN s8aH5zhwdGrKqTt38EsJRff0FBn8JyrdIneiAaeVqkYDwnomnanvgoDrOWIQyJ8OYlCg K1BLPHBjEduRN4n31VXd9iWnWdgGuiebdcSvCfc2oWMhnLepZO4Do/FOj6QKpiv/j2Xh lb0A== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@sent.com header.s=fm3 header.b=tbbKn+qf; dkim=pass header.i=@messagingengine.com header.s=fm2 header.b=TvaKzvrF; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=sent.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id bh5-v6si13357476plb.599.2018.04.26.07.33.27; Thu, 26 Apr 2018 07:33:41 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@sent.com header.s=fm3 header.b=tbbKn+qf; dkim=pass header.i=@messagingengine.com header.s=fm2 header.b=TvaKzvrF; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=sent.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1756665AbeDZOaC (ORCPT + 99 others); Thu, 26 Apr 2018 10:30:02 -0400 Received: from out2-smtp.messagingengine.com ([66.111.4.26]:45851 "EHLO out2-smtp.messagingengine.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1756600AbeDZO2x (ORCPT ); Thu, 26 Apr 2018 10:28:53 -0400 Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.nyi.internal (Postfix) with ESMTP id 7704121A99; Thu, 26 Apr 2018 10:28:52 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute3.internal (MEProxy); Thu, 26 Apr 2018 10:28:52 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sent.com; h=cc :date:from:in-reply-to:message-id:references:subject:to :x-me-sender:x-me-sender:x-sasl-enc; s=fm3; bh=Vs6h/FXwmC/ZemDkg 6BllSD/iPIPYBxFm6GunQ/1FCI=; b=tbbKn+qfrR6XErFy7CWHrU36RjD3gECJO Jh3COntEsySGV5tHBtcpR7nvugmfnECRoftz8QYpurkeBEArKAlWlgMc13y/5W7b k3uFSnbBSySvGvDfrA1pLMJmcdMKxD15MnYxfVqQPI/FCPqHLTEa7SEl/5RKdKIm hCgU2wvHniN7h+rwehdZyLfkUlmiUCw6PD0Q2tLVZ6CzSH+P43IOCsKdFDrepnL9 toAnA6Df5Flg7qkdQ3HT77ub252vbKdPQkE3rKgptwXZ/E+eDE6NwvcdVljmHPYi 5RfmKJiClVAucVxLTq1qTYvSOsCwlK1GeWweidi5LYXzRhU6RpPgg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:date:from:in-reply-to:message-id :references:subject:to:x-me-sender:x-me-sender:x-sasl-enc; s= fm2; bh=Vs6h/FXwmC/ZemDkg6BllSD/iPIPYBxFm6GunQ/1FCI=; b=TvaKzvrF kyPOnVvyvUdCmovli7HN8cONCHg2HIuNsDmflKAaJh/M4skEEVRslxbslLjs3c7x 6UmiMfoDaTdjHDuLhix/lQ5XPjvcpvE8aRJ0Kf9y7u9VeDxDUBk40TceNpAlr5eN IQZx8qGuX8pnl6h3QU2SikDCM6nqcMH54jucBPT/nLotkdx1/7kzLrFS47ayYTm6 yWi1BgqD+/VR/Kd/JdbW/3d/9qP+sAyLb/wPZ+EGMmmKyouZzifOPuwjqKvSRHiD AQf0oOMKh6pFreo/6yb2q2My7/9iX0rPFH9w7FU6+lNSugdy74AyRKvD+Z6TWjyj saZffdehosTHwA== X-ME-Sender: Received: from tenansix.rutgers.edu (pool-165-230-225-59.nat.rutgers.edu [165.230.225.59]) by mail.messagingengine.com (Postfix) with ESMTPA id BE27FE4120; Thu, 26 Apr 2018 10:28:51 -0400 (EDT) From: Zi Yan To: linux-mm@kvack.org, linux-kernel@vger.kernel.org Cc: Zi Yan , Vineet Gupta , linux-snps-arc@lists.infradead.org, Russell King , Christoffer Dall , Marc Zyngier , linux-arm-kernel@lists.infradead.org, Catalin Marinas , Will Deacon , Steve Capper , Kristina Martsenko , Dan Williams , Thomas Gleixner , Ingo Molnar , "Kirill A. Shutemov" , x86@kernel.org, Ralf Baechle , James Hogan , Michal Hocko , linux-mips@linux-mips.org, Benjamin Herrenschmidt , Paul Mackerras , Michael Ellerman , "Aneesh Kumar K.V" , Ram Pai , Balbir Singh , Naoya Horiguchi , linuxppc-dev@lists.ozlabs.org, Martin Schwidefsky , Heiko Carstens , Janosch Frank , linux-s390@vger.kernel.org, "David S. Miller" , sparclinux@vger.kernel.org, "Huang, Ying" Subject: [RFC PATCH 9/9] mm: migrate: enable thp migration for all possible architectures. Date: Thu, 26 Apr 2018 10:28:04 -0400 Message-Id: <20180426142804.180152-10-zi.yan@sent.com> X-Mailer: git-send-email 2.17.0 In-Reply-To: <20180426142804.180152-1-zi.yan@sent.com> References: <20180426142804.180152-1-zi.yan@sent.com> Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org From: Zi Yan Remove CONFIG_ARCH_ENABLE_THP_MIGRATION. thp migration is enabled along with transparent hugepage and can be toggled via /sys/kernel/mm/transparent_hugepage/enable_thp_migration. Signed-off-by: Zi Yan Cc: linux-mm@kvack.org Cc: Vineet Gupta Cc: linux-snps-arc@lists.infradead.org Cc: Russell King Cc: Christoffer Dall Cc: Marc Zyngier Cc: linux-arm-kernel@lists.infradead.org Cc: Catalin Marinas Cc: Will Deacon Cc: Steve Capper Cc: Kristina Martsenko Cc: Dan Williams Cc: Thomas Gleixner Cc: Ingo Molnar Cc: "Kirill A. Shutemov" Cc: x86@kernel.org Cc: Ralf Baechle Cc: James Hogan Cc: Michal Hocko Cc: linux-mips@linux-mips.org Cc: Benjamin Herrenschmidt Cc: Paul Mackerras Cc: Michael Ellerman Cc: "Aneesh Kumar K.V" Cc: Ram Pai Cc: Balbir Singh Cc: Naoya Horiguchi Cc: linuxppc-dev@lists.ozlabs.org Cc: Martin Schwidefsky Cc: Heiko Carstens Cc: Janosch Frank Cc: linux-s390@vger.kernel.org Cc: "David S. Miller" Cc: sparclinux@vger.kernel.org Cc: "Huang, Ying" --- arch/x86/Kconfig | 4 ---- arch/x86/include/asm/pgtable.h | 2 -- fs/proc/task_mmu.c | 2 -- include/asm-generic/pgtable.h | 21 ++------------------- include/linux/huge_mm.h | 9 ++++----- include/linux/swapops.h | 4 +--- mm/Kconfig | 3 --- mm/huge_memory.c | 27 ++++++++++++++++++--------- mm/migrate.c | 6 ++---- mm/rmap.c | 5 ++--- 10 files changed, 29 insertions(+), 54 deletions(-) diff --git a/arch/x86/Kconfig b/arch/x86/Kconfig index 0fa71a78ec99..e73954e3eef7 100644 --- a/arch/x86/Kconfig +++ b/arch/x86/Kconfig @@ -2423,10 +2423,6 @@ config ARCH_ENABLE_HUGEPAGE_MIGRATION def_bool y depends on X86_64 && HUGETLB_PAGE && MIGRATION -config ARCH_ENABLE_THP_MIGRATION - def_bool y - depends on X86_64 && TRANSPARENT_HUGEPAGE - menu "Power management and ACPI options" config ARCH_HIBERNATION_HEADER diff --git a/arch/x86/include/asm/pgtable.h b/arch/x86/include/asm/pgtable.h index b444d83cfc95..f9f54d9b39e3 100644 --- a/arch/x86/include/asm/pgtable.h +++ b/arch/x86/include/asm/pgtable.h @@ -1193,7 +1193,6 @@ static inline pte_t pte_swp_clear_soft_dirty(pte_t pte) return pte_clear_flags(pte, _PAGE_SWP_SOFT_DIRTY); } -#ifdef CONFIG_ARCH_ENABLE_THP_MIGRATION static inline pmd_t pmd_swp_mksoft_dirty(pmd_t pmd) { return pmd_set_flags(pmd, _PAGE_SWP_SOFT_DIRTY); @@ -1209,7 +1208,6 @@ static inline pmd_t pmd_swp_clear_soft_dirty(pmd_t pmd) return pmd_clear_flags(pmd, _PAGE_SWP_SOFT_DIRTY); } #endif -#endif #define PKRU_AD_BIT 0x1 #define PKRU_WD_BIT 0x2 diff --git a/fs/proc/task_mmu.c b/fs/proc/task_mmu.c index dd1b2aeb01e8..07a2f028d29a 100644 --- a/fs/proc/task_mmu.c +++ b/fs/proc/task_mmu.c @@ -1326,7 +1326,6 @@ static int pagemap_pmd_range(pmd_t *pmdp, unsigned long addr, unsigned long end, frame = pmd_pfn(pmd) + ((addr & ~PMD_MASK) >> PAGE_SHIFT); } -#ifdef CONFIG_ARCH_ENABLE_THP_MIGRATION else if (is_swap_pmd(pmd)) { swp_entry_t entry = pmd_to_swp_entry(pmd); unsigned long offset = swp_offset(entry); @@ -1340,7 +1339,6 @@ static int pagemap_pmd_range(pmd_t *pmdp, unsigned long addr, unsigned long end, VM_BUG_ON(!is_pmd_migration_entry(pmd)); page = migration_entry_to_page(entry); } -#endif if (page && page_mapcount(page) == 1) flags |= PM_MMAP_EXCLUSIVE; diff --git a/include/asm-generic/pgtable.h b/include/asm-generic/pgtable.h index f59639afaa39..9dacdd203131 100644 --- a/include/asm-generic/pgtable.h +++ b/include/asm-generic/pgtable.h @@ -674,24 +674,7 @@ static inline void ptep_modify_prot_commit(struct mm_struct *mm, #define arch_start_context_switch(prev) do {} while (0) #endif -#ifdef CONFIG_HAVE_ARCH_SOFT_DIRTY -#ifndef CONFIG_ARCH_ENABLE_THP_MIGRATION -static inline pmd_t pmd_swp_mksoft_dirty(pmd_t pmd) -{ - return pmd; -} - -static inline int pmd_swp_soft_dirty(pmd_t pmd) -{ - return 0; -} - -static inline pmd_t pmd_swp_clear_soft_dirty(pmd_t pmd) -{ - return pmd; -} -#endif -#else /* !CONFIG_HAVE_ARCH_SOFT_DIRTY */ +#ifndef CONFIG_HAVE_ARCH_SOFT_DIRTY static inline int pte_soft_dirty(pte_t pte) { return 0; @@ -946,7 +929,7 @@ static inline int pmd_none_or_trans_huge_or_clear_bad(pmd_t *pmd) * redundant with !pmd_present(). */ if (pmd_none(pmdval) || pmd_trans_huge(pmdval) || - (IS_ENABLED(CONFIG_ARCH_ENABLE_THP_MIGRATION) && !pmd_present(pmdval))) + (IS_ENABLED(CONFIG_TRANSPARENT_HUGEPAGE) && !pmd_present(pmdval))) return 1; if (unlikely(pmd_bad(pmdval))) { pmd_clear_bad(pmd); diff --git a/include/linux/huge_mm.h b/include/linux/huge_mm.h index a8a126259bc4..dc3144bdb7e5 100644 --- a/include/linux/huge_mm.h +++ b/include/linux/huge_mm.h @@ -59,6 +59,7 @@ enum transparent_hugepage_flag { TRANSPARENT_HUGEPAGE_DEFRAG_REQ_MADV_FLAG, TRANSPARENT_HUGEPAGE_DEFRAG_KHUGEPAGED_FLAG, TRANSPARENT_HUGEPAGE_USE_ZERO_PAGE_FLAG, + TRANSPARENT_HUGEPAGE_MIGRATION_FLAG, #ifdef CONFIG_DEBUG_VM TRANSPARENT_HUGEPAGE_DEBUG_COW_FLAG, #endif @@ -126,6 +127,9 @@ static inline bool transparent_hugepage_enabled(struct vm_area_struct *vma) #else /* CONFIG_DEBUG_VM */ #define transparent_hugepage_debug_cow() 0 #endif /* CONFIG_DEBUG_VM */ +#define thp_migration_supported() \ + (transparent_hugepage_flags & \ + (1<pmd); } -#endif diff --git a/mm/migrate.c b/mm/migrate.c index 507cf9ba21bf..cb9c3af32614 100644 --- a/mm/migrate.c +++ b/mm/migrate.c @@ -220,14 +220,12 @@ static bool remove_migration_pte(struct page *page, struct vm_area_struct *vma, new = page - pvmw.page->index + linear_page_index(vma, pvmw.address); -#ifdef CONFIG_ARCH_ENABLE_THP_MIGRATION /* PMD-mapped THP migration entry */ - if (!pvmw.pte) { + if (IS_ENABLED(CONFIG_TRANSPARENT_HUGEPAGE) && !pvmw.pte) { VM_BUG_ON_PAGE(PageHuge(page) || !PageTransCompound(page), page); remove_migration_pmd(&pvmw, new); continue; } -#endif get_page(new); pte = pte_mkold(mk_pte(new, READ_ONCE(vma->vm_page_prot))); @@ -353,7 +351,7 @@ void migration_entry_wait_huge(struct vm_area_struct *vma, __migration_entry_wait(mm, pte, ptl); } -#ifdef CONFIG_ARCH_ENABLE_THP_MIGRATION +#ifdef CONFIG_TRANSPARENT_HUGEPAGE void pmd_migration_entry_wait(struct mm_struct *mm, pmd_t *pmd) { spinlock_t *ptl; diff --git a/mm/rmap.c b/mm/rmap.c index 8d5337fed37b..f5434f4f3e06 100644 --- a/mm/rmap.c +++ b/mm/rmap.c @@ -1369,15 +1369,14 @@ static bool try_to_unmap_one(struct page *page, struct vm_area_struct *vma, mmu_notifier_invalidate_range_start(vma->vm_mm, start, end); while (page_vma_mapped_walk(&pvmw)) { -#ifdef CONFIG_ARCH_ENABLE_THP_MIGRATION /* PMD-mapped THP migration entry */ - if (!pvmw.pte && (flags & TTU_MIGRATION)) { + if (IS_ENABLED(CONFIG_TRANSPARENT_HUGEPAGE) && + !pvmw.pte && (flags & TTU_MIGRATION)) { VM_BUG_ON_PAGE(PageHuge(page) || !PageTransCompound(page), page); set_pmd_migration_entry(&pvmw, page); continue; } -#endif /* * If the page is mlock()d, we cannot swap it out. -- 2.17.0