Received: by 2002:ac0:a594:0:0:0:0:0 with SMTP id m20-v6csp437787imm; Mon, 21 May 2018 08:24:35 -0700 (PDT) X-Google-Smtp-Source: AB8JxZorMrc8VVAneRJbvHUGxDSPpoDmebKlC4q6K0TiYtIZAJnV6enbashHpJ8pt2jrNbYPwdz9 X-Received: by 2002:a17:902:6b09:: with SMTP id o9-v6mr21419283plk.256.1526916275163; Mon, 21 May 2018 08:24:35 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1526916275; cv=none; d=google.com; s=arc-20160816; b=bB86jBNGqmdMYYtzjYZyfVFuW1PtwPSpq/JPoBSoVaNM6AQaOYY4vBIjdyKZdGpKAi dYHVuCyZmKCqtE3JE427Ta4/wXXLIGZG2riXoR1EIFV8L3hEyjg5jwedAz4bLd8K7nOP PY61/Tq65ti1fwSNGav2qSnc4EHm5MpPDUy80DLkTqx6W3NHrsQy+PYdrZShvb3+fH/h RiuGwSRk96wnviBpZMuyYdg7jhGLADTZMNJM4dn0hddKcop4A6wAjCbiSJ1a3ACVNgyR qhtjRciDDZfOZ810fx0BHVn1zFrgzuZ6mM1v/MJqH+SP5R0ng73W5tM/HkTPZbbNReBs mQow== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:references:in-reply-to:message-id:date :subject:cc:to:from:dkim-signature:arc-authentication-results; bh=EIMhtX0QxMyxblxuQCMiltxD9z6VtPX8+7ssCjNHexA=; b=rTbwtawNhl5x2kNlsqCi4CEQbJUgxOOogGHp9V4jNw19lGWmUR8RDDu3gvvt4kpdT6 2K0j6yauzaAd3CIN/Re+anShcx0Fi3O4enzceRvOoWQMtLCxwHtj8XxBRLlTSrcwd7JK uHk6MA4S+RYCD9bOFcKxXDUZH4UIoUjbnbVP35cC9i8rzqg7oscEyIvqygQzLo/akUbL rexgmCXIpaVe6hphb7lmq5mUUS28hFt8ImUSwZ/6o+iphoPUATQF2reuUbkYc9XfEr4Y Q8PssU3VVpxjj8LY+FcpqispJFNcZQ8DqKNGUn4LZdW3uAfaYmXpOIT9+rEVSv3oOCLj E4/w== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=tnHNXQSi; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id i33-v6si14105955pld.546.2018.05.21.08.24.20; Mon, 21 May 2018 08:24:35 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=tnHNXQSi; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1753190AbeEUPUx (ORCPT + 99 others); Mon, 21 May 2018 11:20:53 -0400 Received: from mail-pl0-f68.google.com ([209.85.160.68]:39091 "EHLO mail-pl0-f68.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752701AbeEUPUr (ORCPT ); Mon, 21 May 2018 11:20:47 -0400 Received: by mail-pl0-f68.google.com with SMTP id c19-v6so9004759pls.6; Mon, 21 May 2018 08:20:46 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references; bh=EIMhtX0QxMyxblxuQCMiltxD9z6VtPX8+7ssCjNHexA=; b=tnHNXQSijmQjuS/J7ju3FabsVeoA7eJ7SO3gdgDolmJTpBzkhIRDKtGz5EWGtYIsje 3zSJwbwN4eMuIDiDn5ubZJzsLFdv8efVOekp+a4m6/P3+PpSEzNSEnIn4XjhPs280gG0 ziOyMT7HP0tIjugbLrBDSaKIhe2w6tdVa6CXfdEzLG1+xOMQGB841Crt9SbPVXPw0Y8t 3lH35T1LDdokLtBjMoF7dc/JfGApbSiIYIQBlAvy4pJ2CDMs/HZkOzrL91PdTwr6E8Ly zUs0NVWivgHhwrE3R71zlnI+gyTAQGL9CLq8xRy2YDDXvifjCGaJNSwuSg0Eu2Wjnf5d vw0g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references; bh=EIMhtX0QxMyxblxuQCMiltxD9z6VtPX8+7ssCjNHexA=; b=XjvG/wP8+xteGrsqA5E9F8QDN0i46+gcS7SuN4k8VxjAMqKNMYWmhzNYKylzVwQeGq T+n1PS1/52hgv9+Cgk8kyQOzoaj+BbLnRyuIFBwG9sti34109h0kmfo9UYXnhwd2fZ8M 63kFcwOJHxUsLX2MCoyg1BFfSb9BmGtqKmUUXi1PeL46DQ38BCcEpUWnYjL3xbHl+TJq DSf0NwydTum26oHDSIieRD2Y6FsNaMesJTXc8SBxstkKHrZanrXLDroQrkW1rhGJDRmp jt6ncrUh9NKBGg3QuoCZOQ74gDsUWU2ATd117Xkl3C3Wd2X7urcgg64SRiN9Y3GwDxdv Y+Cw== X-Gm-Message-State: ALKqPweZsvAeyTBLjJYeJMESbIPzdz49gchvmPtcShlxFJD+mrJJV7B1 xlY2OK6ERSzTvsI5R1Y3RiU= X-Received: by 2002:a17:902:5c6:: with SMTP id f64-v6mr20728558plf.50.1526916046663; Mon, 21 May 2018 08:20:46 -0700 (PDT) Received: from localhost.localdomain ([125.33.105.40]) by smtp.gmail.com with ESMTPSA id t14-v6sm30844344pfh.109.2018.05.21.08.20.42 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 21 May 2018 08:20:46 -0700 (PDT) From: Huaisheng Ye To: akpm@linux-foundation.org, linux-mm@kvack.org Cc: mhocko@suse.com, willy@infradead.org, vbabka@suse.cz, mgorman@techsingularity.net, kstewart@linuxfoundation.org, alexander.levin@verizon.com, gregkh@linuxfoundation.org, colyli@suse.de, chengnt@lenovo.com, hehy1@lenovo.com, linux-kernel@vger.kernel.org, iommu@lists.linux-foundation.org, xen-devel@lists.xenproject.org, linux-btrfs@vger.kernel.org, Huaisheng Ye Subject: [RFC PATCH v2 01/12] include/linux/gfp.h: get rid of GFP_ZONE_TABLE/BAD Date: Mon, 21 May 2018 23:20:22 +0800 Message-Id: <1526916033-4877-2-git-send-email-yehs2007@gmail.com> X-Mailer: git-send-email 1.8.3.1 In-Reply-To: <1526916033-4877-1-git-send-email-yehs2007@gmail.com> References: <1526916033-4877-1-git-send-email-yehs2007@gmail.com> Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org From: Huaisheng Ye Replace GFP_ZONE_TABLE and GFP_ZONE_BAD with encoded zone number. Delete ___GFP_DMA, ___GFP_HIGHMEM and ___GFP_DMA32 from GFP bitmasks, the bottom three bits of GFP mask is reserved for storing encoded zone number. The encoding method is XOR. Get zone number from enum zone_type, then encode the number with ZONE_NORMAL by XOR operation. The goal is to make sure ZONE_NORMAL can be encoded to zero. So, the compatibility can be guaranteed, such as GFP_KERNEL and GFP_ATOMIC can be used as before. Reserve __GFP_MOVABLE in bit 3, so that it can continue to be used as a flag. Same as before, __GFP_MOVABLE respresents movable migrate type for ZONE_DMA, ZONE_DMA32, and ZONE_NORMAL. But when it is enabled with __GFP_HIGHMEM, ZONE_MOVABLE shall be returned instead of ZONE_HIGHMEM. __GFP_ZONE_MOVABLE is created to realize it. With this patch, just enabling __GFP_MOVABLE and __GFP_HIGHMEM is not enough to get ZONE_MOVABLE from gfp_zone. All subsystems should use GFP_HIGHUSER_MOVABLE directly to achieve that. Decode zone number directly from bottom three bits of flags in gfp_zone. The theory of encoding and decoding is, A ^ B ^ B = A Suggested-by: Matthew Wilcox Signed-off-by: Huaisheng Ye Cc: Andrew Morton Cc: Vlastimil Babka Cc: Michal Hocko Cc: Mel Gorman Cc: Kate Stewart Cc: "Levin, Alexander (Sasha Levin)" Cc: Greg Kroah-Hartman --- include/linux/gfp.h | 98 ++++++----------------------------------------------- 1 file changed, 11 insertions(+), 87 deletions(-) diff --git a/include/linux/gfp.h b/include/linux/gfp.h index 1a4582b..ab0fb7f 100644 --- a/include/linux/gfp.h +++ b/include/linux/gfp.h @@ -16,9 +16,7 @@ */ /* Plain integer GFP bitmasks. Do not use this directly. */ -#define ___GFP_DMA 0x01u -#define ___GFP_HIGHMEM 0x02u -#define ___GFP_DMA32 0x04u +#define ___GFP_ZONE_MASK 0x07u #define ___GFP_MOVABLE 0x08u #define ___GFP_RECLAIMABLE 0x10u #define ___GFP_HIGH 0x20u @@ -53,11 +51,15 @@ * without the underscores and use them consistently. The definitions here may * be used in bit comparisons. */ -#define __GFP_DMA ((__force gfp_t)___GFP_DMA) -#define __GFP_HIGHMEM ((__force gfp_t)___GFP_HIGHMEM) -#define __GFP_DMA32 ((__force gfp_t)___GFP_DMA32) +#define __GFP_DMA ((__force gfp_t)OPT_ZONE_DMA ^ ZONE_NORMAL) +#define __GFP_HIGHMEM ((__force gfp_t)OPT_ZONE_HIGHMEM ^ ZONE_NORMAL) +#define __GFP_DMA32 ((__force gfp_t)OPT_ZONE_DMA32 ^ ZONE_NORMAL) #define __GFP_MOVABLE ((__force gfp_t)___GFP_MOVABLE) /* ZONE_MOVABLE allowed */ -#define GFP_ZONEMASK (__GFP_DMA|__GFP_HIGHMEM|__GFP_DMA32|__GFP_MOVABLE) +#define GFP_ZONEMASK ((__force gfp_t)___GFP_ZONE_MASK | ___GFP_MOVABLE) +/* bottom 3 bits of GFP bitmasks are used for zone number encoded*/ +#define __GFP_ZONE_MASK ((__force gfp_t)___GFP_ZONE_MASK) +#define __GFP_ZONE_MOVABLE \ + ((__force gfp_t)(ZONE_MOVABLE ^ ZONE_NORMAL) | ___GFP_MOVABLE) /* * Page mobility and placement hints @@ -279,7 +281,7 @@ #define GFP_DMA __GFP_DMA #define GFP_DMA32 __GFP_DMA32 #define GFP_HIGHUSER (GFP_USER | __GFP_HIGHMEM) -#define GFP_HIGHUSER_MOVABLE (GFP_HIGHUSER | __GFP_MOVABLE) +#define GFP_HIGHUSER_MOVABLE (GFP_USER | __GFP_ZONE_MOVABLE) #define GFP_TRANSHUGE_LIGHT ((GFP_HIGHUSER_MOVABLE | __GFP_COMP | \ __GFP_NOMEMALLOC | __GFP_NOWARN) & ~__GFP_RECLAIM) #define GFP_TRANSHUGE (GFP_TRANSHUGE_LIGHT | __GFP_DIRECT_RECLAIM) @@ -326,87 +328,9 @@ static inline bool gfpflags_allow_blocking(const gfp_t gfp_flags) #define OPT_ZONE_DMA32 ZONE_NORMAL #endif -/* - * GFP_ZONE_TABLE is a word size bitstring that is used for looking up the - * zone to use given the lowest 4 bits of gfp_t. Entries are GFP_ZONES_SHIFT - * bits long and there are 16 of them to cover all possible combinations of - * __GFP_DMA, __GFP_DMA32, __GFP_MOVABLE and __GFP_HIGHMEM. - * - * The zone fallback order is MOVABLE=>HIGHMEM=>NORMAL=>DMA32=>DMA. - * But GFP_MOVABLE is not only a zone specifier but also an allocation - * policy. Therefore __GFP_MOVABLE plus another zone selector is valid. - * Only 1 bit of the lowest 3 bits (DMA,DMA32,HIGHMEM) can be set to "1". - * - * bit result - * ================= - * 0x0 => NORMAL - * 0x1 => DMA or NORMAL - * 0x2 => HIGHMEM or NORMAL - * 0x3 => BAD (DMA+HIGHMEM) - * 0x4 => DMA32 or DMA or NORMAL - * 0x5 => BAD (DMA+DMA32) - * 0x6 => BAD (HIGHMEM+DMA32) - * 0x7 => BAD (HIGHMEM+DMA32+DMA) - * 0x8 => NORMAL (MOVABLE+0) - * 0x9 => DMA or NORMAL (MOVABLE+DMA) - * 0xa => MOVABLE (Movable is valid only if HIGHMEM is set too) - * 0xb => BAD (MOVABLE+HIGHMEM+DMA) - * 0xc => DMA32 (MOVABLE+DMA32) - * 0xd => BAD (MOVABLE+DMA32+DMA) - * 0xe => BAD (MOVABLE+DMA32+HIGHMEM) - * 0xf => BAD (MOVABLE+DMA32+HIGHMEM+DMA) - * - * GFP_ZONES_SHIFT must be <= 2 on 32 bit platforms. - */ - -#if defined(CONFIG_ZONE_DEVICE) && (MAX_NR_ZONES-1) <= 4 -/* ZONE_DEVICE is not a valid GFP zone specifier */ -#define GFP_ZONES_SHIFT 2 -#else -#define GFP_ZONES_SHIFT ZONES_SHIFT -#endif - -#if 16 * GFP_ZONES_SHIFT > BITS_PER_LONG -#error GFP_ZONES_SHIFT too large to create GFP_ZONE_TABLE integer -#endif - -#define GFP_ZONE_TABLE ( \ - (ZONE_NORMAL << 0 * GFP_ZONES_SHIFT) \ - | (OPT_ZONE_DMA << ___GFP_DMA * GFP_ZONES_SHIFT) \ - | (OPT_ZONE_HIGHMEM << ___GFP_HIGHMEM * GFP_ZONES_SHIFT) \ - | (OPT_ZONE_DMA32 << ___GFP_DMA32 * GFP_ZONES_SHIFT) \ - | (ZONE_NORMAL << ___GFP_MOVABLE * GFP_ZONES_SHIFT) \ - | (OPT_ZONE_DMA << (___GFP_MOVABLE | ___GFP_DMA) * GFP_ZONES_SHIFT) \ - | (ZONE_MOVABLE << (___GFP_MOVABLE | ___GFP_HIGHMEM) * GFP_ZONES_SHIFT)\ - | (OPT_ZONE_DMA32 << (___GFP_MOVABLE | ___GFP_DMA32) * GFP_ZONES_SHIFT)\ -) - -/* - * GFP_ZONE_BAD is a bitmap for all combinations of __GFP_DMA, __GFP_DMA32 - * __GFP_HIGHMEM and __GFP_MOVABLE that are not permitted. One flag per - * entry starting with bit 0. Bit is set if the combination is not - * allowed. - */ -#define GFP_ZONE_BAD ( \ - 1 << (___GFP_DMA | ___GFP_HIGHMEM) \ - | 1 << (___GFP_DMA | ___GFP_DMA32) \ - | 1 << (___GFP_DMA32 | ___GFP_HIGHMEM) \ - | 1 << (___GFP_DMA | ___GFP_DMA32 | ___GFP_HIGHMEM) \ - | 1 << (___GFP_MOVABLE | ___GFP_HIGHMEM | ___GFP_DMA) \ - | 1 << (___GFP_MOVABLE | ___GFP_DMA32 | ___GFP_DMA) \ - | 1 << (___GFP_MOVABLE | ___GFP_DMA32 | ___GFP_HIGHMEM) \ - | 1 << (___GFP_MOVABLE | ___GFP_DMA32 | ___GFP_DMA | ___GFP_HIGHMEM) \ -) - static inline enum zone_type gfp_zone(gfp_t flags) { - enum zone_type z; - int bit = (__force int) (flags & GFP_ZONEMASK); - - z = (GFP_ZONE_TABLE >> (bit * GFP_ZONES_SHIFT)) & - ((1 << GFP_ZONES_SHIFT) - 1); - VM_BUG_ON((GFP_ZONE_BAD >> bit) & 1); - return z; + return ((__force unsigned int)flags & __GFP_ZONE_MASK) ^ ZONE_NORMAL; } /* -- 1.8.3.1