Received: by 2002:a05:6a10:af89:0:0:0:0 with SMTP id iu9csp4002782pxb; Tue, 25 Jan 2022 01:07:01 -0800 (PST) X-Google-Smtp-Source: ABdhPJyaAptklUaeTsstsFwZsO/urfHA8DnOcQpg8dnypHb4rCfTtSgdYuok183mSza4xrF756X2 X-Received: by 2002:a05:6a00:1a86:b0:4c1:3039:16a6 with SMTP id e6-20020a056a001a8600b004c1303916a6mr17387259pfv.5.1643101621508; Tue, 25 Jan 2022 01:07:01 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1643101621; cv=none; d=google.com; s=arc-20160816; b=MG7bmqtMwMkQ5S8uGTy8qH/Zdgq0S2w1c03q94rYb0rrtDr/dXR2eRGJXVb5XIMXY8 YqsQRKBrdaeOW62tNeifnaDJfxhEbfnewOUA8SErD8pt+XvEgv2VUJyq9qxkKk4QdrxF BDWNBiyTKJTanqbQiG6VJMagubGFFpLTvmq3cLFz4ZSyPoLwBanfD0xN6kXqznRfX6Yg Xd6hALSfSgTiKfqoRcZEcB3+tmZ8yiefEDTo7wYTDjI7rZ0vymzqrvVf47gZcgS2Q0Wr 7HXsuqZjVOOIrGDrY21Xzx4y+3RDdAnWKnVqtTFr/T+5JpUtx94JrAjh0mcjo6UiSXZ6 wS5A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:in-reply-to:content-disposition:mime-version :references:message-id:subject:cc:to:from:date:dkim-signature; bh=+kfuuTm05CZE4AaWWdkMx1F0FTDfVhWKUYXNwsdJSvw=; b=NfTXV6vzW/4PVmOeQn+Kw81mvRqqkqn0TBlxhUJqWYpVedqu2Qx9XA8RaVa3BOKOrw SWoIVNUdAc7rMdqORBkwXmdr0DzSX9qWH86X6eVuBgB8VI4NYmWJKJWHZQRlqipbOqjG iACbB2rgAMf3CPVrYpplTZpcFNuQn8juS4YjQp2h/ThRB+wdgqNWSjZMVSmp3s9Y7g5/ xALfDYylSFHroD6Ft8HJP8+Vhl3cYznp5y2XZE5vwJ3IdtpqppWjkMAvTsEXfJp+VNzt oRPWenf6s9gXMPI1TTzSOyvwUG5FogChfZxoYGq/wUDWbjykP1F/oS37PMyPoNmJTRau eV0g== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=tzZs5+nE; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id w24si4707321pll.11.2022.01.25.01.06.41; Tue, 25 Jan 2022 01:07:01 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=tzZs5+nE; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1358510AbiAYGpu (ORCPT + 99 others); Tue, 25 Jan 2022 01:45:50 -0500 Received: from dfw.source.kernel.org ([139.178.84.217]:46246 "EHLO dfw.source.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1344376AbiAYGnF (ORCPT ); Tue, 25 Jan 2022 01:43:05 -0500 Received: from smtp.kernel.org (relay.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by dfw.source.kernel.org (Postfix) with ESMTPS id 16DEB60C7D for ; Tue, 25 Jan 2022 06:42:59 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id ECB0BC340E0; Tue, 25 Jan 2022 06:42:55 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1643092978; bh=w9kbu9RHX+YfdS4ykZIbMjfDhh8cJ9Xb1CqqNG1jcCs=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=tzZs5+nE41o0br8nF9/ybm8droXUY+SW74VlHxyIw6kSVJmywLYTShTXqpi3FDr+4 75+KIkbJh3Tc0cG0Sj23Z9G+m9Sb7i8VtmNCHyYBoFJOfUXOII+WtGJn04bJuK9bf2 E0umT7Q6dEEuNxsGiAAPyWcq2D1GKoB8gtodl96zRXVkEVHfit5r10X2RfercCAAj4 htLHdFysSYeWoeAOBfhOAM4fbM4Ng+wCYXv4RXvR8mgGbmCUs24Dkw1xu5ej44h5wq fNyoxQZPGJH+cqxsVX3Dqceps2ndNRwPdbgReuC5L0trKinZf6/XOdagg8Gub7Elva mNYHxCrNsAOuw== Date: Tue, 25 Jan 2022 08:42:49 +0200 From: Mike Rapoport To: Zi Yan Cc: Mel Gorman , linux-mm@kvack.org, linux-kernel@vger.kernel.org, David Hildenbrand , Vlastimil Babka , Andrew Morton Subject: Re: [PATCH] mm: page_alloc: avoid merging non-fallbackable pageblocks with others. Message-ID: References: <20220124175957.1261961-1-zi.yan@sent.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20220124175957.1261961-1-zi.yan@sent.com> Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Mon, Jan 24, 2022 at 12:59:57PM -0500, Zi Yan wrote: > From: Zi Yan > > This is done in addition to MIGRATE_ISOLATE pageblock merge avoidance. > It prepares for the upcoming removal of the MAX_ORDER-1 alignment > requirement for CMA and alloc_contig_range(). > > MIGRARTE_HIGHATOMIC should not merge with other migratetypes like > MIGRATE_ISOLATE and MIGRARTE_CMA[1], so this commit prevents that too. > > Remove MIGRARTE_CMA and MIGRATE_ISOLATE from fallbacks list, since they > are never used. > > [1] https://lore.kernel.org/linux-mm/20211130100853.GP3366@techsingularity.net/ > > Signed-off-by: Zi Yan > Acked-by: Mel Gorman Acked-by: Mike Rapoport > --- > include/linux/mmzone.h | 11 +++++++++++ > mm/page_alloc.c | 44 ++++++++++++++++++++---------------------- > 2 files changed, 32 insertions(+), 23 deletions(-) > > diff --git a/include/linux/mmzone.h b/include/linux/mmzone.h > index aed44e9b5d89..71b77aab748d 100644 > --- a/include/linux/mmzone.h > +++ b/include/linux/mmzone.h > @@ -83,6 +83,17 @@ static inline bool is_migrate_movable(int mt) > return is_migrate_cma(mt) || mt == MIGRATE_MOVABLE; > } > > +/* > + * Check whether a migratetype can be merged with another migratetype. > + * > + * It is only mergeable when it can fall back to other migratetypes for > + * allocation. See fallbacks[MIGRATE_TYPES][3] in page_alloc.c. > + */ > +static inline bool migratetype_is_mergeable(int mt) > +{ > + return mt < MIGRATE_PCPTYPES; > +} > + > #define for_each_migratetype_order(order, type) \ > for (order = 0; order < MAX_ORDER; order++) \ > for (type = 0; type < MIGRATE_TYPES; type++) > diff --git a/mm/page_alloc.c b/mm/page_alloc.c > index 8dd6399bafb5..5a91d4d9279a 100644 > --- a/mm/page_alloc.c > +++ b/mm/page_alloc.c > @@ -1117,25 +1117,24 @@ static inline void __free_one_page(struct page *page, > } > if (order < MAX_ORDER - 1) { > /* If we are here, it means order is >= pageblock_order. > - * We want to prevent merge between freepages on isolate > - * pageblock and normal pageblock. Without this, pageblock > - * isolation could cause incorrect freepage or CMA accounting. > + * We want to prevent merge between freepages on pageblock > + * without fallbacks and normal pageblock. Without this, > + * pageblock isolation could cause incorrect freepage or CMA > + * accounting or HIGHATOMIC accounting. > * > * We don't want to hit this code for the more frequent > * low-order merging. > */ > - if (unlikely(has_isolate_pageblock(zone))) { > - int buddy_mt; > + int buddy_mt; > > - buddy_pfn = __find_buddy_pfn(pfn, order); > - buddy = page + (buddy_pfn - pfn); > - buddy_mt = get_pageblock_migratetype(buddy); > + buddy_pfn = __find_buddy_pfn(pfn, order); > + buddy = page + (buddy_pfn - pfn); > + buddy_mt = get_pageblock_migratetype(buddy); > > - if (migratetype != buddy_mt > - && (is_migrate_isolate(migratetype) || > - is_migrate_isolate(buddy_mt))) > - goto done_merging; > - } > + if (migratetype != buddy_mt > + && (!migratetype_is_mergeable(migratetype) || > + !migratetype_is_mergeable(buddy_mt))) > + goto done_merging; > max_order = order + 1; > goto continue_merging; > } > @@ -2479,17 +2478,13 @@ struct page *__rmqueue_smallest(struct zone *zone, unsigned int order, > /* > * This array describes the order lists are fallen back to when > * the free lists for the desirable migrate type are depleted > + * > + * The other migratetypes do not have fallbacks. > */ > static int fallbacks[MIGRATE_TYPES][3] = { > [MIGRATE_UNMOVABLE] = { MIGRATE_RECLAIMABLE, MIGRATE_MOVABLE, MIGRATE_TYPES }, > [MIGRATE_MOVABLE] = { MIGRATE_RECLAIMABLE, MIGRATE_UNMOVABLE, MIGRATE_TYPES }, > [MIGRATE_RECLAIMABLE] = { MIGRATE_UNMOVABLE, MIGRATE_MOVABLE, MIGRATE_TYPES }, > -#ifdef CONFIG_CMA > - [MIGRATE_CMA] = { MIGRATE_TYPES }, /* Never used */ > -#endif > -#ifdef CONFIG_MEMORY_ISOLATION > - [MIGRATE_ISOLATE] = { MIGRATE_TYPES }, /* Never used */ > -#endif > }; > > #ifdef CONFIG_CMA > @@ -2795,8 +2790,8 @@ static void reserve_highatomic_pageblock(struct page *page, struct zone *zone, > > /* Yoink! */ > mt = get_pageblock_migratetype(page); > - if (!is_migrate_highatomic(mt) && !is_migrate_isolate(mt) > - && !is_migrate_cma(mt)) { > + /* Only reserve normal pageblocks (i.e., they can merge with others) */ > + if (migratetype_is_mergeable(mt)) { > zone->nr_reserved_highatomic += pageblock_nr_pages; > set_pageblock_migratetype(page, MIGRATE_HIGHATOMIC); > move_freepages_block(zone, page, MIGRATE_HIGHATOMIC, NULL); > @@ -3545,8 +3540,11 @@ int __isolate_free_page(struct page *page, unsigned int order) > struct page *endpage = page + (1 << order) - 1; > for (; page < endpage; page += pageblock_nr_pages) { > int mt = get_pageblock_migratetype(page); > - if (!is_migrate_isolate(mt) && !is_migrate_cma(mt) > - && !is_migrate_highatomic(mt)) > + /* > + * Only change normal pageblocks (i.e., they can merge > + * with others) > + */ > + if (migratetype_is_mergeable(mt)) > set_pageblock_migratetype(page, > MIGRATE_MOVABLE); > } > -- > 2.34.1 > -- Sincerely yours, Mike.