Received: by 2002:a05:6a10:16a7:0:0:0:0 with SMTP id gp39csp239085pxb; Wed, 11 Nov 2020 02:22:56 -0800 (PST) X-Google-Smtp-Source: ABdhPJzc+1E9y200PyLIMXMvtutVaJdSrS4Ht4y2LcGovJPvvFqtkdr3/rati0QDnEMIze0K5GTW X-Received: by 2002:a17:906:ae95:: with SMTP id md21mr23577801ejb.425.1605090176715; Wed, 11 Nov 2020 02:22:56 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1605090176; cv=none; d=google.com; s=arc-20160816; b=kMjEUkMTWbVMhfP1IwRubphsYCLap/d8Gx9qPfDK9g/T/r2RXMA1mKJncZ3TyZM5Uj 9omy+CzVLRcJI0DqdUojYlQMyeWv5W65zu211i3054pKEy98VPzT9obx2eMG0fB36lPG 1kK0ntgM+JSMv0mYD81Abz7hCYUd38VZfYI0UCPN7LjQy+QG1TkRf6Fm8WK0jHz9Zb4n 7OGWCVGmVqk2ZPcQOQOm6bmnRiwDzsVbeBgfz4+LpPwRPXIIvy6P/M8L/W8Pnw5lIsuP FG8Fu8juU2deWdSpdA6nv3/ym6y/7u4AGj2aQTOlWsPR7r0TA5nb6/u923sk+OISLdVZ kl+w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:cc:to:subject:message-id:date:from:in-reply-to :references:mime-version:dkim-signature; bh=MLokqUz+BQfS7+p2DqaXYnFBJnicm/ytUMPfJX2Jz5g=; b=Ely87xhdzGUf4CLRodw/4pEumrkdNVQCk7jF3/VrRTOxeFV9YP4WvxNdSVqZWRd8vH 8oJUtlMbiP6pbR/8YDlB4LSmjmKBqTQJKrO1WnTmg3pkHd0JIHxgFjotEcf2iQedGrHV L4ifQpROVdawbPq+Gddi/IBYPPoQlW8HBWvuEfS+jtHuu6B04x+bsXIPZ1xUVqf5scPl iKikiantoWNiRRDrc1FD+2Ts9D0d+BgT51PFSPUbfwyPv2BITK1kemxyrkmdXqVHVdxW C5idHOEpdFrtLkZM5mARIJ6JWRxXMf0Qm5okafGh7orE+wbNfbhhc8cRb3st5+fUfZM9 rCKw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=pPLrBrTW; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id j4si1008988ejb.23.2020.11.11.02.22.33; Wed, 11 Nov 2020 02:22:56 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=pPLrBrTW; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727349AbgKKKT4 (ORCPT + 99 others); Wed, 11 Nov 2020 05:19:56 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:51546 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726557AbgKKKTz (ORCPT ); Wed, 11 Nov 2020 05:19:55 -0500 Received: from mail-io1-xd43.google.com (mail-io1-xd43.google.com [IPv6:2607:f8b0:4864:20::d43]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 0914CC0613D1 for ; Wed, 11 Nov 2020 02:19:55 -0800 (PST) Received: by mail-io1-xd43.google.com with SMTP id r9so1718652ioo.7 for ; Wed, 11 Nov 2020 02:19:55 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=MLokqUz+BQfS7+p2DqaXYnFBJnicm/ytUMPfJX2Jz5g=; b=pPLrBrTWQrcPAW62NbT4UyAkW0HDFqEH6yLSHawSw0YPE1lVKQdF854xsXyFK85WZC eqtTqSQT6Be858kJJkBMIpyETvsEZCzsWXunoNqpmUmn7Yah3Ee08qhfC0BcYGytMTo8 zVyc//Rg+g6ltt+fijt070/oZZZK/PLIl+ZQoyhRzw2GSWXdfYuZLvO4EODGmxSQxXSj ZdbokZBjYoJkt2SB1qldZCRKupbUIgWrSb6F2CfvZnZWel4wG5LwBG9RCs4oaVYqLyNS zGNFFM6IIetfS2vncd+OxxiPakhQnKoey8wYb+hORGvWOP4gYDyt5L1+D02fQrXsq6j7 6wfQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=MLokqUz+BQfS7+p2DqaXYnFBJnicm/ytUMPfJX2Jz5g=; b=s9ipjlvVE5T8TmQH4zb/KuRH49Lh+2KhFx8I9yT63Qr5Ynov6+LH1RP6RToeI7CIyE Nsw8AmByNXaXaY283yKkr/W/+vjg90VZQC3pkSQuAGjrjex3IsmMsVUXGY9VkI0o45Zb mY1iZZMF5+shipMwF7QF6QgDhT7+fbCWHGSVAdmUxRv2On9O18OdiGh3u1rTyBFtI85U Eap5PyctRl//cYgit3PHTXNAMJz6RIRKqOCIBBbCbGHxJvU3Q5qB3h8Stx6NsYdfcIt9 PBKL2n5PGHxayfd+QuGcyBpFwyQxUPq/e3SXyqoYquXn2yZXqwLtDNDf19koF1fIgtLu Vp5Q== X-Gm-Message-State: AOAM5325ZsuWx0YSpmJUE+6qo9w/i002hw56hWbNHC3x3CnUP1H0PP7q RKsuJPTy6ujY1QlpleXLNh+FxsNynk7xr/t8eg0= X-Received: by 2002:a6b:5f05:: with SMTP id t5mr17816968iob.67.1605089994400; Wed, 11 Nov 2020 02:19:54 -0800 (PST) MIME-Version: 1.0 References: <20201111092812.11329-1-vbabka@suse.cz> <20201111092812.11329-3-vbabka@suse.cz> In-Reply-To: <20201111092812.11329-3-vbabka@suse.cz> From: Pankaj Gupta Date: Wed, 11 Nov 2020 11:19:43 +0100 Message-ID: Subject: Re: [PATCH v3 2/7] mm, page_alloc: calculate pageset high and batch once per zone To: Vlastimil Babka Cc: Andrew Morton , Linux MM , LKML , Michal Hocko , Pavel Tatashin , David Hildenbrand , Oscar Salvador , Joonsoo Kim , Michal Hocko Content-Type: text/plain; charset="UTF-8" Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org > We currently call pageset_set_high_and_batch() for each possible cpu, which > repeats the same calculations of high and batch values. > > Instead call the function just once per zone, and make it apply the calculated > values to all per-cpu pagesets of the zone. > > This also allows removing the zone_pageset_init() and __zone_pcp_update() > wrappers. > > No functional change. > > Signed-off-by: Vlastimil Babka > Reviewed-by: Oscar Salvador > Reviewed-by: David Hildenbrand > Acked-by: Michal Hocko > --- > mm/page_alloc.c | 42 ++++++++++++++++++------------------------ > 1 file changed, 18 insertions(+), 24 deletions(-) > > diff --git a/mm/page_alloc.c b/mm/page_alloc.c > index 3f1c57344e73..2fa432762908 100644 > --- a/mm/page_alloc.c > +++ b/mm/page_alloc.c > @@ -6307,13 +6307,14 @@ static void setup_pageset(struct per_cpu_pageset *p) > } > > /* > - * Calculate and set new high and batch values for given per-cpu pageset of a > + * Calculate and set new high and batch values for all per-cpu pagesets of a > * zone, based on the zone's size and the percpu_pagelist_fraction sysctl. > */ > -static void pageset_set_high_and_batch(struct zone *zone, > - struct per_cpu_pageset *p) > +static void zone_set_pageset_high_and_batch(struct zone *zone) > { > unsigned long new_high, new_batch; > + struct per_cpu_pageset *p; > + int cpu; > > if (percpu_pagelist_fraction) { > new_high = zone_managed_pages(zone) / percpu_pagelist_fraction; > @@ -6325,23 +6326,25 @@ static void pageset_set_high_and_batch(struct zone *zone, > new_high = 6 * new_batch; > new_batch = max(1UL, 1 * new_batch); > } > - pageset_update(&p->pcp, new_high, new_batch); > -} > - > -static void __meminit zone_pageset_init(struct zone *zone, int cpu) > -{ > - struct per_cpu_pageset *pcp = per_cpu_ptr(zone->pageset, cpu); > > - pageset_init(pcp); > - pageset_set_high_and_batch(zone, pcp); > + for_each_possible_cpu(cpu) { > + p = per_cpu_ptr(zone->pageset, cpu); > + pageset_update(&p->pcp, new_high, new_batch); > + } > } > > void __meminit setup_zone_pageset(struct zone *zone) > { > + struct per_cpu_pageset *p; > int cpu; > + > zone->pageset = alloc_percpu(struct per_cpu_pageset); > - for_each_possible_cpu(cpu) > - zone_pageset_init(zone, cpu); > + for_each_possible_cpu(cpu) { > + p = per_cpu_ptr(zone->pageset, cpu); > + pageset_init(p); > + } > + > + zone_set_pageset_high_and_batch(zone); > } > > /* > @@ -8080,15 +8083,6 @@ int lowmem_reserve_ratio_sysctl_handler(struct ctl_table *table, int write, > return 0; > } > > -static void __zone_pcp_update(struct zone *zone) > -{ > - unsigned int cpu; > - > - for_each_possible_cpu(cpu) > - pageset_set_high_and_batch(zone, > - per_cpu_ptr(zone->pageset, cpu)); > -} > - > /* > * percpu_pagelist_fraction - changes the pcp->high for each zone on each > * cpu. It is the fraction of total pages in each zone that a hot per cpu > @@ -8121,7 +8115,7 @@ int percpu_pagelist_fraction_sysctl_handler(struct ctl_table *table, int write, > goto out; > > for_each_populated_zone(zone) > - __zone_pcp_update(zone); > + zone_set_pageset_high_and_batch(zone); > out: > mutex_unlock(&pcp_batch_high_lock); > return ret; > @@ -8746,7 +8740,7 @@ EXPORT_SYMBOL(free_contig_range); > void __meminit zone_pcp_update(struct zone *zone) > { > mutex_lock(&pcp_batch_high_lock); > - __zone_pcp_update(zone); > + zone_set_pageset_high_and_batch(zone); > mutex_unlock(&pcp_batch_high_lock); > } Acked-by: Pankaj Gupta