Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.36 as permitted sender) client-ip=23.128.96.36;
Date:   Thu, 14 Sep 2023 19:40:22 -0700 (PDT)
From:   "Lameter, Christopher" <cl@os.amperecomputing.com>
To:     Feng Tang <feng.tang@intel.com>
cc:     Hyeonggon Yoo <42.hyeyoo@gmail.com>,
        Vlastimil Babka <vbabka@suse.cz>,
        Andrew Morton <akpm@linux-foundation.org>,
        Pekka Enberg <penberg@kernel.org>,
        David Rientjes <rientjes@google.com>,
        Joonsoo Kim <iamjoonsoo.kim@lge.com>,
        Roman Gushchin <roman.gushchin@linux.dev>, linux-mm@kvack.org,
        linux-kernel@vger.kernel.org
Subject: Re: [RFC Patch 3/3] mm/slub: setup maxim per-node partial according
 to cpu numbers
In-Reply-To: <ZQKwu3TrorCvgH9b@feng-clx>
Message-ID: <21a0ba8b-bf05-0799-7c78-2a35f8c8d52a@os.amperecomputing.com>
References: <20230905141348.32946-1-feng.tang@intel.com> <20230905141348.32946-4-feng.tang@intel.com> <CAB=+i9RWVvUb5LyoTpzZ0XXWoSNxbKJuA6fynvOd4U+P5q+uaA@mail.gmail.com> <ZQKwu3TrorCvgH9b@feng-clx>
Content-Type: text/plain; charset=US-ASCII; format=flowed
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?YBhbxfNllOxrpOmVV2zDpO0QEBvSowThon2dor67Lr0aT58GcF6WJFhMwinI?=
 =?us-ascii?Q?f2DGONJFOacBaN/u9FTC7ilyGH5uMbfqh1h/WlcZNRzrpqYkjqxtNsgP1UFM?=
 =?us-ascii?Q?aub7HWPz6bskIsioUe9nkCDjVMwpBe0JU3qYyIoxzSQP+lbL/MoRPYeJCzxH?=
 =?us-ascii?Q?K76Qr+7amvGedSYFp3Bvjtbx/GvvA1hNVXITk0aYh2BPyd0aJz7OgTuvSGul?=
 =?us-ascii?Q?j5XC72RnIoD66XvRm4BnMZ5D8RLjp8cL0Ol/AeMxiPdmsSe5Qp14GWy2iwwv?=
 =?us-ascii?Q?mfQXFsmtUFgzNR3gUJiapPCZk/5YiSmt5KjL7EcRdmmfSYQ1JK+ZDad/IGOP?=
 =?us-ascii?Q?b1PjDKnzH/j/z5+ei4tbfOes2fJHcgWaE/wJgIUugDKITpIkyzCVrM3bx/y7?=
 =?us-ascii?Q?uTu0PgQ5xWrBejcJZrYm8PA80XnaSxSS74POCgmvlD4LlX86y7v2h109JqJA?=
 =?us-ascii?Q?L305X1wNZYQmUhBm/82YtuJWRdsmbIiW75j40qlv+2tFHhuyngCSb376HgMI?=
 =?us-ascii?Q?3eJ47hb0GZ6P7fIK/lQrM6UxXB8JnjeThed5O5KxD8npsvpbO+sOTX3uFlQk?=
 =?us-ascii?Q?+mSKxkfuhl8/aVqPRnbUKFT94pkI08sKPGd6W4KRfZT1Prvn0UV4k4Enn1L4?=
 =?us-ascii?Q?ctt50fohwn/rpqRGbp1Uj2073mO3ce3vJCnWgNB9uIVmmws/75wFx6PE7XO/?=
 =?us-ascii?Q?qBsdCRjyBbI3ZJbdCnDHqDrbmdt0Zi+8BiatXczxjH2t+WQ9TrdJlB7sjSWM?=
 =?us-ascii?Q?98NYxrjGGlI0P3WbxMlBZ/XpILzIlPdyaSZ7gHgzuTi9ih5JZSULD/pxobXu?=
 =?us-ascii?Q?26EsOMPW8jn+dCDTI/L6mCJ0bdBWrpnD4KMNumcKOlfYSw/rtISh3wxVS7lY?=
 =?us-ascii?Q?ts+IsPOclVSw244+pKBJ+iV69xqxzK5NPrC2P3aktbAjLzThsDo806siQ7zI?=
 =?us-ascii?Q?BLpMd98LSZ14ZtroVSAVfjDc3rMYHwU14QK6axVAV8yrdeD4fhMDa8NAMn7Z?=
 =?us-ascii?Q?epPNNPLP+QKTQGF5LONSBUsRMtP7tSYW1akd10QvglEFky4GiH9iT+sRvvG/?=
 =?us-ascii?Q?JmrSAH9MgN3Yat5PKQTMZQ4/iBDYIV7W8xvEXRYG0hLKJq2R+itFQgHKqjaa?=
 =?us-ascii?Q?W1k4VVN0wjUg+xT3c17lGULYmvAnD8ak5Yf0WlP2GKqp77eA8PhmnseNLbCs?=
 =?us-ascii?Q?0El4bF28ORFsJ9La9xk4MfbKvqcsSJ02mJCVLlVZZqYWMY/HzyAnxTgAMJek?=
 =?us-ascii?Q?xSr9BrUXvxEq7+0sbWIKyCVwpjVhV1e/llAiwfHJlu54bATJu2suT6OaPJX9?=
 =?us-ascii?Q?SpBg8GlyhMeSNfFjgt72PgMqjstOmCnxtQ4rrdmb906t+BRoxgHQLNjRnONG?=
 =?us-ascii?Q?yaqi6K1cCVMfng4O5XAk9fuUp/jyBaITKpcuICbFXgBsxJZU/aiEM7UMwN8s?=
 =?us-ascii?Q?oVdjLaxB5BJxFGYQEO//RBiLvMIorbbLQ+diOGfXUeOywn2jxIbAeL4lRpkD?=
 =?us-ascii?Q?1CevMNsBikvvleuErDdUIe9cCx6QhvrkOaAZjsHqSdtAuHYf5jSlB/GMzWw1?=
 =?us-ascii?Q?ARtPiPzo6MKYvXprngPGErLi/EEfMRQyyBKWfKQAGWTaIxa3ANknwmV5HHjr?=
 =?us-ascii?Q?CpBGQUat2vXEsRQT65Brudg=3D?=
X-OriginatorOrg: os.amperecomputing.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 619f18a9-a364-4992-c36f-08dbb5951f39
X-MS-Exchange-CrossTenant-AuthSource: DM6PR01MB5259.prod.exchangelabs.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 15 Sep 2023 02:40:28.3062
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 3bc2b170-fd94-476d-b0ce-4229bdc904a7
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: v3XddJRDRf0jPj6tA2iokEwIfZKQuT3GRKt95qNC/Nf3Z536AsN/pBPQefKXfcgpdJU8o3yyq4Rsc3FOjc5o/43okQoeyq96QJivAOxqQas=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH0PR01MB6151
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org
X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (pete.vger.email [0.0.0.0]); Thu, 14 Sep 2023 19:40:42 -0700 (PDT)
X-Spam-Status: No, score=-0.9 required=5.0 tests=DKIM_SIGNED,DKIM_VALID,
	DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,
	SPF_HELO_NONE,SPF_PASS autolearn=unavailable autolearn_force=no
	version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on pete.vger.email

On Thu, 14 Sep 2023, Feng Tang wrote:

> One reason I wanted to revisit the MIN_PARTIAL is, it was changed from
> 2 to 5 in 2007 by Christoph, in commit 76be895001f2 ("SLUB: Improve
> hackbench speed"), the system has been much huger since then.
> Currently while a per-cpu partial can already have 5 or more slabs,
> the limit for a node with possible 100+ CPU could be reconsidered.

Well the trick that I keep using in large systems with lots of memory is 
to use huge page sized page allocation. The applications on those 
already are using the same page size. Doing so usually removes a lot of 
overhead and speeds up things significantly.

Try booting with "slab_min_order=9"