Received: by 2002:a05:7412:419a:b0:f3:1519:9f41 with SMTP id i26csp3580174rdh; Mon, 27 Nov 2023 19:19:26 -0800 (PST) X-Google-Smtp-Source: AGHT+IG3K32FUkTF1yhb3SnHkf/Wiy1lTnvotx2iwLsssH6hAtq50F4A8Gp8k+2b8/2ReGZ/oBar X-Received: by 2002:a17:902:b20a:b0:1cf:6783:fd37 with SMTP id t10-20020a170902b20a00b001cf6783fd37mr11978007plr.29.1701141566486; Mon, 27 Nov 2023 19:19:26 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1701141566; cv=none; d=google.com; s=arc-20160816; b=b+GWgPDkOukc1IXFkH8gYQ9B+KDTqmq2Ff31kHLSZR8GJcMFnFsRi5v1WWz7kiSf9I y9+iv78M1NRqas2i/0HymSZ1X84ZDV+iBKQ5FUWXgWqMiYJ2r6EDr0h0R3lxoI7Kwo/y wh48FpRmROy1JAA5V8ITQdRUs9ANNlZQH5Pa6is6q6KnD48vyr8XcxkULPSs/9ncgSso 40YdqVVTrEZ6hixi2qhEiLE8zgOk1RnLABpjyQaUa+ohneyGQ5StbwA3L6p2ElLc4rra 1gewj07CmokQV/qaXIGZ6RiyUEvnRN8sjIn8dlsZzuOOr988rGGorpbd9nf6zZbA1FO6 UZjA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:in-reply-to:from :references:cc:to:content-language:subject:user-agent:mime-version :date:message-id:dkim-signature; bh=aNAGTjDRK2uz3X+viYd2HPrnhIXsIDutv38NEyAwfLU=; fh=Iwq1OHYAK4ZpJ0XWXcACR4CtCzqOr/VfTuocCZx74vg=; b=a4E7e9U56kVJ71YFEhu6WXDk1lzW/CU9eTBGfA1dBchCqirgPC/mYLaa+oI3tvgkpO vnPeACA6bUGaPyU6cdmf7PhGneKlIADvHuXi1eO0IoYY5tZnHr0GSP0v07/kNHwH72EC 6dIcR6vuuYpzol1v7reC9vb8P8t+HNqQygctfpkdTJOhyfmsp0xQgymFquaFnlGahBPl 91Pbhlj5SLdC5eIFfaMsCpWvRTFnPnH3hT7gwHaRhObZsfhIxr7xNEzgfwjVtXUu9QG/ rYyFLrEaVZDcibRqziiHhD9BCRvNtdTQViTvgBbOEqWUtuk7VYgmVqcvfz3kvVPSPuP2 ujYw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@bytedance.com header.s=google header.b=P0rrhgey; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.33 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=QUARANTINE sp=QUARANTINE dis=NONE) header.from=bytedance.com Return-Path: Received: from lipwig.vger.email (lipwig.vger.email. [23.128.96.33]) by mx.google.com with ESMTPS id b11-20020a170902d88b00b001cfdd31f20esi1960297plz.267.2023.11.27.19.19.26 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 27 Nov 2023 19:19:26 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.33 as permitted sender) client-ip=23.128.96.33; Authentication-Results: mx.google.com; dkim=pass header.i=@bytedance.com header.s=google header.b=P0rrhgey; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.33 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=QUARANTINE sp=QUARANTINE dis=NONE) header.from=bytedance.com Received: from out1.vger.email (depot.vger.email [IPv6:2620:137:e000::3:0]) by lipwig.vger.email (Postfix) with ESMTP id 649A680A4F73; Mon, 27 Nov 2023 19:19:24 -0800 (PST) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.11 at lipwig.vger.email Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S234543AbjK1DTM (ORCPT + 99 others); Mon, 27 Nov 2023 22:19:12 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:43732 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229789AbjK1DTL (ORCPT ); Mon, 27 Nov 2023 22:19:11 -0500 Received: from mail-pl1-x636.google.com (mail-pl1-x636.google.com [IPv6:2607:f8b0:4864:20::636]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id CF8191B6 for ; Mon, 27 Nov 2023 19:18:52 -0800 (PST) Received: by mail-pl1-x636.google.com with SMTP id d9443c01a7336-1cff3a03dfaso3619945ad.3 for ; Mon, 27 Nov 2023 19:18:52 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bytedance.com; s=google; t=1701141532; x=1701746332; darn=vger.kernel.org; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :from:to:cc:subject:date:message-id:reply-to; bh=aNAGTjDRK2uz3X+viYd2HPrnhIXsIDutv38NEyAwfLU=; b=P0rrhgeyIkmkcSqf59VsFPcoBcJCNhSTVL61uAmJo/ohBl+vkCOzJ2zslmDiOV2tra hVzbriShZgyNbgIzQo1uusDH4+cURR1BTkNSCfI7FK7kYx3+eNBhGNR2Zn2GEPPI1Jzd wYDg0TcstXU4sME9I8zoPczQAfsA65/LbrPBmxYtXWTvR2L0jqCtBmchwFlv+gRYrjeT RuLggYwEe7RQWye5gOgp/PtLZ1ecAyYOYKd/4ZCu6r2Qs4txlkxbqgFjOnO3IU96z7bi 2Zip/PMlrU+05jJO3EyutitBggVJK3Z9RDFy356ItWmh5xLUUjClM+CvYerdZm4mAerw 8l0w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1701141532; x=1701746332; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=aNAGTjDRK2uz3X+viYd2HPrnhIXsIDutv38NEyAwfLU=; b=lTIcCrBJd/IT0txCr6W+NUh7csLBsvTV+G2nXOwmnQkvSmWqLIM1I40tSqyQIHhSpG j450EM16LaYfA+ikIRfG9pllyiSPzPc7EnmXJ1CFpiBR0CZKj/Vl1zXJm4L1AzYFzLeU Gae7TwFZBtsc9qjxpUfeXFlbDUzhJGD5308TE31EI8CCrvR37pbRrINLSdqFgazYBQbx zMj5D5srPb2XzduCuLEyCffkhQXNEANN/R3NBgv4P6G12oaxeoBot/w74+IaT6HfESuU daJOWBKvQFI5gKmrSkUIgJD9gt4MtepC3m66XPHBdfGbl97Dtg4q+D0nWxR/3lOJDofM 50pA== X-Gm-Message-State: AOJu0Yw6ZUPMT6ZW9+sMG0014NsZnIv9bFnhMh797h24cJ1W/iXCCl4i wZS2irdKNe2FjuPgmGJ+WZtXQw== X-Received: by 2002:a17:903:2308:b0:1ce:6312:5373 with SMTP id d8-20020a170903230800b001ce63125373mr14356179plh.0.1701141532190; Mon, 27 Nov 2023 19:18:52 -0800 (PST) Received: from [10.4.104.221] ([139.177.225.238]) by smtp.gmail.com with ESMTPSA id h4-20020a170902f54400b001cfca674329sm3140094plf.90.2023.11.27.19.18.49 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 27 Nov 2023 19:18:51 -0800 (PST) Message-ID: Date: Tue, 28 Nov 2023 11:18:46 +0800 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [RFC PATCH v1 0/4] hugetlb: parallelize hugetlb page allocation on boot Content-Language: en-US To: David Rientjes , David Hildenbrand Cc: Gang Li , Mike Kravetz , Muchun Song , Andrew Morton , linux-mm@kvack.org, linux-kernel@vger.kernel.org References: <20231123133036.68540-1-gang.li@linux.dev> <5c0e27f2-5826-4537-a1ab-1debfab65b9a@redhat.com> <28e28c2a-e72d-a181-e87a-39cecc8c3c76@google.com> <9d5de524-28ee-4d71-9493-f77967ea213c@redhat.com> <783f8bac-55b8-5b95-eb6a-11a583675000@google.com> From: Gang Li In-Reply-To: <783f8bac-55b8-5b95-eb6a-11a583675000@google.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-0.9 required=5.0 tests=DKIM_SIGNED,DKIM_VALID, DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI, SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lipwig.vger.email Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (lipwig.vger.email [0.0.0.0]); Mon, 27 Nov 2023 19:19:24 -0800 (PST) On 2023/11/25 04:00, David Rientjes wrote: > On Fri, 24 Nov 2023, David Hildenbrand wrote: > >> And there, the 65.2s won't be noise because that 12TB system is up by a snap >> of a finger? :) >> > > In this single boot test, total boot time was 373.78s, so 1GB hugetlb > allocation is 17.4% of that. Thank you for sharing these data. Currently, I don't have access to a machine of such large capacity, so the benefits in my tests are not as pronounced. I believe testing on a system of this scale would yield significant benefits. > > Would love to see what the numbers would look like if 1GB pages were > supported. > Support for 1GB hugetlb is not yet perfect, so it wasn't included in v1. But I'm happy to refine and introduce 1GB hugetlb support in future versions.