Received: by 2002:a05:6a10:af89:0:0:0:0 with SMTP id iu9csp5458885pxb; Wed, 26 Jan 2022 12:27:55 -0800 (PST) X-Google-Smtp-Source: ABdhPJybkb/6FFAGq4lBrfcelGvufSubqEyY2UOKR5qnsSgqL1P6FR4u2sWw6kb8gJrrg8sTPgKd X-Received: by 2002:a17:903:4101:: with SMTP id r1mr621750pld.107.1643228875557; Wed, 26 Jan 2022 12:27:55 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1643228875; cv=none; d=google.com; s=arc-20160816; b=wpG/U9s9yJCZyrw++aqqrpC7RdDy3QIgwauedOvvvwzOKyy2ih2yR98fZ3ywdJerpV WgPhJamhNz66diiCwCZJIPWNDNmvv46YTMwtGcVuYIMGQnUuvcaE2w2kZ/iZhwN3HeJs mwefaDdIf8hjx9cV/160kIO25M9HLT3UT6yfnkNHvaF9akNt2nmJC5zpnf0JBbINtgcu TdG0OL8lVQneybm6JAUIZNtAESWxZhJHAOoCD7M9zhb3ddNATxNdC1CH09dmkIWU1zWy Ta5jG6udP88m0PWO7rMFsOYglleI5cHzrLXLIokdR8ycK1L7+OIpyOgCZqL+tn67Yh4B U+PA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:cc:to:subject:message-id:date:from:in-reply-to :references:mime-version:dkim-signature; bh=foarPWstnqecVutxOFimxf2djiTBSA+fwdzyLI4AMhY=; b=tD+XsYBShwz2c3esMq+/z1uInzhnPC0Z3J3y6I1mPQLd5dTd4u/VSmNiVJKKPTJDsl INZaot5fb/EMYJYMq2W1FSRRUynoBN8XGmEyVjjeGN4Nlhpm04doSE91TTBXl2ER6YKa 60ZwgC4zear+5vw7vI9S2OGAlcSruDkmH/iPfoqB6lJBqaKOJGBjAQ1tnw553bYYj/Gn lpw/WJjyxfVo24wFfZOhf360mXw1nHiq5ndwABC7WK8JJ7wwz1NMcpQ58onarnvJ5UK6 mVhcyiT8KTZETTnHh8uui0PqFOu2HxKyjY5lX48UIbMt77GwE4VXBXqGrHh++kmWJByg H4TA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@bytedance-com.20210112.gappssmtp.com header.s=20210112 header.b=MP7X8j02; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=bytedance.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id u22si3683183pjx.70.2022.01.26.12.27.43; Wed, 26 Jan 2022 12:27:55 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@bytedance-com.20210112.gappssmtp.com header.s=20210112 header.b=MP7X8j02; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=bytedance.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S238123AbiAZIFM (ORCPT + 99 others); Wed, 26 Jan 2022 03:05:12 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:52576 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230011AbiAZIFL (ORCPT ); Wed, 26 Jan 2022 03:05:11 -0500 Received: from mail-yb1-xb29.google.com (mail-yb1-xb29.google.com [IPv6:2607:f8b0:4864:20::b29]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 93D09C061744 for ; Wed, 26 Jan 2022 00:05:11 -0800 (PST) Received: by mail-yb1-xb29.google.com with SMTP id r65so65396713ybc.11 for ; Wed, 26 Jan 2022 00:05:11 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bytedance-com.20210112.gappssmtp.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=foarPWstnqecVutxOFimxf2djiTBSA+fwdzyLI4AMhY=; b=MP7X8j0220ckd7ioqLPwVWazTygw6YKb48hBqEeUHkG9GO2xY3pK2T9Jb8I1RKYQ17 IRHKHKOaKnjWrs90cBaHyVq5PrLcPuPPqCbtdt9pmBlpu89UVafuEV0iRh85cRmZiZQW yT5EThXelesaDDlv6D9ICgf0FdPHL2P48B1lpdihdp+MbBAkpEwsoMQ45G6gwfyRPszf HUZ+2An2mfU0hVtAOwFhci8hL/6k/NvkHOyeNYFUr/Sow0NbXsmyIa7a6sRlLVTTef3K 0WDK+p0TRhFn1SpqhqksVXZzxrjNWDXBE09qD2J8EX7mClRAEsr5wvWQwD+790ZB4Eok IBRA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=foarPWstnqecVutxOFimxf2djiTBSA+fwdzyLI4AMhY=; b=aUqiroFYdXMqONEyqBE6HzVtCeIho160+zZrTkCkx9w4eVH4PLTUQgVnplMlOJkdRp rH62qAc2s/BXmU9gTwn1LtluLkeFB5aR6sVCJ01uLhAbP6etojetALo0jNNhUcoa7U8F drvyLRdcI8+m9H33F9P1/xLt2o1WfMM8CUtx2219Ns1IhUIp1lSB9EK3Sun9ioZGlsNZ SEXE1OzIW333GnUvOpjkBxc1udO7eeE5GCspEsuAwxmriGJsw95T+naaPc45+3mg2g4K 1RikVhXSKhq6Y2XJmcFlsvj/B/s12bOQyIOUD+yReGp/TfcsM3F4OCUirya6PHTyLwGo /uVA== X-Gm-Message-State: AOAM532heJGhArdTU6ll4jEdH0x3+yXVlLUgoekXfR3NTAFCZUhw2cAM jEjMyHuDThDYWI4g4UYLvDCzI53n9tGRT0E2r+D7YA== X-Received: by 2002:a25:af4b:: with SMTP id c11mr34418179ybj.49.1643184310524; Wed, 26 Jan 2022 00:05:10 -0800 (PST) MIME-Version: 1.0 References: <20211101031651.75851-1-songmuchun@bytedance.com> <35c5217d-eb8f-6f70-544a-a3e8bd009a46@oracle.com> <20211123190952.7d1e0cac2d72acacd2df016c@linux-foundation.org> In-Reply-To: <20211123190952.7d1e0cac2d72acacd2df016c@linux-foundation.org> From: Muchun Song Date: Wed, 26 Jan 2022 16:04:34 +0800 Message-ID: Subject: Re: [PATCH v7 0/5] Free the 2nd vmemmap page associated with each HugeTLB page To: Andrew Morton Cc: Mike Kravetz , Oscar Salvador , David Hildenbrand , Michal Hocko , Matthew Wilcox , Jonathan Corbet , Xiongchun duan , Fam Zheng , Muchun Song , Qi Zheng , Linux Doc Mailing List , LKML , Linux Memory Management List , "Song Bao Hua (Barry Song)" , Barry Song <21cnbao@gmail.com>, Chen Huang , "Bodeddula, Balasubramaniam" Content-Type: text/plain; charset="UTF-8" Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Wed, Nov 24, 2021 at 11:09 AM Andrew Morton wrote: > > On Mon, 22 Nov 2021 12:21:32 +0800 Muchun Song wrote: > > > On Wed, Nov 10, 2021 at 2:18 PM Muchun Song wrote: > > > > > > On Tue, Nov 9, 2021 at 3:33 AM Mike Kravetz wrote: > > > > > > > > On 11/8/21 12:16 AM, Muchun Song wrote: > > > > > On Mon, Nov 1, 2021 at 11:22 AM Muchun Song wrote: > > > > >> > > > > >> This series can minimize the overhead of struct page for 2MB HugeTLB pages > > > > >> significantly. It further reduces the overhead of struct page by 12.5% for > > > > >> a 2MB HugeTLB compared to the previous approach, which means 2GB per 1TB > > > > >> HugeTLB. It is a nice gain. Comments and reviews are welcome. Thanks. > > > > >> > > > > > > > > > > Hi, > > > > > > > > > > Ping guys. Does anyone have any comments or suggestions > > > > > on this series? > > > > > > > > > > Thanks. > > > > > > > > > > > > > I did look over the series earlier. I have no issue with the hugetlb and > > > > vmemmap modifications as they are enhancements to the existing > > > > optimizations. My primary concern is the (small) increased overhead > > > > for the helpers as outlined in your cover letter. Since these helpers > > > > are not limited to hugetlb and used throughout the kernel, I would > > > > really like to get comments from others with a better understanding of > > > > the potential impact. > > > > > > Thanks Mike. I'd like to hear others' comments about this as well. > > > From my point of view, maybe the (small) overhead is acceptable > > > since it only affects the head page, however Matthew Wilcox's folio > > > series could reduce this situation as well. > > I think Mike was inviting you to run some tests to quantify the > overhead ;) Hi Andrew, Sorry for the late reply. Specific overhead figures are already in the cover letter. Also, I did some other tests, e.g. kernel compilation, sysbench. I didn't see any regressions. > > > Ping guys. > > > > Hi Andrew, > > > > Do you have any suggestions on this series to move it on? > > > > I tossed it in there for some testing but yes please, additional > reviewing? It's already been in the next-tree (also in our ByteDance servers) for several months, and I didn't receive any negative feedback. Do you think it is ready for 5.17? Thanks.