Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
From:   "Alex Zhu (Kernel)" <alexlzhu@fb.com>
To:     David Hildenbrand <david@redhat.com>
CC:     "linux-mm@kvack.org" <linux-mm@kvack.org>,
        Matthew Wilcox <willy@infradead.org>,
        "hannes@cmpxchg.org" <hannes@cmpxchg.org>,
        "akpm@linux-foundation.org" <akpm@linux-foundation.org>,
        "riel@surriel.com" <riel@surriel.com>,
        Kernel Team <Kernel-team@fb.com>,
        "linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>
Subject: Re: [RFC 2/3] mm: changes to split_huge_page() to free zero filled
 tail pages
Thread-Topic: [RFC 2/3] mm: changes to split_huge_page() to free zero filled
 tail pages
Thread-Index: AQHYuMfP12/URiDwn0CzT9+YyQULcK3A+PIAgACKfoA=
Date:   Fri, 26 Aug 2022 18:34:40 +0000
Message-ID: <9AF37F8E-27FB-4DF4-B745-36CB87E39D91@fb.com>
References: <cover.1661461643.git.alexlzhu@fb.com>
 <490fcdd204ae129a2e43614a569a1cf4bdde9196.1661461643.git.alexlzhu@fb.com>
 <ead1bc0e-c9df-d590-3423-9cfa449167e7@redhat.com>
In-Reply-To: <ead1bc0e-c9df-d590-3423-9cfa449167e7@redhat.com>
Accept-Language: en-US
Content-Language: en-US
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?AZmdL9hIJR2I33D8d6PDn+rHM9/btVulBksdtCSsgnBL/mnKRzxwgJ07qovH?=
 =?us-ascii?Q?UsrBQLRQWtzV6sZ0bN6hjbBCxio7HM4G5PF/gD6yVdQcAO+h6SBYuSdKAGz4?=
 =?us-ascii?Q?U3ZASH7+0mv42cVrxg5nmpRf3bf+BDUspSLaa5glnq9gQHT/oTAgjODXKEoU?=
 =?us-ascii?Q?mnhM0yZhdlnIiMmGALr9q/ZJtnTKPkQVxB84ci3tlaxo5/pzOCBqfJgJiqiY?=
 =?us-ascii?Q?gEaP4yb95NGP1deUmZ20dv1GheFx9qg2gptqjydwQlRauJaI1hKx2NSP/tP6?=
 =?us-ascii?Q?jbW2Fk1HZEuD0RUfPh7dmsCl5GOPBo+WCTV4QTSHZghdATv8mY2nOUaQv7MC?=
 =?us-ascii?Q?bY5+QW2B56uVnLETPTi1vWXaFycX/Wfms0b96xUYZG6lzK9bU8P9FeVa5zHO?=
 =?us-ascii?Q?RNrViFhkb/oq9H18SL/ad4GSWGXSukOfK6a7g6OqFmZrphxGcvnFku6s1rnq?=
 =?us-ascii?Q?XJP6YN+D7RGPgUzeUpEh6nPRaZh5yq9r1morfdkFFHjHl+GKNh8twHXZ8u1q?=
 =?us-ascii?Q?sdRFJSbyZft84wkINxxAwqGBAbpHtQuCGIXbhjzmpg3hBJXePks50VgElZwY?=
 =?us-ascii?Q?a9uwjk/+Lel5aua7juY23cCNXlHOVO4mLAuMyDHqUzu+WXVi0PEFzsqvO7qJ?=
 =?us-ascii?Q?IhPBFhSybXWcsh4TdqNLtjpmAO+AW6QsQ5Ldyx7lTiYzvQhZC2MyTit2jVvQ?=
 =?us-ascii?Q?wzP1t393/T2VPJId/U8+kB3r2ciqgVT95AOvVIZCHiTk9jUm7wx84jXbPsEd?=
 =?us-ascii?Q?DesO21eP64FT9UMbg4jj80MZc4bzYcawgx+f8/1yxWSqm7jGV9/lSrpSbE4g?=
 =?us-ascii?Q?3gU81PhDQqZocLOnaq5s3KpOEzGtuh9+brVHivxD4yfFoAVnxWwI1RPvNsr0?=
 =?us-ascii?Q?ezsgArPMWN1D3vaIESx1fTkBXTDxM02gW2wZ1FsDeI3l2IiPs8heB0MsIyNR?=
 =?us-ascii?Q?raeYPYxmc4fjVHs6QkvSWvIrH5RroGTUphc51XdmuGPje5e5OJh38PzcBafW?=
 =?us-ascii?Q?UlwYdVylJxrNKEaOgN7eawgpWDEmZ4Hy4QADnj4F6cz/zzhHfklRlZhww7cX?=
 =?us-ascii?Q?mTt33aXXp0OobdSYLgS5cd/d4PS94r+CL9caGYYHVudny2ZPmAfI8oynUgf1?=
 =?us-ascii?Q?Mqj7JjPIHcIJ9mhaRccqGMdRs5YzIQeGy953uWd5HIO+4cLQRU4m9HTRsstG?=
 =?us-ascii?Q?KR5VXGNn7VSJzYOKPicweoxdBSZaVzucBS0Vc6In6TTwcgsy5i0e+i+iHH/2?=
 =?us-ascii?Q?Q/iB0spWoInee4/nhToxT2iSpjj97ua8rEjvuvTMkrwirNPxFHdePyYoBv4x?=
 =?us-ascii?Q?IfkuvyJlgEqm903BhmhLzqxTd/clrtqbR7TJ9xeiwkm2SMSjY0kXI6sz7dxy?=
 =?us-ascii?Q?yLe461E147haJwbJu1aLcwDp05DQTpqnyT6qkZ6GLF0O6cJnYCdKnH+bGT7o?=
 =?us-ascii?Q?kFY2o8i2H/qRPHrFyktCr+HSEv3HW1qmwhK+qU4OwX46TlJvHSAw25VIIpq9?=
 =?us-ascii?Q?EIrAQztZuX8T7m70qWTrnEIOFOTQmXzchXHCejzaHlXQcGeHOIY24KZIHIDi?=
 =?us-ascii?Q?emRo5XgKTEt7s2kXtpUU9AFjYnJ2bd5UvpAoA9U6yorbELf82dv0FHxI8SU+?=
 =?us-ascii?Q?MgGCJZfjEtN6E53kfd2wXBU=3D?=
Content-ID: <0B27765C8F0E954DA3745CE57EC83BDD@namprd15.prod.outlook.com>
X-OriginatorOrg: fb.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: CY4PR15MB1781.namprd15.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 1748fb14-c34d-474e-c3d5-08da8791a30c
X-MS-Exchange-CrossTenant-originalarrivaltime: 26 Aug 2022 18:34:40.1408
 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 8ae927fe-1255-47a7-a2af-5f3a069daaa2
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: LedvFSQIzinxi8+ecre/EfgoLNb2O1VzNyZawJB1t7FhxPhWOtyKoSbZxy2IImRY
X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN2PR15MB3022
X-Proofpoint-GUID: qIO0X5wgF0jPf104_nleH9LFJwMGJgWk
X-Proofpoint-ORIG-GUID: qIO0X5wgF0jPf104_nleH9LFJwMGJgWk
Content-Type: text/plain; charset="us-ascii"
X-Proofpoint-UnRewURL: 0 URL was un-rewritten
MIME-Version: 1.0
X-Proofpoint-Virus-Version: vendor=baseguard
 engine=ICAP:2.0.205,Aquarius:18.0.895,Hydra:6.0.517,FMLib:17.11.122.1
 definitions=2022-08-26_10,2022-08-25_01,2022-06-22_01
X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH,
        DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_NONE,
        RCVD_IN_MSPIKE_H3,RCVD_IN_MSPIKE_WL,SPF_HELO_NONE,SPF_NONE,
        T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org


> On Aug 26, 2022, at 3:18 AM, David Hildenbrand <david@redhat.com> wrote:
> 
> !-------------------------------------------------------------------|
>  This Message Is From an External Sender
> 
> |-------------------------------------------------------------------!
> 
> On 25.08.22 23:30, alexlzhu@fb.com wrote:
>> From: Alexander Zhu <alexlzhu@fb.com>
>> 
>> Currently, when /sys/kernel/mm/transparent_hugepage/enabled=always is set
>> there are a large number of transparent hugepages that are almost entirely
>> zero filled.  This is mentioned in a number of previous patchsets
>> including:
>> https://lore.kernel.org/all/20210731063938.1391602-1-yuzhao@google.com/
>> https://lore.kernel.org/all/
>> 1635422215-99394-1-git-send-email-ningzhang@linux.alibaba.com/
>> 
>> Currently, split_huge_page() does not have a way to identify zero filled
>> pages within the THP. Thus these zero pages get remapped and continue to
>> create memory waste. In this patch, we identify and free tail pages that
>> are zero filled in split_huge_page(). In this way, we avoid mapping these
>> pages back into page table entries and can free up unused memory within
>> THPs. This is based off the previously mentioned patchset by Yu Zhao.
>> However, we chose to free zero tail pages whenever they are encountered
>> instead of only on reclaim or migration. We also add a self test to verify
>> the RssAnon value to make sure zero pages are not remapped.
>> 
> 
> Isn't this to some degree splitting the THP (PMDs->PTEs + dissolve
> compound page) and then letting KSM replace the zero-filled page by the
> shared zeropage?
> 
> -- 
> Thanks,
> 
> David / dhildenb

AFAICT KSM may or may not replace the zero filled page with the shared zero page depending on whether the VMA is mergeable. Whether
or not the VMA is mergeable comes from madvise. Madvise only applies to certain memory regions. Here we have THP always enabled rather than on madvise, and the end goal is to deprecate madvise entirely.

These THPs would previously not have been split at all, as we could not identify which THPs were underutilized, and would thus
have just been memory waste when THP was always enabled. 

In split_huge_page() we chose the most straightforward approach to free (zap) the zero page immediately to get rid of the memory waste. It does not seem to me that KSM is necessary here.

Thanks,
Alex