Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Date:   Mon, 24 Apr 2023 18:27:21 -0700
From:   Mike Kravetz <mike.kravetz@oracle.com>
To:     Sidhartha Kumar <sidhartha.kumar@oracle.com>
Cc:     linux-kernel@vger.kernel.org, linux-mm@kvack.org,
        akpm@linux-foundation.org, songmuchun@bytedance.com,
        willy@infradead.org
Subject: Re: [RFC PATCH 0/4] change ->index to PAGE_SIZE for hugetlb pages
Message-ID: <20230425012721.GA6696@monkey>
References: <20230413231452.84529-1-sidhartha.kumar@oracle.com>
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <20230413231452.84529-1-sidhartha.kumar@oracle.com>
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?lzcGwD0LBBe89pBZjiBRCuZqqukrZjsA4b7rfjr6msvyCkvxR6lM++LTnMkD?=
 =?us-ascii?Q?bYFto4HYrEB6TfZiM8ozDGtFiOyvJICE48MzM2HUWGlgJHgEJc6HFuV+8U/e?=
 =?us-ascii?Q?f7h5jF0IYjgKM//XhIg/1XRZ8LXpTXX9BCXIOIF/8yfBXfcTa0ZrR/909OD0?=
 =?us-ascii?Q?3BwGC+4n69PCxb4+G6QGG7b6Ye8abSnEIOJr29+dl8udiRc78eIluPffk/z5?=
 =?us-ascii?Q?BHD06rPllZYhocL7eAhqUB83AzbhVCkFeEAvo3Axa8rHZ6SUshxj489co/LI?=
 =?us-ascii?Q?Pp+gwBHUpQdKTxe7e51dE1SydhMh+zGQVcJO+sT5NpxACwM07bVPIcKyKR2a?=
 =?us-ascii?Q?V7JbXhhZJ8aBwdrwhOqx0MlqMZlcPmmBdxZPU0dfIu5O3cJs22fbFh1Aj2Fn?=
 =?us-ascii?Q?1CpczSd63NjE+2zABYwZoZnSrnZQRoLdU9SQJpd+UX+oEolRa7nodnprTLuZ?=
 =?us-ascii?Q?EtGM1WIkz6pJ5GNnHDjAZQ1nc/egz261fVKFYzHIetRrjCVNhDpiupd+XdXD?=
 =?us-ascii?Q?D+K1dZ+QWabiiP0OKauvj6fgpxn4bSmUf/MoEKp0skAd/AaqxWET6ATBDtF0?=
 =?us-ascii?Q?MmeygyBHovAXu0a3yfyTpSCBQStJzC6wEbFvgjGkOuum/efiZJwb00j7j+vn?=
 =?us-ascii?Q?D63Iif3ENWYt9jlDlR2n9Wbp5PshOe1tPnvFel8ik9ulVhTuSNdZCXDBC1Lg?=
 =?us-ascii?Q?4MV8GZBGHJsW2tmjFqhw8EJbJuapAgCUXUEDkaZOTyLrkEfqGkW/IOUtQEUZ?=
 =?us-ascii?Q?21Y4wncg3gbYL91tDUJiLZHHjQYsoJiTzudOedRV1Eh+F36Ad+him6z4Gey6?=
 =?us-ascii?Q?3KOsAY64GQ/lmcCAKXXGBurIz9BEY8XUPSYPZKdtBhTTQpSkAsIw8h8dyCH3?=
 =?us-ascii?Q?UhGNYt/9MhwC8812JGObLGTARWLoGaSyCCD153FDbf+0VEshMnBBj3bsObYA?=
 =?us-ascii?Q?kseso6hbfAduVoz0ZVtMCCzC4Nprplm4gDjlCxRXobxV7nrMLJu0/gPp8P7o?=
 =?us-ascii?Q?RKDVP762adVaunHUao4gDRggoz6zpX3V/f3PsWuJWZTTLEKvObY3pAVzIXqX?=
 =?us-ascii?Q?+hex7WE4anw7UBKdbkVD4q9aJLZ9wTis/xGqPfZ9FJaJ1wJvGHkk3UcLcu5X?=
 =?us-ascii?Q?h9pfT6NStK1vXuTaV+EhH01xOWhfhy82cIAbReYC2zaXLAoVztMuUkYnugPg?=
 =?us-ascii?Q?zz7v6QQRIR4sXVczNK+OiU8OBJhOPwssnGofZBWRIKkLy/5D/1ZTQYLO6ya1?=
 =?us-ascii?Q?X5BF31JoC2EBE63//ao/XL+TfNoeih00fxRYIlUvOmhDWJqdLAjgj88nzCYp?=
 =?us-ascii?Q?fRs9xF+Pc+iH3gFneZMVZ4ovrDiwe7sTC1uSwR/StoA23P9lqTQ5anh9JMNA?=
 =?us-ascii?Q?Z/SiNKzByeJo8LgWbMKYrli3Z+XDd3t1Upboegw8TW3wH2K27ibTTK5orBbR?=
 =?us-ascii?Q?HfZWgsV6KJtH03itg5yGoWoBGpWod1Jynhqedjf6TwPFzPa7/9rXm5/VoOVO?=
 =?us-ascii?Q?vStQ1kMUrwB4y1YTAnJawLcUjZFRThFssMPaAup7dnxinfKD+HHnVfCxPy1t?=
 =?us-ascii?Q?9eykMReF9c54QNACPPOtICOIpeiP6YWdEYKezTHj?=
X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: lkouUmsXLDemmxvRxxFehSm8I3J/AP/CxQrOZyg0LFZlUxy2/pu3SyQBlStWBkJtNdj7hFhNPk/93mBmlVNjwdjTiOKEJfssD1EqklHbLubuAQTdXiPT9Wp0PTV9mXrKwkId0rRL03A3Tp6m273LtzXJNYWNo17wAU8VKipkeKbY6lNvTY6FssNaTfBaU1nBYG8P28DROl5YpkH0uzo8mC0nS8C6X6VHt5Y/KsXdhrOFxDxMIWlmqNPFDNZya6O/VY4HqYKJm3th5hby3/T5Y3Z17OWHxQ83YzM+SubrvCo+FFwdS0BdGVPSU+xM2s2JoVlYnvj1jl0rle35OGF5a+1rGF3Wrzz9kdU3TffJzQPhOVUYvIcbyCj3XS/VXTRkbbb9PkTScgTcYaA64N3jxHGydV6/9t3QKOdykw0MfKeedyy6YINBw/wVshGVpKmVo++TBrzcLIabmMwCGyHAQW1Ns+wvWGUoXDNeR2cwLV1vgn7VE1J93obEV6vjYRdKl+i9CHWAWhUxPP/2DUJ/+DWkbKRb1TYrUWTGLtSbB5I9NcWjqHCISwVQfHTLknLGtitGC2I71JpkCWd2uYWqhWmHK2QTHcCigW/KzdDGeLc6LUdpNIqZUYn5OdZ1mpJkJn+w938BvchaNuF746bfunfdulcxz7UFiQlcGR5JXYJeCQOuU10VvQeLJ7gX1bJTU2Pjj8jy07yLkhOZFbro8usVAtKYXlsMd591DlId4hLjc+MJiWH+Y7iMvdbuDCC37t6B30wEmWruqjqvui5vxjgfHxL9H07EYr1NqGHXF2OXvGk5bSKei3I2HyjxQ6ccd+tVlonqcA7FyQWF1fjTm+yIOcGvftldzwzqvQCh+bRbi4fjXNyS8fccrnKPC9yoNBTOMpzxwuzQ5jtjCuj6aJs0bHbMdRzZpDK8epVYBv0=
X-OriginatorOrg: oracle.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 33b32a5a-f79d-47f1-5b76-08db452c3910
X-MS-Exchange-CrossTenant-AuthSource: BY5PR10MB4196.namprd10.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 25 Apr 2023 01:27:24.5786
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: HN9sUIIp1YqqtOEGYsAOSp2lrDm9r4Ppa2ZQJLfkrIq5a1Ci/tphx/K8aZLppory8MI8mZXrUHSYC8tcY7hE5w==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CH2PR10MB4168
X-Proofpoint-Virus-Version: vendor=baseguard
 engine=ICAP:2.0.254,Aquarius:18.0.942,Hydra:6.0.573,FMLib:17.11.170.22
 definitions=2023-04-25_01,2023-04-21_01,2023-02-09_01
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 mlxlogscore=999 spamscore=0
 malwarescore=0 mlxscore=0 adultscore=0 suspectscore=0 phishscore=0
 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1
 engine=8.12.0-2303200000 definitions=main-2304250011
X-Proofpoint-ORIG-GUID: -yY-KoH1sFvX2OriAeZRsbUsUCU5r9Fr
X-Proofpoint-GUID: -yY-KoH1sFvX2OriAeZRsbUsUCU5r9Fr
X-Spam-Status: No, score=-2.8 required=5.0 tests=BAYES_00,DKIM_SIGNED,
        DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_LOW,
        RCVD_IN_MSPIKE_H2,SPF_HELO_NONE,SPF_NONE,T_SCC_BODY_TEXT_LINE
        autolearn=ham autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

On 04/13/23 16:14, Sidhartha Kumar wrote:
> This RFC patch series attempts to simplify the page cache code by removing
> special casing code for hugetlb pages. Normal pages in the page cache are
> indexed by PAGE_SIZE while hugetlb pages are indexed by their huge page
> size. This was previously tried but the xarray was not performant enough
> for the changes.
> 
> This series fails many of the hugetlb LTP test cases due to bugs in
> accounting and I was hoping to get help/suggestions about why the page
> accounting breaks from my changes. The basic mmap tests pass but the
> advanced ones which involve overcommiting pages fail.

Sorry for the late reply.

I can appreciate the desire for removing hugetlb special cases from page
cache code.  As you note above, hugetlb tracks page indicies based on
huge pages size.  Page cache page indicies are based on base page size.

Within the hugetlb code, the huge page size indicies are used in at
least two places:
- huge page reservations.  There is a rather ugly set of code managing
  hugetlb mapping reservation maps.  Since a reservation is for a single
  huge page, it makes sense to use huge page sized indicies in this code.
- hugetlb mutex table.  The table is hashed by the values 'mapping' and
  index.  This guarantees that all code performing operations on a huge
  page will use the same mutex.  So, using huge page index is a must.

I think this means there is a need to maintain/use both huge page and
base page indicies.  huge page indicies within hugetlb code and base
page indicies within the page cache.

One approach might be to add the conversion from huge page inded to base
page index for all calls into the page cache.  This could be done with
hugetlb specific wrappers.  There already are hugetlb_add_to_page_cache,
hugetlbfs_pagecache_present, and hugetlb_delete_from_page_cache.
New wrappers would be needed for at least filemap_get_folios and
filemap_lock_folio.
-- 
Mike Kravetz