Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
From:   Sidhartha Kumar <sidhartha.kumar@oracle.com>
To:     linux-kernel@vger.kernel.org, linux-mm@kvack.org
Cc:     akpm@linux-foundation.org, songmuchun@bytedance.com,
        mike.kravetz@oracle.com, willy@infradead.org, vbabka@suse.cz,
        william.kucharski@oracle.com, dhowells@redhat.com,
        peterx@redhat.com, arnd@arndb.de, ccross@google.com,
        hughd@google.com, ebiederm@xmission.com,
        Sidhartha Kumar <sidhartha.kumar@oracle.com>
Subject: [PATCH 0/7] begin converting hugetlb code to folios
Date:   Mon, 29 Aug 2022 16:00:07 -0700
Message-Id: <20220829230014.384722-1-sidhartha.kumar@oracle.com>
Content-Transfer-Encoding: 8bit
Content-Type: text/plain
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?3FV3XMWyB07yIVe2bf8z5yIGTl+z3aBJVNBTjhIUp+H3aNOs367Mgkl740HN?=
 =?us-ascii?Q?CD72cxKImGSJYDGgMJRpv2Z2uM4I96zzkJJrODtqip3zVeAQ/JtA3sUQfx/Z?=
 =?us-ascii?Q?ows1pi9J2fCpESTTw8OA17ZII4YHOlvdoEuF3EqM1fHPXKCU2up3ydH/676J?=
 =?us-ascii?Q?xRecSuM0EiANGBHwkxBGN1gpNnzd+yxX46NxTUDglmDHIN04bP6QIjTCYOz/?=
 =?us-ascii?Q?i52wgv9OCUz4J9iTx4SS/89rHZ0xSMXVfDMF0xCyltIB9xnXIwUGRpD1Nrlh?=
 =?us-ascii?Q?pe8TCggDN/FWXqSCQpNaxfxDx9myaQoUPwv7wUJ7cmgv47JO51hpI8gFVPaM?=
 =?us-ascii?Q?nnllt8GXoskmRjD8oLwDy4/j6CQz/oyQ+nM11EgmWec++WzkykzYKH4A5Whw?=
 =?us-ascii?Q?digV+ikVvOljJuUL9+V7mmLU02Z7PBQrjat2KQirlvaTjNK2zZIWNWfYWzNT?=
 =?us-ascii?Q?WQuew8vikd9Zq5dMtbwfNl6nIPkASi4bRXXehkc1TdJAYDXoQtRiqsIDE7ua?=
 =?us-ascii?Q?gNJ7PLPzkPlD6/B9TpQoN0WB9kVBVM+yA/9f2r1wzdu7vE+nzK1LkVqp65Oo?=
 =?us-ascii?Q?hF9sJiyzS38MhIZO7SUQB0Zr0sMMZN4mkJu1v6UzUaLqEIce9yWwTCTmG8fd?=
 =?us-ascii?Q?n3sHd8sf1ECSP9irnApijhV44wsG3CN13u21UB/3xqxTUukzaAEYtZAkBxzc?=
 =?us-ascii?Q?IYFWobOL9kPJK+8rOCH0au9WMowK4QNmnLK3Wb71cgPpLTd9gGpdZGRWRr0f?=
 =?us-ascii?Q?C5ExbvlfvuniZqfxBso1JV3UdMK+igutbAOIzze2TJtLNRrSCOVPf80iHQVE?=
 =?us-ascii?Q?04jCR1b8kubHH20Pwano4SoeppnRJPSjXD1S082jd49hIr3PQRNuHbz2cmA+?=
 =?us-ascii?Q?mYcMFxhYYKMZEu6mSAkVXogaZL4ohEFVi9uLE/6Q+0ILD1UFh21FjpNMjodW?=
 =?us-ascii?Q?5uJliXlHWVjGqwgW0vclz1EvaP9DIfa3UfryJ6LhVc5mFqLJrvW0XKWsSpr/?=
 =?us-ascii?Q?GYoFDRR39kguMng/4T9yo9l5EoRSzoabIGla69bgvmnyxlS+/ajWPdpstQ34?=
 =?us-ascii?Q?NJpsg7mLF0BMigjGGcQ6OE0dbrSG6Wm+vPN6bgBeCuITBnQgnV58Czte7jKl?=
 =?us-ascii?Q?2xv/ZhSt1puybxQH7LW/NZWxIb0JjmHg2rsHNIh5CIDpQkKk0qk15mLeYvIf?=
 =?us-ascii?Q?GyPdqamh8xftmq1xSIgu6xC6+m+an3ODfMDj3htIDUP7NcMa4VM6AXD7jevi?=
 =?us-ascii?Q?JPXlMu0FmXOmib5NeVh439kGNGmuvLx4Zjh33sZJyZkLlln600O6qyrbsYe/?=
 =?us-ascii?Q?/ZzuP7u8EtaX9lnsZ5RF4iK5abwsd58QkX+ole42xeT0Es2pFFliMZ0ZVDrD?=
 =?us-ascii?Q?htz1ppb05RafvT0PGvqlvPvMN7NdpxaUhK2bUEsA5g6rZpXUwCytqEiikmNo?=
 =?us-ascii?Q?zP42qRY6TpylN+8vbc85wwbQUdOBwzriucdoY7WEqlvEerIfd70xW1hNyLx8?=
 =?us-ascii?Q?62jTr49RJ7QdOrpjcPn458KCDUDn+kpVv4lsBHAOseQiDzCB/MUD0idHvJs9?=
 =?us-ascii?Q?FVMoYSRdPp19CPfhaOxI+9BELM3mPIhe4uHok9vU27eOBjN1Nq0kUvdM+JVW?=
 =?us-ascii?Q?8g=3D=3D?=
X-OriginatorOrg: oracle.com
X-MS-Exchange-CrossTenant-Network-Message-Id: d78af17c-9dc7-47c1-dc1c-08da8a124b35
X-MS-Exchange-CrossTenant-AuthSource: CH0PR10MB5113.namprd10.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 29 Aug 2022 23:00:40.3474
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: fxO+6xXp/6INhHVTgQFnY/fgudTFqzC52jgXsi9WDzlr/IguistvBZnWUnFOcuXPXNKmKPLdUEjrY1/BpwafgxqiiN48j6cw5/Ksj/no5IY=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BYAPR10MB3736
X-Proofpoint-Virus-Version: vendor=baseguard
 engine=ICAP:2.0.205,Aquarius:18.0.895,Hydra:6.0.517,FMLib:17.11.122.1
 definitions=2022-08-29_11,2022-08-25_01,2022-06-22_01
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 malwarescore=0 suspectscore=0
 mlxlogscore=769 adultscore=0 phishscore=0 spamscore=0 bulkscore=0
 mlxscore=0 classifier=spam adjust=0 reason=mlx scancount=1
 engine=8.12.0-2207270000 definitions=main-2208290101
X-Proofpoint-ORIG-GUID: eDDM-DHteFb4OwkX72uDstp1yFmAKdgM
X-Proofpoint-GUID: eDDM-DHteFb4OwkX72uDstp1yFmAKdgM
X-Spam-Status: No, score=-2.8 required=5.0 tests=BAYES_00,DKIM_SIGNED,
        DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_LOW,
        RCVD_IN_MSPIKE_H2,SPF_HELO_NONE,SPF_NONE,T_SCC_BODY_TEXT_LINE
        autolearn=ham autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

This patch series starts the conversion of the hugetlb code to operate
on struct folios rather than struct pages. This removes the ambiguitiy
of whether functions are operating on head pages, tail pages of compound
pages, or base pages. 

This series passes the linux test project hugetlb test cases.

Patch 1 adds hugeltb specific page macros that can operate on folios.

Patch 2 adds the private field of the first tail page to struct page.
This patch depends on Matthew Wilcox's patch mm: Add the first tail
page to struct folio[1]:

Patchs 3-4 introduce hugetlb subpool helper functions which operate on
struct folios. These patches were tested using the hugepage-mmap.c
selftest along with the migratepages command.

Patch 5 converts hugetlb_delete_from_page_cache() to use folios.
This patch depends on Mike Kravetz's patch: hugetlb: rename 
remove_huge_page to hugetlb_delete_from_page_cache[2]:


Patch 6 adds a folio_hstate() function to get hstate information from a
folio.

Patch 7 adds a user of folio_hstate().

Bpftrace was used to track time spent in the free_huge_pages function
during the ltp test cases as it is a caller of the hugetlb subpool
functions. From the histogram, the performance is similar before and
after the patch series. 

Time spent in 'free_huge_page'

6.0.0-rc2.master.20220823
@nsecs:
[256, 512)         14770 |@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@|
[512, 1K)            155 |                                                    |
[1K, 2K)             169 |                                                    |
[2K, 4K)              50 |                                                    |
[4K, 8K)              14 |                                                    |
[8K, 16K)              3 |                                                    |
[16K, 32K)             3 |                                                    |


6.0.0-rc2.master.20220823 + patch series
@nsecs: 
[256, 512)         13678 |@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@|
[512, 1K)            142 |                                                    |
[1K, 2K)             199 |                                                    |
[2K, 4K)              44 |                                                    |
[4K, 8K)              13 |                                                    |
[8K, 16K)              4 |                                                    |
[16K, 32K)             1 |                                                    |

[1] https://lore.kernel.org/linux-mm/20220808193430.3378317-6-willy@infradead.org/
[2] https://lore.kernel.org/all/20220824175757.20590-4-mike.kravetz@oracle.com/T/#me431952361ea576862d7eb617a5dced9807dbabb

Sidhartha Kumar (7):
  mm/hugetlb: add folio support to hugetlb specific flag macros
  mm: add private field of first tail to struct page and struct folio
  mm/hugetlb: add hugetlb_folio_subpool() helper
  mm/hugetlb: add hugetlb_set_folio_subpool() helper
  mm/hugetlb: convert hugetlb_delete_from_page_cache() to use folios
  mm/hugetlb add folio_hstate()
  mm/migrate: use folio_hstate() in alloc_migration_target()

 fs/hugetlbfs/inode.c     | 22 ++++++++++----------
 include/linux/hugetlb.h  | 45 ++++++++++++++++++++++++++++++++++++----
 include/linux/mm_types.h | 15 ++++++++++++++
 mm/migrate.c             |  2 +-
 4 files changed, 68 insertions(+), 16 deletions(-)

-- 
2.31.1