Received: by 2002:a6b:fb09:0:0:0:0:0 with SMTP id h9csp192936iog; Fri, 17 Jun 2022 01:38:04 -0700 (PDT) X-Google-Smtp-Source: AGRyM1uR9Ealmml4VW4ySJVJKPlQjatLfu8glrs1BpPH3loZzLBIpEw+6qgGFzNoen1+G3ONd78A X-Received: by 2002:a05:6402:516e:b0:42d:c48b:b724 with SMTP id d14-20020a056402516e00b0042dc48bb724mr10831491ede.93.1655455083968; Fri, 17 Jun 2022 01:38:03 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1655455083; cv=none; d=google.com; s=arc-20160816; b=HhPpfbX5e7GP0R1nvhVZ1lCLDyD7L4ezd0NCcALMIX8yj4Rlp7CEeU66PomT45WKPb 3y1HU/tnxSaROKW6icd7dCjvTMa9nCbOVl6RN2VMseq4dv5BY0VT7YuBSUBJ/n61B8pw Ro7RQ5C1ePHmbq/MBc2AvVRMBjFvNPx24KDnh38ul3fJhXCGmSxpYJMLMMAXS0viSHga einuDC+Zr++Uck8kHJt+h7eOa07RePBAHXILM8SZsSquCEm/iqyyk7CT5H31955k4twB Ere78qoyjnOmSZoebFOy42COFquZ7CRv09445RO/gnblFRMuNKQBYsWBdKxSLzOPUZja 7dww== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:in-reply-to:content-disposition:mime-version :references:message-id:subject:cc:to:from:date:dkim-signature; bh=7ajw5ZlW7BO6xh4idYg9ZGUxMVX3OZuSbGQMRvZITss=; b=n1Rj4kc8ADEltsKUvhadI2S8Kqcf5J7G8sil1JwS0ePWne0QZcLEoJXo1jRZCdUXwQ 4BzEX6PGhCUXGSIkK6a9I73YVlipVHQ5zWBoteBzwpoc9TwFAg6O6yUA4mzi03t3JumM 28hsxwnY5i1W1W4n6E2EiQIdUTftNlTGp0S/JwSj/J0OGd1VypUshl8e2FCnzS+c9w+X VkiDqImSLb7OX7mc5UNM105thc1GbnWVPif+vxVV0OSMGbXFoYYXNZdbDmFmNcNgLnUT tYFebjwrnkMo1BXjXF00sChafTdkRJjW43nYDr2Y8+eZy4xj3Ii7nowyTl1dQTTDWZE5 OADQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@bytedance-com.20210112.gappssmtp.com header.s=20210112 header.b=BjmCyWwg; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=bytedance.com Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id v4-20020a056402348400b0042b5f804556si3240036edc.15.2022.06.17.01.37.07; Fri, 17 Jun 2022 01:38:03 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@bytedance-com.20210112.gappssmtp.com header.s=20210112 header.b=BjmCyWwg; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=bytedance.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1380688AbiFQINm (ORCPT + 99 others); Fri, 17 Jun 2022 04:13:42 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:52074 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1380002AbiFQINh (ORCPT ); Fri, 17 Jun 2022 04:13:37 -0400 Received: from mail-pl1-x62a.google.com (mail-pl1-x62a.google.com [IPv6:2607:f8b0:4864:20::62a]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 25B8560AA3 for ; Fri, 17 Jun 2022 01:13:33 -0700 (PDT) Received: by mail-pl1-x62a.google.com with SMTP id i15so3291261plr.1 for ; Fri, 17 Jun 2022 01:13:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bytedance-com.20210112.gappssmtp.com; s=20210112; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=7ajw5ZlW7BO6xh4idYg9ZGUxMVX3OZuSbGQMRvZITss=; b=BjmCyWwguCYTpglhYm7P+9sfT2Sf6eI4hqC5TCzRNcj8GpT7Cc5jJvVeFu+/QvdoQO RGPpgCZxneDK+JRvBbAA3vU8YL0MLBkdIjsUazKCO2zJ5IT6caqZ177xBPaHYaNtSFhL wsOPZyAq8zDsC4+RXY1GMKrYj3Yyu9EDxibHdpAAagnIOLEJ3bJD7JOCrpBNaHhaJdjq /4qXmmNFH+/zsDvQ2LPSFYj7Byd34mjZXsxzy6la7Th49HWzuITGgf435hSeF0LnrHen fHCXck9cWmkJX/PFv6Ee2nUXQikqy1BawnEmGitan/14y2a4JTmEO8TSXRXXDJrqoj/v LdRQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=7ajw5ZlW7BO6xh4idYg9ZGUxMVX3OZuSbGQMRvZITss=; b=GaoM3XkOW+qX/x+WHTRJT2aYlDb7p5n6mwhzWXfO6BQ/N0gntNeYjRdaoejBalgDQ+ tz2V1NHrKZOQPnGIrQXRuUoKWImoSEjSlv0NeHkgelEbIzOu7OfCls8IviTxAAzYJP5c w53dyZiK7+Hhlhr5kVvDjpXTSccCF0rCz/OdHBsC2uUOzs09o8cWt+B9pp9WCF8LTxuX GXutCv5NfYqPtUNR7URoCrPOeWWLSXyvrJTeAbBgL7LgBxEKk8UuJYBdBM19C7+k8ZtG DwVKt6+6iX/401MiHYxXNY6aB3cqJKyZGQu5k6dcCiWKtpNfXrqxtdRXSNUozVlpo0l6 E6nQ== X-Gm-Message-State: AJIora8ZgWQxAu455SwlzqHIM67qQ/RwI1Xpm2hBfrHW7Pm64P1PHNAP DPMGy7IlJ1ZuKEzx/optofCjsQ== X-Received: by 2002:a17:90b:4a4c:b0:1e4:da3a:9b07 with SMTP id lb12-20020a17090b4a4c00b001e4da3a9b07mr9398372pjb.242.1655453612597; Fri, 17 Jun 2022 01:13:32 -0700 (PDT) Received: from localhost ([139.177.225.255]) by smtp.gmail.com with ESMTPSA id w22-20020a1709026f1600b0015e8d4eb219sm2932151plk.99.2022.06.17.01.13.31 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 17 Jun 2022 01:13:31 -0700 (PDT) Date: Fri, 17 Jun 2022 16:13:28 +0800 From: Muchun Song To: Mike Kravetz Cc: linux-kernel@vger.kernel.org, linux-mm@kvack.org, linux-arm-kernel@lists.infradead.org, linux-s390@vger.kernel.org, linux-sh@vger.kernel.org, sparclinux@vger.kernel.org, linux-ia64@vger.kernel.org, linux-mips@vger.kernel.org, linux-parisc@vger.kernel.org, linuxppc-dev@lists.ozlabs.org, Baolin Wang , Michal Hocko , Peter Xu , Naoya Horiguchi , James Houghton , Mina Almasry , "Aneesh Kumar K . V" , Anshuman Khandual , Paul Walmsley , Christian Borntraeger , catalin.marinas@arm.com, will@kernel.org, Andrew Morton Subject: Re: [PATCH 1/4] hugetlb: skip to end of PT page mapping when pte not present Message-ID: References: <20220616210518.125287-1-mike.kravetz@oracle.com> <20220616210518.125287-2-mike.kravetz@oracle.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20220616210518.125287-2-mike.kravetz@oracle.com> X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,RCVD_IN_DNSWL_NONE,SPF_HELO_NONE,SPF_PASS, T_SCC_BODY_TEXT_LINE autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, Jun 16, 2022 at 02:05:15PM -0700, Mike Kravetz wrote: > HugeTLB address ranges are linearly scanned during fork, unmap and > remap operations. If a non-present entry is encountered, the code > currently continues to the next huge page aligned address. However, > a non-present entry implies that the page table page for that entry > is not present. Therefore, the linear scan can skip to the end of > range mapped by the page table page. This can speed operations on > large sparsely populated hugetlb mappings. > > Create a new routine hugetlb_mask_last_page() that will return an > address mask. When the mask is ORed with an address, the result > will be the address of the last huge page mapped by the associated > page table page. Use this mask to update addresses in routines which > linearly scan hugetlb address ranges when a non-present pte is > encountered. > > hugetlb_mask_last_page is related to the implementation of > huge_pte_offset as hugetlb_mask_last_page is called when huge_pte_offset > returns NULL. This patch only provides a complete hugetlb_mask_last_page > implementation when CONFIG_ARCH_WANT_GENERAL_HUGETLB is defined. > Architectures which provide their own versions of huge_pte_offset can also > provide their own version of hugetlb_mask_last_page. > > Signed-off-by: Mike Kravetz > Tested-by: Baolin Wang > Reviewed-by: Baolin Wang It'll be more efficient, Thanks. Acked-by: Muchun Song