Received: by 2002:a05:6a10:f3d0:0:0:0:0 with SMTP id a16csp2622191pxv; Sun, 11 Jul 2021 20:26:23 -0700 (PDT) X-Google-Smtp-Source: ABdhPJz6lsM/OIepH6wHyisFBOc8wUGQ/EOHPXLsT24hLKRVfAcvnhfL3lQWYBUpnoZY+AfaAz+i X-Received: by 2002:a05:6638:264e:: with SMTP id n14mr6734994jat.71.1626060383624; Sun, 11 Jul 2021 20:26:23 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1626060383; cv=none; d=google.com; s=arc-20160816; b=OynFMrYsTb9oYPhtQdqDNceN0lZo6gbJnoxIobocNORfP5XfgazEqG/SynMxmO9xE4 5KtvexeJ3PzkOYII2xow8M8rapny448HgUs8xTWUTallgLWpgs5ASqZbjk5NqBjwkvVw g29232GxEmYCDjRflue9K6bUKAJyeSNdMXFYZ0zTtfzvz2MZR0fZo7qeQvAedYLCxV64 pkbUGkNJbDUZIX0mXsHaTm+pR3IXVxFQUrafAjFdJStyXg5iMMfJcco1ypbYJhFBPbk+ 9NXsT7+nyvosMLVSGZwkyeqpAUF4+wC1VB+Ua4PSAoGPHwfSHIvgXnbITOQHf67e+y5g vGFQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from :dkim-signature; bh=nVC+BVk2C7BJc13hyk4hGwQf60siCtkLq/Ed/hMAyaI=; b=XuZpZg8e5iDLnRZ21ZR2J0zmJT7Kj4Mi+Cl1YGrW3exw4n8R7tWmjZ0VJdpBW0cSwS /SddKX33YYnbnxN9ZzkzFLCq3z0UgOcj5JC6wXn8LgdZQ7wbWU3gY/u95M2c66EOnI43 0acN/uah9oIbQC9dOV0yOCB1gJT7mMYSN6JJLWOn2qLeV3Ghnng2EVbQJeA9h4sv0Git q051VxBn2+I/kM9LeNNdzAiHyoLvYKT3o6q8N7l9z99miN2sTCd6j7R15v086qvpj9o+ +I7/BJCRW6YB9kf8TZop3A0LSjqVKWSukLWUNMVDpBrEM4ATM8ulXh+3FZeJAzVDBcYG GCPg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@infradead.org header.s=casper.20170209 header.b=axsdhuyk; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id a10si2356810ilv.72.2021.07.11.20.26.11; Sun, 11 Jul 2021 20:26:23 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@infradead.org header.s=casper.20170209 header.b=axsdhuyk; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232507AbhGLD2T (ORCPT + 99 others); Sun, 11 Jul 2021 23:28:19 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:42692 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S232455AbhGLD2S (ORCPT ); Sun, 11 Jul 2021 23:28:18 -0400 Received: from casper.infradead.org (casper.infradead.org [IPv6:2001:8b0:10b:1236::1]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id C9A01C0613DD; Sun, 11 Jul 2021 20:25:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=casper.20170209; h=Content-Transfer-Encoding:MIME-Version: References:In-Reply-To:Message-Id:Date:Subject:Cc:To:From:Sender:Reply-To: Content-Type:Content-ID:Content-Description; bh=nVC+BVk2C7BJc13hyk4hGwQf60siCtkLq/Ed/hMAyaI=; b=axsdhuykGBz7my0QN9WdWBrj0A mukyHjbu6SoY3vNmu+LvF3DIezUNmUF9A3EB3Zov43uxDi+N4EuXJxvKCMSLhNNs76vhAo3CcPEEr FgkbbGa6Vqj5K8tZpOmNl6l8CapknbH60ANdX5Qs2NKcnseKxmc/0rJVZ63WcDNqF11z38zhwy/+E INI6QSx4junvezwQP4v6akJ8ZeulO2o56ihloeiARpyhRlz5urIWoGLOrnYviQiN89hfb5WpBdWYY SAbIwKgyEDw4VS89/9SHeGG8c/dVmokNORAaysKRBuiI0QCflTmKq1S2xP+tjxrH6+dhqdNZMXBF/ EXmlP+hw==; Received: from willy by casper.infradead.org with local (Exim 4.94.2 #2 (Red Hat Linux)) id 1m2mYL-00Gnyc-DH; Mon, 12 Jul 2021 03:24:28 +0000 From: "Matthew Wilcox (Oracle)" To: linux-kernel@vger.kernel.org Cc: "Matthew Wilcox (Oracle)" , linux-mm@kvack.org, linux-fsdevel@vger.kernel.org, Vlastimil Babka , William Kucharski , Christoph Hellwig , David Howells , "Kirill A . Shutemov" Subject: [PATCH v13 032/137] mm: Add folio_mapped() Date: Mon, 12 Jul 2021 04:05:16 +0100 Message-Id: <20210712030701.4000097-33-willy@infradead.org> X-Mailer: git-send-email 2.31.1 In-Reply-To: <20210712030701.4000097-1-willy@infradead.org> References: <20210712030701.4000097-1-willy@infradead.org> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org This function is the equivalent of page_mapped(). It is slightly shorter as we do not need to handle the PageTail() case. Reimplement page_mapped() as a wrapper around folio_mapped(). folio_mapped() is 13 bytes smaller than page_mapped(), but the page_mapped() wrapper is 30 bytes, for a net increase of 17 bytes of text. Signed-off-by: Matthew Wilcox (Oracle) Acked-by: Vlastimil Babka Reviewed-by: William Kucharski Reviewed-by: Christoph Hellwig Reviewed-by: David Howells Acked-by: Kirill A. Shutemov --- include/linux/mm.h | 1 + include/linux/mm_types.h | 6 ++++++ mm/folio-compat.c | 6 ++++++ mm/util.c | 29 ++++++++++++++++------------- 4 files changed, 29 insertions(+), 13 deletions(-) diff --git a/include/linux/mm.h b/include/linux/mm.h index 24311e4c08e9..a856c078e040 100644 --- a/include/linux/mm.h +++ b/include/linux/mm.h @@ -1766,6 +1766,7 @@ static inline pgoff_t page_index(struct page *page) } bool page_mapped(struct page *page); +bool folio_mapped(struct folio *folio); /* * Return true only if the page has been allocated with diff --git a/include/linux/mm_types.h b/include/linux/mm_types.h index c15b4af8ef4d..d0061ddf080f 100644 --- a/include/linux/mm_types.h +++ b/include/linux/mm_types.h @@ -291,6 +291,12 @@ FOLIO_MATCH(memcg_data, memcg_data); #endif #undef FOLIO_MATCH +static inline atomic_t *folio_mapcount_ptr(struct folio *folio) +{ + struct page *tail = &folio->page + 1; + return &tail->compound_mapcount; +} + static inline atomic_t *compound_mapcount_ptr(struct page *page) { return &page[1].compound_mapcount; diff --git a/mm/folio-compat.c b/mm/folio-compat.c index 3c83f03b80d7..7044fcc8a8aa 100644 --- a/mm/folio-compat.c +++ b/mm/folio-compat.c @@ -35,3 +35,9 @@ void wait_for_stable_page(struct page *page) return folio_wait_stable(page_folio(page)); } EXPORT_SYMBOL_GPL(wait_for_stable_page); + +bool page_mapped(struct page *page) +{ + return folio_mapped(page_folio(page)); +} +EXPORT_SYMBOL(page_mapped); diff --git a/mm/util.c b/mm/util.c index d6176bb63629..0c65b260cded 100644 --- a/mm/util.c +++ b/mm/util.c @@ -652,28 +652,31 @@ void *page_rmapping(struct page *page) return __page_rmapping(page); } -/* - * Return true if this page is mapped into pagetables. - * For compound page it returns true if any subpage of compound page is mapped. +/** + * folio_mapped - Is this folio mapped into userspace? + * @folio: The folio. + * + * Return: True if any page in this folio is referenced by user page tables. */ -bool page_mapped(struct page *page) +bool folio_mapped(struct folio *folio) { - int i; + int i, nr; - if (likely(!PageCompound(page))) - return atomic_read(&page->_mapcount) >= 0; - page = compound_head(page); - if (atomic_read(compound_mapcount_ptr(page)) >= 0) + if (folio_single(folio)) + return atomic_read(&folio->_mapcount) >= 0; + if (atomic_read(folio_mapcount_ptr(folio)) >= 0) return true; - if (PageHuge(page)) + if (folio_hugetlb(folio)) return false; - for (i = 0; i < compound_nr(page); i++) { - if (atomic_read(&page[i]._mapcount) >= 0) + + nr = folio_nr_pages(folio); + for (i = 0; i < nr; i++) { + if (atomic_read(&folio_page(folio, i)->_mapcount) >= 0) return true; } return false; } -EXPORT_SYMBOL(page_mapped); +EXPORT_SYMBOL(folio_mapped); struct anon_vma *page_anon_vma(struct page *page) { -- 2.30.2