Received: by 2002:ab2:3350:0:b0:1f4:6588:b3a7 with SMTP id o16csp1856190lqe; Tue, 9 Apr 2024 02:25:41 -0700 (PDT) X-Forwarded-Encrypted: i=3; AJvYcCWclvwa7H/DabZUY1KVGfqdQOYw+1Mb5UK5Jldji4E3p7ne1xNe89eI/85SaBlZxxlxw+6VmiweeXOa0Fr8ou739heITHTCEqaIjqh2UQ== X-Google-Smtp-Source: AGHT+IGIZW99iGXzhoN5B4RsxEJizRn5DuQKSpGFj9mZp9QNHYlCLyWFKPYWh4RJWVaqQ84F/VK5 X-Received: by 2002:a05:6820:2606:b0:5a4:71b3:d090 with SMTP id cy6-20020a056820260600b005a471b3d090mr11710603oob.5.1712654741114; Tue, 09 Apr 2024 02:25:41 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1712654741; cv=pass; d=google.com; s=arc-20160816; b=QYGpjzMHE+swvkxwiH0pZF9PKsIzTILhGnnNUNMxVGmQB9+GzBZDxwquxmsQ6ZmL+/ tjrvU7COdYV+E6C+kdewF5LZgD4VW5X+irUBSCWtnfuFQktmhDTLJkjsABMqzkwcjkJA WVByZ6n4s4NCCj+fBk7vPDC/JqmUUJulG9BXLW1hJYvfU2mYk9Amv/+R59eB5LcxVB8U Ty9XFHyYcY3ii+TDJpbMkS38Ea9UtOaPiQnyvwmMH9jTFfcJbAEJTE+uZDjuffes0w4G I2lKj/5pmwmWyrUYVlj7T19cmgVKesi8OmzTTzea0Q4kWQJQCjsPikaquLS57X4PCNKH 21RA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:references:in-reply-to:message-id :date:subject:cc:to:from:dkim-signature; bh=qZVGZwY9DtxMHMolatICyCd8jVx09nsfE645jS/598A=; fh=L4VNAxQbQYrcrdeHT1sPO3RlS0TogNvaAEf/71clfA0=; b=lGCd46vJK8+wnzPpIMrV/gaqxWqpdZm3gvrTWYYDmm37DNjXVh1etG2SpcRKkHu984 JsUjwzYW2xgIXMgqrzvMTlcfyPY7V+fo97GdRaeqyLrLHpD6ycljrYgt3Y4Lq6r3WvwP NvRfcJZ8+0KBykTSqayu4tRHwfymwLz3/Q4JtUjnlSNhezqRQE9qHrWOWZ4778Metut2 XXqPtlscJBxM+WskLRvq1aekj8VxK355+W9d1iz4jfM7yYOo2QnekX35Cy3R3i/3EEoV f8Wb6H3c1YMP7hXeC+iDqBplxvI38VO+iwxvUxuMpj5CPA/FxO+XGszLIA+EV5rL/ruo harw==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=DRFcqFN9; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-136553-linux.lists.archive=gmail.com@vger.kernel.org designates 139.178.88.99 as permitted sender) smtp.mailfrom="linux-kernel+bounces-136553-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from sv.mirrors.kernel.org (sv.mirrors.kernel.org. [139.178.88.99]) by mx.google.com with ESMTPS id 8-20020a631948000000b005ee3cfc3620si8140028pgz.670.2024.04.09.02.25.40 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 09 Apr 2024 02:25:41 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel+bounces-136553-linux.lists.archive=gmail.com@vger.kernel.org designates 139.178.88.99 as permitted sender) client-ip=139.178.88.99; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=DRFcqFN9; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-136553-linux.lists.archive=gmail.com@vger.kernel.org designates 139.178.88.99 as permitted sender) smtp.mailfrom="linux-kernel+bounces-136553-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by sv.mirrors.kernel.org (Postfix) with ESMTPS id BC978284CCE for ; Tue, 9 Apr 2024 09:25:40 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 52F018060C; Tue, 9 Apr 2024 09:25:18 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="DRFcqFN9" Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 7E2C38003D for ; Tue, 9 Apr 2024 09:25:17 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1712654717; cv=none; b=gEAOcUzwRfV2I2KguWOYWcPvhrj0LX8uJTV+8tL4wNvG2c/2UytVqQ5RNMCeVr35XHaM8JO3Vm7D2/hQZdeZJl3KZL0MIbuxB3rDjjFRojIGtgmNbfEt5Zfwn1CQcsz5BsHi95LZUpSIj4z5fTWL12/nKduJweZ2bwYZzq9gi7U= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1712654717; c=relaxed/simple; bh=jy6PhQURlzWnemsEhuISNb873RtM8zjTy52Z9fJnaQo=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version; b=ff9U9OawqoJNlrJ6MDdwF7kgeEG3n7qi2NpvoKmcN9EFcZqeKWTCXtzJfMneQIAZkp3k3Q/PKFM+SsgjvwrZl/B86RqgwHZ45sFAJM9GByganNFHRJsyK/Fzzs0Ayq15yRGnjLaqcXkj6DHXZEwTsUqyt38da8bsj6N/UF4c1q0= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=DRFcqFN9; arc=none smtp.client-ip=10.30.226.201 Received: by smtp.kernel.org (Postfix) with ESMTPSA id F0EFEC43390; Tue, 9 Apr 2024 09:25:14 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1712654717; bh=jy6PhQURlzWnemsEhuISNb873RtM8zjTy52Z9fJnaQo=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=DRFcqFN9/XtdCn1Sbvo2Ddn+Ka5gBb/M2Y/Q0SD9k4n7tUVbGSJveLmsl9M8J9cDy 20+EmBJsTN2SUT/vt59KF9BxtksTeVWOSZs3E6BIXoMeScBM1ZfqUx8Fq783/yp8m2 u2oEPEGPPrgCI+XsJXITtUUH8VIM0MlCkXPcy/2EKPzxthn2kzLzMcE5U/a8+L1EYa 91TJ5ltdVOR3EDcHvQdeGI9BJJ5T96tgJZTnePSgKHwFYMpzrqD4vZmzICwhNWKQZk liyNGwApsCciLgWPQ6zoLlKRFvNaQytldVXlzCIsJC8KqkYZJEqkChrbG38FjG9//8 /dOweJU2fevgQ== From: alexs@kernel.org To: Andrew Morton , linux-mm@kvack.org, linux-kernel@vger.kernel.org Cc: "Alex Shi (tencent)" , Izik Eidus , Matthew Wilcox , Andrea Arcangeli , Hugh Dickins , Chris Wright , David Hildenbrand Subject: [PATCH v4 1/9] mm/ksm: add ksm_get_folio Date: Tue, 9 Apr 2024 17:28:16 +0800 Message-ID: <20240409092826.1733637-2-alexs@kernel.org> X-Mailer: git-send-email 2.43.0 In-Reply-To: <20240409092826.1733637-1-alexs@kernel.org> References: <20240409092826.1733637-1-alexs@kernel.org> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit From: "Alex Shi (tencent)" The ksm only contains single pages, so we could add a new func ksm_get_folio for get_ksm_page to use folio instead of pages to save a couple of compound_head calls. After all caller replaced, get_ksm_page will be removed. Signed-off-by: Alex Shi (tencent) To: Andrew Morton Cc: Izik Eidus Cc: Matthew Wilcox Cc: Andrea Arcangeli Cc: Hugh Dickins Cc: Chris Wright Reviewed-by: David Hildenbrand --- mm/ksm.c | 40 ++++++++++++++++++++++++---------------- 1 file changed, 24 insertions(+), 16 deletions(-) diff --git a/mm/ksm.c b/mm/ksm.c index 8c001819cf10..ac080235b002 100644 --- a/mm/ksm.c +++ b/mm/ksm.c @@ -915,10 +915,10 @@ enum get_ksm_page_flags { * a page to put something that might look like our key in page->mapping. * is on its way to being freed; but it is an anomaly to bear in mind. */ -static struct page *get_ksm_page(struct ksm_stable_node *stable_node, +static struct folio *ksm_get_folio(struct ksm_stable_node *stable_node, enum get_ksm_page_flags flags) { - struct page *page; + struct folio *folio; void *expected_mapping; unsigned long kpfn; @@ -926,8 +926,8 @@ static struct page *get_ksm_page(struct ksm_stable_node *stable_node, PAGE_MAPPING_KSM); again: kpfn = READ_ONCE(stable_node->kpfn); /* Address dependency. */ - page = pfn_to_page(kpfn); - if (READ_ONCE(page->mapping) != expected_mapping) + folio = pfn_folio(kpfn); + if (READ_ONCE(folio->mapping) != expected_mapping) goto stale; /* @@ -940,41 +940,41 @@ static struct page *get_ksm_page(struct ksm_stable_node *stable_node, * in folio_migrate_mapping(), it might still be our page, * in which case it's essential to keep the node. */ - while (!get_page_unless_zero(page)) { + while (!folio_try_get(folio)) { /* * Another check for page->mapping != expected_mapping would * work here too. We have chosen the !PageSwapCache test to * optimize the common case, when the page is or is about to * be freed: PageSwapCache is cleared (under spin_lock_irq) * in the ref_freeze section of __remove_mapping(); but Anon - * page->mapping reset to NULL later, in free_pages_prepare(). + * folio->mapping reset to NULL later, in free_pages_prepare(). */ - if (!PageSwapCache(page)) + if (!folio_test_swapcache(folio)) goto stale; cpu_relax(); } - if (READ_ONCE(page->mapping) != expected_mapping) { - put_page(page); + if (READ_ONCE(folio->mapping) != expected_mapping) { + folio_put(folio); goto stale; } if (flags == GET_KSM_PAGE_TRYLOCK) { - if (!trylock_page(page)) { - put_page(page); + if (!folio_trylock(folio)) { + folio_put(folio); return ERR_PTR(-EBUSY); } } else if (flags == GET_KSM_PAGE_LOCK) - lock_page(page); + folio_lock(folio); if (flags != GET_KSM_PAGE_NOLOCK) { - if (READ_ONCE(page->mapping) != expected_mapping) { - unlock_page(page); - put_page(page); + if (READ_ONCE(folio->mapping) != expected_mapping) { + folio_unlock(folio); + folio_put(folio); goto stale; } } - return page; + return folio; stale: /* @@ -990,6 +990,14 @@ static struct page *get_ksm_page(struct ksm_stable_node *stable_node, return NULL; } +static struct page *get_ksm_page(struct ksm_stable_node *stable_node, + enum get_ksm_page_flags flags) +{ + struct folio *folio = ksm_get_folio(stable_node, flags); + + return &folio->page; +} + /* * Removing rmap_item from stable or unstable tree. * This function will clean the information from the stable/unstable tree. -- 2.43.0