Received: by 2002:a05:6358:4e97:b0:b3:742d:4702 with SMTP id ce23csp2225203rwb; Mon, 15 Aug 2022 00:57:50 -0700 (PDT) X-Google-Smtp-Source: AA6agR4CAj1H3Plmh0W17tkljn49qaxpVLsAzAWrBsEF7ivSTb3JMCoXaTBLD2iU3E29Gtpgbw75 X-Received: by 2002:a17:90a:d982:b0:1f5:49e8:7803 with SMTP id d2-20020a17090ad98200b001f549e87803mr26301977pjv.173.1660550270666; Mon, 15 Aug 2022 00:57:50 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1660550270; cv=none; d=google.com; s=arc-20160816; b=geXBdKMJFWk+Qza1fSULooMK8ZD3JVD7+EUbuoi6l7yf9HYA4sFb/u9tzL1TO9Cf5C TgjeLe271fQOiPhaYh9hc+Lm9XMLXRr+oNo0cRD70K6oGt1T+1g+bPTQICCiynKldEBM AHF6SRZahMwYqk/BFJErZU6R3u0zx0CcytMOoUSbA0GY6/mo5Bgr691KYSjx5vOZZmtR hmdx882uNpmqfk9cyLgRV/1HaXoqfUXix/WrF/VVTNDBfsWX7Y2iJ36zdhqC9SXP/co/ kcBt6cAGcJaebWOrx7E8lFenGVL/72Cj4rCc6u10vOheUNYYKzvm7AugN1z14S2PcMEi Yxcw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:mime-version:user-agent:message-id:in-reply-to :date:references:subject:cc:to:from:dkim-signature; bh=RSCIo/frC0o4uN1b0klqJNp11bhrk/dUoOOVQaTy6mI=; b=gQCf6TJObf08pQzCMkeh0Ww4vbHIjfuTZYr9wxXrCvQ4R6RDWXcR0/VBG9Tz+QBAj7 g6EQfntiYt3fpjvM7R06TWyeKZNDRz0/fab7BXxGspz0oBAwrcZKTqFlQGpZXkHnKGcP r0vLFe5ZT4xnvBwYvSBKUlaObLQf8kBpKu4Gjn1+h3eGSv+AyDDDpzwnahIxMtBZLpPP 4zhntGGTIYhkH+8Aj18cH+jBPZeH90m+84hywDC2bsARNLGW/7jl+WmZybGjve8g8zE7 Dp5QCYrS0fLxra0v46gvXZ+P0AjnRMn4GZIzFkml3Bw29EFOKORT7eq8szD5cuEfRfVD oejA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@intel.com header.s=Intel header.b=Bq+rMHnV; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=intel.com Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id q18-20020aa78432000000b0052d99f917b1si9816775pfn.54.2022.08.15.00.57.39; Mon, 15 Aug 2022 00:57:50 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@intel.com header.s=Intel header.b=Bq+rMHnV; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=intel.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S241481AbiHOHuc (ORCPT + 99 others); Mon, 15 Aug 2022 03:50:32 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:50258 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S231335AbiHOHua (ORCPT ); Mon, 15 Aug 2022 03:50:30 -0400 Received: from mga11.intel.com (mga11.intel.com [192.55.52.93]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id B8FEB5FBF for ; Mon, 15 Aug 2022 00:50:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1660549829; x=1692085829; h=from:to:cc:subject:references:date:in-reply-to: message-id:mime-version; bh=kmKiIT0QD7YGmmeSksRuQ1t6fRNGCZ6by4e0YIyvRd8=; b=Bq+rMHnVTvItUjJgP4nkgETRbTQveIQMuBqgk6pzBIM1I+0CTtCgn9AM wTZ21K0PgL87s2RAQzqZjWQY93hEIHL+EPLDBivC8bfYfHQcLFa8iTMxx ytFeJT+L2ak7NKxr9Sz9brFgYP2KJF6cmq6q7DHPgRkMGCkQ1G8Gl7qnK dIqDecBJLmdShkKP3ldlmUjMyDPhWWZnAZp7iLqDVLpMflzWgNTF5Gp3b 4z6W/ICRTHShMmDGI12/lo4YUR9oNTEVW1Xen1Zbod7R4IZbwLF1DuluN OpBwGDSFHBiVqGp/GAMEkh2DR9B9uPRzCZs4uBGVHoUQJRJ/V/YyV3XUF A==; X-IronPort-AV: E=McAfee;i="6400,9594,10439"; a="289481254" X-IronPort-AV: E=Sophos;i="5.93,237,1654585200"; d="scan'208";a="289481254" Received: from orsmga006.jf.intel.com ([10.7.209.51]) by fmsmga102.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 15 Aug 2022 00:50:29 -0700 X-IronPort-AV: E=Sophos;i="5.93,237,1654585200"; d="scan'208";a="582798198" Received: from yhuang6-desk2.sh.intel.com (HELO yhuang6-desk2.ccr.corp.intel.com) ([10.238.208.55]) by orsmga006-auth.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 15 Aug 2022 00:50:26 -0700 From: "Huang, Ying" To: Haiyue Wang Cc: , , , , , , , , , Felix Kuehling Subject: Re: [PATCH v5 2/2] mm: fix the handling Non-LRU pages returned by follow_page References: <20220812084921.409142-1-haiyue.wang@intel.com> <20220815070240.470469-1-haiyue.wang@intel.com> <20220815070240.470469-3-haiyue.wang@intel.com> Date: Mon, 15 Aug 2022 15:50:23 +0800 In-Reply-To: <20220815070240.470469-3-haiyue.wang@intel.com> (Haiyue Wang's message of "Mon, 15 Aug 2022 15:02:40 +0800") Message-ID: <87czd2c5ds.fsf@yhuang6-desk2.ccr.corp.intel.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=ascii X-Spam-Status: No, score=-7.2 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_HI, SPF_HELO_NONE,SPF_NONE,T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Haiyue Wang writes: > The handling Non-LRU pages returned by follow_page() jumps directly, it > doesn't call put_page() to handle the reference count, since 'FOLL_GET' > flag for follow_page() has get_page() called. Fix the zone device page > check by handling the page reference count correctly before returning. > > And as David reviewed, "device pages are never PageKsm pages". Drop this > zone device page check for break_ksm(). > > Fixes: 3218f8712d6b ("mm: handling Non-LRU pages returned by vm_normal_pages") > Signed-off-by: Haiyue Wang LGTM, Thanks! Reviewed-by: "Huang, Ying" > --- > mm/huge_memory.c | 4 ++-- > mm/ksm.c | 12 +++++++++--- > mm/migrate.c | 10 +++++++--- > 3 files changed, 18 insertions(+), 8 deletions(-) > > diff --git a/mm/huge_memory.c b/mm/huge_memory.c > index 8a7c1b344abe..b2ba17c3dcd7 100644 > --- a/mm/huge_memory.c > +++ b/mm/huge_memory.c > @@ -2963,10 +2963,10 @@ static int split_huge_pages_pid(int pid, unsigned long vaddr_start, > /* FOLL_DUMP to ignore special (like zero) pages */ > page = follow_page(vma, addr, FOLL_GET | FOLL_DUMP); > > - if (IS_ERR_OR_NULL(page) || is_zone_device_page(page)) > + if (IS_ERR_OR_NULL(page)) > continue; > > - if (!is_transparent_hugepage(page)) > + if (is_zone_device_page(page) || !is_transparent_hugepage(page)) > goto next; > > total++; > diff --git a/mm/ksm.c b/mm/ksm.c > index 42ab153335a2..e26f57fc1f0e 100644 > --- a/mm/ksm.c > +++ b/mm/ksm.c > @@ -475,7 +475,7 @@ static int break_ksm(struct vm_area_struct *vma, unsigned long addr) > cond_resched(); > page = follow_page(vma, addr, > FOLL_GET | FOLL_MIGRATION | FOLL_REMOTE); > - if (IS_ERR_OR_NULL(page) || is_zone_device_page(page)) > + if (IS_ERR_OR_NULL(page)) > break; > if (PageKsm(page)) > ret = handle_mm_fault(vma, addr, > @@ -560,12 +560,15 @@ static struct page *get_mergeable_page(struct rmap_item *rmap_item) > goto out; > > page = follow_page(vma, addr, FOLL_GET); > - if (IS_ERR_OR_NULL(page) || is_zone_device_page(page)) > + if (IS_ERR_OR_NULL(page)) > goto out; > + if (is_zone_device_page(page)) > + goto out_putpage; > if (PageAnon(page)) { > flush_anon_page(vma, page, addr); > flush_dcache_page(page); > } else { > +out_putpage: > put_page(page); > out: > page = NULL; > @@ -2308,11 +2311,13 @@ static struct rmap_item *scan_get_next_rmap_item(struct page **page) > if (ksm_test_exit(mm)) > break; > *page = follow_page(vma, ksm_scan.address, FOLL_GET); > - if (IS_ERR_OR_NULL(*page) || is_zone_device_page(*page)) { > + if (IS_ERR_OR_NULL(*page)) { > ksm_scan.address += PAGE_SIZE; > cond_resched(); > continue; > } > + if (is_zone_device_page(*page)) > + goto next_page; > if (PageAnon(*page)) { > flush_anon_page(vma, *page, ksm_scan.address); > flush_dcache_page(*page); > @@ -2327,6 +2332,7 @@ static struct rmap_item *scan_get_next_rmap_item(struct page **page) > mmap_read_unlock(mm); > return rmap_item; > } > +next_page: > put_page(*page); > ksm_scan.address += PAGE_SIZE; > cond_resched(); > diff --git a/mm/migrate.c b/mm/migrate.c > index 581dfaad9257..fee12cd2f294 100644 > --- a/mm/migrate.c > +++ b/mm/migrate.c > @@ -1672,9 +1672,12 @@ static int add_page_for_migration(struct mm_struct *mm, unsigned long addr, > goto out; > > err = -ENOENT; > - if (!page || is_zone_device_page(page)) > + if (!page) > goto out; > > + if (is_zone_device_page(page)) > + goto out_putpage; > + > err = 0; > if (page_to_nid(page) == node) > goto out_putpage; > @@ -1868,8 +1871,9 @@ static void do_pages_stat_array(struct mm_struct *mm, unsigned long nr_pages, > if (IS_ERR(page)) > goto set_status; > > - if (page && !is_zone_device_page(page)) { > - err = page_to_nid(page); > + if (page) { > + err = !is_zone_device_page(page) ? page_to_nid(page) > + : -ENOENT; > if (foll_flags & FOLL_GET) > put_page(page); > } else {