Received: by 2002:a05:6902:102b:0:0:0:0 with SMTP id x11csp459836ybt; Fri, 19 Jun 2020 06:05:49 -0700 (PDT) X-Google-Smtp-Source: ABdhPJwKnddnL3hdBvjdpXXXtAZM0TGD9o+Jg6XTCT5DlgnrQ48/VYvNL8M9WE1M2uDF5htSAuih X-Received: by 2002:aa7:c2c7:: with SMTP id m7mr3221117edp.148.1592571949588; Fri, 19 Jun 2020 06:05:49 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1592571949; cv=none; d=google.com; s=arc-20160816; b=thbgdutCRSyN1N2h30LPz9m2AV743PRdyGpBU+x2s6gzGtwFS26YztaXtWV9sUE0dZ 18/WFmecOc5q+waDG1DI9zShiVs2bIwGCfRmlSGbbBW5u8SGug29577CK26T8nvAKr+k Ll52+/atkec28QYxTy4XpdP5cHWfc6A8pYT5+x0iFqm1vY5BZg/4TfWgV/3iNHJ3330N 91Fzp1Eq2gQe9izSrgSg2fOrGx6HZQmlbWrW3/B4Z65lYpPpYWxLybQFKsNSQkT8JE0O /uzTlwwuQCxlEB7BXRumsFUvXxQExvjJ4hkRJ/C8Z/NRkzZHV5dX9XpLaIgffdmZfqQ9 QlDg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from :dkim-signature; bh=h8MQWLpEjUwKS/f3ehtlBKkUYUgruSbsLYJMJymo8VE=; b=IphjDJYNwQkKclPlvPT4S+vN+ZY2y6IxwerSHWBSvlbemyNjHyghacEUCV/seki546 sRPs2AGEQkxaUnaw8id7/tNBpMyoREcatz7k+B5jedFbDJ2tq5lrQo00l8pVwdKW5m8S fThZqRhEJ1s/9inPLWBud9IAsRVK8/P3CT3w3JBBiGFUGT79B6a1O2sHWEvbjSO1yPoU w18fliDZAFJPJzoeAufZrjHlFVhPi+I1rzVn5AOdmwKipK1EampuSk8wPitl/cu6GGdj fanB8nd1J+0HMrQrnpqqAT58xKNXkKVWSdUlsXC/GbMYzyy02I27doeggi6Y8vRAXWIu EZQA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=Oaqk1sPP; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id hh5si3921219ejb.264.2020.06.19.06.05.26; Fri, 19 Jun 2020 06:05:49 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=Oaqk1sPP; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1732935AbgFSM7l (ORCPT + 99 others); Fri, 19 Jun 2020 08:59:41 -0400 Received: from us-smtp-1.mimecast.com ([205.139.110.61]:58178 "EHLO us-smtp-delivery-1.mimecast.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1728851AbgFSM7k (ORCPT ); Fri, 19 Jun 2020 08:59:40 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1592571578; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=h8MQWLpEjUwKS/f3ehtlBKkUYUgruSbsLYJMJymo8VE=; b=Oaqk1sPP+DPPZx4bLDPDXA5Lps/RjlLNg7Jl3feFi8ByQfNXgYVmuAKZKy+DNk51URSV83 Vxg3x3zGV88WyW0mRB5Hv18jFTZfVj+JrjDfcFH08up5xeYjxOPEKYvlACEWvJmCD0NMfX n/4DcHtnHOBGoU0q71vjVNAnvr33QOs= Received: from mimecast-mx01.redhat.com (mimecast-mx01.redhat.com [209.132.183.4]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-300-gYNxaS0bPK2dCVjUmxwz4g-1; Fri, 19 Jun 2020 08:59:36 -0400 X-MC-Unique: gYNxaS0bPK2dCVjUmxwz4g-1 Received: from smtp.corp.redhat.com (int-mx04.intmail.prod.int.phx2.redhat.com [10.5.11.14]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx01.redhat.com (Postfix) with ESMTPS id 95F54835B45; Fri, 19 Jun 2020 12:59:34 +0000 (UTC) Received: from t480s.redhat.com (ovpn-113-137.ams2.redhat.com [10.36.113.137]) by smtp.corp.redhat.com (Postfix) with ESMTP id 21CEC5D9CA; Fri, 19 Jun 2020 12:59:31 +0000 (UTC) From: David Hildenbrand To: linux-kernel@vger.kernel.org Cc: linux-mm@kvack.org, David Hildenbrand , Michal Hocko , stable@vger.kernel.org, Andrew Morton , Johannes Weiner , Minchan Kim , Huang Ying , Wei Yang , Mel Gorman Subject: [PATCH v2 1/3] mm/shuffle: don't move pages between zones and don't read garbage memmaps Date: Fri, 19 Jun 2020 14:59:20 +0200 Message-Id: <20200619125923.22602-2-david@redhat.com> In-Reply-To: <20200619125923.22602-1-david@redhat.com> References: <20200619125923.22602-1-david@redhat.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.79 on 10.5.11.14 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Especially with memory hotplug, we can have offline sections (with a garbage memmap) and overlapping zones. We have to make sure to only touch initialized memmaps (online sections managed by the buddy) and that the zone matches, to not move pages between zones. To test if this can actually happen, I added a simple BUG_ON(page_zone(page_i) != page_zone(page_j)); right before the swap. When hotplugging a 256M DIMM to a 4G x86-64 VM and onlining the first memory block "online_movable" and the second memory block "online_kernel", it will trigger the BUG, as both zones (NORMAL and MOVABLE) overlap. This might result in all kinds of weird situations (e.g., double allocations, list corruptions, unmovable allocations ending up in the movable zone). Fixes: e900a918b098 ("mm: shuffle initial free memory to improve memory-side-cache utilization") Acked-by: Michal Hocko Cc: stable@vger.kernel.org # v5.2+ Cc: Andrew Morton Cc: Johannes Weiner Cc: Michal Hocko Cc: Minchan Kim Cc: Huang Ying Cc: Wei Yang Cc: Mel Gorman Signed-off-by: David Hildenbrand --- mm/shuffle.c | 18 +++++++++--------- 1 file changed, 9 insertions(+), 9 deletions(-) diff --git a/mm/shuffle.c b/mm/shuffle.c index 44406d9977c77..dd13ab851b3ee 100644 --- a/mm/shuffle.c +++ b/mm/shuffle.c @@ -58,25 +58,25 @@ module_param_call(shuffle, shuffle_store, shuffle_show, &shuffle_param, 0400); * For two pages to be swapped in the shuffle, they must be free (on a * 'free_area' lru), have the same order, and have the same migratetype. */ -static struct page * __meminit shuffle_valid_page(unsigned long pfn, int order) +static struct page * __meminit shuffle_valid_page(struct zone *zone, + unsigned long pfn, int order) { - struct page *page; + struct page *page = pfn_to_online_page(pfn); /* * Given we're dealing with randomly selected pfns in a zone we * need to ask questions like... */ - /* ...is the pfn even in the memmap? */ - if (!pfn_valid_within(pfn)) + /* ... is the page managed by the buddy? */ + if (!page) return NULL; - /* ...is the pfn in a present section or a hole? */ - if (!pfn_in_present_section(pfn)) + /* ... is the page assigned to the same zone? */ + if (page_zone(page) != zone) return NULL; /* ...is the page free and currently on a free_area list? */ - page = pfn_to_page(pfn); if (!PageBuddy(page)) return NULL; @@ -123,7 +123,7 @@ void __meminit __shuffle_zone(struct zone *z) * page_j randomly selected in the span @zone_start_pfn to * @spanned_pages. */ - page_i = shuffle_valid_page(i, order); + page_i = shuffle_valid_page(z, i, order); if (!page_i) continue; @@ -137,7 +137,7 @@ void __meminit __shuffle_zone(struct zone *z) j = z->zone_start_pfn + ALIGN_DOWN(get_random_long() % z->spanned_pages, order_pages); - page_j = shuffle_valid_page(j, order); + page_j = shuffle_valid_page(z, j, order); if (page_j && page_j != page_i) break; } -- 2.26.2