Received: by 2002:ad5:474a:0:0:0:0:0 with SMTP id i10csp811345imu; Thu, 13 Dec 2018 05:02:14 -0800 (PST) X-Google-Smtp-Source: AFSGD/U+DcphXwCVtaRK+7+i2D917OgM7Lkewo08AeMMaDCaQPCnvrCPgfh797WGy8zPwt4A5A/i X-Received: by 2002:a62:59c9:: with SMTP id k70mr23864643pfj.243.1544706134530; Thu, 13 Dec 2018 05:02:14 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1544706134; cv=none; d=google.com; s=arc-20160816; b=yVPaUu/uDGTShqICgqZN1BnvoPaLu0/VGWVSMD+8eBbvxfxFrrB2WtFtzguGJy4Xf1 hJtQAXrIyjDWL0zS6/kUZL7BysfBQel3ap+/Rv4wNE+vvEE3WlCMFL6Ij+vqvZWy3z7T 1eXPBJARroQ0qU0lcHaVm/XbUZ2kVuFa7S/ZDZPZHgbzaRSSia07tW1DUhhpYlh69Iv5 7wS+mj7l+k0AJMEEsxCV2rz8eRNLDZxgt3TTXMe7ZKt+2OJ8gpnzQBRSnJV/lFxjemQb uhlwxAE90cO3UwPcJrKXXDSllc8+oRpMevycd8hJl7oOmFg5OC1O024NPxy6ZKOVdCjA FZNw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-disposition:mime-version:references:message-id:subject:cc :to:from:date; bh=Z/xNzumvUolWHeJw34HEdBEH6CdChg7H86zDLJ0PGi0=; b=RhL6Kum0rC6J4K0xPYGRDhY4udF5W3/ZtJLbdD543rYSFSb01b5yW3b3lT/1Mffjjd OBwtl30OTe07K9EYQ/ZwXdfzsopp8513wkVAcL4qbTdwF1u56Qz9HACsjI4xT5KZg0J7 +oEqHqjbsqVUJzykcwW//eIaIFdyxTWSANmKlbp2JPqXqCjE32Z3ZeJe513DK+jmrq75 fwD7J5QIme8w+Uupeg/+WlbapUjYWfpDhmrRrgPKAxdxlU42r4J+bBGMmItaqi7uH06+ 4aR/ZrXK+LkefKLCmWO4nPMsM6OE+hmpLGIbP8a84niSJ18yESuMPg8yHcbp5NewhZcl IZCA== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id e1si1615226pln.55.2018.12.13.05.01.54; Thu, 13 Dec 2018 05:02:14 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1729298AbeLMM7z (ORCPT + 99 others); Thu, 13 Dec 2018 07:59:55 -0500 Received: from mx2.suse.de ([195.135.220.15]:60982 "EHLO mx1.suse.de" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1728803AbeLMM7z (ORCPT ); Thu, 13 Dec 2018 07:59:55 -0500 X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay2.suse.de (unknown [195.135.220.254]) by mx1.suse.de (Postfix) with ESMTP id 9136DAF79; Thu, 13 Dec 2018 12:59:52 +0000 (UTC) Date: Thu, 13 Dec 2018 13:59:52 +0100 From: Michal Hocko To: Mikhail Zaslonko Cc: akpm@linux-foundation.org, linux-kernel@vger.kernel.org, linux-mm@kvack.org, Pavel.Tatashin@microsoft.com, schwidefsky@de.ibm.com, heiko.carstens@de.ibm.com, gerald.schaefer@de.ibm.com Subject: Re: [PATCH v2 1/1] mm, memory_hotplug: Initialize struct pages for the full memory section Message-ID: <20181213125952.GA1286@dhcp22.suse.cz> References: <20181212172712.34019-1-zaslonko@linux.ibm.com> <20181212172712.34019-2-zaslonko@linux.ibm.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20181212172712.34019-2-zaslonko@linux.ibm.com> User-Agent: Mutt/1.10.1 (2018-07-13) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Wed 12-12-18 18:27:12, Mikhail Zaslonko wrote: > If memory end is not aligned with the sparse memory section boundary, the > mapping of such a section is only partly initialized. This may lead to > VM_BUG_ON due to uninitialized struct page access from > is_mem_section_removable() or test_pages_in_a_zone() function triggered by > memory_hotplug sysfs handlers: > > Here are the the panic examples: > CONFIG_DEBUG_VM=y > CONFIG_DEBUG_VM_PGFLAGS=y > > kernel parameter mem=2050M > -------------------------- > page:000003d082008000 is uninitialized and poisoned > page dumped because: VM_BUG_ON_PAGE(PagePoisoned(p)) > Call Trace: > ([<0000000000385b26>] test_pages_in_a_zone+0xde/0x160) > [<00000000008f15c4>] show_valid_zones+0x5c/0x190 > [<00000000008cf9c4>] dev_attr_show+0x34/0x70 > [<0000000000463ad0>] sysfs_kf_seq_show+0xc8/0x148 > [<00000000003e4194>] seq_read+0x204/0x480 > [<00000000003b53ea>] __vfs_read+0x32/0x178 > [<00000000003b55b2>] vfs_read+0x82/0x138 > [<00000000003b5be2>] ksys_read+0x5a/0xb0 > [<0000000000b86ba0>] system_call+0xdc/0x2d8 > Last Breaking-Event-Address: > [<0000000000385b26>] test_pages_in_a_zone+0xde/0x160 > Kernel panic - not syncing: Fatal exception: panic_on_oops > > kernel parameter mem=3075M > -------------------------- > page:000003d08300c000 is uninitialized and poisoned > page dumped because: VM_BUG_ON_PAGE(PagePoisoned(p)) > Call Trace: > ([<000000000038596c>] is_mem_section_removable+0xb4/0x190) > [<00000000008f12fa>] show_mem_removable+0x9a/0xd8 > [<00000000008cf9c4>] dev_attr_show+0x34/0x70 > [<0000000000463ad0>] sysfs_kf_seq_show+0xc8/0x148 > [<00000000003e4194>] seq_read+0x204/0x480 > [<00000000003b53ea>] __vfs_read+0x32/0x178 > [<00000000003b55b2>] vfs_read+0x82/0x138 > [<00000000003b5be2>] ksys_read+0x5a/0xb0 > [<0000000000b86ba0>] system_call+0xdc/0x2d8 > Last Breaking-Event-Address: > [<000000000038596c>] is_mem_section_removable+0xb4/0x190 > Kernel panic - not syncing: Fatal exception: panic_on_oops > > Fix the problem by initializing the last memory section of each zone > in memmap_init_zone() till the very end, even if it goes beyond the zone > end. > > Signed-off-by: Mikhail Zaslonko > Reviewed-by: Gerald Schaefer > Cc: This has alwways been problem AFAIU. It just went unnoticed because we have zeroed memmaps during allocation before f7f99100d8d9 ("mm: stop zeroing memory during allocation in vmemmap") and so the above test would simply skip these ranges as belonging to zone 0 or provided a garbage. So I guess we do care for post f7f99100d8d9 kernels mostly and therefore Fixes: f7f99100d8d9 ("mm: stop zeroing memory during allocation in vmemmap") Other than that looks good to me. Acked-by: Michal Hocko Thanks! > --- > mm/page_alloc.c | 12 ++++++++++++ > 1 file changed, 12 insertions(+) > > diff --git a/mm/page_alloc.c b/mm/page_alloc.c > index 2ec9cc407216..e2afdb2dc2c5 100644 > --- a/mm/page_alloc.c > +++ b/mm/page_alloc.c > @@ -5542,6 +5542,18 @@ void __meminit memmap_init_zone(unsigned long size, int nid, unsigned long zone, > cond_resched(); > } > } > +#ifdef CONFIG_SPARSEMEM > + /* > + * If the zone does not span the rest of the section then > + * we should at least initialize those pages. Otherwise we > + * could blow up on a poisoned page in some paths which depend > + * on full sections being initialized (e.g. memory hotplug). > + */ > + while (end_pfn % PAGES_PER_SECTION) { > + __init_single_page(pfn_to_page(end_pfn), end_pfn, zone, nid); > + end_pfn++; > + } > +#endif > } > > #ifdef CONFIG_ZONE_DEVICE > -- > 2.16.4 -- Michal Hocko SUSE Labs