Received: by 2002:ad5:474a:0:0:0:0:0 with SMTP id i10csp1447119imu; Tue, 20 Nov 2018 18:27:02 -0800 (PST) X-Google-Smtp-Source: AFSGD/V3NHFb8mbvTdWaJswEOO5PRxPAR2Lvko0/a7SfUOTFtOMJCGvN9NrKsyQsBuPzRAAbdbUp X-Received: by 2002:a65:48c4:: with SMTP id o4mr4113733pgs.371.1542767222517; Tue, 20 Nov 2018 18:27:02 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1542767222; cv=none; d=google.com; s=arc-20160816; b=hM5V2ZViU+Ux6K4uiETOLHuczFsD7n/d1NlEUEV8j7rhjAqulDHDu9XzE3Gd9q1kr/ Dhad1yMhEravmYGObfkx4wCnDy7/Ri0WwLIQ0uHuEM5FYQsA9B3LediNTnMV+OC5EGOB SPEmWEdovyTb4d7Rk8GlfUYDFbE4zHhm40IUG+5HEowgKPyWMQS/iZj3i/OVKf4m/vEk hyeaB+oEwCfcmmKJxLUPE5gPcdQZWrhyqXiKxAzidhSkMA3Fddas4b20QjOZNul729Mt YNU+aGRpfa0FSva+DFpTi6sfEVANHizS3E8zkdeJS0TGhlCV8b0tn1OyCWhAm2K7lBAz zqYg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:in-reply-to:content-disposition :mime-version:references:message-id:subject:cc:to:from:date; bh=5CBA/LN+17MBURg4XNXD+jHH6lDDDGGAE4nlfuXIP40=; b=ZsYsyEICtN0o4kbIz8ICxIXb+RjbzIedMpRO4v0QG04RWp6pNtfs7iKGAsHPXNhQzy yk3HA77izV3qgu565SOgJXnjjlnLfRsAoOXG7gZuItg0FOXFsjXN4AkeNa+LlXF1ZTBg BsUpt47cibEhHfZuDFZsj32Gdugi1HXChexKr5BHtmxCkbadV4GiABt23issG4+dMZhF 0o0Qmd+pjrscxc9UcYv+FKwc6ScbyaL5qYaX711TZhy+CnVPvsCoaWnPHvuBo+ftDoQC F02Jmt3yyF4VWYx9OsqakxNTUlmf+XpLat0hNtEqOGlhA5FNJHsOjOe1hNS0h1bGuffV ebAg== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id v2si533935plz.53.2018.11.20.18.26.33; Tue, 20 Nov 2018 18:27:02 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726200AbeKUMa2 (ORCPT + 99 others); Wed, 21 Nov 2018 07:30:28 -0500 Received: from mx1.redhat.com ([209.132.183.28]:60752 "EHLO mx1.redhat.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1725913AbeKUMa1 (ORCPT ); Wed, 21 Nov 2018 07:30:27 -0500 Received: from smtp.corp.redhat.com (int-mx03.intmail.prod.int.phx2.redhat.com [10.5.11.13]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id B5E233082A2F; Wed, 21 Nov 2018 01:58:13 +0000 (UTC) Received: from redhat.com (ovpn-120-136.rdu2.redhat.com [10.10.120.136]) by smtp.corp.redhat.com (Postfix) with SMTP id DFFAD66070; Wed, 21 Nov 2018 01:58:08 +0000 (UTC) Date: Tue, 20 Nov 2018 20:58:07 -0500 From: "Michael S. Tsirkin" To: David Hildenbrand Cc: linux-mm@kvack.org, linux-kernel@vger.kernel.org, linux-doc@vger.kernel.org, devel@linuxdriverproject.org, linux-fsdevel@vger.kernel.org, linux-pm@vger.kernel.org, xen-devel@lists.xenproject.org, kexec-ml , pv-drivers@vmware.com, Jonathan Corbet , Alexey Dobriyan , Mike Rapoport , Andrew Morton , Christian Hansen , Vlastimil Babka , "Kirill A. Shutemov" , Stephen Rothwell , Matthew Wilcox , Michal Hocko , Pavel Tatashin , Alexander Duyck , Naoya Horiguchi , Miles Chen , David Rientjes , Konstantin Khlebnikov , Kazuhito Hagio Subject: Re: [PATCH v1 2/8] mm: convert PG_balloon to PG_offline Message-ID: <20181120205632-mutt-send-email-mst@kernel.org> References: <20181119101616.8901-1-david@redhat.com> <20181119101616.8901-3-david@redhat.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20181119101616.8901-3-david@redhat.com> X-Scanned-By: MIMEDefang 2.79 on 10.5.11.13 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.5.110.45]); Wed, 21 Nov 2018 01:58:14 +0000 (UTC) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Mon, Nov 19, 2018 at 11:16:10AM +0100, David Hildenbrand wrote: > PG_balloon was introduced to implement page migration/compaction for pages > inflated in virtio-balloon. Nowadays, it is only a marker that a page is > part of virtio-balloon and therefore logically offline. > > We also want to make use of this flag in other balloon drivers - for > inflated pages or when onlining a section but keeping some pages offline > (e.g. used right now by XEN and Hyper-V via set_online_page_callback()). > > We are going to expose this flag to dump tools like makedumpfile. But > instead of exposing PG_balloon, let's generalize the concept of marking > pages as logically offline, so it can be reused for other purposes > later on. > > Rename PG_balloon to PG_offline. This is an indicator that the page is > logically offline, the content stale and that it should not be touched > (e.g. a hypervisor would have to allocate backing storage in order for the > guest to dump an unused page). We can then e.g. exclude such pages from > dumps. > > We replace and reuse KPF_BALLOON (23), as this shouldn't really harm > (and for now the semantics stay the same). In following patches, we will > make use of this bit also in other balloon drivers. While at it, document > PGTABLE. > > Cc: Jonathan Corbet > Cc: Alexey Dobriyan > Cc: Mike Rapoport > Cc: Andrew Morton > Cc: Christian Hansen > Cc: Vlastimil Babka > Cc: "Kirill A. Shutemov" > Cc: Stephen Rothwell > Cc: Matthew Wilcox > Cc: "Michael S. Tsirkin" > Cc: Michal Hocko > Cc: Pavel Tatashin > Cc: Alexander Duyck > Cc: Naoya Horiguchi > Cc: Miles Chen > Cc: David Rientjes > Cc: Konstantin Khlebnikov > Cc: Kazuhito Hagio > Signed-off-by: David Hildenbrand > --- > Documentation/admin-guide/mm/pagemap.rst | 9 ++++++--- > fs/proc/page.c | 4 ++-- > include/linux/balloon_compaction.h | 8 ++++---- > include/linux/page-flags.h | 11 +++++++---- > include/uapi/linux/kernel-page-flags.h | 2 +- > tools/vm/page-types.c | 2 +- > 6 files changed, 21 insertions(+), 15 deletions(-) > > diff --git a/Documentation/admin-guide/mm/pagemap.rst b/Documentation/admin-guide/mm/pagemap.rst > index 3f7bade2c231..340a5aee9b80 100644 > --- a/Documentation/admin-guide/mm/pagemap.rst > +++ b/Documentation/admin-guide/mm/pagemap.rst > @@ -75,9 +75,10 @@ number of times a page is mapped. > 20. NOPAGE > 21. KSM > 22. THP > - 23. BALLOON > + 23. OFFLINE > 24. ZERO_PAGE > 25. IDLE > + 26. PGTABLE > > * ``/proc/kpagecgroup``. This file contains a 64-bit inode number of the > memory cgroup each page is charged to, indexed by PFN. Only available when > @@ -118,8 +119,8 @@ Short descriptions to the page flags > identical memory pages dynamically shared between one or more processes > 22 - THP > contiguous pages which construct transparent hugepages > -23 - BALLOON > - balloon compaction page > +23 - OFFLINE > + page is logically offline > 24 - ZERO_PAGE > zero page for pfn_zero or huge_zero page > 25 - IDLE > @@ -128,6 +129,8 @@ Short descriptions to the page flags > Note that this flag may be stale in case the page was accessed via > a PTE. To make sure the flag is up-to-date one has to read > ``/sys/kernel/mm/page_idle/bitmap`` first. > +26 - PGTABLE > + page is in use as a page table > > IO related page flags > --------------------- > diff --git a/fs/proc/page.c b/fs/proc/page.c > index 6c517b11acf8..378401af4d9d 100644 > --- a/fs/proc/page.c > +++ b/fs/proc/page.c > @@ -152,8 +152,8 @@ u64 stable_page_flags(struct page *page) > else if (page_count(page) == 0 && is_free_buddy_page(page)) > u |= 1 << KPF_BUDDY; > > - if (PageBalloon(page)) > - u |= 1 << KPF_BALLOON; > + if (PageOffline(page)) > + u |= 1 << KPF_OFFLINE; > if (PageTable(page)) > u |= 1 << KPF_PGTABLE; > > diff --git a/include/linux/balloon_compaction.h b/include/linux/balloon_compaction.h > index cbe50da5a59d..f111c780ef1d 100644 > --- a/include/linux/balloon_compaction.h > +++ b/include/linux/balloon_compaction.h > @@ -95,7 +95,7 @@ extern int balloon_page_migrate(struct address_space *mapping, > static inline void balloon_page_insert(struct balloon_dev_info *balloon, > struct page *page) > { > - __SetPageBalloon(page); > + __SetPageOffline(page); > __SetPageMovable(page, balloon->inode->i_mapping); > set_page_private(page, (unsigned long)balloon); > list_add(&page->lru, &balloon->pages); > @@ -111,7 +111,7 @@ static inline void balloon_page_insert(struct balloon_dev_info *balloon, > */ > static inline void balloon_page_delete(struct page *page) > { > - __ClearPageBalloon(page); > + __ClearPageOffline(page); > __ClearPageMovable(page); > set_page_private(page, 0); > /* > @@ -141,13 +141,13 @@ static inline gfp_t balloon_mapping_gfp_mask(void) > static inline void balloon_page_insert(struct balloon_dev_info *balloon, > struct page *page) > { > - __SetPageBalloon(page); > + __SetPageOffline(page); > list_add(&page->lru, &balloon->pages); > } > > static inline void balloon_page_delete(struct page *page) > { > - __ClearPageBalloon(page); > + __ClearPageOffline(page); > list_del(&page->lru); > } > > diff --git a/include/linux/page-flags.h b/include/linux/page-flags.h > index 50ce1bddaf56..f91da3d0a67e 100644 > --- a/include/linux/page-flags.h > +++ b/include/linux/page-flags.h > @@ -670,7 +670,7 @@ PAGEFLAG_FALSE(DoubleMap) > #define PAGE_TYPE_BASE 0xf0000000 > /* Reserve 0x0000007f to catch underflows of page_mapcount */ > #define PG_buddy 0x00000080 > -#define PG_balloon 0x00000100 > +#define PG_offline 0x00000100 > #define PG_kmemcg 0x00000200 > #define PG_table 0x00000400 > > @@ -700,10 +700,13 @@ static __always_inline void __ClearPage##uname(struct page *page) \ > PAGE_TYPE_OPS(Buddy, buddy) > > /* > - * PageBalloon() is true for pages that are on the balloon page list > - * (see mm/balloon_compaction.c). > + * PageOffline() indicates that the pages is logically offline although the with this typo fixed .. > + * containing section is online. (e.g. inflated in a balloon driver or > + * not onlined when onlining the section). > + * The content of these pages is effectively stale. Such pages should not > + * be touched (read/write/dump/save) except by their owner. > */ > -PAGE_TYPE_OPS(Balloon, balloon) > +PAGE_TYPE_OPS(Offline, offline) > > /* > * If kmemcg is enabled, the buddy allocator will set PageKmemcg() on > diff --git a/include/uapi/linux/kernel-page-flags.h b/include/uapi/linux/kernel-page-flags.h > index 21b9113c69da..6f2f2720f3ac 100644 > --- a/include/uapi/linux/kernel-page-flags.h > +++ b/include/uapi/linux/kernel-page-flags.h > @@ -32,7 +32,7 @@ > > #define KPF_KSM 21 > #define KPF_THP 22 > -#define KPF_BALLOON 23 > +#define KPF_OFFLINE 23 > #define KPF_ZERO_PAGE 24 > #define KPF_IDLE 25 > #define KPF_PGTABLE 26 > diff --git a/tools/vm/page-types.c b/tools/vm/page-types.c > index 37908a83ddc2..6c38d3b862e4 100644 > --- a/tools/vm/page-types.c > +++ b/tools/vm/page-types.c > @@ -133,7 +133,7 @@ static const char * const page_flag_names[] = { > [KPF_NOPAGE] = "n:nopage", > [KPF_KSM] = "x:ksm", > [KPF_THP] = "t:thp", > - [KPF_BALLOON] = "o:balloon", > + [KPF_OFFLINE] = "o:offline", > [KPF_PGTABLE] = "g:pgtable", > [KPF_ZERO_PAGE] = "z:zero_page", > [KPF_IDLE] = "i:idle_page", for balloon changes: Acked-by: Michael S. Tsirkin > -- > 2.17.2