Received-SPF: pass (google.com: domain of linux-ext4-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Date:   Wed, 21 Sep 2022 16:45:22 -0700
From:   Dan Williams <dan.j.williams@intel.com>
To:     Jason Gunthorpe <jgg@nvidia.com>,
        Dan Williams <dan.j.williams@intel.com>,
        Alistair Popple <apopple@nvidia.com>
CC:     <akpm@linux-foundation.org>, Matthew Wilcox <willy@infradead.org>,
        "Jan Kara" <jack@suse.cz>, "Darrick J. Wong" <djwong@kernel.org>,
        "Christoph Hellwig" <hch@lst.de>,
        John Hubbard <jhubbard@nvidia.com>,
        <linux-fsdevel@vger.kernel.org>, <nvdimm@lists.linux.dev>,
        <linux-xfs@vger.kernel.org>, <linux-mm@kvack.org>,
        <linux-ext4@vger.kernel.org>
Subject: Re: [PATCH v2 16/18] mm/memremap_pages: Support initializing pages
 to a zero reference count
Message-ID: <632ba212e32bb_349629451@dwillia2-xfh.jf.intel.com.notmuch>
References: <166329930818.2786261.6086109734008025807.stgit@dwillia2-xfh.jf.intel.com>
 <166329940343.2786261.6047770378829215962.stgit@dwillia2-xfh.jf.intel.com>
 <YyssywF6HmZrfqhD@nvidia.com>
Content-Type: text/plain; charset="us-ascii"
Content-Disposition: inline
In-Reply-To: <YyssywF6HmZrfqhD@nvidia.com>
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?+1ufcVv4foL0LBQqu+uGRdxCUrj+tgbXplBOOaCp4BXv1ugrNocgPg+Ho+y0?=
 =?us-ascii?Q?Y+VQin6Wkz41P5rZ+NoMvmnelN48X51kyaFeW0YvlyKgpdVSGz7Dyf+r3dY/?=
 =?us-ascii?Q?cr8zgCiiXuGqLj0+KlhEeXUB/IxPUglqcAc5z6Q75MIzjFtdG9vdmV8zantN?=
 =?us-ascii?Q?cu7IxuyzNquk59SrHURnpsvG0L7PGk66lOhCIHl2vnQexdTkAEOArKRUES6V?=
 =?us-ascii?Q?moKcuqpwj6K528gEERt+K1GUb15jFJhiiIwekZphc3aiqzmvf0BYfQMO/KUR?=
 =?us-ascii?Q?5Ir7IwtkzQfMdnhUHOjxZ77gGg7W9Pedexocb0DzhElRZ8f2j+nlUs750cJy?=
 =?us-ascii?Q?PMVLU0l4ld88gY4R4kpgbGEPiWU8sje6U2KBoEl4usZdd6BP68GUsRlBOO5r?=
 =?us-ascii?Q?hYiFAC4LFqoLAAVwZHAq0r1ptojHMRhwsns1yoO/jtURhh2EULU6DAGQaTJC?=
 =?us-ascii?Q?XChnHiu+myH+JXB5taUYdqSwuqaa/65rcEGz3Rm/yd8VH8b+cWn7fyC+5RqX?=
 =?us-ascii?Q?d96xcWdL7TGL/4Ugc2sswOFZiOXalD3mFdJdG0efpG0aEqpytfLNpVIlTVbP?=
 =?us-ascii?Q?BoopLuYoWvXjwe3w3N1j0k2nKbaa3RExE9vPvg6G9w1hDeeZ0VIzvIsKJEuv?=
 =?us-ascii?Q?Jv2jOYkxLtrrqIAsZYW44ukpI7OqC3WYuKo0PnIht1cP5PSBMK5nn4chS1D1?=
 =?us-ascii?Q?Ff28S4OBsJWLd/NTWJ3DESsa/rJekYOt7xt7rQbc+rAl88+C652JSagfcyV2?=
 =?us-ascii?Q?+SSKVfMduV3EzUrgCceM2h9RffkxF8q2YReHcfhGT8uuNNRXl0bXEsX3y/04?=
 =?us-ascii?Q?xg0/JphsEk0XB/NNYltsFmiUaNfF46h8Q/Gdk4LiYeRRuc0YNJGtePvvmbM1?=
 =?us-ascii?Q?oOXzGSeU40fKWMQWkRUVu618/nDhnlNGIRx65l0xN3ug9XCHvCo0VOxKSZ3s?=
 =?us-ascii?Q?fzbM/EnTVe9Srn8jOfie68/z91AFRnfTHzAHFs02YucYJclm0MAPfIkU4Pwv?=
 =?us-ascii?Q?Fc9lhk+CcjIHVw7noKE4IccA7WhzIGG1xYFF99ljlgiyb1BG+azZeIrqbjiA?=
 =?us-ascii?Q?78a6ZYnZqDt5XynK+XNvZQf1NJkwfQ7MGJU/EZ5GoSX/M8odrSL9X9qIVDg+?=
 =?us-ascii?Q?YgA7vukHMy+QP2MH27geGB2SR+XSu19BVFx3eJ8f1Ocx97rs71yWm5FbWGMo?=
 =?us-ascii?Q?y88vyX04+p7D9SGK2H1DfET4hgoIwVuGlylrV+y2iQLsR0Ga4Evm0ucqhDlL?=
 =?us-ascii?Q?48FEkulswnpJ4fbx8mM5uBhW433A9gvMizUaiVpC66ao734ZdOC7KeQLJV04?=
 =?us-ascii?Q?VIzIFsy3HsqmD2wFyQiis5ok7KRBHZ0vAXM3Ilty5mcEdRc6hy8BjlPJyzSL?=
 =?us-ascii?Q?IFnnzYED9SmBAvcpZDdjNu3jmT15aq3XJE4tGYxFV4yx3a5mdjxOQPCbJVz+?=
 =?us-ascii?Q?VozGeypWO+aN3aCDZrdAyC8ZTVQmF4Zb98iW7s/3IDO6U7ZbQcwi7XdusRpd?=
 =?us-ascii?Q?ImLBlh5GuReEHWtpKFMMe8fs4jmOufTfNdft0AX/PwbvJjSauDDl2gXkGctR?=
 =?us-ascii?Q?PsQ9Q7F69j8nenD2iGbjUINW6TI59niHgblx44UNsK6HwRASpz9vFi6tB+jZ?=
 =?us-ascii?Q?dQ=3D=3D?=
X-MS-Exchange-CrossTenant-Network-Message-Id: b272ddf2-72b3-4f2b-52f2-08da9c2b5b3c
X-MS-Exchange-CrossTenant-AuthSource: MWHPR1101MB2126.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 21 Sep 2022 23:45:25.6740
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: 9aVLIipQFRNwafm9jkG2Xzx0sXhewxlBCuyhKufaIWC+bOIpC5uYpNZ18NurL1VxK9Rj6m75W08sRBvwO0cJmd3gFxkPAtsX3eyrS0qx15g=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SJ1PR11MB6204
X-OriginatorOrg: intel.com
X-Spam-Status: No, score=-7.1 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH,
        DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_HI,
        SPF_HELO_NONE,SPF_NONE autolearn=ham autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-ext4.vger.kernel.org>
X-Mailing-List: linux-ext4@vger.kernel.org

Jason Gunthorpe wrote:
> On Thu, Sep 15, 2022 at 08:36:43PM -0700, Dan Williams wrote:
> > The initial memremap_pages() implementation inherited the
> > __init_single_page() default of pages starting life with an elevated
> > reference count. This originally allowed for the page->pgmap pointer to
> > alias with the storage for page->lru since a page was only allowed to be
> > on an lru list when its reference count was zero.
> > 
> > Since then, 'struct page' definition cleanups have arranged for
> > dedicated space for the ZONE_DEVICE page metadata, and the
> > MEMORY_DEVICE_{PRIVATE,COHERENT} work has arranged for the 1 -> 0
> > page->_refcount transition to route the page to free_zone_device_page()
> > and not the core-mm page-free. With those cleanups in place and with
> > filesystem-dax and device-dax now converted to take and drop references
> > at map and truncate time, it is possible to start MEMORY_DEVICE_FS_DAX
> > and MEMORY_DEVICE_GENERIC reference counts at 0.
> > 
> > MEMORY_DEVICE_{PRIVATE,COHERENT} still expect that their ZONE_DEVICE
> > pages start life at _refcount 1, so make that the default if
> > pgmap->init_mode is left at zero.
> 
> I'm shocked to read this - how does it make any sense?

I think what happened is that since memremap_pages() historically
produced pages with an elevated reference count that GPU drivers skipped
taking a reference on first allocation and just passed along an elevated
reference count page to the first user.

So either we keep that assumption or update all users to be prepared for
idle pages coming out of memremap_pages().

This is all in reaction to the "set_page_count(page, 1);" in
free_zone_device_page(). Which I am happy to get rid of but need from
help from MEMORY_DEVICE_{PRIVATE,COHERENT} folks to react to
memremap_pages() starting all pages at reference count 0.

> dev_pagemap_ops->page_free() is only called on the 1->0 transition, so
> any driver which implements it must be expecting pages to have a 0
> refcount.
> 
> Looking around everything but only fsdax_pagemap_ops implements
> page_free()

Right.

> So, how does it work? Surely the instant the page map is created all
> the pages must be considered 'free', and after page_free() is called I
> would also expect the page to be considered free.

The GPU drivers need to increment reference counts when they hand out
the page rather than reuse the reference count that they get by default.

> How on earth can a free'd page have both a 0 and 1 refcount??

This is residual wonkiness from memremap_pages() handing out pages with
elevated reference counts at the outset.

> eg look at the simple hmm_test, it threads pages on to the
> mdevice->free_pages list immediately after memremap_pages and then
> again inside page_free() - it is completely wrong that they would have
> different refcounts while on the free_pages list.

I do not see any page_ref_inc() in that test, only put_page() so it is
assuming non-idle pages at the outset.

> I would expect that after the page is removed from the free_pages list
> it will have its recount set to 1 to make it non-free then it will go
> through the migration.
> 
> Alistair how should the refcounting be working here in hmm_test?
> 
> Jason