Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
References: <20220729024645.764366-1-apopple@nvidia.com>
 <YuQ4mJqjIUncf7iF@nvidia.com> <87wnbsd6yp.fsf@nvdebian.thelocal>
 <YukWtNwRvOPh6jmM@nvidia.com>
User-agent: mu4e 1.6.9; emacs 27.1
From:   Alistair Popple <apopple@nvidia.com>
To:     Jason Gunthorpe <jgg@nvidia.com>
Cc:     akpm@linux-foundation.org, minchan@kernel.org, linux-mm@kvack.org,
        linux-kernel@vger.kernel.org, jhubbard@nvidia.com,
        pasha.tatashin@soleen.com
Subject: Re: [PATCH] mm/gup.c: Simplify and fix
 check_and_migrate_movable_pages() return codes
Date:   Tue, 02 Aug 2022 22:52:29 +1000
In-reply-to: <YukWtNwRvOPh6jmM@nvidia.com>
Message-ID: <877d3qdcds.fsf@nvdebian.thelocal>
Content-Type: text/plain
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?XZfbfgysEkCSfZ7ymaRtvJZ+LOqmAEL5TI06y58DpKxs3gt1xC7DgvlcXohy?=
 =?us-ascii?Q?RfslAy17MOSG+YHqAh/uSH2T48NGdXw9KZe5tbwi9sw+lVbY5C51Jf2bfvD6?=
 =?us-ascii?Q?vZGQv2aAan90EajHwPFxa/F6tZQFSICEOWl8aMm5gValch66axKFptekaxFi?=
 =?us-ascii?Q?ys+eKwbZnxSv3tQwOnR/1hr5RO+Wgtk0aP2tWkmW8H2qw7MWY2yrey3MIWTL?=
 =?us-ascii?Q?KbtT9QJiCL38a9i593+LJ9DhDPTOrrTcXadsvxKR/3IVp3TJnDbAc7ehESm8?=
 =?us-ascii?Q?bauEDY8V7gC3RXcrVIEujwMoigB0KhQSN0/1sNmFNlhndLS1h+F2NTBqq7l+?=
 =?us-ascii?Q?BdVKzwolzpfVl5YZhyi3395Hn50NGIERutTrskdti7yyQKXAtvANTjmT1ocI?=
 =?us-ascii?Q?NNd4OcJKSMTm+6w9z0bBS/gClGfD0DqsXTywW1Z35TaCUFDYGn9CqhCq+mYr?=
 =?us-ascii?Q?pATpMTO0d9puFU7Z1xGtGXbnTxToW2VB9SH/nY39PljQDNmkzahlQ3MUJMyQ?=
 =?us-ascii?Q?uSZsstiOVxT9RNAlO/0dBaI2mXJlK/EWVCOUdIoNOLhsKUgZHG0V5z7PKjJd?=
 =?us-ascii?Q?4oDPu4x0tKoEuw+Y6cHzBHaEBCnKgJksT0rh+7Vp18D/XteGQzYQKbky1o+T?=
 =?us-ascii?Q?3ouxW7WB677Xc7MAp1NeOmtls1eCL742kKfVBEyZdasvtLzIAQSQnAtUZ1YL?=
 =?us-ascii?Q?aX6zCKp5cfM+fcZuaCiaIwRFn7ZZC3Nt7QicDCMPegE3vN28ahFi2UlFR3LF?=
 =?us-ascii?Q?I07fg7wJl0EYBx9Oprg5YLOPL+PnU0W0iAjBBcdS3rMxL0HWToGGZGdXFkxH?=
 =?us-ascii?Q?75rQNcEnsXXpaJiUOsXk/y5x242H5pwhKNHyNqqqX2/RMwtbsvVrt7Wld4kT?=
 =?us-ascii?Q?+vfQvP+0z9ntPupaCxd7PzD3RZjT23S6WguRbDTSysOYsBn6MpbeRP/LQQY5?=
 =?us-ascii?Q?WoznV7Mvd7FJB0KLqhguYsy/d8vEjALo176kzOAHwMA0tsMC51+IHViCduoX?=
 =?us-ascii?Q?P5mJnMJ1tOLd5EuiVSfTE5+acHij/R4h/fRpBrHt3wJKzh6svbIVsNFPzHyx?=
 =?us-ascii?Q?kBDWP2WOWS1EqHFPNl1OBa8YEdfZ94bK8M8Yhg9pTCZiGczGhFNt/0vJWpO4?=
 =?us-ascii?Q?olYVr9V9oI1yuCYP9vDLL6et0OhDBPZ5MaPB2pA4RZ+UjYOkM0x06valhXrw?=
 =?us-ascii?Q?4CDLAhS2Z0OwTgeKoMK0rDCpviCdyEaxap1l+7vqK5n72WYARyLU9RyPi2r2?=
 =?us-ascii?Q?VUEtah2Uce0IkvfutoIHxFsEy/gRYkXhv7wX50dlrQsraUKFxyn1eNee7gAk?=
 =?us-ascii?Q?jfH2qfzQ4dr/VAdNBxX53V7LOyJPz9o66QhCbmjcALg3URv4TwsS+b2DMeC8?=
 =?us-ascii?Q?fnp8Uw6TXNdJ9s+Cfdcje91RfeWctV8srnJPv86yba/VOwpaDxKZGesTf+b1?=
 =?us-ascii?Q?IRGGDP8rSmbu3ZKbaWo48FYqNhpYUBUJDfaiOblTp9Ct51x+PPrsbpD9y/s5?=
 =?us-ascii?Q?X7+qEmylzWpoPUFnyP8Zfg9dvcvuOGcuRy6iO84F0WWiyNtzJ8EtzMS/Ahk5?=
 =?us-ascii?Q?7qdqnhBpRLEDLJ7/8lxMykH/MVoyoi/aZi4t0797?=
X-OriginatorOrg: Nvidia.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 71062cbf-82b3-4e2e-6d26-08da7487a897
X-MS-Exchange-CrossTenant-AuthSource: BYAPR12MB3176.namprd12.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 02 Aug 2022 13:05:22.5968
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: HSGZj3DRt7nLtF7C2Pn4fqIhxUVRSDGH536cW+NHJQy5CyXghzh5vgJM9e1D6Z69gE+PKD5s6mT168JSilHngg==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: MWHPR12MB1678
X-Spam-Status: No, score=-1.7 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH,
        DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FORGED_SPF_HELO,
        RCVD_IN_DNSWL_NONE,RCVD_IN_MSPIKE_H2,SPF_HELO_PASS,SPF_NONE
        autolearn=no autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org


Jason Gunthorpe <jgg@nvidia.com> writes:

> On Mon, Aug 01, 2022 at 12:18:53PM +1000, Alistair Popple wrote:
>
>> > AFAICT there is no reason to 'continue' in most of these paths since
>> > we intend to return to userspace with an error anyhow? Why try to
>> > isolate more pages?
>>
>> The main reason would be if callers want to retry the operation. AFAIK
>> isolate_folio_lru() can have transient failures, so if callers want to
>> retry it makes sense to isolate and migrate as many pages as possible
>> rather than one page at a time as subsequent retries may find different
>> pages that can't be isolated.
>
> Except we don't try to do the migrate, we just isolate and then
> unisolate and return failure.

Unless I'm missing something any pages successfully isolated are still
added to movable_page_list then migrated if we 'continue' (at least in
the original code and this patch version, but not v2). Obviously pages
that couldn't be isolated can't be migrated, but subsequent retries
should only need to deal with those pages as the rest should already be
in the correct zone.

>> Actually I should have called this out more clearly - the previous
>> behaviour on isolation failure was to retry indefinitely which is what
>> lead to looping in the kernel. This patch turns isolation failure into
>> an error and doesn't retry. I wonder though if we need to maintain a
>> retry count similar to what migrate_pages() does if there are unexpected
>> page refs?
>
> This makes more sense, exporting this mess to the caller and hoping
> they retry (they won't) doesn't make sense..

Ok, sounds reasonable. Will post a v3 that does this instead.

> Jason