Received-SPF: pass (google.com: domain of linux-kernel+bounces-132322-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) client-ip=147.75.80.249;
Message-ID: <0fae21aa-d9a1-48d1-85e1-ad746edae361@amd.com>
Date: Fri, 5 Apr 2024 07:45:02 +0530
User-Agent: Mozilla Thunderbird
Subject: Re: [PATCH v2] rcu: Reduce synchronize_rcu() delays when all wait
 heads are in use
Content-Language: en-US
To: Frederic Weisbecker <frederic@kernel.org>
Cc: paulmck@kernel.org, joel@joelfernandes.org, urezki@gmail.com,
 josh@joshtriplett.org, boqun.feng@gmail.com, rostedt@goodmis.org,
 mathieu.desnoyers@efficios.com, jiangshanlai@gmail.com,
 qiang.zhang1211@gmail.com, rcu@vger.kernel.org,
 linux-kernel@vger.kernel.org, neeraj.upadhyay@kernel.org
References: <20240403105212.237354-1-Neeraj.Upadhyay@amd.com>
 <Zg8ezv2vzylVwg2q@pavilion.home>
From: Neeraj Upadhyay <Neeraj.Upadhyay@amd.com>
In-Reply-To: <Zg8ezv2vzylVwg2q@pavilion.home>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0:
	=?utf-8?B?RUJuOUc0Vk50c3I1bThseGZWSDF1SnNnRXcwVXdIenVocHQyUGlkSVFwRDcv?=
 =?utf-8?B?YVp2T2ZoRE8rNGZoM25GUHpSY3l5WGNCUmdEcWpBcHRUQkxPb0hFeWRVazdF?=
 =?utf-8?B?VUFqTXlwUEg1eDh6NWJYTklLU3VlTEUrZHpTeWZwY1AzTTVJV2ZiYUkvTkxD?=
 =?utf-8?B?SDZyT1FadUhPdU9nbVJLcXpTeUM4SEsrbFdmRzQxOGdWL1pqS09VRGdVbzdV?=
 =?utf-8?B?dzY3Yit0bVBoTVdQb2U4anczdmFxOXlqY0JqYjNBZ1ZyL2lGZThGL1dYWThy?=
 =?utf-8?B?M0t6Ulh3T2RldTFORVd4eEVRNGd6K0xiSGtwS1pBTHFtd2pqdFBCTXFyV1NP?=
 =?utf-8?B?eXZkakszTG1BLzlXOEtBbTZzUFloaTJJZE5vbndIL1VhWm9xRHFPOEY3VEZt?=
 =?utf-8?B?eEpvbG54WEJkMkpCbitRY21CU1dvMTdpbTZTRjF1YTVBc3N5cnRCOExncVpr?=
 =?utf-8?B?c085dW80SzhpV0JDNUJtRU4wMmtaYXQ2dzcxWituRmN5OXhwNWhEUEJDRENw?=
 =?utf-8?B?MEZoOUpUSmZ5eHlldzhKeUZ4WXptUUMzT3A4NkxwUWY2UmVKdXhnUU5hQ0dk?=
 =?utf-8?B?eWNDSTNnUkgzbUNjRERTbVBlUWQra1N2Vm1rS3orVDF0Yk1EcUplMkU2YnBI?=
 =?utf-8?B?MnloSWJITVFsSFNYTEs0bHRCQzBrdUN5bjBZZGlqY09oQzlzT2pQa3A1VG8r?=
 =?utf-8?B?S1lSOTRhbEQ2eHdJNXp1ZWhqMzB6VmtpZVI3bFVGZ1dEU0MrQllUelpUdC9C?=
 =?utf-8?B?YmdJVWdKYVI2aVpjcFNtUk51VkVBTGFPaHVxR05NYXo5c0grdWUyNm5oTDR1?=
 =?utf-8?B?czZuNHdYSHZRRGhCQlp6ZDhoaXFWQ3dxa2FWUnY5ai9VUTFqZm1MQ0QyQi9z?=
 =?utf-8?B?SWVxSmt4SFpYTVpuT1R4TE1xTzRwaWd3ZURrS1B6MTI2ZGdtbjhRdlBSSU93?=
 =?utf-8?B?SzlxTWczUEFwS2Y3NnJHSElMbDR5d2ptSEVxcEsycXNHTVVJcDhETW1LUGNP?=
 =?utf-8?B?eFYyRytOMDhHQ1lSaUxtd3Z6UGJxRFRPV0VPMysrbno5MS9KLzFhaXVzY3Bm?=
 =?utf-8?B?dy9uSTEveUFETDlyT1owMVRwNzAySkl4bGVtOE9kck5KSFZwMk90d0h3aHlF?=
 =?utf-8?B?ZEVpd0hvNzFxN05aSEFxdTM2SldxeFlINzVoY0crQy9FYytKTjFoUzc1T0xR?=
 =?utf-8?B?RTJ5ZDZnbFJEcHhFMTgycTdLejBJUGE2bTdhbGk0WEE0SUpXdXlUMlNZQnAr?=
 =?utf-8?B?aWtXa1IvTVVlQ21PcTlsSXI2SU80VUVEZXdEQW8reEFSelNsb1JMUU14SU5u?=
 =?utf-8?B?Yk9Fdmd4aVp2RHVJOHpFV0lHelIrWWtBckVONUVQVGFSZHBSQ05rdytRdTBW?=
 =?utf-8?B?VW1vWVZsTVpKbGVuLzltVHJCZ090Zzk0SE9XYmQwTHlHQW9zTEJNTjVabUFk?=
 =?utf-8?B?T3FTQU1YRDRoamcydUhrR2U0eDQyc3ZwcDIxRzd3L0xvN0FFRXVTMDVZTE9w?=
 =?utf-8?B?N0dZcUNrTWFuWFN1NHRtTmNTOUxGWU1lOUxxNzNUcXBoZXlTelYrNHlmUFBy?=
 =?utf-8?B?OWxkYnpQSFRpNkpRV2sxVkE1c3NnR3ZBTUxUV0cvZi9YakhMYVFtODV6VnpC?=
 =?utf-8?B?ODRFQ0lJUUVuTU5qdzhDUW1BUVp3UnljbUN6eTdCU3hwckMwUTZwRGRCYmdt?=
 =?utf-8?B?bVlwZmF5ZFpVV0dnNnAvcTV1TWtPd3l6SUlZMi82TThNTm9lNFdLdzd5ZE9F?=
 =?utf-8?B?YWxJcHZxWjQvSldCTGIwSWhIaVN3STBJVW50QmF5TU0yYmpSci9uSlFGRGVT?=
 =?utf-8?B?ejR3Q2Q2YWhsWXRNZy9LZXVJUjJTQmxuZEYrZ3p6eHVaeVRMUjZOcFltWVd3?=
 =?utf-8?B?ck1ETzdSdWV3amVJdTdWVkVGSFN0VmtJRk1hT1RqTjNNSjAwVXBKTVVpdDRH?=
 =?utf-8?B?UFgrM3BvVTRXSjRFdGs5SFVPSGNXeE1BRE5yMnJKMnZCN2lIa1BHdnJreTlt?=
 =?utf-8?B?VlV1TE5EWmtrRS9kM2ErcE5EM1pweWFnVW1IZ1lIcnVOWXV5Z2RDdlF1Wit3?=
 =?utf-8?B?a0E2cWhXVzArTWxQVGQ4U1pTTjZUaG1TMW1ic2xzWkZJU2Z4V05HWi8wVTZr?=
 =?utf-8?Q?NzR5/NscSohTimCHe1GqrIpWB?=
X-OriginatorOrg: amd.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 7e6ea172-4d23-43f1-4933-08dc55163984
X-MS-Exchange-CrossTenant-AuthSource: DS0PR12MB6608.namprd12.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 05 Apr 2024 02:15:12.7283
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: TMYTeRkyAwF+0FABgOd0Wozt2pSYvNwB0NsKiUJKgMqJQZC/G6PvB8AQWc0IDzAB3wNmBPnmXHknD6f5VHmXWg==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: LV8PR12MB9136


On 4/5/2024 3:12 AM, Frederic Weisbecker wrote:
> Le Wed, Apr 03, 2024 at 04:22:12PM +0530, Neeraj Upadhyay a écrit :
>> When all wait heads are in use, which can happen when
>> rcu_sr_normal_gp_cleanup_work()'s callback processing
>> is slow, any new synchronize_rcu() user's rcu_synchronize
>> node's processing is deferred to future GP periods. This
>> can result in long list of synchronize_rcu() invocations
>> waiting for full grace period processing, which can delay
>> freeing of memory. Mitigate this problem by using first
>> node in the list as wait tail when all wait heads are in use.
>> While methods to speed up callback processing would be needed
>> to recover from this situation, allowing new nodes to complete
>> their grace period can help prevent delays due to a fixed
>> number of wait head nodes.
>>
>> Signed-off-by: Neeraj Upadhyay <Neeraj.Upadhyay@amd.com>
> 
> Looking at it again, I'm not sure if it's a good idea to
> optimize the thing that far. It's already a tricky state machine
> to review and the workqueue has SR_NORMAL_GP_WAIT_HEAD_MAX - 1 = 4
> grace periods worth of time to execute. Such a tense situation may
> happen of course but, should we really work around that?
> 
> I let you guys judge. In the meantime, I haven't found correctness

I agree that this adds more complexity for handling a scenario
which is not expected to happen often. Also, this does not help
much to recover from the situation, as most of the callbacks are still
blocked on kworker execution. Intent was to keep the patch ready, in
case we see fixed SR_NORMAL_GP_WAIT_HEAD_MAX  as a blocking factor.
It's fine from my side if we want to hold off this one. Uladzislau
what do you think?

> issues:
> 
> Reviewed-by: Frederic Weisbecker <frederic@kernel.org>
> 

Thanks!


- Neeraj

> Thanks.