Received-SPF: pass (google.com: domain of linux-kernel+bounces-62958-linux.lists.archive=gmail.com@vger.kernel.org designates 139.178.88.99 as permitted sender) client-ip=139.178.88.99;
From: Ankur Arora <ankur.a.arora@oracle.com>
To: linux-kernel@vger.kernel.org
Cc: tglx@linutronix.de, peterz@infradead.org, torvalds@linux-foundation.org,
        paulmck@kernel.org, akpm@linux-foundation.org, luto@kernel.org,
        bp@alien8.de, dave.hansen@linux.intel.com, hpa@zytor.com,
        mingo@redhat.com, juri.lelli@redhat.com, vincent.guittot@linaro.org,
        willy@infradead.org, mgorman@suse.de, jpoimboe@kernel.org,
        mark.rutland@arm.com, jgross@suse.com, andrew.cooper3@citrix.com,
        bristot@kernel.org, mathieu.desnoyers@efficios.com,
        geert@linux-m68k.org, glaubitz@physik.fu-berlin.de,
        anton.ivanov@cambridgegreys.com, mattst88@gmail.com,
        krypton@ulrich-teichert.org, rostedt@goodmis.org,
        David.Laight@ACULAB.COM, richard@nod.at, mjguzik@gmail.com,
        jon.grimm@amd.com, bharata@amd.com, raghavendra.kt@amd.com,
        boris.ostrovsky@oracle.com, konrad.wilk@oracle.com,
        Ankur Arora <ankur.a.arora@oracle.com>
Subject: [PATCH 06/30] entry: handle lazy rescheduling at user-exit
Date: Mon, 12 Feb 2024 21:55:30 -0800
Message-Id: <20240213055554.1802415-7-ankur.a.arora@oracle.com>
In-Reply-To: <20240213055554.1802415-1-ankur.a.arora@oracle.com>
References: <20240213055554.1802415-1-ankur.a.arora@oracle.com>
Content-Transfer-Encoding: 8bit
Content-Type: text/plain
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: 
	=?us-ascii?Q?8TWLDvlHT1A9q6YQU+sr9xAvMKEd//CXz+eOzSqyrtO8wpnfMwmRmRqHdgJf?=
 =?us-ascii?Q?Eq8MOLgHJVzX/cOmyOPbbi4y9dVf2UxUpnZPh2WbJdq4dX7q97f/WdTbkzdo?=
 =?us-ascii?Q?8cGwww1chQ615fzEw8lgmS35eYLgT154OfU+ArXbm+Ioaxcln6Wqz5qrIbs3?=
 =?us-ascii?Q?08YU17Fjb6ib3ty1lAM4gWM5utYAFJg2KfizsZp9gMBu+lr2jUIKc9BGcDmD?=
 =?us-ascii?Q?merQFRgAolaYcQW/8z90SvcLqPF65HrfvpLO/EcA0lJg7fvcduqVITz9UWsf?=
 =?us-ascii?Q?Xk7yqzlIjWFdPYQ8ceqVThNHgpCHv6r6KII48+o/slY0X9BV3OSjZeYIx7nW?=
 =?us-ascii?Q?gHdeXGwO4EMX4CjooMREDudeI2jq5aS+fk51tE+VKfVcUHvvo8rBDql6l14r?=
 =?us-ascii?Q?o5+2nz/rIQJAu9RjP/BKq8ECmsAeLleHJJt4Cjb/VszgcuS8Z7ojayhEMNWc?=
 =?us-ascii?Q?KilOG005lpIoKF/c/65vZpaYQL8s00ozt35tgQM+VzXJtIyoNVqTriQne14n?=
 =?us-ascii?Q?yV85ZyVjoL4zHlNGuBbnq6euBX5h+OoKBkh0jbwwWwj58d5L4GyJUUX+wGun?=
 =?us-ascii?Q?NUT2E2GREPXBMTdA0FXF9SIk1aiYobAjY05BOwc+/WhaBLfryCdvGa1MZCEB?=
 =?us-ascii?Q?WAbWtJfpIhDC0qeG472TRJ1QkSRJTD9UD2n4OfuaBnNK8IWX692+GBu9MwZY?=
 =?us-ascii?Q?IDvQaWnZejvRFTrjzn8WGo6RCOCRkNfDvZAceqX4moIrGsbNgEFgCzPP5z1e?=
 =?us-ascii?Q?49g8g6BbVF4G9oouYah/83XjTDwXXKe0crkxXRCX+ELZk/MOFWWWOe5gW660?=
 =?us-ascii?Q?/QJWZrWcZ6xk0lx4dRuPBeo4BDmwW+t4rhnWvEbiQF3Ziv6VyyfCr9n1aaqz?=
 =?us-ascii?Q?iabXQWfRpA13chevJ7G9nihELovGZCKbQZpL9L1x+bN6T8oTmDusCkY1snNN?=
 =?us-ascii?Q?z5EuGkF2u0W+wwrnhi9BbejpPggFu2RCCp2Grt7VAQyQBr7i9ixG7Zu/JvvD?=
 =?us-ascii?Q?iUMJ5T89FJPiVNw3aUxObVzUYrWnugvW/MQKvCTV63T7u9xPCGiVCrVIjUjD?=
 =?us-ascii?Q?Jbi+dVWHDN6JM/J0OgGNkOdGnnFf+pruuRf6KymRYftFLlNrpJsSBWVy7yTg?=
 =?us-ascii?Q?58YCEUHGmRGgY1ARLNyNpUTCkofGASD2IVuKIQSN88kPbcJL41Yzb0EkKoT/?=
 =?us-ascii?Q?zbFYUwgF0xM55+ca5haw9VAhe/tMvHbzV3V81tkgq3Di9dIL2/vV+/kBu/hk?=
 =?us-ascii?Q?uog8sRQ3lBG7TwhhbwUokrk21ClNhi6xSLTnXQInwQ7dK9/T62bm6m7j8ZI0?=
 =?us-ascii?Q?ztTXu3rOMbFxkbazdITFxEhSaN0Gg51RMeqisP1gG3upyD1KLzLr8HNfNaX0?=
 =?us-ascii?Q?nLV/AS5ju/qyRoKrMi2+mSLIM1U3VjNanUBRAteUiPSt8ywBl4QqgMYRVIgK?=
 =?us-ascii?Q?Spb2la3vd2lJBabFRqLVjIdf5RcMi5Cvm3nZsrOzcFkCsL/WR4rSBQfM6ROv?=
 =?us-ascii?Q?WYefdAL1BZaAj1GbmwCL6XYKgNst1jiDedfo3H7+bpmTaz5Ydf7lWTK+mcva?=
 =?us-ascii?Q?aD7tefYX30Bmh3BQrlv7mIhDuSImyfT6cnIh7LjftZ593zyTT3dfpdYq/8I5?=
 =?us-ascii?Q?Jg=3D=3D?=
X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: 
	MB5jCMiQN0XTQ+QLTc0uIMZ92Cx2s1y2m7rTyVOx2/rzwis4jLv6TOvzuoSYkJae3jHd+7rPUm+HYXN3uCqwWiU4Y1CtVbHHq3ry83ObmOePEFktDbab9evSL/UZUMbxG7ZAe3edLlcYFb2yzUX89L7cmcub5cyDO668QOYEnzTaN0LQmxdwkbcKuUU6+T2wtheszpAm6pLN507JLBpAHwO1FiuZtXVyY17RYTKLdOxCiE5jj5M53OWEkZL6ai2KFT3tgQTuYZcTMvDiyHCnL9LTY38ukHDeo11kJC628KpjyFuCYnv8RrQJX23o75bA+X2K6cGqUtjxcDd3csKdlTLqof2jOG+OJiiNYg1RHCcx+ubXqkTjqUCxmu5n5sTcFb9R+/G937weRvZ0228L5hFc1dP1P6w99rWJTrhg6OOrxe9XGyJmOq3rdLDlYGrOCgaxcpY4EmZETPrIeduA6HJRDQpfUJwUKzNKxcrhHZSrERARYGTcI19OkzzdAkdR9HYJK7LVQghqYzzEJ+PGul2PSuNoCo9HQMwyEO7KHgd3PwEjDhORtRZk0Dn4DJ0cNaoV9zZMqEiUWFA3Tu6e3argZA89VKAqliMM6pUlP00=
X-OriginatorOrg: oracle.com
X-MS-Exchange-CrossTenant-Network-Message-Id: f508e533-7c47-48c1-9dea-08dc2c587084
X-MS-Exchange-CrossTenant-AuthSource: CO6PR10MB5409.namprd10.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 13 Feb 2024 05:55:53.7565
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: 3USngZK16H39tNBdEHl6eylsdjV8qTenvHev3Q0/SaCEZVM5ilffRz5ehGIeKLshxlqkBZposJ4rm8Rlhtg/g7wCp83xacvbjJ1Zv/d2WNA=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CO1PR10MB4642
X-Proofpoint-Virus-Version: vendor=baseguard
 engine=ICAP:2.0.272,Aquarius:18.0.1011,Hydra:6.0.619,FMLib:17.11.176.26
 definitions=2024-02-13_02,2024-02-12_03,2023-05-22_02
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 adultscore=0 bulkscore=0
 mlxlogscore=611 malwarescore=0 mlxscore=0 spamscore=0 suspectscore=0
 phishscore=0 classifier=spam adjust=0 reason=mlx scancount=1
 engine=8.12.0-2311290000 definitions=main-2402130043
X-Proofpoint-GUID: VjPYC7iAKuk3zqty61qdMbSb9u94d3hO
X-Proofpoint-ORIG-GUID: VjPYC7iAKuk3zqty61qdMbSb9u94d3hO

The scheduling policy for TIF_NEED_RESCHED_LAZY is to allow the
running task to voluntarily schedule out, running it to completion.

For archs with GENERIC_ENTRY, do this by adding a check in
exit_to_user_mode_loop().

Cc: Peter Zijlstra <peterz@infradead.org>
Cc: Andy Lutomirski <luto@kernel.org>
Originally-by: Thomas Gleixner <tglx@linutronix.de>
Link: https://lore.kernel.org/lkml/87jzshhexi.ffs@tglx/
Signed-off-by: Ankur Arora <ankur.a.arora@oracle.com>
---
 include/linux/entry-common.h | 2 +-
 kernel/entry/common.c        | 2 +-
 2 files changed, 2 insertions(+), 2 deletions(-)

diff --git a/include/linux/entry-common.h b/include/linux/entry-common.h
index b0fb775a600d..f5bb19369973 100644
--- a/include/linux/entry-common.h
+++ b/include/linux/entry-common.h
@@ -65,7 +65,7 @@
 #define EXIT_TO_USER_MODE_WORK						\
 	(_TIF_SIGPENDING | _TIF_NOTIFY_RESUME | _TIF_UPROBE |		\
 	 _TIF_NEED_RESCHED | _TIF_PATCH_PENDING | _TIF_NOTIFY_SIGNAL |	\
-	 ARCH_EXIT_TO_USER_MODE_WORK)
+	 _TIF_NEED_RESCHED_LAZY | ARCH_EXIT_TO_USER_MODE_WORK)
 
 /**
  * arch_enter_from_user_mode - Architecture specific sanity check for user mode regs
diff --git a/kernel/entry/common.c b/kernel/entry/common.c
index 88cb3c88aaa5..5c5befb05410 100644
--- a/kernel/entry/common.c
+++ b/kernel/entry/common.c
@@ -92,7 +92,7 @@ __always_inline unsigned long exit_to_user_mode_loop(struct pt_regs *regs,
 
 		local_irq_enable_exit_to_user(ti_work);
 
-		if (ti_work & _TIF_NEED_RESCHED)
+		if (ti_work & (_TIF_NEED_RESCHED | _TIF_NEED_RESCHED_LAZY))
 			schedule();
 
 		if (ti_work & _TIF_UPROBE)
-- 
2.31.1