Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
From:   Ankit Jain <ankitja@vmware.com>
To:     juri.lelli@redhat.com, bristot@redhat.com, l.stach@pengutronix.de,
        suhui_kernel@163.com, msimmons@redhat.com, peterz@infradead.org,
        glenn@aurora.tech, stable@vger.kernel.org,
        linux-kernel@vger.kernel.org, gregkh@linuxfoundation.org
Cc:     srivatsab@vmware.com, srivatsa@csail.mit.edu, akaher@vmware.com,
        amakhalov@vmware.com, vsirnapalli@vmware.com,
        sturlapati@vmware.com, bordoloih@vmware.com, keerthanak@vmware.com,
        Ankit Jain <ankitja@vmware.com>
Subject: [PATCH v5.4.y 2/4] sched/deadline: Fix stale throttling on de-/boosted tasks
Date:   Mon, 22 Aug 2022 13:09:40 +0530
Message-Id: <20220822073942.218045-3-ankitja@vmware.com>
In-Reply-To: <20220822073942.218045-1-ankitja@vmware.com>
References: <20220822073942.218045-1-ankitja@vmware.com>
Content-Transfer-Encoding: 8bit
Content-Type: text/plain
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?hSPrxS1S/asLOcDXH04R0JeTOj18Nr9O66h/sia7COgOmXndCXueZ/8XQvb9?=
 =?us-ascii?Q?89tcf62mj3i7rvydmn/ssDDAah/A0y/fiEN4VvoITol/YGZPQyesDmPwu/bc?=
 =?us-ascii?Q?ipzjqKu1WD/UQp1G1Cj4b0fVWfGyHW4TNJGQXuBBk4k/yZraX6VfvHU5xd0f?=
 =?us-ascii?Q?hi3xAz5eGWvZ0lQrnOFOeAuosKdGt66QRnFXSXx3Oaqudvq+P0W5vKAWWIV+?=
 =?us-ascii?Q?iO+kSCcNSFT7XgYgYo7cfOj1VxoJjCW1Bx03twylrAiCpM96dKEIO14HmR00?=
 =?us-ascii?Q?wLGIIQrUCdPu+U98gRF6DRS/4COHgKkZuSRtIWr1p6xly7GVAfnb3bSDGilo?=
 =?us-ascii?Q?1AWgNuEPP4l7nh9dGJZ55IBIaWO5OPWe2/79u7TxrwFQY6bRBjl4Qykt2GTB?=
 =?us-ascii?Q?VsGSd3TNCPMZ3mFakfNcrC1P6ZVp1Sn1sWs66DklrlZkQ8AWlVX1vTvuu2sW?=
 =?us-ascii?Q?WIqNBsiclHbO9ASP+8m8LNlJ2W9SdOcWE5vLlZPnW1g34rjOF0+bKESSpXpu?=
 =?us-ascii?Q?/Jb0fNKucluXW8VxH3Mhmk9tTO0abKMERVb8Ap0uICPJHgpegAz1mmHstpkH?=
 =?us-ascii?Q?PnU0xqdjetzK41/F75BguVVC30PzynJu+ZuyC8n7WU4HdEarFaXup7spk1Cv?=
 =?us-ascii?Q?vOnxhhzBppB3iuNWjeq2+jCe1h5MDMfuS4+T7LZz0v0K8TSR+9Qnc1vc+6et?=
 =?us-ascii?Q?BSkNZ8F1meuLkxgkO6Yy6boGkHsGyK/x+lsORhBKeLPJ23CU1ahHyfcaNs88?=
 =?us-ascii?Q?sSKYvaSd5Dw2y+sAEf59o0f87z4cPPifgffYPqJsMRt9dZYUHYqtVJeEllbW?=
 =?us-ascii?Q?d0vk/jXU2H4a8i3UWdkeWSDDlkRFlFoLpU9wjMTg4PiOx87VxVnG7+rGdEb8?=
 =?us-ascii?Q?Nrol/60fasURYfsOSlJxo4S1M3oFn13FQQSJMRb9QnxWKrKtPNC7u4+MzgMP?=
 =?us-ascii?Q?XxpvhqgJBqoocITGCJIdMlT40QAFn1UDJnM2wsR7rInDpU2DtpKHVl0IBna2?=
 =?us-ascii?Q?kyKT3dwTL4YjBjR21Hf6ZbL02OuzgqmzoS4HeB/ICa1L8xjM3Li6BXnPpJu+?=
 =?us-ascii?Q?01VxS/nmelrq8H2l04iDwgxoI/7vEMSACngdpbUvZ00QfQXbeP0oZVfOg9tA?=
 =?us-ascii?Q?winGOA2dvQx9B3mIftWqe/f4COyGDZkwIn8IBRYQlbe7lTGf/MW6nFlm74W0?=
 =?us-ascii?Q?hyHt5BWy5WCcmowNd2k3aKm+LZipVQlOZ2yfYlGBgeUTA64aTPUbWYFu9Fp9?=
 =?us-ascii?Q?JZNUDsCWLPQHIxZV1X7lOaqkK/r0yYGpDfKmtRV1mEmMu4yYg14VHjLSdj99?=
 =?us-ascii?Q?kO3Dk1lMl7AxjabCGMfzqyELPToMwhkMoQYDddZMjXMeWupdWagTVN7Fuwi6?=
 =?us-ascii?Q?5YmzRtukyAcVzE81rccn0JZ63mVVfFl0PgoTRNTfrCyjowxUlnrAddUcoX5Z?=
 =?us-ascii?Q?Z0JI3vfIiKXQ8ejHASNwriPGxH0/9DBLWEe0AfK6x9ebBDS5lVDshIri0XnT?=
 =?us-ascii?Q?igIfHJBjM2h496XWtRhtuAthVN3f6aJatv8mEmQANtTCP8VCh5okhrMa48Kp?=
 =?us-ascii?Q?YMnQvxheWqCD4E9cCRxOgYwifDtVAMmJrAod738i?=
X-OriginatorOrg: vmware.com
X-MS-Exchange-CrossTenant-Network-Message-Id: c6fef729-a15d-4c47-1815-08da84120090
X-MS-Exchange-CrossTenant-AuthSource: SA1PR05MB8311.namprd05.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 22 Aug 2022 07:43:28.1473
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: b39138ca-3cee-4b4a-a4d6-cd83d9dd62f0
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: RdyGiSwRWnwFeDIoAZpTmEjh726eW5Op/KDYcmwIHd9o6BNjprId5edHKUPo8jZw9Wr9IRenhBDkXJttviPKYA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM4PR05MB9253
X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH,
        DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FORGED_SPF_HELO,
        RCVD_IN_DNSWL_NONE,RCVD_IN_MSPIKE_H2,SPF_HELO_PASS,SPF_NONE,
        T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

From: Lucas Stach <l.stach@pengutronix.de>

commit 46fcc4b00c3cca8adb9b7c9afdd499f64e427135 upstream.

When a boosted task gets throttled, what normally happens is that it's
immediately enqueued again with ENQUEUE_REPLENISH, which replenishes the
runtime and clears the dl_throttled flag. There is a special case however:
if the throttling happened on sched-out and the task has been deboosted in
the meantime, the replenish is skipped as the task will return to its
normal scheduling class. This leaves the task with the dl_throttled flag
set.

Now if the task gets boosted up to the deadline scheduling class again
while it is sleeping, it's still in the throttled state. The normal wakeup
however will enqueue the task with ENQUEUE_REPLENISH not set, so we don't
actually place it on the rq. Thus we end up with a task that is runnable,
but not actually on the rq and neither a immediate replenishment happens,
nor is the replenishment timer set up, so the task is stuck in
forever-throttled limbo.

Clear the dl_throttled flag before dropping back to the normal scheduling
class to fix this issue.

Signed-off-by: Lucas Stach <l.stach@pengutronix.de>
Signed-off-by: Peter Zijlstra (Intel) <peterz@infradead.org>
Acked-by: Juri Lelli <juri.lelli@redhat.com>
Link: https://lkml.kernel.org/r/20200831110719.2126930-1-l.stach@pengutronix.de
[Ankit: Regenerated the patch for v5.4.y]
Signed-off-by: Ankit Jain <ankitja@vmware.com>
---
 kernel/sched/deadline.c | 13 ++++++++-----
 1 file changed, 8 insertions(+), 5 deletions(-)

diff --git a/kernel/sched/deadline.c b/kernel/sched/deadline.c
index fdeb2afffc48..4b87c5362ec0 100644
--- a/kernel/sched/deadline.c
+++ b/kernel/sched/deadline.c
@@ -1507,12 +1507,15 @@ static void enqueue_task_dl(struct rq *rq, struct task_struct *p, int flags)
 		}
 	} else if (!dl_prio(p->normal_prio)) {
 		/*
-		 * Special case in which we have a !SCHED_DEADLINE task
-		 * that is going to be deboosted, but exceeds its
-		 * runtime while doing so. No point in replenishing
-		 * it, as it's going to return back to its original
-		 * scheduling class after this.
+		 * Special case in which we have a !SCHED_DEADLINE task that is going
+		 * to be deboosted, but exceeds its runtime while doing so. No point in
+		 * replenishing it, as it's going to return back to its original
+		 * scheduling class after this. If it has been throttled, we need to
+		 * clear the flag, otherwise the task may wake up as throttled after
+		 * being boosted again with no means to replenish the runtime and clear
+		 * the throttle.
 		 */
+		p->dl.dl_throttled = 0;
 		BUG_ON(!p->dl.dl_boosted || flags != ENQUEUE_REPLENISH);
 		return;
 	}
-- 
2.34.1