Received: by 2002:a05:6a10:8c0a:0:0:0:0 with SMTP id go10csp932873pxb; Wed, 3 Mar 2021 21:34:50 -0800 (PST) X-Google-Smtp-Source: ABdhPJyotTq0pShoesMSsrTlewXxTveUUXuybx9ig/A8vUyGf6y/ufabdZ18+BtqNuS7i21tshIJ X-Received: by 2002:a17:906:801:: with SMTP id e1mr2251334ejd.465.1614836089909; Wed, 03 Mar 2021 21:34:49 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1614836089; cv=none; d=google.com; s=arc-20160816; b=OEXzFmzZvXMHrAaLyJ1+NOxxgdXil90CQYAWt8y5T7GSTxC2reuJKqqPLl9c9IyYa7 qBUUdC2YjhboIAF/YYqEx4mkiYz4s/LlY6z+BDh+2Hl/i7wX7RrobY7hOL0KAs+jB3ro AyPp6PtUbwgDcg9x1S/nHMobGDm/Z/gQN3AgT6D30Q/1pTvrpH4yQSzNOYGkGmJl/82C yQ7olzDMLkfs0W1kpVgtKXjv3HTPgkRoIuxORJ/u68omrUoo/K78BxL7jzCv0kXmJyGt hBsidcZX7Ta6+Uuen5PzmO0pSm8ONJx8j9RADwNMDxI7qrvv3lX2Ai+LpWkx48k6DM7z WAIw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:references:content-transfer-encoding:message-id :mime-version:to:subject:from:date:dkim-signature; bh=vA9wWjDn6bLma0CuAY4qp6fi9IxIzOHwRVYPhrr5f6E=; b=ulvSnkMzDAuTJwJ5TbD62ieMPSoYLlCQyILmWdCJz6QvcXX9HOxVBjUGT39UrkcLCx Jz42dHTK2haa1eEecXVKjsOrgaBuEc8MY1Q6DJ21c20VjbUngo5ET/DqRJmFMuj7HyUH 2/yooyfqWBI5ApCZT+Wu9qsbIVbjEa4mC+sqP6Tp6MvkElGyDk2HsW/2mflnq0QPc7fn sRLKnOP5ZtHT17GA/5e2g/GERAAMq+2wSM7xeLWjHHi1YrkYf3f3MGLj9t42uE44r412 5RFaD3UHyuYJE4hbvFCJGMi0IqzuL+quV6kK4y5OG5DomsPpOa5A/T0jTJwUCSkmKnDI EugA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@yahoo.ca header.s=s2048 header.b=Uv2FV+hj; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=yahoo.ca Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id i13si8378613ejy.93.2021.03.03.21.34.26; Wed, 03 Mar 2021 21:34:49 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@yahoo.ca header.s=s2048 header.b=Uv2FV+hj; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=yahoo.ca Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1576216AbhCBE0J (ORCPT + 99 others); Mon, 1 Mar 2021 23:26:09 -0500 Received: from sonic309-22.consmr.mail.gq1.yahoo.com ([98.137.65.148]:42277 "EHLO sonic309-22.consmr.mail.gq1.yahoo.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S240175AbhCBA7U (ORCPT ); Mon, 1 Mar 2021 19:59:20 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.ca; s=s2048; t=1614646676; bh=vA9wWjDn6bLma0CuAY4qp6fi9IxIzOHwRVYPhrr5f6E=; h=Date:From:Subject:To:References:From:Subject:Reply-To; b=Uv2FV+hjQ8q3kuDHKTVRJypP56qDy6uJ/8z42+yFsUOH5qLd8kKZbk2sva0EncyVPI2kQjsydiDPzUKfTFJJezEdPI/0QM6u1scHOCaz8Jr/KG2N3w8Eno38bq0evz4Pb/TEg+Lfhi531I6pSm4qsAcpssen4iDc9En7NxnvAHv5iIRGCe5t47KK3z6M/T40GCTSEERDcJEpuW56cTxtACCP8mQ4sq1m4epZu+0NktFXuCJmS2wvzdvQChNMgI7h7uK/C3iQt4NmKCwc1HoRfRcP3S4xlq6pT4h4X7TF6Ph5WImKjlCNsnZKZRR4FMdfAqQ/IPZvCCNQJUOeTQlHgQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1614646676; bh=Wch3LCNOJB7MJeUSkweI4aZ/nlO4ap+48VyCOV920QQ=; h=X-Sonic-MF:Date:From:Subject:To:From:Subject; b=TOf825wncIpRYMAcAL1EIaYuXPkZJNMmqh1Lz/HKa4wD3tVU3Oy0P5gxUNlR9YN8U0Nq/QibQksI8h5dsA8FHr2XJ8egKg6fUboRCFKckyDGPOMgM8/F8oaEyjYIavJG3fOVVFpBOBWdnEWIVi2QxrBgXue2at4dCrZvWGaJUeGTyd2cvZrEhT/JC0hk5ElVmitfxA2mgEIq6TRYA3uD2+DEJCu436u+cnw2j3Q5/RSxnwhKvRuioiqIB8A+v+RHhdzgMaHRcH3cNus3ufcStKZUPFETCbP1qTicwaHCMqe6BZ+vPtAuPuyMgSvKF3uddyv78hWao6tJicSQT+iV0Q== X-YMail-OSG: bU8m3UQVM1kKpbeCirlobVfuXYiKp.RHohhdsuz6o5CAuD5e5vIT6wMPvCyWFo7 vPB4hEp7UY9HjxnMBXe2hK8dkOfzyt8Y7xx1mUUWp2RK4pEO2zMy0Cz6z70UylQhOJ9eODe65PTy u1LmJ2Xxkjq9d1aHb.d9F2xMX1xjK0Uh6trEfKRj8eem7zG9NFVC2BYCIEQVm4pNPPsnLmRGdbmh xLw125Fh4qnn1DsaetCC9KYIAC8rFSmpTxvWj191Vc4cnht.5iyXsd_YTmckKWCsud2VTsxykTy2 _ai5_HAbPpzVh6AbIY4qHt8DboZvneaqHFdm93JX0g9Sp391pQWme4_5wqa8dQrbTAKssr_cluGx .95mW1Q.WpAGdV__oXvGlpvvM4J9jqQZXWv21fFqG2Wai__wrubu_S88mp_ntLoaNb7_vruqQ6NH cqaHverwIUS3GxCOZBZlH.ZrvNgcmUS6cJ9AjpFylvkvipmt4sJCpPjZDvyuh1W_RT.ZqZQglg8k NJQOyKpBmgd.pxG1gwUNmjhRMzg.nntQGw34WipMX2UvX34iZ7u5AiAMiygZkS78MpLDNyis5YNB moo6zqgueIAynTssHuIGus_rf1nuNM.pnAu7rrXo9ns1jNwdRN7tjASrTL4F0IhZdB9feDt6XY68 3rVyTgcMmaF9tdgSjjR7Y6CQGSUfcqbPr8WUI2HU2OhHxWNkyzxepYj4u32kRtGT1yKffdZsfUev MMJ0GxHv0tiJSyenXMCMF9X1sSyV9s99uv.cWZ2AS93HY4BMZqzBYRBUL_PaGcMVRgg0reH5P_YL FR_UAn5wft1VaRRMvpJmIx9XSKst3yxjy.Iq3QZLBMd16eOOexoNMYUM3H4sTNjFeX5ugmwNYUw5 7yNPPol0qCgw0BmUPdz1CuPQjCDkmMU4.jNwKmGZb37Lxdwn67lQp5YmYfq8ctjIkzsilVOmrKX. 9C8i82dMQkkhYwBxobR7_HTb5C.uvDUDW00XIgCqOeSrGkZHyddOlAhzRrULnilP.iO1sJa9kxt4 LQCY4RJSh1vOBvGqVd6oOhLolx2whfMJJ9O93XBly8Dkvnn9T2i8pDioKYcpOuDSqCUqnRS5m27A DR1qbiFT2mvpoBTr1YMR8FTkybphjDX9TBFDjKX3XridXL9eVAy6mVuQI7altDgARTk8ddli9Zqa amehohK_rDrpkE1Z3KwFYjMenq8UwboEHnQeE76KyF7O_JoQMxa_kvxdiPuauU__GI5fUulE0qbf Ph.vlm92OWPtlDZkwXu1BEyx6CGcLnONhc6Gte2N2ybqsbzVc8lf2iGABQ7wIu4_irtLTI_ObzmC gZnnDgatVKgBKNpDZgM_tq3kYDm9Mlg3uRSmVkqo7vtpdkwkcoiWismHm3q1JJT_FjXO_zj.uKPO l5lt8BIIWbg7U_RtdqxuA6pZq1kbEZcEsOoos84H9sOHikn07Z0Q9Q6WVoVoUudfzwkZiEetmYBZ 4adhXf4SoqgYFpXic2J_b0ivczjsvjPsBssw1ZwgUJKQqhlGnpi4jd0B2iaRfVeE2d1LYMTd1pLV 7b4avpmoWSL3NDau5qJb1eJyLi.7r.0qVFuRBNN7.CIFjT1rQBVGmEcYsNE67f7H8w_63wxLkLqs pyHOUMUD3v6Bvo6szhCxcGtgttwvpCCXlc_EPVqcIvEcOUBd2CTs6zqAfpx1hAY_x5Xq2HZnEiui IiHpG69uFthhkey9YeHwkxlbjXuOI9bgliTTHD34datZOrxP.2Vf02mr6ca87UO436qJ4YGTC7So Th2flvtlHqcCQVp6szXdsjzouDCdI3viofyN1BNyCrgcpVwudfSaaEa8Kt9GgUtbZ4qZfoIkoU9R ID..kDb62fO7xAa0IA.Ur8XBxFFDgHzYzw_yW_cgjmxMOuG3wuuTt9JbDDb82XKXf6S9DUcoQSod YMFw3vEuc0WxJtX_nmgdMHooehztOGRIOYYBjMBGgkm1dyXnotYMEjzXZbT7.aDoLVN0jdMd_YU7 Z4B46gYmlzlZoRsxJsZMRFKyf6ag9iIUNIUFSa86Q5i_I..Dc2116GhY68tnfqO6QQ49rpHhFzfx Z7L4Yhw0hNk20r0WfCVIs8omp0I.CqbV.TJ3coe_E6xaWeuci1nWeBVqiSlAhz1D8XH877KfQ0o4 lvgcnUtK57jLwwQnBAlz9a_e.nGEeG4WD0ox0kneaGVpm41OpRXS.kGHYg0iRce.Ew66MqMRJgXR j8dFgYrEeMNGEfDt0z8.kmVHOBcrdbwAPsUtwl7cx3z9KxtMr99FgO3UGBsl3TednBbxka9.NG_o KEmn4.RGxoCRNDj5BQtzDVFHS2WQwRupea2Roff8W207FhtygiYxFzQKTdBhDeQxr5.XjYrBLqG. S4vLYgtM1WFLWBsjl.tdUfdoB1F8YZo6hXgRsrIE9dcI04qMmcGnCuvtHJkStx_64ZU6OiDoD99X Kxa56fAkyC.7WgMpPnIDey8zZC6HLFo3gH__cd2FXcRcLBbcmBguDX8Wtfl_WJurW0lw- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic309.consmr.mail.gq1.yahoo.com with HTTP; Tue, 2 Mar 2021 00:57:56 +0000 Received: by smtp401.mail.bf1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 1eada59726444d77940edec9cae3d9d9; Tue, 02 Mar 2021 00:57:50 +0000 (UTC) Date: Mon, 01 Mar 2021 19:57:46 -0500 From: "Alex Xu (Hello71)" Subject: 5.12-rc1 regression: freezing iou-mgr/wrk failed To: linux-kernel@vger.kernel.org, linux-block@vger.kernel.org, Jens Axboe MIME-Version: 1.0 Message-Id: <1614646241.av51lk2de4.none@localhost> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable References: <1614646241.av51lk2de4.none.ref@localhost> X-Mailer: WebService/1.1.17828 mail.backend.jedi.jws.acl:role.jedi.acl.token.atz.jws.hermes.yahoo Apache-HttpAsyncClient/4.1.4 (Java/11.0.9.1) Content-Length: 2727 Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hi, On Linux 5.12-rc1, I am unable to suspend to RAM. The system freezes for=20 about 40 seconds and then continues operation. The following messages=20 are printed to the kernel log: [ 240.650300] PM: suspend entry (deep) [ 240.650748] Filesystems sync: 0.000 seconds [ 240.725605] Freezing user space processes ... [ 260.739483] Freezing of tasks failed after 20.013 seconds (3 tasks refus= ing to freeze, wq_busy=3D0): [ 260.739497] task:iou-mgr-446 state:S stack: 0 pid: 516 ppid: 4= 39 flags:0x00004224 [ 260.739504] Call Trace: [ 260.739507] ? sysvec_apic_timer_interrupt+0xb/0x81 [ 260.739515] ? pick_next_task_fair+0x197/0x1cde [ 260.739519] ? sysvec_reschedule_ipi+0x2f/0x6a [ 260.739522] ? asm_sysvec_reschedule_ipi+0x12/0x20 [ 260.739525] ? __schedule+0x57/0x6d6 [ 260.739529] ? del_timer_sync+0xb9/0x115 [ 260.739533] ? schedule+0x63/0xd5 [ 260.739536] ? schedule_timeout+0x219/0x356 [ 260.739540] ? __next_timer_interrupt+0xf1/0xf1 [ 260.739544] ? io_wq_manager+0x73/0xb1 [ 260.739549] ? io_wq_create+0x262/0x262 [ 260.739553] ? ret_from_fork+0x22/0x30 [ 260.739557] task:iou-mgr-517 state:S stack: 0 pid: 522 ppid: 4= 39 flags:0x00004224 [ 260.739561] Call Trace: [ 260.739563] ? sysvec_apic_timer_interrupt+0xb/0x81 [ 260.739566] ? pick_next_task_fair+0x16f/0x1cde [ 260.739569] ? sysvec_apic_timer_interrupt+0xb/0x81 [ 260.739571] ? asm_sysvec_apic_timer_interrupt+0x12/0x20 [ 260.739574] ? __schedule+0x5b7/0x6d6 [ 260.739578] ? del_timer_sync+0x70/0x115 [ 260.739581] ? schedule_timeout+0x211/0x356 [ 260.739585] ? __next_timer_interrupt+0xf1/0xf1 [ 260.739588] ? io_wq_check_workers+0x15/0x11f [ 260.739592] ? io_wq_manager+0x69/0xb1 [ 260.739596] ? io_wq_create+0x262/0x262 [ 260.739600] ? ret_from_fork+0x22/0x30 [ 260.739603] task:iou-wrk-517 state:S stack: 0 pid: 523 ppid: 4= 39 flags:0x00004224 [ 260.739607] Call Trace: [ 260.739609] ? __schedule+0x5b7/0x6d6 [ 260.739614] ? schedule+0x63/0xd5 [ 260.739617] ? schedule_timeout+0x219/0x356 [ 260.739621] ? __next_timer_interrupt+0xf1/0xf1 [ 260.739624] ? task_thread.isra.0+0x148/0x3af [ 260.739628] ? task_thread_unbound+0xa/0xa [ 260.739632] ? task_thread_bound+0x7/0x7 [ 260.739636] ? ret_from_fork+0x22/0x30 [ 260.739647] OOM killer enabled. [ 260.739648] Restarting tasks ... done. [ 260.740077] PM: suspend exit and then a set of similar messages except with s2idle instead of deep. Reverting 5695e51619 ("Merge tag 'io_uring-worker.v3-2021-02-25' of=20 git://git.kernel.dk/linux-block") appears to resolve the issue. I have=20 not yet bisected further. Let me know which troubleshooting steps I=20 should perform next. Thanks, Alex.