Received-SPF: pass (google.com: domain of linux-kernel+bounces-106753-linux.lists.archive=gmail.com@vger.kernel.org designates 139.178.88.99 as permitted sender) client-ip=139.178.88.99;
From: Kamaljit Singh <Kamaljit.Singh1@wdc.com>
To: "linux-nvme@lists.infradead.org" <linux-nvme@lists.infradead.org>,
	"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
	"kbusch@kernel.org" <kbusch@kernel.org>, Sagi Grimberg <sagi@grimberg.me>
Subject: WQ_UNBOUND workqueue warnings from multiple drivers
Thread-Topic: WQ_UNBOUND workqueue warnings from multiple drivers
Thread-Index: AQHaeXhd/UIUk2VZGEG0Qh+3CF4eQA==
Date: Mon, 18 Mar 2024 22:33:30 +0000
Message-ID:
 <BYAPR04MB41513F04DB2ECDC3601CC36ABC2D2@BYAPR04MB4151.namprd04.prod.outlook.com>
Accept-Language: en-US
Content-Language: en-US
msip_labels:
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: BYAPR04MB4151:EE_|SJ2PR04MB8560:EE_
wdcipoutbound: EOP-TRUE
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info:
 GlfznXczxyp+w26QsRmkcn2Woc35TWtVPNnyhCWkWyR6oTpH/gH2ir75Wh32rlA3eNfLaLNv+yxMdnfUWCxB9NuGMZyF8/pkUC5wpGD9HnVYCO/b68Yse26Cbi/jiTojebKhnsCyuYSMzPbvLYHkqhBtJihyuHr0TvHDO/2zrPXYi6WwDEgrLSAuSHGm+cOfRkoGrsauo1GrRwU2qbo2e4kkkS6mPdsDU1eQPzWhaLBmHw/eNM51upC/ReDxDro3hk8IbNCkp2lmQSVupBOhGCXlUDZ/dYUCQJlOxypFy3tExW666jYxVZZ1+Se/V6n40S2Kks/G5Cd7DUcBDQeG1MiOJ9YSZCjA0boXcooExDaanNWvgwMHFXRzms27Q3Kth6HxK8/OyGhVxVfkL+ubM0wLhwk2WW4UV2YIxGxFcVFh0jJdsi5pLmxu2MjX13+qTKo6VMnAqpYtO+NK+KvMSjme+gOjw1Nd4tWs4uPjtwz0QOO3PY2zgpKSUsm6Znk9jI33VDbrmfYdtz+plMuGfXTjnrZuRTvuhi+zFqn8KL5alTirPtKeGPdi3gx0ZOCb4Xu8DVQlN3kz5NUXDygkC9BlQR/RVM+S9caAoi33gtA=
x-forefront-antispam-report:
 CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:BYAPR04MB4151.namprd04.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230031)(1800799015)(366007)(376005);DIR:OUT;SFP:1102;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0:
 =?iso-8859-1?Q?SlthbKfdYqc9gTXsLjW9oiuffrdn2A3Dk70fDy2eBgKlt8mpiZWGGGYB6H?=
 =?iso-8859-1?Q?iJcaa8nnJromVAh7iLCEU5XmqknBrddvimEBy/XgjWjLQxf5ZWwupg2smQ?=
 =?iso-8859-1?Q?2/Owq1/kBlU+evvTLBD6kDH6Qe8eDJyKe1dLj96ZYx7y72OjOZvb3kSx2I?=
 =?iso-8859-1?Q?NO4qQR0kcBwHtv7t92ALNMaAwBaGnbfaj4tueuGe6F6BeBQNvdKVLD7OD8?=
 =?iso-8859-1?Q?9PaqCt6EEVHeqqzEZ3RlavTx/4aHwPKauF4VeXpE/7fq+Q1q+cLhIO5m/y?=
 =?iso-8859-1?Q?TRDWy9CAiVj57G3uY2aWYaDQ0a0azdz8hnxw92YCZJPMolvzNhRdIXAvgp?=
 =?iso-8859-1?Q?vmsyrbiQysYcF2KnXmVqms3NXXU5VeNhGO/LSyfQuDNB8BIxVSwh3AIx5O?=
 =?iso-8859-1?Q?hio5k5QrBwpbgoD54o+1ZJvIrcEOx56qcwUABcMWM+7c1Ccy0z5qbW9mw1?=
 =?iso-8859-1?Q?nn+jiBRr95RqbJ1laF+hOW4nhV26fF0QAUYBP3LM5Fm1LONyxivIYLrmeQ?=
 =?iso-8859-1?Q?AjrX4t/Wti2k/XocAl1rV5/A4TAGfer050uoi470Uzkke1ShpdmigMHW2z?=
 =?iso-8859-1?Q?lPp8NqJpCw1VcPJP6O7h3SPkxI+EDgkpJI3gVYU3v6Jfr95+nzQrzAYOPC?=
 =?iso-8859-1?Q?6TotvKgL5iGDyAgWvafthRir8H18anhIJLunJnlxn1O21KxyffHaZMrFMI?=
 =?iso-8859-1?Q?eRuXs20PJOyrUmw8w4AQQIPAaR/Y5IJ4NGQGhDpn+hUIhdD1Kkqlbhc4Hu?=
 =?iso-8859-1?Q?WVxDzok0iB30JRgnWSlx3zp426g65WxWTeyh3cFXDY0rGXpC2MfdMgNtRY?=
 =?iso-8859-1?Q?9sXjS0Y8RCWi1BD+NafLLoaupHqySWhAFdJJgOWYtwOOH/cyrwlGdjTznt?=
 =?iso-8859-1?Q?tEPDmI7aFEa3BQfJDbaHGxkAY/sM1FejrjrekU4EoMdgUBMiPkYE7rWksR?=
 =?iso-8859-1?Q?AMg7JnDxRfHUwUrg3OoKcpAQDK+WcPx1YxM076DThkD6EILZxWLzPV8HTa?=
 =?iso-8859-1?Q?FUtxeRnBcw9JId9IH+RtInW/EQU9wsEXyXIyhGaFaJF/i3jJoU07hXvGLb?=
 =?iso-8859-1?Q?pohWqXGhcB+iT0RjQ/6MoSa/S7Dr/7nPzjOL6zitV3v37dhU+BTmYYlECf?=
 =?iso-8859-1?Q?0X3Cvv3o8dvbzLgj/Bl1JJMytCWC2zqNR35R4DkllqGQIK5f0maNTCOFy+?=
 =?iso-8859-1?Q?nH/dynqwrb6eJBhAvMrXSRpdDqUpOqA9lQLfNE67SH9cpbWSIrvb0cH8z+?=
 =?iso-8859-1?Q?yb6WkI9nrRT0tyMJErkACzjJFxIZtCGc6Wk7KE4ykH2vnqkJ/jSAY/TwTu?=
 =?iso-8859-1?Q?QkwRYG4Fo8OCvEd5e6FSE6ZeaFc3SMPnD8ey6HmBvJrygyHaqRbVqcfEPr?=
 =?iso-8859-1?Q?uA9oCp+G/PqUu1ycK0QkvX/mqUMzx2cLM52SaXr1aG4q0OQ/8vxURuN4VQ?=
 =?iso-8859-1?Q?HdNpO4THr6KaAfZOj9qNGphh0IIPq59zJI3UJpnuTeQ16OLlIfjjT8twTH?=
 =?iso-8859-1?Q?mkSr2Eggxhwh7eezsxrM/54dhU6Qf4x0256FsGm0Sk5dcLFHWAKfZTrfg1?=
 =?iso-8859-1?Q?ngDw+2cm0q215DralztPpIkO7SWJ/xU4KLBRmZmCaloOzoCj+NrJtgJPab?=
 =?iso-8859-1?Q?LweIx1pa9hHOD3zSkpcTJYQodF/OI/R2XD?=
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
Precedence: bulk
X-Mailing-List: linux-kernel@vger.kernel.org
List-Id: <linux-kernel.vger.kernel.org>
List-Subscribe: <mailto:linux-kernel+subscribe@vger.kernel.org>
List-Unsubscribe: <mailto:linux-kernel+unsubscribe@vger.kernel.org>
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0:
	YWsK1Q2IHfERadq2ksOMMONvYeFtXU/fpiIcXLhyGV2uoGgJwtoR94a08KZE3JReSi6dTxBLgxmboXyKrMlOxEjxEJZh/FojJxAg3ZQkK1ww4MTYrNuUKCBst07kHWab8dikY5H6pR1vvGQhLpH/IZssl1fyTSRB2nNizwqZbQhSS+q8LoVXXWmkcgOJGpfyZf4xiPKJOuI/f9VMFm2h2hIzbU91bKkPpN+lvQxLA5Dm4i0fKBVWd3uQYhImSugEI8+ACRHdI9PsG+qJbMaEhthgiXdmf7dmCc00Kq5dv7wzN0fcgcEwZm+0yzdZ+CdPaTf68AuoM8PGTO57v+nIhli1UuMgkygUeKeb2kLek7T8nGCLuv/J59VFlYzesoLib3RoHUW3O4zrohSEXkP8YzuNWRmLlCKcQE9OO8HzcngwIAa/fGx0xW+5FHe1Qq7d/KLjlvHZ7ZTiIp/UPLDLdzZDbKHTgtVoNGQmwYSs2ubA53pXCV+alkcp5QzUIXoFXc9PC1NW/k9dTSUC+7G/JhkpQpA773j6qkmczwVR0KkxfyqAmLnCC0gLPRgZK6+4iJPX680P1Y1tUqC5DxWKlCcE5oNSJgeBejO61bz5a3Ni0qhO20tqFocehIw7+KOt
X-OriginatorOrg: wdc.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: BYAPR04MB4151.namprd04.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 4e56b2ce-aec8-4506-b9cc-08dc479b6fd2
X-MS-Exchange-CrossTenant-originalarrivaltime: 18 Mar 2024 22:33:30.1070
 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: b61c8803-16f3-4c35-9b17-6f65f441df86
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: cs+rFmDZu3Fs1CXfFKH7vxWh+X063zg+gZQSDUq7b5s4sjUN3zQsLwtczuOZfG1J43kLJfGb/XRF3v09fPJ8TQ==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SJ2PR04MB8560

Hello,=0A=
=0A=
After switching from Kernel v6.6.2 to v6.6.21 we're now seeing these workqu=
eue =0A=
warnings. I found a discussion thread about the the Intel drm driver here =
=0A=
https://lore.kernel.org/lkml/ZO-BkaGuVCgdr3wc@slm.duckdns.org/T/=0A=
=0A=
and this related bug report https://gitlab.freedesktop.org/drm/intel/-/issu=
es/9245=0A=
but that that drm fix isn't merged into v6.6.21. It appears that we may nee=
d the same =0A=
WQ_UNBOUND change to the nvme host tcp driver among others.=0A=
=A0=0A=
[Fri Mar 15 22:30:06 2024] workqueue: nvme_tcp_io_work [nvme_tcp] hogged CP=
U for >10000us 4 times, consider switching to WQ_UNBOUND=0A=
[Fri Mar 15 23:44:58 2024] workqueue: drain_vmap_area_work=A0hogged CPU for=
 >10000us 4 times, consider switching to WQ_UNBOUND=0A=
[Sat Mar 16 09:55:27 2024] workqueue: drain_vmap_area_work=A0hogged CPU for=
 >10000us 8 times, consider switching to WQ_UNBOUND=0A=
[Sat Mar 16 17:51:18 2024] workqueue: nvme_tcp_io_work=A0[nvme_tcp] hogged =
CPU for >10000us 8 times, consider switching to WQ_UNBOUND=0A=
[Sat Mar 16 23:04:14 2024] workqueue: nvme_tcp_io_work=A0[nvme_tcp] hogged =
CPU for >10000us 16 times, consider switching to WQ_UNBOUND=0A=
[Sun Mar 17 21:35:46 2024] perf: interrupt took too long (2707 > 2500), low=
ering kernel.perf_event_max_sample_rate=A0to 73750=0A=
[Sun Mar 17 21:49:34 2024] workqueue: drain_vmap_area_work=A0hogged CPU for=
 >10000us 16 times, consider switching to WQ_UNBOUND=0A=
..=0A=
workqueue: drm_fb_helper_damage_work [drm_kms_helper] hogged CPU for >10000=
us 32 times, consider switching to WQ_UNBOUND=0A=
=A0=0A=
=A0=0A=
Thanks,=0A=
Kamaljit Singh=