Received: by 2002:a89:d88:0:b0:1fa:5c73:8e2d with SMTP id eb8csp694614lqb; Fri, 24 May 2024 10:13:34 -0700 (PDT) X-Forwarded-Encrypted: i=3; AJvYcCVkZ50sCFNu2dotsDa4+VBaGMvBzNKD3h3ZNZrMpNq9JDVhkzQ0USs5Smlfcc6N474Utbs7y4qo9XkzR/QC5XH5FSjz6cQ+Fqrilm8stQ== X-Google-Smtp-Source: AGHT+IHtECetNVXNZGPZ4CHu1AVXmLvAcloijJZh4MV56qOUTMCQAtSrI/c8iVxfQoI1iXukjVuy X-Received: by 2002:a05:6102:2156:b0:47c:1251:cf25 with SMTP id ada2fe7eead31-48a3856fa14mr3350420137.12.1716570813837; Fri, 24 May 2024 10:13:33 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1716570813; cv=pass; d=google.com; s=arc-20160816; b=rBqMlW0FjxZ1SPRb0sQJSHWjzRJKBkpDLCWqEqBs0LlB6FDzwNIhJby4HpA8AuYXdA aPW1i0GXIB4v5WFfkEIISgvMCU5Hjh3ZwBpNzN3iudnJBh4fa54jua1EjqDukpnwqq3E l97OXC9oWBcrpF26plyzfW+CxvyNgI3Z0shfcfZ1fwZSGNrhQfD7XDXZuVjM1iyP3Xl2 ccx4Nf6KiEKSaNiXljwn9igoF8dyrEbKEOWB1hECO197S3CZWnjaTpfMgihxSXY5lg/0 igJD+AYDBP0sPwPuPK80A/l0ypq4fhUbpmhteelSt/LwsNpf+aMQambSmjpNFr451OoP 6mvw== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:references:in-reply-to:message-id :subject:cc:to:from:date; bh=QDiaquebay/Yjv7LGqgLIgdzNy1YvOj8iRYw0K8PSZ8=; fh=xSbff4mA9pXr9ObRe+vMESKf8yjS6n+NF5Rqcg4k4HA=; b=mCIpiYnPouJlEBvrQQ90ciwe8qSjAR37WHtKlXB/9sx/aExJ/+gIMawnAX6k8GXBVM 521qG5xvcPuKt664Wj9YxWG+M+579ZRUxasfCLodall21cMPhsxF8tOKbTcAKYzm6VJ8 LnGzlDWmJVxf11Kb1LAsZParm5NOl1YDrP5j4q+nYbrC1+LdfDqmcnvc093RJXlx7D+E hWfxCksS0N0QVLsBNUb/o/a4eiWjqNWBeOS1YtYfvGnIXNeLdKDp1DJuR7TW7fROOdwr 93b//Vrh9LMGZwWyntli9B+RQtZwoOOZmGfbWxBZ4aDonKe/ahwMVxCGzxzu5MKwxvE/ JhSA==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; arc=pass (i=1); spf=pass (google.com: domain of linux-kernel+bounces-188963-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.199.223 as permitted sender) smtp.mailfrom="linux-kernel+bounces-188963-linux.lists.archive=gmail.com@vger.kernel.org" Return-Path: Received: from ny.mirrors.kernel.org (ny.mirrors.kernel.org. [147.75.199.223]) by mx.google.com with ESMTPS id ada2fe7eead31-48a3a349bb3si414802137.406.2024.05.24.10.13.33 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 24 May 2024 10:13:33 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel+bounces-188963-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.199.223 as permitted sender) client-ip=147.75.199.223; Authentication-Results: mx.google.com; arc=pass (i=1); spf=pass (google.com: domain of linux-kernel+bounces-188963-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.199.223 as permitted sender) smtp.mailfrom="linux-kernel+bounces-188963-linux.lists.archive=gmail.com@vger.kernel.org" Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ny.mirrors.kernel.org (Postfix) with ESMTPS id 486641C21378 for ; Fri, 24 May 2024 17:13:32 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 37BD312F37F; Fri, 24 May 2024 17:13:26 +0000 (UTC) Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id A81F9381CC; Fri, 24 May 2024 17:13:25 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1716570805; cv=none; b=lY/HxHqrq+gpkQIUEt3ND3GOdLnh7ZeWujG/bhZIY51y6uXnpykRjB4j9cdfnKJ2V9x1SD3v3oTyc8TrfBm2FIYADvDaVCEGsLHTol5W/mTP6I/JMzOsx8tt8WnpVXgZHgXsV8zRxve4/OzrB8c8j1sO7DwNp25ZZzu4RLxUiQE= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1716570805; c=relaxed/simple; bh=vphDPHazOPYYZyWRv4dKhwcY4W9o4i4ZeP8O0B/7XYM=; h=Date:From:To:Cc:Subject:Message-ID:In-Reply-To:References: MIME-Version:Content-Type; b=SBo6iz49gxP9i0f205fGRCnFiJYOoRsv/2zBOw5/PtZ+z75qkkAN7dFqIio6KExi75d7tK8b8kmnzlQoWyled93vPa4jHEYgSogPY1OFNhnz8DSWo0p4m0ghthdsCOtud8D9Yln3/pSSjg+wG/bbqVduTqI2JrSvwGq8HLrErS8= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 Received: by smtp.kernel.org (Postfix) with ESMTPSA id 7C2F3C2BBFC; Fri, 24 May 2024 17:13:24 +0000 (UTC) Date: Fri, 24 May 2024 13:14:11 -0400 From: Steven Rostedt To: "Linux regression tracking (Thorsten Leemhuis)" Cc: Linux regressions mailing list , Ilkka =?UTF-8?B?TmF1bGFww6TDpA==?= , stable@vger.kernel.org, linux-kernel@vger.kernel.org, linux-trace-kernel@vger.kernel.org Subject: Re: Bug in Kernel 6.8.x, 6.9.x Causing Trace/Panic During Shutdown/Reboot Message-ID: <20240524131411.4bfe89d2@gandalf.local.home> In-Reply-To: <5b79732b-087c-411f-a477-9b837566673e@leemhuis.info> References: <5b79732b-087c-411f-a477-9b837566673e@leemhuis.info> X-Mailer: Claws Mail 3.20.0git84 (GTK+ 2.24.33; x86_64-pc-linux-gnu) Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable On Fri, 24 May 2024 12:50:08 +0200 "Linux regression tracking (Thorsten Leemhuis)" = wrote: > [CCing a few people] >=20 Thanks for the Cc. > On 24.05.24 12:31, Ilkka Naulap=C3=A4=C3=A4 wrote: > >=20 > > I have encountered a critical bug in the Linux vanilla kernel that > > leads to a kernel panic during the shutdown or reboot process. The > > issue arises after all services, including `journald`, have been > > stopped. As a result, the machine fails to complete the shutdown or > > reboot procedure, effectively causing the system to hang and not shut > > down or reboot. =20 To understand this, did you do anything with tracing? Before shutting down, is there anything in /sys/kernel/tracing/instances directory? Were any of the files/directories permissions in /sys/kernel/tracing change= d? >=20 > Thx for the report. Not my area of expertise, so take this with a gain > of salt. But given the versions your mention in your report and the > screenshot that mentioned tracefs_free_inode I suspect this is caused by > baa23a8d4360d ("tracefs: Reset permissions on remount if permissions are > options"). A few fixes for it will soon hit mainline and are meant to be > backported to affected stable trees: >=20 > https://lore.kernel.org/all/20240523212406.254317554@goodmis.org/ > https://lore.kernel.org/all/20240523174419.1e5885a5@gandalf.local.home/ >=20 > You might want to try them =E2=80=93 or recheck once they hit the stable = trees > you are about. If they don't work, please report back. There's been quite a bit of updates in this code, but this looks new to me. I have more fixes that were just pulled by Linus today. https://git.kernel.org/torvalds/c/0eb03c7e8e2a4cc3653eb5eeb2d2001182071215 I'm not sure how relevant that is for this. But if you can reproduce it with that commit, then this is a new bug. -- Steve