Received: by 2002:a05:6500:1b8f:b0:1fa:5c73:8e2d with SMTP id df15csp166826lqb; Tue, 28 May 2024 11:49:54 -0700 (PDT) X-Forwarded-Encrypted: i=3; AJvYcCXcS/LVKmYNPAAXGbamiMAlAubJuLFDWYjFG9B8mZzFb66yUfPX26CY5qhT5uSDnyFDcnnPKIVZTkX/P38qxDN1KkjOcEm5KrjXuWc80Q== X-Google-Smtp-Source: AGHT+IF+2sSXMq02JEyf8AoSkkJqp091dHbEWiQC57rIaT6mEj/GSYLqDgpfAr2J7fseVPdAVeB5 X-Received: by 2002:a05:620a:8ce:b0:793:822:d737 with SMTP id af79cd13be357-794ab110757mr1274240685a.69.1716922194078; Tue, 28 May 2024 11:49:54 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1716922194; cv=pass; d=google.com; s=arc-20160816; b=wD5IsyUgZDwDtxTtPgvzANWRIgCOGEhtX7GPkP3i8ZbluKdE0vHJ/8tORlaEIAt/0t JTST0Lcsn2zYVLxh8GJc00KXhphTJbReCGDH3wS2VCmWfPNjUNxg+WnzY5wR4fn6EPt7 A1kOhmh0nuhSTamFvOia5PS5TBzr1w39rigCGcOBZGVa+2J02vcn6czkPbORMdmTsBxL 1mJbV33EYsZJ/gy/0z+xpu6SS5vYJVX47iEo9dQdrCbN4faua/jruYQOc5yi5nHDkCxv DT8xLiFSvUn+gnoyF4Cq78AaJDiwArAUOtXJF9WN4ecs5kXfNd8oGLSuEfgMhYg7n6oL CmAg== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:references:in-reply-to:message-id :subject:cc:to:from:date; bh=1JWkT4Wzys/kvsX2MXcWK4HsCEquDydygZ7x8EKkHEA=; fh=eoHkjZBPSdVVJru8Z4AyehB1S5Dv4REm1CAs19l3JNE=; b=q+/SBDZgdVQG4/w7tFzkogSlF5OhxGRhkVgNfS3vsAMMTa9wf8uBxwUuHzLyHLcL4F 5fSnWpxiw6AeNdBv/a4q9bPRbMNJbtJwBRTMYyBS84CZb7u6/qNB44xoAeCfJwqp61r1 weR6nWkDA1NytsFmb7VgHRLeU18iYs+CNJqMrs5+nQ/DEJK2tc186H8nUPLQRPW509I1 +7VLJXRtrFac6O5eXQRj2F39f1aBOmqR6AjscglrSQ5Xi2snRAb9U5t5SlyK9F0bidoO AchOKngHy82QzyJHWnoi5jhni3BZrHxsbtkL1x9iTIUqp8VKz9CPqo85E8emvR7miub+ jnYg==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; arc=pass (i=1); spf=pass (google.com: domain of linux-kernel+bounces-192883-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45d1:ec00::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-192883-linux.lists.archive=gmail.com@vger.kernel.org" Return-Path: Received: from ny.mirrors.kernel.org (ny.mirrors.kernel.org. [2604:1380:45d1:ec00::1]) by mx.google.com with ESMTPS id af79cd13be357-794abbfdaeesi1195769585a.0.2024.05.28.11.49.53 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 28 May 2024 11:49:54 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel+bounces-192883-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45d1:ec00::1 as permitted sender) client-ip=2604:1380:45d1:ec00::1; Authentication-Results: mx.google.com; arc=pass (i=1); spf=pass (google.com: domain of linux-kernel+bounces-192883-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45d1:ec00::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-192883-linux.lists.archive=gmail.com@vger.kernel.org" Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ny.mirrors.kernel.org (Postfix) with ESMTPS id AC4741C22F3A for ; Tue, 28 May 2024 18:49:53 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 2C4B316FF53; Tue, 28 May 2024 18:47:47 +0000 (UTC) Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 9A390179954; Tue, 28 May 2024 18:47:46 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1716922066; cv=none; b=hXjT8cuvHc+m4rB1yod6GaZFBpNlCWERDaG3IZCCJyXeVcIDgA/LY4Q14Ddo2JL2BpFLeWJ/E204qSmJd59cUQp88cQg2AuOIyIjd0oy4B/SxvCwsaknG6E7aSiZIEpyt7eE9w34jUxihQgG1kTVjdXYg+y5fbZ4JjZComXmPHU= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1716922066; c=relaxed/simple; bh=hwmeUbItsm+bV91/Ve29xLJ4dPvWDPNLCD48sqQOZYk=; h=Date:From:To:Cc:Subject:Message-ID:In-Reply-To:References: MIME-Version:Content-Type; b=SZMb1b37WGl3Iyi677JGjgRunJL0iTxwtz+pR0d4Ktr+y46q5jKdd6obinyJpxBXFnuJx98VAEuFcvNZw/e69hW/qAlr/oVhQbxnzoQWTdUwdUXDCENwLH6XrChXm3HfLgMGyiIdSCXYW53gTmqmcFzAPETNmetaF5qtXsPxDuA= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 Received: by smtp.kernel.org (Postfix) with ESMTPSA id 6D691C32781; Tue, 28 May 2024 18:47:45 +0000 (UTC) Date: Tue, 28 May 2024 14:47:43 -0400 From: Steven Rostedt To: Ilkka =?UTF-8?B?TmF1bGFww6TDpA==?= Cc: "Linux regression tracking (Thorsten Leemhuis)" , Linux regressions mailing list , stable@vger.kernel.org, linux-kernel@vger.kernel.org, linux-trace-kernel@vger.kernel.org Subject: Re: Bug in Kernel 6.8.x, 6.9.x Causing Trace/Panic During Shutdown/Reboot Message-ID: <20240528144743.149e351b@rorschach.local.home> In-Reply-To: References: <5b79732b-087c-411f-a477-9b837566673e@leemhuis.info> <20240527183139.42b6123c@rorschach.local.home> X-Mailer: Claws Mail 3.17.8 (GTK+ 2.24.33; x86_64-pc-linux-gnu) Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable On Tue, 28 May 2024 07:51:30 +0300 Ilkka Naulap=C3=A4=C3=A4 wrote: > yeah, the cache_from_obj tracing bug (without panic) has been > displayed quite some time now - maybe even since 6.7.x or so. I could > try checking a few versions back for this and try bisecting it if I > can find when this started. >=20 OK, so I don't think the commit your last bisect hit is the cause of the bug. It added a delay (via RCU) and is causing the real bug to blow up more. Can you add this patch to v6.9.2 and hopefully it crashes in a better location that we can find where the mixup happened. You may need to add the other commit (too if this doesn't trigger. Thanks, -- Steve diff --git a/fs/tracefs/inode.c b/fs/tracefs/inode.c index 417c840e6403..7af3f696696d 100644 --- a/fs/tracefs/inode.c +++ b/fs/tracefs/inode.c @@ -50,6 +50,7 @@ static struct inode *tracefs_alloc_inode(struct super_blo= ck *sb) list_add_rcu(&ti->list, &tracefs_inodes); spin_unlock_irqrestore(&tracefs_inode_lock, flags); =20 + ti->magic =3D 20240823; return &ti->vfs_inode; } =20 @@ -66,6 +67,7 @@ static void tracefs_free_inode(struct inode *inode) struct tracefs_inode *ti =3D get_tracefs(inode); unsigned long flags; =20 + BUG_ON(ti->magic !=3D 20240823); spin_lock_irqsave(&tracefs_inode_lock, flags); list_del_rcu(&ti->list); spin_unlock_irqrestore(&tracefs_inode_lock, flags); @@ -271,16 +273,6 @@ static const struct inode_operations tracefs_file_inod= e_operations =3D { .setattr =3D tracefs_setattr, }; =20 -struct inode *tracefs_get_inode(struct super_block *sb) -{ - struct inode *inode =3D new_inode(sb); - if (inode) { - inode->i_ino =3D get_next_ino(); - simple_inode_init_ts(inode); - } - return inode; -} - struct tracefs_mount_opts { kuid_t uid; kgid_t gid; @@ -448,6 +440,17 @@ static const struct super_operations tracefs_super_ope= rations =3D { .show_options =3D tracefs_show_options, }; =20 +struct inode *tracefs_get_inode(struct super_block *sb) +{ + struct inode *inode =3D new_inode(sb); + BUG_ON(sb->s_op !=3D &tracefs_super_operations); + if (inode) { + inode->i_ino =3D get_next_ino(); + simple_inode_init_ts(inode); + } + return inode; +} + /* * It would be cleaner if eventfs had its own dentry ops. * diff --git a/fs/tracefs/internal.h b/fs/tracefs/internal.h index f704d8348357..dda7d2708e30 100644 --- a/fs/tracefs/internal.h +++ b/fs/tracefs/internal.h @@ -16,6 +16,7 @@ struct tracefs_inode { }; /* The below gets initialized with memset_after(ti, 0, vfs_inode) */ struct list_head list; + unsigned long magic; unsigned long flags; void *private; };