Received: by 2002:a05:7412:d8a:b0:e2:908c:2ebd with SMTP id b10csp3999685rdg; Wed, 18 Oct 2023 11:46:26 -0700 (PDT) X-Google-Smtp-Source: AGHT+IGuqXd6ztgqxyENncveM+E8u3uSk9gQxAiIgFrRAxI2K+TFvrBMzm2schJDSuZEhIBlK1Xz X-Received: by 2002:a17:903:1cb:b0:1c7:22ae:4080 with SMTP id e11-20020a17090301cb00b001c722ae4080mr367668plh.0.1697654785879; Wed, 18 Oct 2023 11:46:25 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1697654785; cv=none; d=google.com; s=arc-20160816; b=UJG3ulGsrnlHiYl81ItOOcCkJxPTN4Axg7I9xOyPj3XYm6mwxoTrVyayfj1SGnzORL 59ol0Rw9CMmuHVFYGJBCBrOiu0V6mMzP4O7IOPGqPpssH4BpykO5dy6NQZGcu5i1+Nx2 93rJqQjuYIPajcfd3IutqlBVVcm/+0TQX36A8NZDHbKsGATk60aobfqm8a4n/n47rklM 8TnPvV82YkpSHnsg0a69xydrdtlx/vDq6Rb9NNfEY28s9oTLqusBJ7WwHUx2xvguqlWo YcnbD40/3mTJsZjeoIVFXQqCZGxMBWU9pPAFDWfhjYmdyX/6cITNsPqOpo5hfpIoRlUS oxPw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:in-reply-to:content-disposition:mime-version :references:message-id:subject:cc:to:from:date:dkim-signature :dkim-signature; bh=Szwtnfcke0SpMIDxlSZbJqKrDwqMF6CyFTyCgfEvpI0=; fh=JbVUgWB4lj6g9DNB07WgTrptog2z27EpC2Gn07Mzt7g=; b=D0Xi3hnn81sq8vdf87J9usvjNAaH+JV5vmAqsGo0jCG8F10wPTx7JCKc4Nu4zauZuk GinCxmz6H3ely4N3cSqlDAROLdGUe5gG5osvPiZXHUbaKCdubli7U8K/9lUbVPz4eVfV LCOSr0HzkgtlTjEaKOalTSdY2eaVDOQ1Ki/7InG4uNDveqwtEGYt6Sqb5IJzxpcFdBB5 3u6T9UJj6itJ5qPhfIY91PoN/Pmx+nDXYSCmhD3hUkeJDKvoF6HAFXTXOyIkwuP80hpL 8LS3TKAX0lDy/uBS3/yWWSSzIp1m7kh9ixQyhnAOf516Brohb4wfeSVHMcXygSolAV2L c11A== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@suse.cz header.s=susede2_rsa header.b=OOlMdN3Z; dkim=neutral (no key) header.i=@suse.cz; spf=pass (google.com: domain of linux-ext4-owner@vger.kernel.org designates 2620:137:e000::3:8 as permitted sender) smtp.mailfrom=linux-ext4-owner@vger.kernel.org Return-Path: Received: from fry.vger.email (fry.vger.email. [2620:137:e000::3:8]) by mx.google.com with ESMTPS id y7-20020a17090322c700b001b222cd9826si477305plg.349.2023.10.18.11.46.25 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 18 Oct 2023 11:46:25 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-ext4-owner@vger.kernel.org designates 2620:137:e000::3:8 as permitted sender) client-ip=2620:137:e000::3:8; Authentication-Results: mx.google.com; dkim=pass header.i=@suse.cz header.s=susede2_rsa header.b=OOlMdN3Z; dkim=neutral (no key) header.i=@suse.cz; spf=pass (google.com: domain of linux-ext4-owner@vger.kernel.org designates 2620:137:e000::3:8 as permitted sender) smtp.mailfrom=linux-ext4-owner@vger.kernel.org Received: from out1.vger.email (depot.vger.email [IPv6:2620:137:e000::3:0]) by fry.vger.email (Postfix) with ESMTP id 74A3F8108301; Wed, 18 Oct 2023 11:46:20 -0700 (PDT) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.10 at fry.vger.email Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229482AbjJRSqU (ORCPT + 99 others); Wed, 18 Oct 2023 14:46:20 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:34312 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229447AbjJRSqS (ORCPT ); Wed, 18 Oct 2023 14:46:18 -0400 Received: from smtp-out2.suse.de (smtp-out2.suse.de [IPv6:2001:67c:2178:6::1d]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 5531C114; Wed, 18 Oct 2023 11:46:16 -0700 (PDT) Received: from imap2.suse-dmz.suse.de (imap2.suse-dmz.suse.de [192.168.254.74]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-521) server-digest SHA512) (No client certificate requested) by smtp-out2.suse.de (Postfix) with ESMTPS id 34FB71F383; Wed, 18 Oct 2023 18:46:14 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.cz; s=susede2_rsa; t=1697654774; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=Szwtnfcke0SpMIDxlSZbJqKrDwqMF6CyFTyCgfEvpI0=; b=OOlMdN3ZPUx6jMv77bJrzoUDAI9vDmlO2f+WzeY5DP+RtLaAp+dwz3tCZxFAxcFDVhOXaB qzth31EooNxs3Tudf9fP0UMYpjKcBzpUb6i0bOA5i6c3zEztz68qPLbR+S3ykkmQrSAIqS fBheBoi3Do5+HT29SYxXZGuZ4n2k/7g= DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=suse.cz; s=susede2_ed25519; t=1697654774; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=Szwtnfcke0SpMIDxlSZbJqKrDwqMF6CyFTyCgfEvpI0=; b=Mp+8zqpwTLu/y67W0FyQ3bwpvZ/Zyi9kZAHJpkKLKnxbvvtuyNTHCI0S7cuyw759R8XtSu 3SDgr8uWgI3GleAA== Received: from imap2.suse-dmz.suse.de (imap2.suse-dmz.suse.de [192.168.254.74]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-521) server-digest SHA512) (No client certificate requested) by imap2.suse-dmz.suse.de (Postfix) with ESMTPS id 2749D13915; Wed, 18 Oct 2023 18:46:14 +0000 (UTC) Received: from dovecot-director2.suse.de ([192.168.254.65]) by imap2.suse-dmz.suse.de with ESMTPSA id K1yPCfYnMGWZVwAAMHmgww (envelope-from ); Wed, 18 Oct 2023 18:46:14 +0000 Received: by quack3.suse.cz (Postfix, from userid 1000) id ACFC8A06B0; Wed, 18 Oct 2023 20:46:13 +0200 (CEST) Date: Wed, 18 Oct 2023 20:46:13 +0200 From: Jan Kara To: Andy Shevchenko Cc: Jan Kara , Ferry Toth , Linus Torvalds , linux-fsdevel@vger.kernel.org, linux-ext4@vger.kernel.org Subject: Re: [GIT PULL] ext2, quota, and udf fixes for 6.6-rc1 Message-ID: <20231018184613.tphd3grenbxwgy2v@quack3> References: <20231017133245.lvadrhbgklppnffv@quack3> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: Authentication-Results: smtp-out2.suse.de; none X-Spam-Level: X-Spam-Score: -6.60 X-Spamd-Result: default: False [-6.60 / 50.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-3.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; RCPT_COUNT_FIVE(0.00)[6]; DKIM_SIGNED(0.00)[suse.cz:s=susede2_rsa,suse.cz:s=susede2_ed25519]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; MID_RHS_NOT_FQDN(0.50)[]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; BAYES_HAM(-3.00)[100.00%] X-Spam-Status: No, score=-0.8 required=5.0 tests=DKIM_SIGNED,DKIM_VALID, DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI, SPF_HELO_NONE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on fry.vger.email Precedence: bulk List-ID: X-Mailing-List: linux-ext4@vger.kernel.org X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (fry.vger.email [0.0.0.0]); Wed, 18 Oct 2023 11:46:20 -0700 (PDT) On Tue 17-10-23 19:02:52, Andy Shevchenko wrote: > On Tue, Oct 17, 2023 at 06:34:50PM +0300, Andy Shevchenko wrote: > > On Tue, Oct 17, 2023 at 06:14:54PM +0300, Andy Shevchenko wrote: > > > On Tue, Oct 17, 2023 at 05:50:10PM +0300, Andy Shevchenko wrote: > > > > On Tue, Oct 17, 2023 at 04:42:29PM +0300, Andy Shevchenko wrote: > > > > > On Tue, Oct 17, 2023 at 03:32:45PM +0200, Jan Kara wrote: > > > > > > On Tue 17-10-23 14:46:20, Andy Shevchenko wrote: > > > > > > > On Tue, Oct 17, 2023 at 01:32:53PM +0300, Andy Shevchenko wrote: > > > > > > > > On Tue, Oct 17, 2023 at 01:29:27PM +0300, Andy Shevchenko wrote: > > > > > > > > > On Tue, Oct 17, 2023 at 01:27:19PM +0300, Andy Shevchenko wrote: > > > > > > > > > > On Wed, Aug 30, 2023 at 12:24:34PM +0200, Jan Kara wrote: > > > > > > > > > > > Hello Linus, > > ... > > > > > > > > > > > This merge commit (?) broke boot on Intel Merrifield. > > > > > > > > > > It has earlycon enabled and only what I got is watchdog > > > > > > > > > > trigger without a bit of information printed out. > > > > > > > > > > > > > > Okay, seems false positive as with different configuration it > > > > > > > boots. It might be related to the size of the kernel itself. > > > > > > > > > > > > Ah, ok, that makes some sense. > > > > > > > > > > I should have mentioned that it boots with the configuration say "A", > > > > > while not with "B", where "B" = "A" + "C" and definitely the kernel > > > > > and initrd sizes in the "B" case are bigger. > > > > > > > > If it's a size (which is only grew from 13M->14M), it's weird. > > > > > > > > Nevertheless, I reverted these in my local tree > > > > > > > > 85515a7f0ae7 (HEAD -> topic/mrfld) Revert "defconfig: enable DEBUG_SPINLOCK" > > > > 786e04262621 Revert "defconfig: enable DEBUG_ATOMIC_SLEEP" > > > > 76ad0a0c3f2d Revert "defconfig: enable DEBUG_INFO" > > > > f8090166c1be Revert "defconfig: enable DEBUG_LIST && DEBUG_OBJECTS_RCU_HEAD" > > > > > > > > and it boots again! So, after this merge something affects one of this? > > > > > > > > I'll continuing debugging which one is a culprit, just want to share > > > > the intermediate findings. > > > > > > CONFIG_DEBUG_LIST with this merge commit somehow triggers this issue. > > > Any ideas? > > > Dropping CONFIG_QUOTA* helps as well. > > More precisely it's enough to drop either from CONFIG_DEBUG_LIST and CONFIG_QUOTA > to make it boot again. > > And I'm done for today. OK, thanks for debugging! So can you perhaps enable CONFIG_DEBUG_LIST permanently in your kernel config and then bisect through the quota changes in the merge? My guess is commit dabc8b20756 ("quota: fix dqput() to follow the guarantees dquot_srcu should provide") might be the culprit given your testing but I fail to see how given I don't expect any quotas to be used during boot of your platform... BTW, there's also fixup: 869b6ea160 ("quota: Fix slow quotaoff") merged last week so you could try testing a kernel after this fix to see whether it changes anything. Honza -- Jan Kara SUSE Labs, CR