Received: by 2002:ab2:710b:0:b0:1ef:a325:1205 with SMTP id z11csp1353125lql; Tue, 12 Mar 2024 14:46:21 -0700 (PDT) X-Forwarded-Encrypted: i=3; AJvYcCVcs6C+sy3qW+nsvSr1ygld4bWzmZhVPR8pEhb2fc/K3o2D/EJyUVP69MPBh0mLao24Yb05Bb7sNZVqjhooKUHB8YjtaUHho4KFgc0+6Q== X-Google-Smtp-Source: AGHT+IER1eDd5hSJmHMx02VVPVqu7YHi7s1nzpXorXz60oqzNqqW6275tkWZyP+U0SD/ktz3gl3U X-Received: by 2002:a05:622a:203:b0:42e:b063:a35f with SMTP id b3-20020a05622a020300b0042eb063a35fmr13042576qtx.8.1710279981695; Tue, 12 Mar 2024 14:46:21 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1710279981; cv=pass; d=google.com; s=arc-20160816; b=oCk508TZU7JkkkLXCiIAYKgPVl5kQwRKxqc3wjxG4b3P+oRfxWLp76XdKmneQD+TEo +BgIhjrM6lHDVaIVbWxieCp5KqK33xFcpRxGdYE8bKVHFkYQmNRwT9V9brTi5e758Is8 MA/+wT2DWkQNdITB3aXd5dPdKwwnGxWQ4E25DUHaassyLvdJ3sLn+HSnxkpcsqcQrTwe 1x8sCOXS/kPPQ2VW4kLzICSYt3x7dfMCgMsm4cZQFACG2nwDYCy+SL9iJDfub9pMgg8G E7Sv7tEKFAtR4hwgPV87fgsVQVtaEx/kWTTyPGiIBN/BvIjqpWPluer+NlKl5brtJbpz 1Iiw== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:list-unsubscribe:list-subscribe:list-id:precedence :dkim-signature; bh=+QBam0nDIK6OKPia5iCGv4lhBlNNZUHT9InuuVs5DM8=; fh=5pfGJn+PV9dm5mrIBgz8sSlv46aIdl+4NzCxX17cJe4=; b=wDrHfB3f64Gi5hQjE+O+DsXVTJRTP0F/azGqvjUM0c4r3sluqlJW4XtyJKLSRH8wVw Dd/IN4C/zcQ9K95egp+QXNtaPwHkGrYb5EbyIa12ErdO0Zal0oEM6YDJzYvY2+cPJZUB MIoHREzmLO9dDMfznypdLETPamorEOsJut+bts1WECjwn5TBdxcjtS0mforZQanVHARi 5ou5Oztb3mOkzUFptBrvP8kMFp2bOVrCQVN+N9e3fROLdFKmSk3v8PExUV4+SfHXvBXs SuAmaS473YKzuGIc61TyLvAN9G9iEfCeAvIBwhNSxLLCl6TdwsG9N0DkCjgxjD3kAf99 LLgw==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@linux-foundation.org header.s=google header.b=KKRfRaWe; arc=pass (i=1 spf=pass spfdomain=linuxfoundation.org dkim=pass dkdomain=linux-foundation.org); spf=pass (google.com: domain of linux-kernel+bounces-100829-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45d1:ec00::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-100829-linux.lists.archive=gmail.com@vger.kernel.org" Return-Path: Received: from ny.mirrors.kernel.org (ny.mirrors.kernel.org. [2604:1380:45d1:ec00::1]) by mx.google.com with ESMTPS id o4-20020ac87c44000000b0042f01a365a4si8481971qtv.114.2024.03.12.14.46.21 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 12 Mar 2024 14:46:21 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel+bounces-100829-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45d1:ec00::1 as permitted sender) client-ip=2604:1380:45d1:ec00::1; Authentication-Results: mx.google.com; dkim=pass header.i=@linux-foundation.org header.s=google header.b=KKRfRaWe; arc=pass (i=1 spf=pass spfdomain=linuxfoundation.org dkim=pass dkdomain=linux-foundation.org); spf=pass (google.com: domain of linux-kernel+bounces-100829-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45d1:ec00::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-100829-linux.lists.archive=gmail.com@vger.kernel.org" Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ny.mirrors.kernel.org (Postfix) with ESMTPS id 639471C21946 for ; Tue, 12 Mar 2024 21:46:21 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id ADBF714403C; Tue, 12 Mar 2024 21:44:37 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=linux-foundation.org header.i=@linux-foundation.org header.b="KKRfRaWe" Received: from mail-lf1-f41.google.com (mail-lf1-f41.google.com [209.85.167.41]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id C33F9143C74 for ; Tue, 12 Mar 2024 21:44:34 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.167.41 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1710279876; cv=none; b=Pq13MqD6gvf/IN9y8JR+zWHPuH2v/oJP/6dIXo81o25oX1gPlNOftLX6x6xzISCfilieNi9IWQSJCC0PnLKScmLVWT/2M6tzLPx5wo49TcgF7I2uypM12c0GIGLy95ahLyAniBAWeyYFzUQvCwD1YZt7esqU/QwX0H+PMGvPKcI= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1710279876; c=relaxed/simple; bh=XwiL2+kAZDq+JSypY/KCkgWIbQMNeeVzIuxHI5gIcF4=; h=MIME-Version:References:In-Reply-To:From:Date:Message-ID:Subject: To:Cc:Content-Type; b=tn+eZnuh44Qwv0jvOZZO35RtbbFRIdEmIemBGhYxjzV1f8+eP0CpD5BW6EFb6M7Hjgp4JLQjxxnCthDHCLtU+tjuwOwCYRb6Cx5+qsnvR2gxV+vMkyhM3bNUtmZyrbV/3BWBStQXlV6PKGBIrOpS8Ni6a4PM22zMMfO2Ubn5QvQ= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=none (p=none dis=none) header.from=linux-foundation.org; spf=pass smtp.mailfrom=linuxfoundation.org; dkim=pass (1024-bit key) header.d=linux-foundation.org header.i=@linux-foundation.org header.b=KKRfRaWe; arc=none smtp.client-ip=209.85.167.41 Authentication-Results: smtp.subspace.kernel.org; dmarc=none (p=none dis=none) header.from=linux-foundation.org Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=linuxfoundation.org Received: by mail-lf1-f41.google.com with SMTP id 2adb3069b0e04-5139d80f8b6so4061192e87.1 for ; Tue, 12 Mar 2024 14:44:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linux-foundation.org; s=google; t=1710279873; x=1710884673; darn=vger.kernel.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=+QBam0nDIK6OKPia5iCGv4lhBlNNZUHT9InuuVs5DM8=; b=KKRfRaWeA6WSJdE01jClK/UZ9c6TbaidThWmnu5tE+bYqU3vaT19gg9q1g4EBuR2hW PfrPpUU+cHjfITAphWWvAg/c2+9qxtNLlhQPJHmt0MoogdJ5WuLTFrkz3WbcTb0nRtCo PX7RvAUAW8e2nmLuUzA2wIYw+qss/+WxynHU0= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1710279873; x=1710884673; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=+QBam0nDIK6OKPia5iCGv4lhBlNNZUHT9InuuVs5DM8=; b=bIerk/Xk5GxlJohdzC3IoNq+HWZfT6HPsXz+z1+lLbqIOL+/tMgJqr6zYFUfcS90IX 5UvidVHVaDLBL2MNqciEZ9+pjkaAU+bt0wsh8C0rAyjfsqKwkFH3Dtw8xZZ9FG9hxZoa Ze4pLnqGVHei3+/RyutThflVDSyPMDw7/i+CtBw87CvOIYtn1XRO/fdZtxsXlTxe/vnu N17x6Oz0M9fbyEjivfGRaDxvnphUOsytlUhPMc4JFEo3CeB1sLjFSrXWdlg0qIXr8CU1 qmaiJ5JXaqBpRZrkN9J5bIiLNc0sMDdHWsPUC9hwppZo19TT57eilV5/aoQCkbO4ind0 gKXw== X-Forwarded-Encrypted: i=1; AJvYcCUbmwJIdq1A9LwXHiu+I3M/G92zTqTUaJE0gWHRauI4TEkU8iwi5Ic/0HEykiqGHnQV0uMRkxwWmPW3VosJnzOOG4qfUTVsicSkT01E X-Gm-Message-State: AOJu0YwKPSUz4DUodiOFgpp79nbjc43ZQDffsAgZd25O1K5T6EupIPdn x40sMpXaQjOckljC5YMG3XXO263i1O+aIYmwEHujL+z0IAN/XeXb6JaOKe5ryBk+CVP6i8TwOU6 aZb2jpA== X-Received: by 2002:a05:6512:3ae:b0:513:c2aa:6b87 with SMTP id v14-20020a05651203ae00b00513c2aa6b87mr1304155lfp.39.1710279872857; Tue, 12 Mar 2024 14:44:32 -0700 (PDT) Received: from mail-lj1-f180.google.com (mail-lj1-f180.google.com. [209.85.208.180]) by smtp.gmail.com with ESMTPSA id r3-20020ac24d03000000b005139f4ffdd9sm1578659lfi.30.2024.03.12.14.44.30 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Tue, 12 Mar 2024 14:44:31 -0700 (PDT) Received: by mail-lj1-f180.google.com with SMTP id 38308e7fff4ca-2d208be133bso69181991fa.2 for ; Tue, 12 Mar 2024 14:44:30 -0700 (PDT) X-Forwarded-Encrypted: i=1; AJvYcCUAJFYFPZXhC4yecUnUESQVplaTzojRgvkZ0LcQHOwGGuTMjSEiQDPdhQ275Gx0Qz5jxK+1BS5NOG5/n7eWVpmUnruPjnlv8WBJpUGj X-Received: by 2002:ac2:484a:0:b0:513:5a38:f545 with SMTP id 10-20020ac2484a000000b005135a38f545mr8283446lfy.62.1710279870592; Tue, 12 Mar 2024 14:44:30 -0700 (PDT) Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 References: <4274be61-60bd-4e1e-9c16-26e6e5e06f65@gmail.com> In-Reply-To: From: Linus Torvalds Date: Tue, 12 Mar 2024 14:44:14 -0700 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Unexplained long boot delays [Was Re: [GIT PULL] RCU changes for v6.9] To: Florian Fainelli Cc: Boqun Feng , linux-kernel@vger.kernel.org, kernel-team@meta.com, paulmck@kernel.org, mingo@kernel.org, tglx@linutronix.de, rcu@vger.kernel.org, joel@joelfernandes.org, neeraj.upadhyay@amd.com, urezki@gmail.com, qiang.zhang1211@gmail.com, frederic@kernel.org, bigeasy@linutronix.de, anna-maria@linutronix.de, chenzhongjin@huawei.com, yangjihong1@huawei.com, rostedt@goodmis.org Content-Type: text/plain; charset="UTF-8" On Tue, 12 Mar 2024 at 14:34, Florian Fainelli wrote: > > and here is a log where this fails: > > https://gist.github.com/ffainelli/ed08a2b3e853f59343786ebd20364fc8 You could try the 'initcall_debug' kernel command line. It will make the above *much* noisier, but it might - thanks to all the new noise - show exactly *what* is being crazy slow to initialize. Because right now it's just radio silence in between those [ 1.926435] bcmgenet f0480000.ethernet: GENET 5.0 EPHY: 0x0000 [ 162.148135] unimac-mdio unimac-mdio.0: Broadcom UniMAC MDIO bus things, and that's presumably because some random initcall there just takes forever to time out. Linus