Received: by 2002:ab2:2994:0:b0:1ef:ca3e:3cd5 with SMTP id n20csp371131lqb; Thu, 14 Mar 2024 13:45:59 -0700 (PDT) X-Forwarded-Encrypted: i=3; AJvYcCX4RRAJOaqZrmF13p5vqN60y8j9v7OgUGkfwECVC28MAnxRp0Zb+Aghb+7gXzzsXUiBNeG6yaGbUqekcZM7b9QR8GLsS8KnyuVnPPb9lg== X-Google-Smtp-Source: AGHT+IHem2LdS6dHnn4OgIIjQ8WLQ7sNnzkEw1ny+OwbhS86MbG1WTuA87yIt8sHor8ouGnoezvB X-Received: by 2002:a05:6358:9987:b0:17e:6aab:2ccb with SMTP id j7-20020a056358998700b0017e6aab2ccbmr3832375rwb.20.1710449159446; Thu, 14 Mar 2024 13:45:59 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1710449159; cv=pass; d=google.com; s=arc-20160816; b=sefjUTuR4meVuQDap7R3RNPNqZSp6Ge3Qq3z9mzZQ7poKgsdFmQalayewkDnFrCo3N ilO0/f8x/lYj91sWv2jjyWLR46AYIf26fShAfp2C29N/Hl/VRxMmwwozgiuyKUmo4nLE jOyRuVBKmy6+u0CacuN6veI5OEpVz9XDxPJp8pimIVLOA/LypZdr8Om+8XhWUbEp8K5K SxsRh46mOTbqeE2joJ072Q11pb+sjpL67FJv9t7hPR/nFxSC3OkqgBooCfsp+bYJsHeC NV4XFgbjaupGxpqOy7z8U4SsZjRDG9pvq5FUnYrQgTIVPhQ3TprFqAqsutQKdC/xJ8LA cbHA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:list-unsubscribe:list-subscribe:list-id:precedence :message-id:date:references:in-reply-to:subject:cc:to:dkim-signature :dkim-signature:from; bh=nJy+NUZ8ACD5J2EIR57tnDEqsbwNo2P7mRbaWsqp06E=; fh=sivLZ+YwdsQJBqzENcwFbjRbWrTsfjxYApFsgXSwxF4=; b=APksn2woNbc1pgOP+OvWfIkIOmlHw9ZYf8Zo9bNeHXJHy1B4Zl/FQ9CxNzjvJmUwHE OO+ixRDiSEAyZLbVDB1FVSFUSBDJtKYPfZBCscLJ+tjCF315k1gyOGLUuKt/3iLURnO4 Wuo8xSYCM8svu8eJC7LCGvKUFdk394YEZGCCfdHHjy8oL/D8vMiGr2ABPYzMmEaVOfNi zte6RdB0KAaw1uq+6wvKHQyGl7lUjqgr6ur0bOfUv4Wttkp8eA3+h+jPintXUnXgfgKY C8aD72tP5lUeX0FcYWWslA0YWstODFLSxkkZQwqwr4H2otDE+czxucMDhcoO519wy6zQ 7AIw==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@linutronix.de header.s=2020 header.b="Ko/VWB/I"; dkim=neutral (no key) header.i=@linutronix.de header.s=2020e; arc=pass (i=1 spf=pass spfdomain=linutronix.de dkim=pass dkdomain=linutronix.de dmarc=pass fromdomain=linutronix.de); spf=pass (google.com: domain of linux-kernel+bounces-103780-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:40f1:3f00::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-103780-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=linutronix.de Return-Path: Received: from sy.mirrors.kernel.org (sy.mirrors.kernel.org. [2604:1380:40f1:3f00::1]) by mx.google.com with ESMTPS id v37-20020a631525000000b005dc8a58a853si1213313pgl.525.2024.03.14.13.45.58 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 14 Mar 2024 13:45:59 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel+bounces-103780-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:40f1:3f00::1 as permitted sender) client-ip=2604:1380:40f1:3f00::1; Authentication-Results: mx.google.com; dkim=pass header.i=@linutronix.de header.s=2020 header.b="Ko/VWB/I"; dkim=neutral (no key) header.i=@linutronix.de header.s=2020e; arc=pass (i=1 spf=pass spfdomain=linutronix.de dkim=pass dkdomain=linutronix.de dmarc=pass fromdomain=linutronix.de); spf=pass (google.com: domain of linux-kernel+bounces-103780-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:40f1:3f00::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-103780-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=linutronix.de Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by sy.mirrors.kernel.org (Postfix) with ESMTPS id DABD4B21775 for ; Thu, 14 Mar 2024 20:45:51 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 5BBB9763FF; Thu, 14 Mar 2024 20:45:41 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=linutronix.de header.i=@linutronix.de header.b="Ko/VWB/I"; dkim=permerror (0-bit key) header.d=linutronix.de header.i=@linutronix.de header.b="tZR0FPOc" Received: from galois.linutronix.de (Galois.linutronix.de [193.142.43.55]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 071F56FE28; Thu, 14 Mar 2024 20:45:38 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=193.142.43.55 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1710449140; cv=none; b=G8HWXB3SjLQl7v+ZH0N9krA21UnsRjExdW6qOBrZFfjqMstg4QUO3sgYcvREMxJ9OdzlXFV0S8dtMHMciEo1gWuoTw1jlXvGRX5sBGpwnPF73ULzFrC/7/Bd5DpOfyUcUI86w3zEirNMJT89uLYQ4ajGGUVRJZdzHfpEpvNF8gI= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1710449140; c=relaxed/simple; bh=O8DozmNrZ4VDRmyiSjzVDJqXlYrMmP08o1YadCXt0Ts=; h=From:To:Cc:Subject:In-Reply-To:References:Date:Message-ID: MIME-Version:Content-Type; b=p/RtogEXBqMorT2nTLkbMfWyV4CJH6Zy9eB3zbCFZ2tOlFjsDAP3VnEtW1/465Wq0z8uzChjaa5zY+my5WQFVWQdKmIUb4xqWd47uLgMMvOPi2H/WGrNyc+OY8ci4r1y/v4sGsT4A+MHDLt3Vv5d1oB6GxqGohwCmJ8J9W4OfIk= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linutronix.de; spf=pass smtp.mailfrom=linutronix.de; dkim=pass (2048-bit key) header.d=linutronix.de header.i=@linutronix.de header.b=Ko/VWB/I; dkim=permerror (0-bit key) header.d=linutronix.de header.i=@linutronix.de header.b=tZR0FPOc; arc=none smtp.client-ip=193.142.43.55 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linutronix.de Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=linutronix.de From: Thomas Gleixner DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linutronix.de; s=2020; t=1710449136; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=nJy+NUZ8ACD5J2EIR57tnDEqsbwNo2P7mRbaWsqp06E=; b=Ko/VWB/IPyrGtliE6RtDoxypx/OyPJNFP+tpVuZcSyyChSkVkMYH+c30NGsI81y2yLLz4h vfO0CQeaWKgjNfnMAwF5jhxU9UVfd2sMNbviuMGCQqyioEz/YddwSdSxNRfn/PmeNvab53 qGfV+FTpRDfMMcqL4TPmpdl7qtNkiunJjNomT7F94q0uFlJalFWCP+KbIGKq22zkWeSxPu sa9X2DHVEIrwCJclgItzFEz+LJpD7u8JCVndFwgziqTc/N3XTG7SsdTBnVHQmNrEdpRWBr WMQyxOoOLzy7OVlRsaV5f+ukgDtmV5XoM8ZHSrVWgC6kk37vMTcPXk/JBBh7og== DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=linutronix.de; s=2020e; t=1710449136; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=nJy+NUZ8ACD5J2EIR57tnDEqsbwNo2P7mRbaWsqp06E=; b=tZR0FPOcg/7trlG4MSqmxmcjUH0dg+fEKfbsPJL/zePo5/iPlnYngA1mla48M07AQY4pFl yLwQ1BU3pLB0DtDQ== To: Florian Fainelli , Boqun Feng Cc: Frederic Weisbecker , "Russell King (Oracle)" , Joel Fernandes , Anna-Maria Behnsen , Linus Torvalds , linux-kernel@vger.kernel.org, kernel-team@meta.com, paulmck@kernel.org, mingo@kernel.org, rcu@vger.kernel.org, neeraj.upadhyay@amd.com, urezki@gmail.com, qiang.zhang1211@gmail.com, bigeasy@linutronix.de, chenzhongjin@huawei.com, yangjihong1@huawei.com, rostedt@goodmis.org, Justin Chen Subject: Re: Unexplained long boot delays [Was Re: [GIT PULL] RCU changes for v6.9] In-Reply-To: References: <2fb110ed-ba04-4320-9ef0-8766c9df5578@gmail.com> <533151c9-afb5-453b-8014-9fbe7c3b26c2@gmail.com> Date: Thu, 14 Mar 2024 21:45:36 +0100 Message-ID: <87v85olez3.ffs@tglx> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain On Thu, Mar 14 2024 at 12:09, Florian Fainelli wrote: > On 3/14/24 11:51, Boqun Feng wrote: >>>> trace_event=timer_migration:*,timer_start,timer_expire_entry,timer_cancel >>>> >>>> Though it's fairly possible that timer migration is not enabled at this point >>>> as it's a late initcall. But we better not miss its traces otherwise. >>> >>> Here is another log with timer_migration: >>> >>> https://gist.github.com/ffainelli/237a5f9928850d6d8900d1f36da45aee >> >> FWIW, the trace point is still not enabled: >> >> [ 0.000000] Failed to enable trace event: timer_migration:* >> >> you need this commit in master: >> >> 36e40df35d2c "timer_migration: Add tracepoints" >> >> , which is one commit later than 7ee988770326 AFAICT > > Argh, thanks Boqun, here is a new capture: > > https://gist.github.com/ffainelli/cb562c1a60ef8e0e69e7d42143c48e8f > > this one is does include the tmigr events. Thanks! You need 8ca1836769d758e4fbf5851bb81e181c52193f5d too.