Received: by 2002:ab2:1149:0:b0:1f3:1f8c:d0c6 with SMTP id z9csp1709488lqz; Mon, 1 Apr 2024 14:56:46 -0700 (PDT) X-Forwarded-Encrypted: i=3; AJvYcCU0kMUBLPexFdIYIYJG/mdjZsKBk0g3KJPKP+ycRIiwBJ1FXWeLSIzQ1noB9WsqAzZ312mO4/Dg/uQeLeImXGBNoFENbG8AJ5ozL4Yr3g== X-Google-Smtp-Source: AGHT+IH9RsMlYABx53bdZ+zMj/CUnaHSZ5BZg9aJ8bjKLWzeMxUIhouHLPVzAisi6TO5eeeuMfv0 X-Received: by 2002:a50:d687:0:b0:56b:9025:44a5 with SMTP id r7-20020a50d687000000b0056b902544a5mr8949682edi.11.1712008606718; Mon, 01 Apr 2024 14:56:46 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1712008606; cv=pass; d=google.com; s=arc-20160816; b=si3FddeGhq2JtBnRPP4DuFSZI8O5z9yOk6b1/6mQ40NvwU1I+T6Z3mi1lA77HO48vG bnw/WmDq5QWFRIzhXdsSF+4P8wPhwq0M/ypqTzSdzvprvWNw2IrKusO2YdBO5zQDhy8/ /ibjKxabTy1jNLYrWDiXOcJUcw9G8Tv5l/yJ+f4HCoF5FZAkjD+URO2T4SyDwdoZZuxp ZAMI2PkC8nKFS984m1uMxSKU0AbZFqu+QphE3CnsPrktDBS+0n0d2OR8lhUIoD9+fpuZ CpkKwvKLnPqkOVDCJIXD8WNiDCUxsCUWOBRjtuJ7ckW5ovqYPoCoZrF8EG0+WN+s48Nt 3cVQ== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=in-reply-to:content-transfer-encoding:content-disposition :mime-version:list-unsubscribe:list-subscribe:list-id:precedence :references:message-id:subject:cc:to:from:date:dkim-signature; bh=f0DSw1XqsXQWA3u9nbmIRJdFaud8NqclfmJD6AGbaAI=; fh=tCtXs8o4b5S26mTG6gxjiDoHss0JJZAi6xEELEFJecM=; b=GF0Khub5InzyYCwMErkWiLAZ1NTmusm6Og/Y3YfSzYU/KEj/s8bNaD0VsU//IUFjRh WkOT5bZ0eLa/cnuR5t0OCqmKT1sCC/A9eKECIP+Vs1MRjeLynPxB3aJ4SIUPxC0qLiT7 NM2Jbw+CXd8nKKkV5fkzmJ/bCc63fgjCVWXJDX+SdqcJVauJQK6vZn5/ry+yLB0hGBUV y5Bh2NdHSjuSen837PtvcoJr8nQT5+v5yxe+sW9LUGM39o6uroCzOt2QEb6q6VO/fbdw TaIvuLZVyKcwVEVT304u1Oc1kWFyleHrB9I/MR7HOYGeMZ7/fujPnlNUaqcoCsi94KMT rdPQ==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=DGHPGO1p; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-127114-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) smtp.mailfrom="linux-kernel+bounces-127114-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from am.mirrors.kernel.org (am.mirrors.kernel.org. [147.75.80.249]) by mx.google.com with ESMTPS id u18-20020a50c2d2000000b0056dc5dbcda5si2409882edf.381.2024.04.01.14.56.46 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 01 Apr 2024 14:56:46 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel+bounces-127114-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) client-ip=147.75.80.249; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=DGHPGO1p; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-127114-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) smtp.mailfrom="linux-kernel+bounces-127114-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by am.mirrors.kernel.org (Postfix) with ESMTPS id 74A161F22578 for ; Mon, 1 Apr 2024 21:56:46 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 2367553E35; Mon, 1 Apr 2024 21:56:40 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="DGHPGO1p" Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 482D755792 for ; Mon, 1 Apr 2024 21:56:38 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1712008599; cv=none; b=AoHkwgkkezuEg+yjHg6quIYnRddNnxCJ0jEGmswuER3IDYMlMZCkqYyrlE4R3dNJnTqfXj2nUlnODFo7XKIUnITogKPuerxIKAKHz56qcD4/dpM322Hud7O55hfzxFSBSA5UldUVwiDMNwWf1ZEOMfnrxC4Efk+VFaxUQn8viLo= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1712008599; c=relaxed/simple; bh=6k5BrjOuMeQB/WSl+ly2g5AtD0c2vDIBP07u7b9MxN0=; h=Date:From:To:Cc:Subject:Message-ID:References:MIME-Version: Content-Type:Content-Disposition:In-Reply-To; b=ZvenqjPgyuI5IWE1YxYmM8J/JGsjid1qsxh3DxnQ30usgiIjj/sXtXI0owDKEEHeBj3dLsxEQxHSiHzMDa5hcb1SVFM3FlkoqEAP1FgP6gnCdC0w9sYg2EUGe8G79m5CM9TncfjgMUGR8Y4jjy4o4tzGFB2Ql5R3pCd1+UfSQiI= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=DGHPGO1p; arc=none smtp.client-ip=10.30.226.201 Received: by smtp.kernel.org (Postfix) with ESMTPSA id 7C436C433C7; Mon, 1 Apr 2024 21:56:38 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1712008598; bh=6k5BrjOuMeQB/WSl+ly2g5AtD0c2vDIBP07u7b9MxN0=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=DGHPGO1pjbSvbZfmQHmu66cGRmgZD1wO0PrDbfnlVh593aDmgzXhFYSwaaNtXSnRO daipjZX5dKsVWEmuYeR13abZDAELBCJYw4vfBN9QxqTiIgLqBSm3qmIoqli1bCwW6X YVv4GrVY9quvMyZ5m2C7WoAcZVhpbtBAH+RmAJ0hnxx450ocmOh1gwDn0rNxSI0LiL zjmS9/B5Zp6CWDd6CYBkAhBoKOjWtEjiW18PlJdWL7e70/FxypCS64eJf0fZ2XQ4sa FwiSXbURee2yz5Dn+rjHPQ7D5POUJDK9Gf1NP/CQFO/QXs9njhbjMtNvVBGhxdg4b0 EB3tYayIKuK2Q== Date: Mon, 1 Apr 2024 23:56:36 +0200 From: Frederic Weisbecker To: "Paul E. McKenney" Cc: Thomas Gleixner , LKML , Ingo Molnar , Anna-Maria Behnsen Subject: Re: [PATCH 2/2] timers: Fix removed self-IPI on global timer's enqueue in nohz_full Message-ID: References: <20240318230729.15497-1-frederic@kernel.org> <20240318230729.15497-3-frederic@kernel.org> <464f6be2-4a72-440d-be53-6a1035d56a4f@paulmck-laptop> <1b5752c8-ef32-4ed4-b539-95d507ec99ce@paulmck-laptop> <6a95b6ac-6681-4492-b155-e30c19bb3341@paulmck-laptop> <797f44f9-701d-4fca-a9f4-d112a7178e7b@paulmck-laptop> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <797f44f9-701d-4fca-a9f4-d112a7178e7b@paulmck-laptop> Le Mon, Apr 01, 2024 at 02:26:25PM -0700, Paul E. McKenney a ?crit : > > > _ The RCU CPU Stall report. I strongly suspect the cause is the hrtimer > > > enqueue to an offline CPU. Let's solve that and we'll see if it still > > > triggers. > > > > Sounds like a plan! > > Just checking in on this one. I did reproduce your RCU CPU stall report > and also saw a TREE03 OOM that might (or might not) be related. Please > let me know if hammering TREE03 harder or adding some debug would help. > Otherwise, I will assume that you are getting sufficient bug reports > from your own testing to be getting along with. Hehe, there are a lot indeed :-) So there has been some discussion on CPUSET VS Hotplug, as a problem there is likely the cause of the hrtimer warning you saw, which in turn might be the cause of the RCU stalls. Do you always see the hrtimer warning along the RCU stalls? Because if so, this might help: https://lore.kernel.org/lkml/20240401145858.2656598-1-longman@redhat.com/T/#m1bed4d298715d1a6b8289ed48e9353993c63c896 Thanks. > > Thanx, Paul