Received: by 2002:ab2:1149:0:b0:1f3:1f8c:d0c6 with SMTP id z9csp1757565lqz; Mon, 1 Apr 2024 17:04:18 -0700 (PDT) X-Forwarded-Encrypted: i=3; AJvYcCV6Gp247nxty9CMQEeBWCJSsPAd462hXASOJT4n5FzWEMhB9/AXLHUSyMzTMDAxtqclonFJofFLOGhG1Q1XFWmnjuauOBJa1KlHvOGK2g== X-Google-Smtp-Source: AGHT+IEf1EGRwnV/qrZ/rs7B/RXdjmqdSBjsFAa/H3nYgiXPoZiLtYcR/uKzoRnHlhou0qVOugql X-Received: by 2002:a05:6e02:13ad:b0:368:c21e:3887 with SMTP id h13-20020a056e0213ad00b00368c21e3887mr12977797ilo.5.1712016258545; Mon, 01 Apr 2024 17:04:18 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1712016258; cv=pass; d=google.com; s=arc-20160816; b=rja4JAWgn0sed7r97bvoqQxP1Fv/nLdQCf+0YRtkEDWZNSnYoRbP9kAO/utC12DruM 5LdbbiszGN41J4oYj6nWsYzpyVcxiBSHU/x/h5iiA3bv0FDW5Iwjh2PyV8fiEaFKKpHG cb9EbyAdRlU8jPNfWZH3+RYdSccA+JRhRU9c3D0qRZGLZCeipTIMu8Tpi4WXOTt9czKE nZjfBRFxRC2lBsdSd+buJdaZPSnkejxqmJ9xf++NN0lUvjD+1GJB0ztYsNQ8Mmqs8mC4 6avgz6cafH7YU/Fd7TSnWcOPyd8ypVu86gDlbnGKvVXGp+HiXkQpHM/WP/F6s13Rmv0u XmgQ== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=in-reply-to:content-transfer-encoding:content-disposition :mime-version:list-unsubscribe:list-subscribe:list-id:precedence :references:reply-to:message-id:subject:cc:to:from:date :dkim-signature; bh=wwvqviQYKyZ23y+QqSkCkS8oTBK6GOQ5BvwzwsCH2jg=; fh=Vzoq0nVshxERZBL4pLZ68yhgpR1mmqRekZaurNon2Tg=; b=OhwD6/3YSYC7O9ShgLeikLiPRDHm6s6hdxzsjfdlY+59QnHFxRCB8+KiuhwBOYemQ6 WblARleFTxr8JTYeF9N7qqPU0y9CRqciLMH/bNH5jtVT7NRWSt5Il0R0Oh/nfCztmpQb i736KWp1ZOIInC5W+KxnCvrLag9b62KONLNFpaDmfUDp1oTCRhAkLtkz3jprvUmEKeXF waThGF1Q2ybNwJKq/4ZUupEhG+bDY7zeKpIIgv+fqHJ+lBROXAfVCEoJHjVvcRmGXJrg Jn/5yQkqtz3BnQmEX21uIfbLTi1euFiTgScJmseJV5hbX7dqmPTio/XKpRdKZeLL7k/4 hokQ==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=gCV41nB7; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-127214-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45e3:2400::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-127214-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from sv.mirrors.kernel.org (sv.mirrors.kernel.org. [2604:1380:45e3:2400::1]) by mx.google.com with ESMTPS id d21-20020a63fd15000000b005dcbba892cdsi10056215pgh.327.2024.04.01.17.04.18 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 01 Apr 2024 17:04:18 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel+bounces-127214-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45e3:2400::1 as permitted sender) client-ip=2604:1380:45e3:2400::1; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=gCV41nB7; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-127214-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45e3:2400::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-127214-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by sv.mirrors.kernel.org (Postfix) with ESMTPS id 3ADF82810DB for ; Tue, 2 Apr 2024 00:04:18 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 51F4AD51D; Tue, 2 Apr 2024 00:04:12 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="gCV41nB7" Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 7C75FD2E5 for ; Tue, 2 Apr 2024 00:04:11 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1712016251; cv=none; b=EG94wkh0tmUdUnCTUtth9317RAWtaESUVtmOGpLQEpEAoVIBw0N3ixgq89U5CDuCtvcyuArQ6IiP7NT30BhXPVSuMYPHwg+3EghM2A3HpWm/LnTIUdIZk+aHZf7UcSudLbzxo62qhFd5Exgxcl7K0XhdsGuPnwkJcCVIZgBrIBw= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1712016251; c=relaxed/simple; bh=3KJUgnaTGHoZsMQESW1SKaX90zJEGC7vi1C4okmuHq4=; h=Date:From:To:Cc:Subject:Message-ID:References:MIME-Version: Content-Type:Content-Disposition:In-Reply-To; b=bw0f0mp6IouxN7kzy9m97NCMB3W18uDMQi8iySQOAKdcvRBwHBFRr02b7CZNF+nrOe+VAyYtASvYCdwvVh/751lEbq2TLwv0lOlBN4pHlbdl0FpMJbKXxdZLf3Mf2n3z72YSSsPe4xG4tBS1bLrMozbOOy7vpTRP/Ei1HouNneI= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=gCV41nB7; arc=none smtp.client-ip=10.30.226.201 Received: by smtp.kernel.org (Postfix) with ESMTPSA id F3419C433F1; Tue, 2 Apr 2024 00:04:10 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1712016251; bh=3KJUgnaTGHoZsMQESW1SKaX90zJEGC7vi1C4okmuHq4=; h=Date:From:To:Cc:Subject:Reply-To:References:In-Reply-To:From; b=gCV41nB7cwuTj6eZo/I75KfeID3R1YwSQG53CXeUkv5gRV9MzWgZYvfC5C07Oe7v2 Z/RggWTpXbWhMoS/2Lm0MofKJiC2hqzYiIBhMNlK/9zNMjs6qQD36rsEdl7qyNQISI 7uIMBmk/N82zVonthKMKr7SlRQ8YeyiG9KzceZAbHpQdJft75L9PZMPLT9twPOw8TV 6uIVbSfztvp6k114sUC2mYfIXW9xgn5ohcpbZlKgtVUhwoXaIE0k3lRPExhJbt90mj oTkg4gJkuA0PsUCLGBltb2zS3Ddbz8M5oqDuKZQQiz83p0pDWO3qirvcv8v8MdF8lE cgTRrSh1ORrGw== Received: by paulmck-ThinkPad-P17-Gen-1.home (Postfix, from userid 1000) id 8FEB8CE074C; Mon, 1 Apr 2024 17:04:10 -0700 (PDT) Date: Mon, 1 Apr 2024 17:04:10 -0700 From: "Paul E. McKenney" To: Frederic Weisbecker Cc: Thomas Gleixner , LKML , Ingo Molnar , Anna-Maria Behnsen Subject: Re: [PATCH 2/2] timers: Fix removed self-IPI on global timer's enqueue in nohz_full Message-ID: Reply-To: paulmck@kernel.org References: <20240318230729.15497-1-frederic@kernel.org> <20240318230729.15497-3-frederic@kernel.org> <464f6be2-4a72-440d-be53-6a1035d56a4f@paulmck-laptop> <1b5752c8-ef32-4ed4-b539-95d507ec99ce@paulmck-laptop> <6a95b6ac-6681-4492-b155-e30c19bb3341@paulmck-laptop> <797f44f9-701d-4fca-a9f4-d112a7178e7b@paulmck-laptop> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: On Mon, Apr 01, 2024 at 11:56:36PM +0200, Frederic Weisbecker wrote: > Le Mon, Apr 01, 2024 at 02:26:25PM -0700, Paul E. McKenney a ?crit : > > > > _ The RCU CPU Stall report. I strongly suspect the cause is the hrtimer > > > > enqueue to an offline CPU. Let's solve that and we'll see if it still > > > > triggers. > > > > > > Sounds like a plan! > > > > Just checking in on this one. I did reproduce your RCU CPU stall report > > and also saw a TREE03 OOM that might (or might not) be related. Please > > let me know if hammering TREE03 harder or adding some debug would help. > > Otherwise, I will assume that you are getting sufficient bug reports > > from your own testing to be getting along with. > > Hehe, there are a lot indeed :-) > > So there has been some discussion on CPUSET VS Hotplug, as a problem there > is likely the cause of the hrtimer warning you saw, which in turn might > be the cause of the RCU stalls. > > Do you always see the hrtimer warning along the RCU stalls? Because if so, this > might help: > https://lore.kernel.org/lkml/20240401145858.2656598-1-longman@redhat.com/T/#m1bed4d298715d1a6b8289ed48e9353993c63c896 Not always, but why not give it a shot? Thanx, Paul