Received: by 2002:a05:6a10:5bc5:0:0:0:0 with SMTP id os5csp3676992pxb; Mon, 1 Nov 2021 18:40:05 -0700 (PDT) X-Google-Smtp-Source: ABdhPJxqq1GRIMbwBpMYA58GamScKLYVtgjLeo594UlheGQzEVHBxNq2WjCj5PTj/Ul0qE6AuTRh X-Received: by 2002:a50:be81:: with SMTP id b1mr46721638edk.59.1635817205150; Mon, 01 Nov 2021 18:40:05 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1635817205; cv=none; d=google.com; s=arc-20160816; b=zE7aNG8KiMBG0ViQkeMvjb4xWDFKPGJjAiOYwi+5vxPYRdyjit8dflfxpqs0JRVcUP 6MjL3mcdNNxrXt0AA65YXF4n+PFu0mkBp5tJjN2ZJmrps/I4mQCb7ZE7WTQ3InUNWE6w AGTkHDtKEAiXAZgvxX6AP38ITxv8VDfRrSXYBoDNTkfm1M+r+4wOIx0xepChURTn1dOK XRf2PLC2VvaS0n1ibSgFgI62R+TetMHEn8rJFkMcpWBiMqjoezIZbldpyjMlo9ACQspw WL/vUl5myN6drkAMF1VrakACF1LE+wsYFJ/S/TVILNjqDsjxEtjdquLkKnlHlA6X2CV2 BN8Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:in-reply-to:references :cc:to:from:content-language:subject:user-agent:mime-version:date :message-id:dkim-signature; bh=6pCTTHi9Wlvjb+KMDPqRjVtEGfFxP2f85KljOLiCuhQ=; b=ZSo/UuKC5J6nRpTolw2xXg0wnfNb55udTuqExUOuBusuU7Fgnu36hgmYzvodw6niLp iF0UtrsZx18jLTxqvZwUYF+TUxmvkvgaVEKe8A26PWqqY2V6rnvqXaV5/0ZVFNHWsTTm EMNwCQ+SSHloZZ3SwLz8tnnYbyEEPWknRFI7IwQv+dAK0ol7XC9eJeXpBMzap4I+2+5P Uvg10BC5Stz235staZ+tNedXr/Crj/8Gar4cLbGTqEuWlcsUXTdLgIO6Cn4cOULy5seA fTGHW0ps1E7r6JTJG4VBxDog789l9Pz9Pol0kNnuiCjwyhAXPCmjiN8HJsbK0G+x5/93 HesQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20210112 header.b=jOY7quIU; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id e10si29675890edj.183.2021.11.01.18.39.38; Mon, 01 Nov 2021 18:40:05 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20210112 header.b=jOY7quIU; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229671AbhKBBhm (ORCPT + 99 others); Mon, 1 Nov 2021 21:37:42 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:37378 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229479AbhKBBhl (ORCPT ); Mon, 1 Nov 2021 21:37:41 -0400 Received: from mail-pl1-x630.google.com (mail-pl1-x630.google.com [IPv6:2607:f8b0:4864:20::630]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 59239C061714 for ; Mon, 1 Nov 2021 18:35:07 -0700 (PDT) Received: by mail-pl1-x630.google.com with SMTP id u17so4348540plg.9 for ; Mon, 01 Nov 2021 18:35:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=message-id:date:mime-version:user-agent:subject:content-language :from:to:cc:references:in-reply-to:content-transfer-encoding; bh=6pCTTHi9Wlvjb+KMDPqRjVtEGfFxP2f85KljOLiCuhQ=; b=jOY7quIUlD+Xt80Fw5Yo5iFmJqufm0iV+gkvcf8iZoXVSdjJE3zqyEws+9KwGYkrEz hOiBTWXs9FPOLiUfsxqs9NT5OsSHDYjIWSEK7XYE+/LeiYfONTPKKEwe6AmbjbWfZ28I Ec7JRgym0XV+lK/W4sn49eHprpfpjgYQLNpQjl/rDyvVH/m3uPZwqWDU7rryzGL5diDk OTQCuHBbEOiN4T4PjdFmYoYuuAqMvo+cd636+ltLRZLCCNEsQlozlXv/BNCequS/8hm6 LJCvs9zxcZIKEv9cgyGuh0T3lCo1TGQGoxaVKVmsCowVMOqNRyAX1L857TMiEg7jwDkH XeuA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:message-id:date:mime-version:user-agent:subject :content-language:from:to:cc:references:in-reply-to :content-transfer-encoding; bh=6pCTTHi9Wlvjb+KMDPqRjVtEGfFxP2f85KljOLiCuhQ=; b=qibOyk0mlruhA5imi4qjZla/IUbKh2orPnlxao8gXmPZpJbvoJKLpaj+1Rj+c8iGSE 9bCJ2u3RRG25aJk5oI+1cP63mTOO7KHUB6T+gzOPHaUuzm88pf36CqgyOybAk1xqZS1r S9LkimxlT0qQTKRR+0AjArzwjKgQghbSSSV61bcPrusKhn1M+Do+k/JNwepIJG5fbmfO hKu03/CpvZp27GB3WfTDbd/AmKV/uSlX6DDR2Wm7iN8e21Jv0EXcA6LlzXyI5moN9jan NFsoDaUANTsHrtJluvth0TnYSN620QpMD/AIUTh6CM2u5P5IG+rNnMjjJ/L09Y8KiNCV iavQ== X-Gm-Message-State: AOAM533azai1itKuckIHrIUqjvWlvgjBiarOAAlsbnQDY0tN3cmja5P9 wJBfw034vGoqBHKJ64hhLxs= X-Received: by 2002:a17:902:8b8b:b0:13d:e91c:a1b9 with SMTP id ay11-20020a1709028b8b00b0013de91ca1b9mr29015857plb.60.1635816906914; Mon, 01 Nov 2021 18:35:06 -0700 (PDT) Received: from ?IPV6:2601:645:8400:1:99e5:9255:239c:47f4? ([2601:645:8400:1:99e5:9255:239c:47f4]) by smtp.gmail.com with ESMTPSA id u6sm3356122pfg.30.2021.11.01.18.35.06 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 01 Nov 2021 18:35:06 -0700 (PDT) Message-ID: <8957c970-88f2-40a8-835f-062ed7a982af@gmail.com> Date: Mon, 1 Nov 2021 18:35:05 -0700 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.2.0 Subject: Re: Performance regression: thread wakeup time (latency) increased up to 3x Content-Language: en-US From: Norbert To: "Rafael J. Wysocki" , Peter Zijlstra Cc: Steven Rostedt , linux-kernel@vger.kernel.org, Ingo Molnar , Thomas Gleixner , Yunfeng Ye , frederic@kernel.org References: <035c23b4-118e-6a35-36d9-1b11e3d679f8@gmail.com> <8691a8ec-410d-afe8-f468-eefe698c6751@gmail.com> <4674203.GXAFRqVoOG@kreacher> <70998f86-74d7-7ced-867e-f17695bc88e7@gmail.com> In-Reply-To: <70998f86-74d7-7ced-867e-f17695bc88e7@gmail.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 10/23/21 22:09, Norbert wrote: > (The more important part being SCHED_FIFO.) Please ignore this side-comment. The decisive factor is isolated/nohz_full vs normal. There are indications that "normal" times have become worse lately (measured in 5.14.14), relative to earlier, but in that area the fluctuations I see in my current tests are too large to get a clear picture. Best, Norbert