Received: by 2002:ab2:68c1:0:b0:1fd:9a81:d0e4 with SMTP id e1csp402081lqp; Sun, 9 Jun 2024 01:07:42 -0700 (PDT) X-Forwarded-Encrypted: i=3; AJvYcCUIbP3Yj8AhKFXx4kS1R9BkQlIBAfhYzzL+fU5fa4+sII7pSkFvJtAL2x8BnQCFBM6z0h7qyJwpykFk6rwrad7imVMofcDQquTgDBsy5w== X-Google-Smtp-Source: AGHT+IHuotWPeRZUl0UQfPLjjLWZ+Ee22OePUKpmkIQdSzkmAXYSA/wslOXqvOfH2wpkuCg4gyIw X-Received: by 2002:a17:906:a850:b0:a69:1219:2e2d with SMTP id a640c23a62f3a-a6cd76a939dmr431778966b.35.1717920462523; Sun, 09 Jun 2024 01:07:42 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1717920462; cv=pass; d=google.com; s=arc-20160816; b=QIGIzQCFBzUI274H6GW1b+kcGv10U1DmtNA7mI3gTvgqwmlziw3vsDe7bZqGtzpwGp wuEjCh//D4KmQqRt979pWN5UFreqebCZ4RcBy+jTrpERo+HrBcMfM5ShbNM2xvZkI6cg nrJbkr0Qg7l+XFb2jGIKFkpvlcPCTmwv1bm9rLSvuQHGkST3W4ucI7xaETDSSBNhNjHg mhJQMFv7di66+AVq9s43xwyPrIVxRmeEQHMjwn1TV6b4QkpFGPxE5gNOGp0GzG2U1Hgo sy2YTFEImtOlbabpEm/h8qbiFyeraMl4PMC+n3pKB3yLA77KRBYyStpIVT90/bJId2F2 wLzw== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=in-reply-to:content-disposition:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:references:message-id:subject:cc :to:from:date:dkim-signature; bh=xvjKx4BYWca7HiKwGOo5lMnmt2ImaegZ2PaA5jaJdUY=; fh=LuE2eT4UbEx49D7fVOI8/KSfY+KnYpn5nMwt1WCHmS8=; b=BbAeOikDPVI60aS8h/2C0dm0l+gfWJioLv4l/sMAdUPqDBNcQEhIZGkA4PI9knyP2N AuSkWpl2/qWGIfUJJ+P7ZFsTEkWgnZ/kfI7W+vc4HV9V5cEg7alYxK/LjvO+mN7ONzEI JC2zESpfljIhykiW41UiLYXYXmpHrK7aGu/7OWeSqqjZRNN0/tNq88LcGvhlnNX5bkov TALlFxSCGJEvqo1OXjDoWb6oga0GtcdWCTOZzTkrNZalxuUV2M6p2QB5bklFck3CzkP8 2JGXai6fhlNTOftvviYGcx0MgQUTEQN7Bah9BGoc7n1TQ7tRVBrfpXzR0mUJuyknjb3P raoQ==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=rlFAMsSt; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-207273-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:4601:e00::3 as permitted sender) smtp.mailfrom="linux-kernel+bounces-207273-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from am.mirrors.kernel.org (am.mirrors.kernel.org. [2604:1380:4601:e00::3]) by mx.google.com with ESMTPS id a640c23a62f3a-a6effdbd770si138451166b.18.2024.06.09.01.07.42 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 09 Jun 2024 01:07:42 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel+bounces-207273-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:4601:e00::3 as permitted sender) client-ip=2604:1380:4601:e00::3; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=rlFAMsSt; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-207273-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:4601:e00::3 as permitted sender) smtp.mailfrom="linux-kernel+bounces-207273-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by am.mirrors.kernel.org (Postfix) with ESMTPS id 402931F21873 for ; Sun, 9 Jun 2024 08:07:42 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 6211B1C698; Sun, 9 Jun 2024 08:07:35 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="rlFAMsSt" Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 8C7A8D26A for ; Sun, 9 Jun 2024 08:07:34 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1717920454; cv=none; b=EgRK1IRot8mfCQ22ly2ad0AyTQyKW2qjnjNtW/ZcIYqbB28R/MG8C/N62cTaymIIl1dJPYQKC0YliTY9ZOZgp9EWwljK55nolsPEddecrJmfR4xIWa/zB7Qbh3IAchhncNPtMmlPuJ4qoBwvk8Bia6/VEgI6dO7Pem3b3+CsTPk= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1717920454; c=relaxed/simple; bh=lOSN//yUQFmhLpm5Bd1YqSKVJsxaLRxaQ+D/NYYOnxU=; h=Date:From:To:Cc:Subject:Message-ID:References:MIME-Version: Content-Type:Content-Disposition:In-Reply-To; b=qWc7kxznnsqlF3o+ZAx9j+TvWjePMKazyLjmct0j4tvdpG0Y0CZnwckZQDK54pW4WNZcmag0TGh2iPZzbJ3aI/JGbIa+at4v2Pb8ElI+Of34rTJGkw4m2vpgA17M7auRgzebqQ/424/2Dq8tO9F+13cpYKt7ZDVZQlazkGu1ecE= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=rlFAMsSt; arc=none smtp.client-ip=10.30.226.201 Received: by smtp.kernel.org (Postfix) with ESMTPSA id 09BF4C2BD10; Sun, 9 Jun 2024 08:07:34 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1717920454; bh=lOSN//yUQFmhLpm5Bd1YqSKVJsxaLRxaQ+D/NYYOnxU=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=rlFAMsStExGoQBYvuSIo0iDEJHa4iKG/EfmfB9bdHbNXmA4tarjE3A1ad6uuHN8R1 LpsVMw9kUTmTq1i7v2Gw6FgQwOPuFCdwpQk2PHtISl+EAG3nPN0+ABKK2kZ5RQfK6u XIZZdrPv4JeliIHs3ZBUFeV+eKvnpnmZGoAK4XvuWXcthpqEBE/cpWnJu6eycqeSov XfFa+xkYLO/oPjT3NlL2A7fRPWVexwHB6Rb7Ao+47yYMZRfK3Vzg9i3ia0B69hiSab y428LSwwqvuLxOxWlE1e+bVU4IFYj7RV2FvvqqjoHFpDrc9tk6vyfmXe2ezgXMr3W0 1ipplsLYj6eIw== Received: from johan by xi.lan with local (Exim 4.97.1) (envelope-from ) id 1sGDaP-000000006fV-05O9; Sun, 09 Jun 2024 10:07:33 +0200 Date: Sun, 9 Jun 2024 10:07:33 +0200 From: Johan Hovold To: Linus Torvalds Cc: David Laight , Linux Kernel Mailing List Subject: Re: Linux 6.10-rc2 - massive performance regression Message-ID: References: <46cb50d65e414bfd9bef5549d68ae4ea@AcuMS.aculab.com> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: On Sat, Jun 08, 2024 at 03:00:43PM -0700, Linus Torvalds wrote: > On Sat, 8 Jun 2024 at 14:36, David Laight wrote: > > I've done some tests. > > I'm seeing a three-fold slow down on: > > $ i=0; while [ $i -lt 1000000 ]; do i=$((i + 1)); done > > which goes from 1 second to 3. > > > > I can run that with ftrace monitoring scheduler events (and a few > > other things) and can't spot anywhere the process isn't running > > for a significant time. > > Sounds like cpu frequency. Almost certainly hw-specific. I went > through that on my Threadripper in the 6.9 timeframe, but I'm not > seeing any issues in this current release. > > If you bisect it, we have somebody to blame and point fingers at... This may possibly be related to the cpufreq/thermal regression I just reported here: https://lore.kernel.org/lkml/ZmVfcEOxmjUHZTSX@hovoldconsulting.com/ which causes the big cores on the Lenovo ThinkPad X13s to be stuck at a low frequency once they've been throttled. Johan