Received-SPF: pass (google.com: domain of linux-kernel+bounces-207211-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.199.223 as permitted sender) client-ip=147.75.199.223;
Precedence: bulk
MIME-Version: 1.0
References: <CAHk-=wisJ8bS3qe6iBPwL9x=PqJA5oE7tum-E9oZfyPgd2mmrw@mail.gmail.com>
 <46cb50d65e414bfd9bef5549d68ae4ea@AcuMS.aculab.com> <CAHk-=wh170Lme6HHSGa5eM6YNcd01vdkOoPenZ0m7P+Yv6_zxg@mail.gmail.com>
 <adbbd899aabf4e6898bbbb04f90b3ede@AcuMS.aculab.com>
In-Reply-To: <adbbd899aabf4e6898bbbb04f90b3ede@AcuMS.aculab.com>
From: Linus Torvalds <torvalds@linux-foundation.org>
Date: Sat, 8 Jun 2024 15:00:43 -0700
Message-ID: <CAHk-=wjwFGQZcDinK=BkEaA8FSyVg5NaUe0BobxowxeZ5PvetA@mail.gmail.com>
Subject: Re: Linux 6.10-rc2 - massive performance regression
To: David Laight <David.Laight@aculab.com>
Cc: Linux Kernel Mailing List <linux-kernel@vger.kernel.org>
Content-Type: text/plain; charset="UTF-8"

On Sat, 8 Jun 2024 at 14:36, David Laight <David.Laight@aculab.com> wrote:
>
> I'll try to remember how to bisect through the merge :-)

git bisect should just do all the work for you. All you need to do is
give a know good and bad point, and keep testing what git bisect asks
you to do.

> I've done some tests.
> I'm seeing a three-fold slow down on:
> $ i=0; while [ $i -lt 1000000 ]; do i=$((i + 1)); done
> which goes from 1 second to 3.
>
> I can run that with ftrace monitoring scheduler events (and a few
> other things) and can't spot anywhere the process isn't running
> for a significant time.

Sounds like cpu frequency. Almost certainly hw-specific. I went
through that on my Threadripper in the 6.9 timeframe, but I'm not
seeing any issues in this current release.

If you bisect it, we have somebody to blame and point fingers at...

                Linus