Received-SPF: pass (google.com: domain of linux-kernel+bounces-207213-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45e3:2400::1 as permitted sender) client-ip=2604:1380:45e3:2400::1;
Subject: Re: Linux 6.10-rc2 - massive performance regression
To: Linus Torvalds <torvalds@linux-foundation.org>,
 David Laight <David.Laight@aculab.com>
Cc: Linux Kernel Mailing List <linux-kernel@vger.kernel.org>
References: <CAHk-=wisJ8bS3qe6iBPwL9x=PqJA5oE7tum-E9oZfyPgd2mmrw@mail.gmail.com>
 <46cb50d65e414bfd9bef5549d68ae4ea@AcuMS.aculab.com>
 <CAHk-=wh170Lme6HHSGa5eM6YNcd01vdkOoPenZ0m7P+Yv6_zxg@mail.gmail.com>
 <adbbd899aabf4e6898bbbb04f90b3ede@AcuMS.aculab.com>
 <CAHk-=wjwFGQZcDinK=BkEaA8FSyVg5NaUe0BobxowxeZ5PvetA@mail.gmail.com>
From: Woody Suwalski <terraluna977@gmail.com>
Message-ID: <b6083a4c-44be-c90d-bb41-c48e130503b9@gmail.com>
Date: Sat, 8 Jun 2024 18:28:17 -0400
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101
 Firefox/91.0 SeaMonkey/2.53.18.2
Precedence: bulk
MIME-Version: 1.0
In-Reply-To: <CAHk-=wjwFGQZcDinK=BkEaA8FSyVg5NaUe0BobxowxeZ5PvetA@mail.gmail.com>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit

Linus Torvalds wrote:
> On Sat, 8 Jun 2024 at 14:36, David Laight <David.Laight@aculab.com> wrote:
>> I'll try to remember how to bisect through the merge :-)
> git bisect should just do all the work for you. All you need to do is
> give a know good and bad point, and keep testing what git bisect asks
> you to do.
>
>> I've done some tests.
>> I'm seeing a three-fold slow down on:
>> $ i=0; while [ $i -lt 1000000 ]; do i=$((i + 1)); done
>> which goes from 1 second to 3.
>>
>> I can run that with ftrace monitoring scheduler events (and a few
>> other things) and can't spot anywhere the process isn't running
>> for a significant time.
> Sounds like cpu frequency. Almost certainly hw-specific. I went
> through that on my Threadripper in the 6.9 timeframe, but I'm not
> seeing any issues in this current release.
>
> If you bisect it, we have somebody to blame and point fingers at...
>
>                  Linus
>
I have run a quick test on my laptop doing

time (i=0; while [ $i -lt 1000000 ]; do i=$((i+1)); done)

and 6.8.12, 6.9.3 and 6.10-rc2 have identical results...

Woody