Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Message-ID: <178000f1-1464-03cb-2335-a01b77e70692@amd.com>
Date:   Fri, 20 Jan 2023 11:20:53 +0530
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101
 Thunderbird/102.6.1
Subject: Re: [bisected] clang 15 built kernel fails to boot, stuck at "Loading
 Linux 6.1.1 ...", gcc 12 built kernel with same config boots fine
To:     "Erhard F." <erhard_f@mailbox.org>,
        Peter Zijlstra <peterz@infradead.org>
Cc:     linux-kernel@vger.kernel.org
References: <20230119022303.177052e4@yea>
 <Y8lL95T93g5xK+mu@hirez.programming.kicks-ass.net>
 <Y8lfStnaUFNRxgYu@hirez.programming.kicks-ass.net>
Content-Language: en-US
From:   Sandipan Das <sandipan.das@amd.com>
In-Reply-To: <Y8lfStnaUFNRxgYu@hirez.programming.kicks-ass.net>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?c29EZDFUWjBFNGlSazBSZmZ5ZzhSdUE5cTVmOUtoTm41YkdEOHVaRHYzY2V4?=
 =?utf-8?B?RXczNmxiVXVTakNralBuU0xDZ0p5SE1KR3hPMzB6cDM2OTFHRFpCQW9EV1Vs?=
 =?utf-8?B?UU9VUDcvbUwvWjJuM1dyVjFNSEJzaVhTRFFNYWR6TnBHbjB1NUQxTGtFM2Rw?=
 =?utf-8?B?SWQyRXhQRFpTdVExeEJzR2VQeWVFbUVBWGJEYlZkeFpKYlA1bFFNVVZJYVV2?=
 =?utf-8?B?NzBuM1dTWno0NUlKK0VYS0pERW4zVHBOcENRWUxpUzhtZ21tMVdjTUFwWXN2?=
 =?utf-8?B?QmVtR2hybjFGMmZlbUdtZFBBaTNiOElFSkE1dnVsZlhhZ1oxc1VSWms4aTUw?=
 =?utf-8?B?M2l2VHFUVGhudndVdURiK3JBUG1hK1VBUjl0NnZJdkFXMTlHNFZkZ0IrbXFw?=
 =?utf-8?B?Z21jRzYvQVFZeFlaYXExY0lUaHlOc2QxTlErUUMvdGM0S1EzRVdqanlkNjBS?=
 =?utf-8?B?MzlIVTJsOEZjQW0zLzBkRVhVelBacHNHZmZhWG8zTGx6M1lBemZDZWdpcXEz?=
 =?utf-8?B?TDNzMjU5a1JXYWFpcW93SDFzM0ZVRnJLOHBFeVpIWWJ1RUdlell1NEp2bXdo?=
 =?utf-8?B?NWIxRWpuUGVKcEY1MjgrQkgxTDA4SkVlclprL0Z6ZW5qandjdlcydko3Q1ZZ?=
 =?utf-8?B?R1RjVHJQOHpWZFM5U1lVazk4SGd0TE41aFJPZ3ZMTVI3dnV0bTNhNnBqcnVX?=
 =?utf-8?B?MzNQekQzZVQrL09CWmxHT2FOL1F4Qkk4dHJaSHJmN2RKcTlXYXdFZjZKV0ZV?=
 =?utf-8?B?OVpyYXRyYXVzeGIxWGJRenBpcHk3UDl5TzRXbzgwMy9nQUNRVDB2a0cwcEh4?=
 =?utf-8?B?TWxOUW5SMDRDRXRVLzZuRVcxTjQ5cjcvWk5laXNPRmgyNW0yais4cWtuSmtR?=
 =?utf-8?B?VzhqY2xiVEpTdUR5OS9icEpqYitheGpKTzJjaXNqN2s2eElZbnBDblZnVG8w?=
 =?utf-8?B?cm1vNFhrOVZJZXg4Y3E3Z1F4Vnp3b1ZFYjJENUMrZjV3TUx5UU01ZHMzM2E2?=
 =?utf-8?B?MkhEUFNNdmRGUzh6UnRKTDJRQ1p4d3h2N1lFZ1EyaHhPcysyQnJVMWhEM2pT?=
 =?utf-8?B?MitqaUdXc21GKzhXck91VWkxR0p1Yzc5UGwxV2dNc3AxekZCMHkwenlraWZR?=
 =?utf-8?B?WlJWK1AxWW5pTU42b05DVmFRaURoSVFkd2pNUFZKQndEMUtYcEYrRUpyYlFl?=
 =?utf-8?B?SUZSelNTWjRlNjNKeWZoOTFBSVRzSktTOXNXWHp1a2ZBQXpuQVFGWFZRTFFn?=
 =?utf-8?B?QUcwZmhTdXZWZDZ5c1dudEtQaXhpRkMxRm9iVVc3MGR6VVRrc2tuS1NCMzVD?=
 =?utf-8?B?dWNoNDF4ZkJ5elppWTNNOUVieDNXYm5WNjZ1T2ZUZnZLaTBxZG8rZzJxK3dB?=
 =?utf-8?B?eEg5L0dTdzhIOGg1OTRYN1FrU2g5TTc0TlJ3TVFKQy9XS0w4eWJsbmpNa0pJ?=
 =?utf-8?B?dTBUbVEvRHk5SXA0OXlzaFBOSm5xek1XUC8ySm90ay9oTHdOcys0dEtjemtT?=
 =?utf-8?B?TkZHaFplOGEwOXJLbVlOVzZHU09GQmZqZ0tVb3BYWXRuWEY1NlhkR1NwYzRR?=
 =?utf-8?B?RlhpbFdRYzJpR1BsVUs3RWJIdjFuTm5JTk11dXdmOUNhblNpL3h3MmNML3B0?=
 =?utf-8?B?Nm9qazhoQkdhZzVWTFA1UUMyLzA5WjlOVHdUS1BQRTg3QVd4MGdVMGk1QkZr?=
 =?utf-8?B?RlpGL21IUnRpS3pTYkI2bjdiUG9tYThVbGo3ZlJnUTN5dW40US9NV1hnSlEv?=
 =?utf-8?B?Y0RRd3QvSDJYaWpWYWRMQXJ3RkhWQTFWa25UbHJvclZJckVQT0RuQ0NSUXFG?=
 =?utf-8?B?MG1Bc2VoRUdwbXZlckhXdGtIYzJMRnM5cXVvelh2VTFoOFBGQjFWdTRpS21F?=
 =?utf-8?B?VkE1QlNuWm1xZ0Vob0dFUUdvRUpGS2IreG1uVGJxbVhuSFBkQ1JDUEtGUDBL?=
 =?utf-8?B?SUxYakJ0UUx5dTZZanpqNHVjSU9KNGhsMU9DK1dKOWVrTFZORGdNTldrcmFD?=
 =?utf-8?B?TmZob0pzQU10WElEb25HaGY2MFUzemtudEEvRzgrajhVRGZRMXdVK2tHYklr?=
 =?utf-8?B?RVhrUW5yRlZncGgxRThmSVcyaU94dURMWEdCcURjME5ndGJEZ0RidGVBdkFU?=
 =?utf-8?Q?ODekJdMTCU68yn1BDHbO9Zux9?=
X-OriginatorOrg: amd.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 5178f65d-7a9a-471e-248c-08dafaaa51e5
X-MS-Exchange-CrossTenant-AuthSource: PH7PR12MB5712.namprd12.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 20 Jan 2023 05:51:05.6076
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: 1bEOP1hr3qkfvzH0lIdLKNRKD8f6toiV7AJXEpeZZMS1T261eEkN3m3vox9WZzLVlXVy01YwHCd8SGXmH14ewA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH7PR12MB7020
X-Spam-Status: No, score=-2.2 required=5.0 tests=BAYES_00,DKIM_SIGNED,
        DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,NICE_REPLY_A,RCVD_IN_DNSWL_NONE,
        RCVD_IN_MSPIKE_H2,SPF_HELO_PASS,SPF_PASS autolearn=ham
        autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

On 1/19/2023 8:48 PM, Peter Zijlstra wrote:
> On Thu, Jan 19, 2023 at 02:56:08PM +0100, Peter Zijlstra wrote:
>> On Thu, Jan 19, 2023 at 02:23:03AM +0100, Erhard F. wrote:
>>> Hi!
>>>
>>> I did a kernel bisect for an issue I originally posted on https://github.com/ClangBuiltLinux/linux/issues/1774
>>>
>>> It is about kernel 6.1.x not booting on my machines when built with clang. A gcc built kernel with the same config just works fine. Turns out kernel v6.2-rc4 and earlier v6.2-rc are still affected.
>>>
>>> I did a kernel bisect which revealed this commit:
>>>
>>>  # git bisect bad
>>> 706460a96fc654e80b6bed1f562b00d2ce9f2f4d is the first bad commit
>>> commit 706460a96fc654e80b6bed1f562b00d2ce9f2f4d
>>> Author: Sandipan Das <sandipan.das@amd.com>
>>> Date:   Thu Aug 11 17:59:51 2022 +0530
>>>
>>>     perf/x86/amd/core: Add generic branch record interfaces
>>>     
>>>     AMD processors that are capable of recording branches support either Branch
>>>     Sampling (BRS) or Last Branch Record (LBR). In preparation for adding Last
>>>     Branch Record Extension Version 2 (LbrExtV2) support, introduce new static
>>>     calls which act as gateways to call into the feature-dependent functions
>>>     based on what is available on the processor.
>>>     
>>>     Signed-off-by: Sandipan Das <sandipan.das@amd.com>
>>>     Signed-off-by: Peter Zijlstra (Intel) <peterz@infradead.org>
>>>     Link: https://lore.kernel.org/r/b75dbc32663cb395f0d701167e952c6a6b0445a3.1660211399.git.sandipan.das@amd.com
>>>
>>>  arch/x86/events/amd/core.c | 34 ++++++++++++++++++++++------------
>>>  1 file changed, 22 insertions(+), 12 deletions(-)
>>
>> Using: v6.2-rc4-67-g7287904c8771
>>
>> I have an AMD Interlagos and after bringing it back to live/up-to-date I
>> can't seem to even boot your .config in qemu/kvm irrespective of
>> GCC/Clang.
>>

I had a similar experience on a system with an AMD EPYC 7713. Both guest
and bare-metal boot failed.

>> When I build defconfig+kvm_guest.config both GCC-12 and clang-15 boot
>> just fine in qemu/kvm.
> 
> Furthermore, testing localyesconfig based off Debian's
> config-6.1.0-1-amd64 boots fine using both GCC-12 and clang-15 as host
> kernels on that machine.
> 

With the combination of defconfig+kvm_guest.config+localyesconfig, the only
thing that made a difference was the compiler optimization choice. The kernel
boots up with CONFIG_CC_OPTIMIZE_FOR_PERFORMANCE=y but not with
CONFIG_CC_OPTIMIZE_FOR_SIZE=y. Both Clang 15 and 16 kernel builds are affected.

- Sandipan