Message-ID: <e08e33d5-4f6d-91aa-f335-9404d16a983c@amd.com>
Date:   Mon, 20 Mar 2023 10:14:51 +0530
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101
 Thunderbird/102.6.1
Subject: Re: NMI reason 2d when running perf
Content-Language: en-US
To:     Jens Axboe <axboe@kernel.dk>,
        Peter Zijlstra <peterz@infradead.org>,
        Ingo Molnar <mingo@redhat.com>, acme@kernel.org
Cc:     linux-perf-users@vger.kernel.org,
        LKML <linux-kernel@vger.kernel.org>,
        "Lendacky, Thomas" <Thomas.Lendacky@amd.com>,
        Kim Phillips <kim.phillips@amd.com>
References: <25fccb43-8338-a690-0009-384dc0640169@kernel.dk>
From:   Ravi Bangoria <ravi.bangoria@amd.com>
In-Reply-To: <25fccb43-8338-a690-0009-384dc0640169@kernel.dk>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?T0JEUFdGNlZVMTN3MnZNUzlnOFJOb0VGOGpNV040cmlzTUZ5eWFMNGEydDNp?=
 =?utf-8?B?TitwbUpiWksxVmJMVEs2bVpjckN5ZDVyaVBaL1lBelF2ZTduNmljN2lEaFhm?=
 =?utf-8?B?alpGVWV6OWYzVmo4NHU0SVZ2NXpQdDR3MGFDemkycjhUNXVzTW5saGhIOHdI?=
 =?utf-8?B?Y2xtamZCQVQzcmVJSVl0YVJDVE9hWW9wVThhQlQzMVpSdlZlekI0NklXbjZI?=
 =?utf-8?B?MFdlVWFZQ3hWUStVcjJpKy9rc0xGTlZ2RHB5RUdtUE9DaUdOR0xRUWpEbDZG?=
 =?utf-8?B?c25tanFlSWgrNG4zcWJrNmtWaTd0Mng5c3hSSjF3aStYQWI2cm8zQWxqZGZZ?=
 =?utf-8?B?UVZjRWYrNnpKUDBLeDdiRjNFREI1UnJ5Y1RrWlhXOEM1YUsvd1kvRHhMMDdk?=
 =?utf-8?B?Ni9KbDk1bUhjZS8yVWVXaDBzTXFrc3E1dEhpMldaTUFFRElJZ0lRMTBtdVJP?=
 =?utf-8?B?NGMwbjZTanR0Q2FrMm83RlAyQ0tjWFVDZHVNQjBLa0plNThYWjNxT2VsNzJj?=
 =?utf-8?B?N3dPWGhlZitHSFVXSzBldEEwUlQ0V1F4VTZzMDdyY055eEo4QmI2R0tjM01M?=
 =?utf-8?B?dWRrNnBPZzlhZVVwOWIzaHVWQzNaYkZoNkdXQmNiYU5JTDdFT3hGT0JLRTFH?=
 =?utf-8?B?bkQweXFNV3JhOTZJSjhzcWxnYXUwaGJnQkFsSFRYSERrbXpkQU45M2I5ZXE4?=
 =?utf-8?B?SDVEZzF4WE9HSFJLcWlBMjJUUHBaakl3M1JvcHhWRUI4bklxaDhVL3p0eFpJ?=
 =?utf-8?B?cHMxeUtFTm42d2J6VnVhMCtHQlhoL04wYm5QZUlUbUlZSWJWNWNTQUFDS2tK?=
 =?utf-8?B?Tko5SEpPUWM3T1d5L0xHd2dzNUNmTTBad09pUDd5aTgzbnlDY2VreHMrcGlw?=
 =?utf-8?B?cys5RGhXcjM1c3VMVTNFMkZta0J0SWljRWJkVGxiRkNPK21zU1ZnajRtaFZt?=
 =?utf-8?B?T0x0Wnp5NlVRbkJnaW5QYmxmWFJiQVdjNVNPU29lUEV1RzloMjlDYUJBTTEv?=
 =?utf-8?B?SE9xdWhzVHVMWVlkVzc0SG1xV3V1UWFaSzE0VEp3RWpaUUJqeWZjNk1EaXFG?=
 =?utf-8?B?RTZHVmFjMmw5T1pUMzd6dEc3UXJMSWM4RWhlL2VONjAwWHJoZGNidDhHNyti?=
 =?utf-8?B?ci9qV0dBMXdWZzY5QjdRSm5HTkVRbkhNT0htbnRTeDhNclhiN05DOGxHd0FW?=
 =?utf-8?B?Y1hZUzdiNTcxOXNIWEk5TGNKT1M3R25WWEI1ME40bHJ5VWpTQmVPbFhDaE1q?=
 =?utf-8?B?WW1YUlRmL1N5eEtWYXh2QXEwWUJ4ak1INjQ5Y0xkRE9mQjYvTDh4WlhhWHNS?=
 =?utf-8?B?SGxqRnhkM3JwSTB5aVE1ZGhwL1pvMGwrVzZuRXppZ1FjbGhaelpYNWNlUFFH?=
 =?utf-8?B?Y0ZrM3A3WUZ1WE1oU3FiWDJyNExkeDkyUnBGTDVQREtoODN4UnFhTXRrVzVq?=
 =?utf-8?B?WU9zWUF3d2VDMk9vYVBXNnp1aktvdWJmM0ROcUZ2N0pZeG00WWMxUFJPL2lx?=
 =?utf-8?B?TW9yMkliWHM2a3B2ZUlmZ05nWEp4a0FCVUE5NWJKcUE2WTVTTWZ6NWJIVUgv?=
 =?utf-8?B?bS8zWFA4dHA2aTBqcEpEcDUwUnAxSVBxT1ZsNDgyZjRtd2c5WFdsMWJ3aW1I?=
 =?utf-8?B?YytIY3VjeFBIMllOMmEwYVhucWRyNzMzaXA1S3JZTkE4L1hSWTU4WmNsV0tX?=
 =?utf-8?B?MjdmcEluQXpkUWtXclQrUEIzNm9UTmJ5clBmelcrbENwbFh1UVJYdDJnY2RZ?=
 =?utf-8?B?c1VTNHhyQTJnR2hOaVFodFYrME5LdnRZZ1F6bGhwRzNPdDcxQmF3S2xYU2Na?=
 =?utf-8?B?UHdFTDIrUHdFVFVPUFdibFRJNmtORXR2VmptYk0wc0RuQi9wdDRqNWhrS0JQ?=
 =?utf-8?B?Njg1ZDhsNnZVTVVWZ1g2SmN1OW5uQU9RTkFqQ05QSzQ5N09QNlJLN0oxUHpR?=
 =?utf-8?B?QXl0dXN1MmgzeVZUZExSNzBHMW5JTDNqVTUwYkNNcmQxV1o3dkpNL25ON1Vx?=
 =?utf-8?B?Nk9CdCtnOUc2Ny9xbzZLRmk1SUxEelV6SkM2SmZOMmNaMjdvNlVvaEtuMDVv?=
 =?utf-8?B?ZFgxZjd2R1NIS3Njdmlvc29VY1JKNFdyblk2UDM0NC81VCsrVWdSWnpJUGV5?=
 =?utf-8?Q?J78QqgDoAUyxwqbqN5BdAjCPU?=
X-OriginatorOrg: amd.com
X-MS-Exchange-CrossTenant-Network-Message-Id: b608c783-2738-413d-3140-08db28fddda2
X-MS-Exchange-CrossTenant-AuthSource: PH7PR12MB6588.namprd12.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 20 Mar 2023 04:45:01.5006
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: oFX/iBHt1tuTGcJZy5zSNn4x9w4XChsxjg5nuog88Jik2oejKm2KOuyV9lk4SvMV9fkRBcVzi+3/GeeOOodUUA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CH0PR12MB5387
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

On 17-Mar-23 7:55 PM, Jens Axboe wrote:
> Hi,
> 
> When running perf on my Dell R7525 on a running process, I get a ton of:
> 
> [  504.234782] Dazed and confused, but trying to continue
> [  504.267843] Uhhuh. NMI received for unknown reason 2d on CPU 48.
> [  504.267846] Dazed and confused, but trying to continue
> [  504.335975] Uhhuh. NMI received for unknown reason 2d on CPU 48.
> [  504.335977] Dazed and confused, but trying to continue
> [  504.368031] Uhhuh. NMI received for unknown reason 2d on CPU 48.
> [  504.368033] Dazed and confused, but trying to continue
> [  504.371037] Uhhuh. NMI received for unknown reason 2d on CPU 48.
> [  504.371038] Dazed and confused, but trying to continue
> [  504.439165] Uhhuh. NMI received for unknown reason 2d on CPU 48.
> [  504.439167] Dazed and confused, but trying to continue
> 
> spew in dmesg. The box has 2x7763 CPUS.

Are you using IBS directly or indirectly (perf record, if run as root
without explicit -e event, internally invokes IBS)? fwiw, Zen2 had
similar hw issue where IBS can raise NMI without sample valid bit set
while exiting from CC6 state[1]. But as per my knowledge, it's already
fixed in Zen3.

[1]: https://lore.kernel.org/all/YFDSSxftYw9tCGC6@krava/

> This seems to be a recent
> regression, been using this box for a while and haven't seen this
> before. The test being traced is pinned to CPU 48. The box is currently
> running:
> 
> commit 6015b1aca1a233379625385feb01dd014aca60b5 (origin/master, origin/HEAD)
> Author: Linus Torvalds <torvalds@linux-foundation.org>
> Date:   Tue Mar 14 19:32:38 2023 -0700
> 
>     sched_getaffinity: don't assume 'cpumask_size()' is fully initialized
> 
> with the pending block/io_uring branches merged in for testing.
>