2023-09-22 20:34:25

by Bagas Sanjaya

[permalink] [raw]
Subject: Re: [bug report] RIP: 0010:throtl_trim_slice+0xc6/0x320 caused kernel panic

On Fri, Sep 22, 2023 at 10:10:45AM +0800, Changhui Zhong wrote:
> Hello,
>
> triggered below issue with branch 'for-next',please help check,
>
> INFO: HEAD of cloned kernel:
> commit d975b468819a142a49c8e7db83feb07c3018c550
> Merge: 58fac6aac7a2 df137dff93fc
> Author: Jens Axboe <[email protected]>
> Date: Wed Sep 13 13:16:19 2023 -0600
>
> Merge branch 'io_uring-futex' into for-next
>
> * io_uring-futex:
> io_uring: add support for vectored futex waits
> futex: make the vectored futex operations available
> futex: make futex_parse_waitv() available as a helper
> futex: add wake_data to struct futex_q
> io_uring: add support for futex wake and wait
> futex: abstract out a __futex_wake_mark() helper
> futex: factor out the futex wake handling
> futex: move FUTEX2_VALID_MASK to futex.h
> futex: Validate futex value against futex size
> futex: Flag conversion
> futex: Extend the FUTEX2 flags
> futex: Clarify FUTEX2 flags
>
>
> reproduce steps:
> echo "+cpuset +cpu +io" > /sys/fs/cgroup/cgroup.subtree_control
> mkdir /sys/fs/cgroup/test
> MAJ=$(ls -l /dev/"$disk" | awk -F ',' '{print $1}' | awk -F ' ' '{print $NF}')
> MIN=$(ls -l /dev/"$disk" | awk -F ',' '{print $2}' | awk -F ' ' '{print $1}')
> echo "$MAJ:$MIN wbps=1024" > /sys/fs/cgroup/test/io.max
> echo $$ > /sys/fs/cgroup/test/cgroup.procs
> dd if=/dev/zero of=/dev/$disk bs=10k count=1 oflag=direct &
> dd if=/dev/zero of=/dev/$disk bs=10k count=1 oflag=direct &
> wait
>
> console log:
> [ 1979.303330] divide error: 0000 [#1] PREEMPT SMP NOPTI
> [ 1979.308393] CPU: 28 PID: 0 Comm: swapper/28 Not tainted 6.6.0-rc1+ #1
> [ 1979.314837] Hardware name: Dell Inc. PowerEdge R7525/0590KW, BIOS
> 2.6.6 01/13/2022
> [ 1979.322402] RIP: 0010:throtl_trim_slice+0xc6/0x320
> [ 1979.327195] Code: 00 00 48 89 e8 48 f7 f1 48 29 d5 74 9f 40 0f b6
> f6 48 89 df 89 34 24 e8 f8 f5 ff ff 8b 34 24 b9 e8 03 00 00 48 89 df
> 48 f7 e5 <48> f7 f1 49 03 85 f8 01 00 00 49 89 c7 e8 78 e0 ff ff ba ff
> ff ff
> [ 1979.345942] RSP: 0018:ffffadf9c2484dc0 EFLAGS: 00010847
> [ 1979.351169] RAX: ffffffffffffd8f0 RBX: ffff8f5486a99800 RCX: 00000000000003e8
> [ 1979.358300] RDX: 000000000000270f RSI: 0000000000000001 RDI: ffff8f5486a99800
> [ 1979.365435] RBP: 0000000000002710 R08: ffffffffffffffff R09: ffff8f565a67b818
> [ 1979.372565] R10: ffff8f5486a99810 R11: ffff8f565a67b830 R12: 0000000000000001
> [ 1979.379698] R13: ffff8f5486a99808 R14: 0000000000000001 R15: 0000000000000021
> [ 1979.386833] FS: 0000000000000000(0000) GS:ffff8f5677d00000(0000)
> knlGS:0000000000000000
> [ 1979.394916] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [ 1979.400663] CR2: 00007f7db5443250 CR3: 0000000459420000 CR4: 0000000000350ee0
> [ 1979.407797] Call Trace:
> [ 1979.410250] <IRQ>
> [ 1979.412270] ? die+0x33/0x90
> [ 1979.415157] ? do_trap+0xe0/0x110
> [ 1979.418476] ? throtl_trim_slice+0xc6/0x320
> [ 1979.422662] ? do_error_trap+0x65/0x80
> [ 1979.426412] ? throtl_trim_slice+0xc6/0x320
> [ 1979.430600] ? exc_divide_error+0x36/0x50
> [ 1979.434612] ? throtl_trim_slice+0xc6/0x320
> [ 1979.438800] ? asm_exc_divide_error+0x16/0x20
> [ 1979.443163] ? throtl_trim_slice+0xc6/0x320
> [ 1979.447347] tg_dispatch_one_bio+0xf0/0x1e0
> [ 1979.451533] throtl_pending_timer_fn+0x1e5/0x510
> [ 1979.456152] ? __pfx_throtl_pending_timer_fn+0x10/0x10
> [ 1979.461287] ? __pfx_throtl_pending_timer_fn+0x10/0x10
> [ 1979.466427] call_timer_fn+0x27/0x130
> [ 1979.470096] __run_timers.part.0+0x1ee/0x280
> [ 1979.474368] ? srso_return_thunk+0x5/0x10
> [ 1979.478379] ? __hrtimer_run_queues+0x121/0x2b0
> [ 1979.482914] ? srso_return_thunk+0x5/0x10
> [ 1979.486925] ? srso_return_thunk+0x5/0x10
> [ 1979.490939] ? srso_return_thunk+0x5/0x10
> [ 1979.494953] run_timer_softirq+0x26/0x50
> [ 1979.498878] __do_softirq+0xcb/0x2ab
> [ 1979.502459] __irq_exit_rcu+0xa1/0xc0
> [ 1979.506124] sysvec_apic_timer_interrupt+0x72/0x90
> [ 1979.510917] </IRQ>
> [ 1979.513021] <TASK>
> [ 1979.515128] asm_sysvec_apic_timer_interrupt+0x16/0x20
> [ 1979.520265] RIP: 0010:mwait_idle+0x4f/0x70
> [ 1979.524365] Code: 31 d2 48 89 d1 65 48 8b 04 25 80 18 03 00 0f 01
> c8 48 8b 00 a8 08 75 13 eb 07 0f 00 2d 96 f3 36 00 31 c0 48 89 c1 fb
> 0f 01 c9 <fa> 65 48 8b 04 25 80 18 03 00 f0 80 60 02 df e9 6d 3f 01 00
> 0f ae
> [ 1979.543111] RSP: 0018:ffffadf9c04a7ed0 EFLAGS: 00000246
> [ 1979.548338] RAX: 0000000000000000 RBX: ffff8f548019cd40 RCX: 0000000000000000
> [ 1979.555471] RDX: 0000000000000000 RSI: 0000000000000087 RDI: 000000000016e484
> [ 1979.562605] RBP: 0000000000000000 R08: ffff8f5677d22a80 R09: 0000000000000000
> [ 1979.569738] R10: 00000000000001dc R11: 0000000000000000 R12: 0000000000000000
> [ 1979.576868] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
> [ 1979.584009] default_idle_call+0x28/0xd0
> [ 1979.587938] cpuidle_idle_call+0x125/0x160
> [ 1979.592036] ? sched_clock_cpu+0xb/0x190
> [ 1979.595963] do_idle+0x7b/0xe0
> [ 1979.599022] cpu_startup_entry+0x19/0x20
> [ 1979.602949] start_secondary+0x115/0x140
> [ 1979.606875] secondary_startup_64_no_verify+0x17d/0x18b
> [ 1979.612104] </TASK>
> [ 1979.614293] Modules linked in: binfmt_misc dm_crypt raid10 raid1
> raid0 dm_raid raid456 async_raid6_recov async_memcpy async_pq
> async_xor xor async_tx raid6_pq loop tls rpcsec_gss_krb5 auth_rpcgss
> nfsv4 dns_resolver nfs lockd grace fscache netfs rfkill sunrpc
> dm_multipath ipmi_ssif intel_rapl_msr intel_rapl_common amd64_edac
> edac_mce_amd kvm_amd kvm mgag200 i2c_algo_bit dcdbas acpi_ipmi
> drm_shmem_helper irqbypass ipmi_si drm_kms_helper dell_smbios rapl
> wmi_bmof pcspkr dell_wmi_descriptor ipmi_devintf k10temp ptdma
> i2c_piix4 ipmi_msghandler acpi_power_meter drm fuse xfs libcrc32c
> sd_mod t10_pi sg ahci libahci crct10dif_pclmul crc32_pclmul
> crc32c_intel libata ghash_clmulni_intel tg3 ccp sp5100_tco wmi
> dm_mirror dm_region_hash dm_log dm_mod [last unloaded: scsi_debug]
> [ 1979.681931] ---[ end trace 0000000000000000 ]---
> [ 1979.706620] pstore: backend (erst) writing error (-22)
> [ 1979.711761] RIP: 0010:throtl_trim_slice+0xc6/0x320
> [ 1979.716555] Code: 00 00 48 89 e8 48 f7 f1 48 29 d5 74 9f 40 0f b6
> f6 48 89 df 89 34 24 e8 f8 f5 ff ff 8b 34 24 b9 e8 03 00 00 48 89 df
> 48 f7 e5 <48> f7 f1 49 03 85 f8 01 00 00 49 89 c7 e8 78 e0 ff ff ba ff
> ff ff
> [ 1979.735301] RSP: 0018:ffffadf9c2484dc0 EFLAGS: 00010847
> [ 1979.740527] RAX: ffffffffffffd8f0 RBX: ffff8f5486a99800 RCX: 00000000000003e8
> [ 1979.747659] RDX: 000000000000270f RSI: 0000000000000001 RDI: ffff8f5486a99800
> [ 1979.754793] RBP: 0000000000002710 R08: ffffffffffffffff R09: ffff8f565a67b818
> [ 1979.761924] R10: ffff8f5486a99810 R11: ffff8f565a67b830 R12: 0000000000000001
> [ 1979.769056] R13: ffff8f5486a99808 R14: 0000000000000001 R15: 0000000000000021
> [ 1979.776190] FS: 0000000000000000(0000) GS:ffff8f5677d00000(0000)
> knlGS:0000000000000000
> [ 1979.784278] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [ 1979.790023] CR2: 00007f7db5443250 CR3: 0000000459420000 CR4: 0000000000350ee0
> [ 1979.797155] Kernel panic - not syncing: Fatal exception in interrupt
> [ 1979.805797] Kernel Offset: 0x30600000 from 0xffffffff81000000
> (relocation range: 0xffffffff80000000-0xffffffffbfffffff)
> [ 1979.835382] ---[ end Kernel panic - not syncing: Fatal exception in
> interrupt ]---
>

Does v6.6-rc2 have this issue? v6.5?

--
An old man doll... just what I always wanted! - Clara


Attachments:
(No filename) (7.47 kB)
signature.asc (235.00 B)
Download all attachments

2023-09-25 10:13:44

by Changhui Zhong

[permalink] [raw]
Subject: Re: [bug report] RIP: 0010:throtl_trim_slice+0xc6/0x320 caused kernel panic

On Fri, Sep 22, 2023 at 4:53 PM Bagas Sanjaya <[email protected]> wrote:
>
> On Fri, Sep 22, 2023 at 10:10:45AM +0800, Changhui Zhong wrote:
> > Hello,
> >
> > triggered below issue with branch 'for-next',please help check,
> >
> > INFO: HEAD of cloned kernel:
> > commit d975b468819a142a49c8e7db83feb07c3018c550
> > Merge: 58fac6aac7a2 df137dff93fc
> > Author: Jens Axboe <[email protected]>
> > Date: Wed Sep 13 13:16:19 2023 -0600
> >
> > Merge branch 'io_uring-futex' into for-next
> >
> > * io_uring-futex:
> > io_uring: add support for vectored futex waits
> > futex: make the vectored futex operations available
> > futex: make futex_parse_waitv() available as a helper
> > futex: add wake_data to struct futex_q
> > io_uring: add support for futex wake and wait
> > futex: abstract out a __futex_wake_mark() helper
> > futex: factor out the futex wake handling
> > futex: move FUTEX2_VALID_MASK to futex.h
> > futex: Validate futex value against futex size
> > futex: Flag conversion
> > futex: Extend the FUTEX2 flags
> > futex: Clarify FUTEX2 flags
> >
> >
> > reproduce steps:
> > echo "+cpuset +cpu +io" > /sys/fs/cgroup/cgroup.subtree_control
> > mkdir /sys/fs/cgroup/test
> > MAJ=$(ls -l /dev/"$disk" | awk -F ',' '{print $1}' | awk -F ' ' '{print $NF}')
> > MIN=$(ls -l /dev/"$disk" | awk -F ',' '{print $2}' | awk -F ' ' '{print $1}')
> > echo "$MAJ:$MIN wbps=1024" > /sys/fs/cgroup/test/io.max
> > echo $$ > /sys/fs/cgroup/test/cgroup.procs
> > dd if=/dev/zero of=/dev/$disk bs=10k count=1 oflag=direct &
> > dd if=/dev/zero of=/dev/$disk bs=10k count=1 oflag=direct &
> > wait
> >
> > console log:
> > [ 1979.303330] divide error: 0000 [#1] PREEMPT SMP NOPTI
> > [ 1979.308393] CPU: 28 PID: 0 Comm: swapper/28 Not tainted 6.6.0-rc1+ #1
> > [ 1979.314837] Hardware name: Dell Inc. PowerEdge R7525/0590KW, BIOS
> > 2.6.6 01/13/2022
> > [ 1979.322402] RIP: 0010:throtl_trim_slice+0xc6/0x320
> > [ 1979.327195] Code: 00 00 48 89 e8 48 f7 f1 48 29 d5 74 9f 40 0f b6
> > f6 48 89 df 89 34 24 e8 f8 f5 ff ff 8b 34 24 b9 e8 03 00 00 48 89 df
> > 48 f7 e5 <48> f7 f1 49 03 85 f8 01 00 00 49 89 c7 e8 78 e0 ff ff ba ff
> > ff ff
> > [ 1979.345942] RSP: 0018:ffffadf9c2484dc0 EFLAGS: 00010847
> > [ 1979.351169] RAX: ffffffffffffd8f0 RBX: ffff8f5486a99800 RCX: 00000000000003e8
> > [ 1979.358300] RDX: 000000000000270f RSI: 0000000000000001 RDI: ffff8f5486a99800
> > [ 1979.365435] RBP: 0000000000002710 R08: ffffffffffffffff R09: ffff8f565a67b818
> > [ 1979.372565] R10: ffff8f5486a99810 R11: ffff8f565a67b830 R12: 0000000000000001
> > [ 1979.379698] R13: ffff8f5486a99808 R14: 0000000000000001 R15: 0000000000000021
> > [ 1979.386833] FS: 0000000000000000(0000) GS:ffff8f5677d00000(0000)
> > knlGS:0000000000000000
> > [ 1979.394916] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> > [ 1979.400663] CR2: 00007f7db5443250 CR3: 0000000459420000 CR4: 0000000000350ee0
> > [ 1979.407797] Call Trace:
> > [ 1979.410250] <IRQ>
> > [ 1979.412270] ? die+0x33/0x90
> > [ 1979.415157] ? do_trap+0xe0/0x110
> > [ 1979.418476] ? throtl_trim_slice+0xc6/0x320
> > [ 1979.422662] ? do_error_trap+0x65/0x80
> > [ 1979.426412] ? throtl_trim_slice+0xc6/0x320
> > [ 1979.430600] ? exc_divide_error+0x36/0x50
> > [ 1979.434612] ? throtl_trim_slice+0xc6/0x320
> > [ 1979.438800] ? asm_exc_divide_error+0x16/0x20
> > [ 1979.443163] ? throtl_trim_slice+0xc6/0x320
> > [ 1979.447347] tg_dispatch_one_bio+0xf0/0x1e0
> > [ 1979.451533] throtl_pending_timer_fn+0x1e5/0x510
> > [ 1979.456152] ? __pfx_throtl_pending_timer_fn+0x10/0x10
> > [ 1979.461287] ? __pfx_throtl_pending_timer_fn+0x10/0x10
> > [ 1979.466427] call_timer_fn+0x27/0x130
> > [ 1979.470096] __run_timers.part.0+0x1ee/0x280
> > [ 1979.474368] ? srso_return_thunk+0x5/0x10
> > [ 1979.478379] ? __hrtimer_run_queues+0x121/0x2b0
> > [ 1979.482914] ? srso_return_thunk+0x5/0x10
> > [ 1979.486925] ? srso_return_thunk+0x5/0x10
> > [ 1979.490939] ? srso_return_thunk+0x5/0x10
> > [ 1979.494953] run_timer_softirq+0x26/0x50
> > [ 1979.498878] __do_softirq+0xcb/0x2ab
> > [ 1979.502459] __irq_exit_rcu+0xa1/0xc0
> > [ 1979.506124] sysvec_apic_timer_interrupt+0x72/0x90
> > [ 1979.510917] </IRQ>
> > [ 1979.513021] <TASK>
> > [ 1979.515128] asm_sysvec_apic_timer_interrupt+0x16/0x20
> > [ 1979.520265] RIP: 0010:mwait_idle+0x4f/0x70
> > [ 1979.524365] Code: 31 d2 48 89 d1 65 48 8b 04 25 80 18 03 00 0f 01
> > c8 48 8b 00 a8 08 75 13 eb 07 0f 00 2d 96 f3 36 00 31 c0 48 89 c1 fb
> > 0f 01 c9 <fa> 65 48 8b 04 25 80 18 03 00 f0 80 60 02 df e9 6d 3f 01 00
> > 0f ae
> > [ 1979.543111] RSP: 0018:ffffadf9c04a7ed0 EFLAGS: 00000246
> > [ 1979.548338] RAX: 0000000000000000 RBX: ffff8f548019cd40 RCX: 0000000000000000
> > [ 1979.555471] RDX: 0000000000000000 RSI: 0000000000000087 RDI: 000000000016e484
> > [ 1979.562605] RBP: 0000000000000000 R08: ffff8f5677d22a80 R09: 0000000000000000
> > [ 1979.569738] R10: 00000000000001dc R11: 0000000000000000 R12: 0000000000000000
> > [ 1979.576868] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
> > [ 1979.584009] default_idle_call+0x28/0xd0
> > [ 1979.587938] cpuidle_idle_call+0x125/0x160
> > [ 1979.592036] ? sched_clock_cpu+0xb/0x190
> > [ 1979.595963] do_idle+0x7b/0xe0
> > [ 1979.599022] cpu_startup_entry+0x19/0x20
> > [ 1979.602949] start_secondary+0x115/0x140
> > [ 1979.606875] secondary_startup_64_no_verify+0x17d/0x18b
> > [ 1979.612104] </TASK>
> > [ 1979.614293] Modules linked in: binfmt_misc dm_crypt raid10 raid1
> > raid0 dm_raid raid456 async_raid6_recov async_memcpy async_pq
> > async_xor xor async_tx raid6_pq loop tls rpcsec_gss_krb5 auth_rpcgss
> > nfsv4 dns_resolver nfs lockd grace fscache netfs rfkill sunrpc
> > dm_multipath ipmi_ssif intel_rapl_msr intel_rapl_common amd64_edac
> > edac_mce_amd kvm_amd kvm mgag200 i2c_algo_bit dcdbas acpi_ipmi
> > drm_shmem_helper irqbypass ipmi_si drm_kms_helper dell_smbios rapl
> > wmi_bmof pcspkr dell_wmi_descriptor ipmi_devintf k10temp ptdma
> > i2c_piix4 ipmi_msghandler acpi_power_meter drm fuse xfs libcrc32c
> > sd_mod t10_pi sg ahci libahci crct10dif_pclmul crc32_pclmul
> > crc32c_intel libata ghash_clmulni_intel tg3 ccp sp5100_tco wmi
> > dm_mirror dm_region_hash dm_log dm_mod [last unloaded: scsi_debug]
> > [ 1979.681931] ---[ end trace 0000000000000000 ]---
> > [ 1979.706620] pstore: backend (erst) writing error (-22)
> > [ 1979.711761] RIP: 0010:throtl_trim_slice+0xc6/0x320
> > [ 1979.716555] Code: 00 00 48 89 e8 48 f7 f1 48 29 d5 74 9f 40 0f b6
> > f6 48 89 df 89 34 24 e8 f8 f5 ff ff 8b 34 24 b9 e8 03 00 00 48 89 df
> > 48 f7 e5 <48> f7 f1 49 03 85 f8 01 00 00 49 89 c7 e8 78 e0 ff ff ba ff
> > ff ff
> > [ 1979.735301] RSP: 0018:ffffadf9c2484dc0 EFLAGS: 00010847
> > [ 1979.740527] RAX: ffffffffffffd8f0 RBX: ffff8f5486a99800 RCX: 00000000000003e8
> > [ 1979.747659] RDX: 000000000000270f RSI: 0000000000000001 RDI: ffff8f5486a99800
> > [ 1979.754793] RBP: 0000000000002710 R08: ffffffffffffffff R09: ffff8f565a67b818
> > [ 1979.761924] R10: ffff8f5486a99810 R11: ffff8f565a67b830 R12: 0000000000000001
> > [ 1979.769056] R13: ffff8f5486a99808 R14: 0000000000000001 R15: 0000000000000021
> > [ 1979.776190] FS: 0000000000000000(0000) GS:ffff8f5677d00000(0000)
> > knlGS:0000000000000000
> > [ 1979.784278] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> > [ 1979.790023] CR2: 00007f7db5443250 CR3: 0000000459420000 CR4: 0000000000350ee0
> > [ 1979.797155] Kernel panic - not syncing: Fatal exception in interrupt
> > [ 1979.805797] Kernel Offset: 0x30600000 from 0xffffffff81000000
> > (relocation range: 0xffffffff80000000-0xffffffffbfffffff)
> > [ 1979.835382] ---[ end Kernel panic - not syncing: Fatal exception in
> > interrupt ]---
> >
>
> Does v6.6-rc2 have this issue? v6.5?
>

v6.6-rc2 have this issue too,

[ 1987.693190] CPU: 8 PID: 0 Comm: swapper/8 Not tainted 6.6.0-rc2+ #1
[ 1987.699452] Hardware name: Dell Inc. PowerEdge R7525/0590KW, BIOS
2.6.6 01/13/2022
[ 1987.707022] RIP: 0010:throtl_trim_slice+0xc6/0x320
[ 1987.711821] Code: 00 00 48 89 e8 48 f7 f1 48 29 d5 74 9f 40 0f b6
f6 48 89 df 89 34 24 e8 f8 f5 ff ff 8b 34 24 b9 e8 03 00 00 48 89 df
48 f7 e5 <48> f7 f1 49 03 85 f8 01 00 00 49 89 c7 e8 78 e0 ff ff ba ff
ff ff
[ 1987.730568] RSP: 0018:ffffa2be407e8dc0 EFLAGS: 00010847
[ 1987.735792] RAX: ffffffffffffd8f0 RBX: ffff8f6e85ad5800 RCX: 00000000000003e8
[ 1987.742927] RDX: 000000000000270f RSI: 0000000000000001 RDI: ffff8f6e85ad5800
[ 1987.750058] RBP: 0000000000002710 R08: ffffffffffffffff R09: ffff8f6e85735018
[ 1987.757191] R10: ffff8f6e85ad5810 R11: ffff8f6e85735030 R12: 0000000000000001
[ 1987.764323] R13: ffff8f6e85ad5808 R14: 0000000000000001 R15: 0000000000000021
[ 1987.771458] FS: 0000000000000000(0000) GS:ffff8f7077a00000(0000)
knlGS:0000000000000000
[ 1987.779543] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1987.785290] CR2: 0000559c2e11aae0 CR3: 000000010aa8e000 CR4: 0000000000350ee0
[ 1987.792424] Call Trace:
[ 1987.794877] <IRQ>
[ 1987.796898] ? die+0x33/0x90
[ 1987.799782] ? do_trap+0xe0/0x110
[ 1987.803101] ? throtl_trim_slice+0xc6/0x320
[ 1987.807289] ? do_error_trap+0x65/0x80
[ 1987.811040] ? throtl_trim_slice+0xc6/0x320
[ 1987.815226] ? exc_divide_error+0x36/0x50
[ 1987.819239] ? throtl_trim_slice+0xc6/0x320
[ 1987.823426] ? asm_exc_divide_error+0x16/0x20
[ 1987.827790] ? throtl_trim_slice+0xc6/0x320
[ 1987.831982] tg_dispatch_one_bio+0xf0/0x1e0
[ 1987.836167] throtl_pending_timer_fn+0x1e5/0x510
[ 1987.840786] ? __pfx_throtl_pending_timer_fn+0x10/0x10
[ 1987.845924] ? __pfx_throtl_pending_timer_fn+0x10/0x10
[ 1987.851063] call_timer_fn+0x27/0x130
[ 1987.854730] __run_timers.part.0+0x1ee/0x280
[ 1987.859004] ? srso_return_thunk+0x5/0x10
[ 1987.863014] ? __hrtimer_run_queues+0x121/0x2b0
[ 1987.867548] ? srso_return_thunk+0x5/0x10
[ 1987.871559] ? srso_return_thunk+0x5/0x10
[ 1987.875574] ? srso_return_thunk+0x5/0x10
[ 1987.879586] run_timer_softirq+0x26/0x50
[ 1987.883513] __do_softirq+0xcb/0x2ab
[ 1987.887093] __irq_exit_rcu+0xa1/0xc0
[ 1987.890756] sysvec_apic_timer_interrupt+0x72/0x90
[ 1987.895550] </IRQ>
[ 1987.897656] <TASK>
[ 1987.899763] asm_sysvec_apic_timer_interrupt+0x16/0x20
[ 1987.904902] RIP: 0010:mwait_idle+0x4f/0x70
[ 1987.909002] Code: 31 d2 48 89 d1 65 48 8b 04 25 c0 18 03 00 0f 01
c8 48 8b 00 a8 08 75 13 eb 07 0f 00 2d 96 03 37 00 31 c0 48 89 c1 fb
0f 01 c9 <fa> 65 48 8b 04 25 c0 18 03 00 f0 80 60 02 df e9 6d 3f 01 00
0f ae
[ 1987.927747] RSP: 0018:ffffa2be402f7ed0 EFLAGS: 00000246
[ 1987.932972] RAX: 0000000000000000 RBX: ffff8f6e80120000 RCX: 0000000000000000
[ 1987.940104] RDX: 0000000000000000 RSI: 0000000000000087 RDI: 0000000000168424
[ 1987.947237] RBP: 0000000000000000 R08: ffff8f7077a22ac0 R09: 0000000000000000
[ 1987.954372] R10: 0000000000000400 R11: 0000000000000000 R12: 0000000000000000
[ 1987.961505] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
[ 1987.968640] default_idle_call+0x28/0xd0
[ 1987.972563] cpuidle_idle_call+0x125/0x160
[ 1987.976662] ? sched_clock_cpu+0xb/0x190
[ 1987.980588] do_idle+0x7b/0xe0
[ 1987.983650] cpu_startup_entry+0x26/0x30
[ 1987.987575] start_secondary+0x115/0x140
[ 1987.991501] secondary_startup_64_no_verify+0x17d/0x18b
[ 1987.996733] </TASK>
[ 1987.998920] Modules linked in: binfmt_misc dm_crypt raid10 raid1
raid0 dm_raid raid456 async_raid6_recov async_memcpy async_pq
async_xor xor async_tx raid6_pq loop rfkill sunrpc dm_multipath
ipmi_ssif intel_rapl_msr intel_rapl_common amd64_edac edac_mce_amd
kvm_amd kvm mgag200 dcdbas i2c_algo_bit acpi_ipmi drm_shmem_helper
ipmi_si irqbypass dell_smbios drm_kms_helper ipmi_devintf rapl
wmi_bmof dell_wmi_descriptor pcspkr i2c_piix4 ptdma k10temp
ipmi_msghandler acpi_power_meter drm fuse xfs libcrc32c sd_mod t10_pi
sg ahci libahci crct10dif_pclmul crc32_pclmul crc32c_intel libata
ghash_clmulni_intel tg3 ccp sp5100_tco wmi dm_mirror dm_region_hash
dm_log dm_mod [last unloaded: scsi_debug]
[ 1988.059529] ---[ end trace 0000000000000000 ]---
[ 1988.092310] RIP: 0010:throtl_trim_slice+0xc6/0x320
[ 1988.097106] Code: 00 00 48 89 e8 48 f7 f1 48 29 d5 74 9f 40 0f b6
f6 48 89 df 89 34 24 e8 f8 f5 ff ff 8b 34 24 b9 e8 03 00 00 48 89 df
48 f7 e5 <48> f7 f1 49 03 85 f8 01 00 00 49 89 c7 e8 78 e0 ff ff ba ff
ff ff
[ 1988.115854] RSP: 0018:ffffa2be407e8dc0 EFLAGS: 00010847
[ 1988.121078] RAX: ffffffffffffd8f0 RBX: ffff8f6e85ad5800 RCX: 00000000000003e8
[ 1988.128211] RDX: 000000000000270f RSI: 0000000000000001 RDI: ffff8f6e85ad5800
[ 1988.135345] RBP: 0000000000002710 R08: ffffffffffffffff R09: ffff8f6e85735018
[ 1988.142477] R10: ffff8f6e85ad5810 R11: ffff8f6e85735030 R12: 0000000000000001
[ 1988.149609] R13: ffff8f6e85ad5808 R14: 0000000000000001 R15: 0000000000000021
[ 1988.156741] FS: 0000000000000000(0000) GS:ffff8f7077a00000(0000)
knlGS:0000000000000000
[ 1988.164830] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1988.170574] CR2: 0000559c2e11aae0 CR3: 000000010aa8e000 CR4: 0000000000350ee0
[ 1988.177707] Kernel panic - not syncing: Fatal exception in interrupt
[ 1988.185995] Kernel Offset: 0x19400000 from 0xffffffff81000000
(relocation range: 0xffffffff80000000-0xffffffffbfffffff)
[ 1988.217854] pstore: backend (erst) writing error (-22)
[ 1988.222993] ---[ end Kernel panic - not syncing: Fatal exception in
interrupt ]---