On 2022/3/14 10:05, Oliver Sang wrote:
> Hi Qu,
>
> On Wed, Mar 09, 2022 at 04:42:41PM +0800, Qu Wenruo wrote:
>>
>>
>> On 2022/3/9 15:49, Oliver Sang wrote:
>>> Hi Qu,
>>>
>>> On Fri, Mar 04, 2022 at 03:26:19PM +0800, Qu Wenruo wrote:
>>>>
>>>>
>>>> On 2022/3/2 16:44, Oliver Sang wrote:
>>>>> Hi Qu,
>>>>>
>>>>> On Tue, Mar 01, 2022 at 03:47:38PM +0800, Qu Wenruo wrote:
>>>>>>
>>>>>>
>>>>>> This is weird, the code is from simple_stripe_full_stripe_len(), which
>>>>>> means the chunk map must be RAID0 or RAID10.
>>>>>>
>>>>>> In that case, their sub_stripes should be either 1 or 2, why we got 0 there?
>>>>>>
>>>>>> In fact, from volumes.c, all sub_stripes is from btrfs_raid_array[],
>>>>>> which all have either 1 or 2 sub_stripes.
>>>>>>
>>>>>>
>>>>>> Although the code is old, not the latest version, it should still not
>>>>>> cause such problem.
>>>>>>
>>>>>> Mind to retest with my branch to see if it can be reproduced?
>>>>>> https://github.com/adam900710/linux/tree/refactor_scrub
>>>>>
>>>>> we tested head of this branch:
>>>>> d6e3a8c42f2fad btrfs: scrub: rename scrub_bio::pagev and related members
>>>>> and:
>>>>> fdad4a9615f180 btrfs: introduce dedicated helper to scrub simple-stripe based range
>>>>> on this branch.
>>>>>
>>>>> by attached config.
>>>>>
>>>>> still reproduce the same issue.
>>>>>
>>>>> attached dmesgs FYI.
>>>>
>>>> Still failed to reproduce here.
>>>>
>>>> Those btrfs/07[0123] tests are already in scrub/replace group, thus I
>>>> ran them almost hourly during the development.
>>>>
>>>>
>>>> Although there are some ASSERT()s doing extra sanity checks, they should
>>>> not affect the result anyway.
>>>>
>>>> Thus I pushed a branch with more explicit BUG_ON()s to catch the
>>>> possible divide by zero bugs.
>>>> (https://github.com/adam900710/linux/tree/refactor_scrub_testing)
>>>>
>>>> Mind to give it a try?
>>>
>>>
>>> in our tests, it seems one BUG_ON you added is triggered
>>> (full dmesg attached):
>>
>> What the heck...
>>
>> It's indeed some weird extent mapping has its sub-stripes as 0...
>>
>> I must be insane or there is something fundamental wrong.
>>
>> Mind to try that branch again? I have updated the branch, now it will
>> trigger BUG_ON() as soon as it finds a chunk mapping with sub_stripes == 0.
>>
>> I'm wondering if it's old btrfs-progs involved (which may not properly
>> initialize btrfs_chunk::sub_stripes) now.
>
> below BUG print was caught by your new patch (detail dmesg attached):
Thank you very much for the detailed report!
The triggered BUG_ON() means, we're getting sub_stripes == 0, for
unrelated chunks (in this case, it's DUP from sys chunk array, from the
full dmesg).
And from the code context, it's from super-block, thus there must be
something wrong with the mkfs.btrfs.
But unfortunately, I re-compiled my btrfs-progs v5.15.1, retried, and
still no reproduce.
Mind to share the result of "btrfs ins dump-tree -t chunk /dev/sdb2" and
"btrfs ins dump-super -f /dev/sdb2" just after the mkfs.btrfs call of it?
As the BUG_ON() mostly means, the result from mkfs.btrfs is not correct.
Thanks,
Qu
>
> [ 44.577527][ T1980] ------------[ cut here ]------------
> [ 44.583552][ T335]
> [ 44.583990][ T337] 512+0 records out
> [ 44.583997][ T337]
> [ 44.593932][ T1980] kernel BUG at fs/btrfs/volumes.c:7157!
> [ 44.593940][ T1980] invalid opcode: 0000 [#1] SMP KASAN PTI
> [ 44.598832][ T335] Data: single 8.00MiB
> [ 44.603293][ T1980] CPU: 5 PID: 1980 Comm: mount Not tainted 5.17.0-rc4-00095-g7f159e82828e #1
> [ 44.603297][ T1980] Hardware name: Dell Inc. OptiPlex 9020/0DNKMN, BIOS A05 12/05/2013
> [ 44.603299][ T1980] RIP: 0010:read_one_chunk+0xa02/0xc80 [btrfs]
> [ 44.605509][ T335]
> [ 44.609168][ T1980] Code: 03 0f b6 14 02 4c 89 f0 83 e0 07 83 c0 03 38 d0 7c 08 84 d2 0f 85 14 01 00 00 48 8b 44 24 10 8b 50 1c 85 d2 0f 85 19 fb ff ff <0f> 0b 4c
> 89 c7 e8 f4 b0 fa ff 31 c0 e9 4d ff ff ff 48 8b 7c 24 78
> [ 44.609171][ T1980] RSP: 0018:ffffc90002be76c8 EFLAGS: 00010246
> [ 44.609175][ T1980] RAX: ffff888102c98e00 RBX: 0000000000000000 RCX: 0000000000000000
> [ 44.609178][ T1980] RDX: 0000000000000000 RSI: 0000000000000008 RDI: fffff5200057ce75
> [ 44.612227][ T335] Metadata: DUP 1.00GiB
> [ 44.616871][ T1980] RBP: 000000000000033c R08: 000000000000005e R09: ffffed1034dd6791
> [ 44.616873][ T1980] R10: ffff8881a6eb3c87 R11: ffffed1034dd6790 R12: ffff888214586b40
> [ 44.616874][ T1980] R13: ffff888102c98e18 R14: ffff888102c98e1c R15: 0000000000000022
> [ 44.616876][ T1980] FS: 00007fad1bd12100(0000) GS:ffff8881a6e80000(0000) knlGS:0000000000000000
> [ 44.622475][ T335]
> [ 44.628578][ T1980] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [ 44.628580][ T1980] CR2: 00007fff9d90df68 CR3: 00000001407fc003 CR4: 00000000001706e0
> [ 44.628583][ T1980] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [ 44.628585][ T1980] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
> [ 44.628588][ T1980] Call Trace:
> [ 44.638095][ T335] System: DUP 8.00MiB
> [ 44.645166][ T1980] <TASK>
> [ 44.645168][ T1980] ? _raw_spin_lock+0x81/0x100
> [ 44.651206][ T335]
> [ 44.653388][ T1980] ? _raw_spin_lock_bh+0x100/0x100
> [ 44.653395][ T1980] ? __raw_callee_save___native_queued_spin_unlock+0x11/0x1e
> [ 44.673370][ T335] SSD detected: no
> [ 44.678876][ T1980] ? add_missing_dev+0x3c0/0x3c0 [btrfs]
> [ 44.686756][ T335]
> [ 44.694598][ T1980] ? btrfs_get_token_64+0x700/0x700 [btrfs]
> [ 44.701187][ T335] Zoned device: no
> [ 44.708574][ T1980] ? memcpy+0x39/0x80
> [ 44.708581][ T1980] ? write_extent_buffer+0x192/0x240 [btrfs]
> [ 44.716449][ T335]
> [ 44.724294][ T1980] btrfs_read_sys_array+0x2c7/0x380 [btrfs]
> [ 44.734138][ T335] Incompat features: extref, skinny-metadata, no-holes
> [ 44.735313][ T1980] ? read_one_dev+0x13c0/0x13c0 [btrfs]
> [ 44.741786][ T335]
> [ 44.749628][ T1980] ? mutex_lock+0x80/0x100
> [ 44.749634][ T1980] ? __mutex_lock_slowpath+0x40/0x40
> [ 44.758164][ T335] Runtime features: free-space-tree
> [ 44.765352][ T1980] ? btrfs_init_workqueues+0x4c1/0x7ba [btrfs]
> [ 44.768515][ T335]
> [ 44.774620][ T1980] open_ctree+0x16ac/0x2656 [btrfs]
> [ 44.777966][ T335] Checksum: crc32c
> [ 44.782064][ T1980] btrfs_mount_root.cold+0x13/0x192 [btrfs]
> [ 44.784268][ T335]
> [ 44.789241][ T1980] ? arch_stack_walk+0x9e/0x100
> [ 44.789247][ T1980] ? parse_rescue_options+0x300/0x300 [btrfs]
> [ 44.796977][ T335] Number of devices: 1
> [ 44.800614][ T1980] ? vfs_parse_fs_param_source+0x3b/0x1c0
> [ 44.806131][ T335]
> [ 44.808314][ T1980] ? legacy_parse_param+0x6a/0x7c0
> [ 44.808320][ T1980] ? parse_rescue_options+0x300/0x300 [btrfs]
> [ 44.814273][ T335] Devices:
> [ 44.818205][ T1980] legacy_get_tree+0xef/0x200
> [ 44.818210][ T1980] vfs_get_tree+0x84/0x2c0
> [ 44.822077][ T335]
> [ 44.827928][ T1980] fc_mount+0xf/0x80
> [ 44.827934][ T1980] vfs_kern_mount+0x71/0xc0
> [ 44.830557][ T335] ID SIZE PATH
> [ 44.835890][ T1980] btrfs_mount+0x1fc/0xa40 [btrfs]
> [ 44.842730][ T335]
> [ 44.848134][ T1980] ? kasan_save_stack+0x1e/0x40
> [ 44.848149][ T1980] ? kasan_set_track+0x21/0x40
> [ 44.850862][ T335] 1 300.00GiB /dev/sdb4
> [ 44.854618][ T1980] ? kasan_set_free_info+0x20/0x40
> [ 44.854624][ T1980] ? btrfs_show_options+0xf00/0xf00 [btrfs]
> [ 44.859803][ T335]
> [ 44.865032][ T1980] ? __x64_sys_mount+0x12c/0x1c0
> [ 44.865036][ T1980] ? entry_SYSCALL_64_after_hwframe+0x44/0xae
> [ 44.871101][ T335]
> [ 44.873263][ T1980] ? terminate_walk+0x203/0x4c0
> [ 44.873268][ T1980] ? vfs_parse_fs_param_source+0x3b/0x1c0
> [ 44.878354][ T335]
> [ 44.882803][ T1980] ? legacy_parse_param+0x6a/0x7c0
> [ 44.882808][ T1980] ? vfs_parse_fs_string+0xd7/0x140
> [ 44.889280][ T335] 2022-03-14 01:34:21 mkdir -p /fs/sdb1
> [ 44.890770][ T1980] ? btrfs_show_options+0xf00/0xf00 [btrfs]
> [ 44.895501][ T335]
> [ 44.901430][ T1980] ? legacy_get_tree+0xef/0x200
> [ 44.901435][ T1980] legacy_get_tree+0xef/0x200
> [ 44.901448][ T1980] ? security_capable+0x56/0xc0
> [ 44.905612][ T335] btrfs
> [ 44.911057][ T1980] vfs_get_tree+0x84/0x2c0
> [ 44.911062][ T1980] ? ns_capable_common+0x57/0x100
> [ 44.913278][ T335]
> [ 44.918247][ T1980] path_mount+0x7fc/0x1a40
> [ 44.918252][ T1980] ? kasan_set_track+0x21/0x40
> [ 44.925201][ T335] 2022-03-14 01:34:21 mount -t btrfs /dev/sdb1 /fs/sdb1
> [ 44.927087][ T1980] ? finish_automount+0x600/0x600
> [ 44.927092][ T1980] ? kmem_cache_free+0xa1/0x400
> [ 44.931642][ T335]
> [ 44.935926][ T1980] do_mount+0xca/0x100
> [ 44.935931][ T1980] ? path_mount+0x1a40/0x1a40
> [ 44.935933][ T1980] ? _copy_from_user+0x94/0x100
> [ 44.938799][ T335] 2022-03-14 01:34:21 mkdir -p /fs/sdb2
> [ 44.941885][ T1980] ? memdup_user+0x4e/0x80
> [ 44.941890][ T1980] __x64_sys_mount+0x12c/0x1c0
> [ 44.941893][ T1980] do_syscall_64+0x3b/0xc0
> [ 44.946884][ T335]
> [ 44.951068][ T1980] entry_SYSCALL_64_after_hwframe+0x44/0xae
> [ 44.951074][ T1980] RIP: 0033:0x7fad1bf10fea
> [ 44.951077][ T1980] Code: 48 8b 0d a9 0e 0c 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 49 89 ca b8 a5 00 00 00 0f 05 <48> 3d 01
> f0 ff ff 73 01 c3 48 8b 0d 76 0e 0c 00 f7 d8 64 89 01 48
> [ 44.956197][ T335] btrfs
> [ 44.958245][ T1980] RSP: 002b:00007fff9d90f878 EFLAGS: 00000246 ORIG_RAX: 00000000000000a5
> [ 44.958249][ T1980] RAX: ffffffffffffffda RBX: 00005628efc57970 RCX: 00007fad1bf10fea
> [ 44.958251][ T1980] RDX: 00005628efc57b80 RSI: 00005628efc57bc0 RDI: 00005628efc57ba0
> [ 44.958263][ T1980] RBP: 00007fad1c25e1c4 R08: 0000000000000000 R09: 00005628efc5a890
> [ 44.958264][ T1980] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
> [ 44.962993][ T335]
> [ 44.967613][ T1980] R13: 0000000000000000 R14: 00005628efc57ba0 R15: 00005628efc57b80
> [ 44.967616][ T1980] </TASK>
> [ 44.967617][ T1980] Modules linked in: dm_mod btrfs blake2b_generic xor raid6_pq
> [ 44.973257][ T335] 2022-03-14 01:34:21 mount -t btrfs /dev/sdb2 /fs/sdb2
> [ 44.977243][ T1980] zstd_compress libcrc32c sd_mod t10_pi sg
> [ 44.983019][ T335]
> [ 44.985203][ T1980] ipmi_devintf ata_generic ipmi_msghandler intel_rapl_msr intel_rapl_common x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel
> [ 44.990720][ T335] 2022-03-14 01:34:21 mkdir -p /fs/sdb3
> [ 44.995962][ T1980] i915 kvm intel_gtt ttm drm_kms_helper irqbypass crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel syscopyarea sysfillrect
> [ 44.998174][ T335]
> [ 45.002882][ T1980] sysimgblt rapl mei_wdt fb_sys_fops ata_piix intel_cstate libata drm mei_me mei intel_uncore video ip_tables
> [ 45.002919][ T1980] ---[ end trace 0000000000000000 ]---
>
>
>>
>> Thanks,
>> Qu
>>
>>>
>>>
>>> [ 75.279958][ T3602] ------------[ cut here ]------------
>>> [ 75.285221][ T3602] kernel BUG at fs/btrfs/scrub.c:3387!
>>> [ 75.290490][ T3602] invalid opcode: 0000 [#1] SMP KASAN PTI
>>> [ 75.296010][ T3602] CPU: 2 PID: 3602 Comm: btrfs Not tainted 5.17.0-rc4-00095-g6b837d4c40d5 #1
>>> [ 75.304521][ T3602] Hardware name: Dell Inc. OptiPlex 9020/0DNKMN, BIOS A05 12/05/2013
>>> [ 75.312344][ T3602] RIP: 0010:scrub_stripe+0xed3/0x1340 [btrfs]
>>> [ 75.318250][ T3602] Code: 90 00 00 00 e8 0e f9 96 c0 e9 98 f3 ff ff e8 c4 f9 96 c0 e9 26 f3 ff ff 48 8b bc 24 80 00 00 00 e8 f2 f8 96 c0 e9 3b f4 ff ff <0f> 0b 0f
>>> 0b 4c 8d a4 24 b8 01 00 00 31 f6 4c 8d bd 20 02 00 00 4c
>>> [ 75.337480][ T3602] RSP: 0018:ffffc9000b47f550 EFLAGS: 00010246
>>> [ 75.343340][ T3602] RAX: 0000000000000007 RBX: ffff88810231d600 RCX: ffff88810231d61c
>>> [ 75.351074][ T3602] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff8881023a2458
>>> [ 75.358807][ T3602] RBP: ffff8881097ad800 R08: 0000000000000001 R09: ffffed102828100d
>>> [ 75.366550][ T3602] R10: ffff888141408063 R11: ffffed102828100c R12: 0000000000000000
>>> [ 75.374282][ T3602] R13: 0000000000100000 R14: ffff888141408000 R15: ffff888129c9c000
>>> [ 75.382016][ T3602] FS: 00007f94c24ec8c0(0000) GS:ffff8881a6d00000(0000) knlGS:0000000000000000
>>> [ 75.390691][ T3602] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>>> [ 75.397054][ T3602] CR2: 00007ffe454aa8e8 CR3: 000000020a796004 CR4: 00000000001706e0
>>> [ 75.404785][ T3602] Call Trace:
>>> [ 75.407886][ T3602] <TASK>
>>> [ 75.410645][ T3602] ? btrfs_wait_ordered_extents+0x9a1/0xe40 [btrfs]
>>> [ 75.417049][ T3602] ? scrub_raid56_parity+0x5c0/0x5c0 [btrfs]
>>> [ 75.422853][ T3602] ? btrfs_remove_ordered_extent+0xbc0/0xbc0 [btrfs]
>>> [ 75.429341][ T3602] ? mutex_unlock+0x80/0x100
>>> [ 75.433733][ T3602] ? __wake_up_common_lock+0xe3/0x140
>>> [ 75.438897][ T3602] ? __lookup_extent_mapping+0x215/0x300 [btrfs]
>>> [ 75.445037][ T3602] scrub_chunk+0x294/0x480 [btrfs]
>>> [ 75.449984][ T3602] scrub_enumerate_chunks+0x643/0x1340 [btrfs]
>>> [ 75.455962][ T3602] ? scrub_chunk+0x480/0x480 [btrfs]
>>> [ 75.461083][ T3602] ? __scrub_blocked_if_needed+0xb9/0x200 [btrfs]
>>> [ 75.467317][ T3602] ? scrub_checksum_data+0x4c0/0x4c0 [btrfs]
>>> [ 75.473121][ T3602] ? down_read+0x137/0x240
>>> [ 75.477339][ T3602] ? mutex_unlock+0x80/0x100
>>> [ 75.481726][ T3602] ? __mutex_unlock_slowpath+0x300/0x300
>>> [ 75.487743][ T3602] ? btrfs_find_device+0xac/0x240 [btrfs]
>>> [ 75.493285][ T3602] btrfs_scrub_dev+0x535/0xc00 [btrfs]
>>> [ 75.498578][ T3602] ? scrub_enumerate_chunks+0x1340/0x1340 [btrfs]
>>> [ 75.504812][ T3602] ? btrfs_apply_pending_changes+0x80/0x80 [btrfs]
>>> [ 75.511120][ T3602] ? btrfs_record_root_in_trans+0x4d/0x180 [btrfs]
>>> [ 75.517428][ T3602] ? finish_wait+0x280/0x280
>>> [ 75.521819][ T3602] btrfs_dev_replace_by_ioctl.cold+0x62c/0x720 [btrfs]
>>> [ 75.528483][ T3602] ? btrfs_finish_block_group_to_copy+0x3c0/0x3c0 [btrfs]
>>> [ 75.535440][ T3602] ? __raw_callee_save___native_queued_spin_unlock+0x11/0x1e
>>> [ 75.542575][ T3602] btrfs_ioctl+0x37ee/0x51c0 [btrfs]
>>> [ 75.547691][ T3602] ? fput_many+0xaa/0x140
>>> [ 75.551823][ T3602] ? filp_close+0xef/0x140
>>> [ 75.556041][ T3602] ? __x64_sys_close+0x2d/0x80
>>> [ 75.560600][ T3602] ? do_syscall_64+0x3b/0xc0
>>> [ 75.564991][ T3602] ? entry_SYSCALL_64_after_hwframe+0x44/0xae
>>> [ 75.570838][ T3602] ? btrfs_ioctl_get_supported_features+0x40/0x40 [btrfs]
>>> [ 75.577756][ T3602] ? _raw_spin_lock_irq+0x82/0xd2
>>> [ 75.582572][ T3602] ? _raw_spin_lock+0x100/0x100
>>> [ 75.587218][ T3602] ? fiemap_prep+0x200/0x200
>>> [ 75.591607][ T3602] ? lockref_put_or_lock+0xc4/0x1c0
>>> [ 75.596600][ T3602] ? do_sigaction+0x4b3/0x840
>>> [ 75.601075][ T3602] ? __x64_sys_pidfd_send_signal+0x600/0x600
>>> [ 75.606837][ T3602] ? __might_fault+0x4d/0x80
>>> [ 75.611226][ T3602] ? __x64_sys_rt_sigaction+0x1d0/0x240
>>> [ 75.616558][ T3602] ? __ia32_sys_signal+0x140/0x140
>>> [ 75.621461][ T3602] ? __fget_light+0x57/0x540
>>> [ 75.625854][ T3602] __x64_sys_ioctl+0x127/0x1c0
>>> [ 75.630414][ T3602] do_syscall_64+0x3b/0xc0
>>> [ 75.634633][ T3602] entry_SYSCALL_64_after_hwframe+0x44/0xae
>>> [ 75.640307][ T3602] RIP: 0033:0x7f94c25df427
>>> [ 75.644533][ T3602] Code: 00 00 90 48 8b 05 69 aa 0c 00 64 c7 00 26 00 00 00 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 b8 10 00 00 00 0f 05 <48> 3d 01
>>> f0 ff ff 73 01 c3 48 8b 0d 39 aa 0c 00 f7 d8 64 89 01 48
>>> [ 75.663771][ T3602] RSP: 002b:00007ffd06a4acc8 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
>>> [ 75.671937][ T3602] RAX: ffffffffffffffda RBX: 000055d51e9f72a0 RCX: 00007f94c25df427
>>> [ 75.679671][ T3602] RDX: 00007ffd06a4b108 RSI: 00000000ca289435 RDI: 0000000000000004
>>> [ 75.687404][ T3602] RBP: 00000000ffffffff R08: 0000000000000000 R09: 000055d51e9fa580
>>> [ 75.695137][ T3602] R10: 0000000000000008 R11: 0000000000000246 R12: 00007ffd06a4e97a
>>> [ 75.702868][ T3602] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000005
>>> [ 75.710600][ T3602] </TASK>
>>> [ 75.713445][ T3602] Modules linked in: dm_mod btrfs blake2b_generic xor raid6_pq zstd_compress libcrc32c sd_mod t10_pi sg ata_generic ipmi_devintf ipmi_msghandler
>>> intel_rapl_msr intel_rapl_common x86_pkg_temp_thermal intel_powerclamp coretemp i915 kvm_intel kvm intel_gtt ttm irqbypass crct10dif_pclmul crc32_pclmul crc32c_intel
>>> ghash_clmulni_intel drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops rapl ata_piix mei_wdt intel_cstate drm libata mei_me intel_uncore mei video ip_tables
>>> [ 75.756460][ T3602] ---[ end trace 0000000000000000 ]---
>>>
>>>
>>>>
>>>> Thanks,
>>>> Qu
>>>>
Hi Qu,
On 3/14/2022 10:24, Qu Wenruo wrote:
>
>
> On 2022/3/14 10:05, Oliver Sang wrote:
>> Hi Qu,
>>
>> On Wed, Mar 09, 2022 at 04:42:41PM +0800, Qu Wenruo wrote:
>>>
>>>
>>> On 2022/3/9 15:49, Oliver Sang wrote:
>>>> Hi Qu,
>>>>
>>>> On Fri, Mar 04, 2022 at 03:26:19PM +0800, Qu Wenruo wrote:
>>>>>
>>>>>
>>>>> On 2022/3/2 16:44, Oliver Sang wrote:
>>>>>> Hi Qu,
>>>>>>
>>>>>> On Tue, Mar 01, 2022 at 03:47:38PM +0800, Qu Wenruo wrote:
>>>>>>>
>>>>>>>
>>>>>>> This is weird, the code is from simple_stripe_full_stripe_len(), which
>>>>>>> means the chunk map must be RAID0 or RAID10.
>>>>>>>
>>>>>>> In that case, their sub_stripes should be either 1 or 2, why we got 0 there?
>>>>>>>
>>>>>>> In fact, from volumes.c, all sub_stripes is from btrfs_raid_array[],
>>>>>>> which all have either 1 or 2 sub_stripes.
>>>>>>>
>>>>>>>
>>>>>>> Although the code is old, not the latest version, it should still not
>>>>>>> cause such problem.
>>>>>>>
>>>>>>> Mind to retest with my branch to see if it can be reproduced?
>>>>>>> https://github.com/adam900710/linux/tree/refactor_scrub
>>>>>>
>>>>>> we tested head of this branch:
>>>>>> d6e3a8c42f2fad btrfs: scrub: rename scrub_bio::pagev and related members
>>>>>> and:
>>>>>> fdad4a9615f180 btrfs: introduce dedicated helper to scrub simple-stripe based range
>>>>>> on this branch.
>>>>>>
>>>>>> by attached config.
>>>>>>
>>>>>> still reproduce the same issue.
>>>>>>
>>>>>> attached dmesgs FYI.
>>>>>
>>>>> Still failed to reproduce here.
>>>>>
>>>>> Those btrfs/07[0123] tests are already in scrub/replace group, thus I
>>>>> ran them almost hourly during the development.
>>>>>
>>>>>
>>>>> Although there are some ASSERT()s doing extra sanity checks, they should
>>>>> not affect the result anyway.
>>>>>
>>>>> Thus I pushed a branch with more explicit BUG_ON()s to catch the
>>>>> possible divide by zero bugs.
>>>>> (https://github.com/adam900710/linux/tree/refactor_scrub_testing)
>>>>>
>>>>> Mind to give it a try?
>>>>
>>>>
>>>> in our tests, it seems one BUG_ON you added is triggered
>>>> (full dmesg attached):
>>>
>>> What the heck...
>>>
>>> It's indeed some weird extent mapping has its sub-stripes as 0...
>>>
>>> I must be insane or there is something fundamental wrong.
>>>
>>> Mind to try that branch again? I have updated the branch, now it will
>>> trigger BUG_ON() as soon as it finds a chunk mapping with sub_stripes == 0.
>>>
>>> I'm wondering if it's old btrfs-progs involved (which may not properly
>>> initialize btrfs_chunk::sub_stripes) now.
>>
>> below BUG print was caught by your new patch (detail dmesg attached):
>
> Thank you very much for the detailed report!
>
> The triggered BUG_ON() means, we're getting sub_stripes == 0, for
> unrelated chunks (in this case, it's DUP from sys chunk array, from the
> full dmesg).
>
> And from the code context, it's from super-block, thus there must be
> something wrong with the mkfs.btrfs.
>
> But unfortunately, I re-compiled my btrfs-progs v5.15.1, retried, and
> still no reproduce.
>
> Mind to share the result of "btrfs ins dump-tree -t chunk /dev/sdb2" and
> "btrfs ins dump-super -f /dev/sdb2" just after the mkfs.btrfs call of it?
>
> As the BUG_ON() mostly means, the result from mkfs.btrfs is not correct.
We have added the "btrfs ins dump" commands after mkfs btrfs call, and got below log:
(full dmesg attached)
[ 83.859614][ T337] 2022-03-17 03:28:07 ~~~~~~~~~~~~~~ /dev/sdb2 start ~~~~~~~~~~~~~~
[ 83.859620][ T337]
[ 83.870522][ T337] 2022-03-17 03:28:07 mkfs -t btrfs /dev/sdb2
[ 83.870528][ T337]
[ 84.160841][ T1446] BTRFS: device fsid 3f698242-c4db-4b90-9aef-804b56f2bb6e devid 1 transid 6 /dev/sdb2 scanned by mkfs.btrfs (1446)
[ 84.173707][ T337] btrfs-progs v5.15.1
[ 84.173714][ T337]
[ 84.180774][ T337] See http://btrfs.wiki.kernel.org for more information.
[ 84.180781][ T337]
[ 84.189916][ T337]
[ 84.189930][ T337]
[ 84.195706][ T337] NOTE: several default settings have changed in version 5.15, please make sure
[ 84.195712][ T337]
[ 84.207588][ T337] this does not affect your deployments:
[ 84.207594][ T337]
[ 84.216415][ T337] - DUP for metadata (-m dup)
[ 84.216420][ T337]
[ 84.224369][ T337] - enabled no-holes (-O no-holes)
[ 84.224374][ T337]
[ 84.233011][ T337] - enabled free-space-tree (-R free-space-tree)
[ 84.233017][ T337]
[ 84.241956][ T337]
[ 84.241961][ T337]
[ 84.246811][ T337] Label: (null)
[ 84.246817][ T337]
[ 84.254487][ T337] UUID: 3f698242-c4db-4b90-9aef-804b56f2bb6e
[ 84.254493][ T337]
[ 84.264219][ T337] Node size: 16384
[ 84.264224][ T337]
[ 84.271244][ T337] Sector size: 4096
[ 84.271250][ T337]
[ 84.278261][ T337] Filesystem size: 300.00GiB
[ 84.278266][ T337]
[ 84.285545][ T337] Block group profiles:
[ 84.285551][ T337]
[ 84.292560][ T337] Data: single 8.00MiB
[ 84.292566][ T337]
[ 84.301673][ T337] Metadata: DUP 1.00GiB
[ 84.301678][ T337]
[ 84.310792][ T337] System: DUP 8.00MiB
[ 84.310798][ T337]
[ 84.319517][ T337] SSD detected: no
[ 84.319523][ T337]
[ 84.326270][ T337] Zoned device: no
[ 84.326275][ T337]
[ 84.333495][ T337] Incompat features: extref, skinny-metadata, no-holes
[ 84.333500][ T337]
[ 84.343101][ T337] Runtime features: free-space-tree
[ 84.343107][ T337]
[ 84.350971][ T337] Checksum: crc32c
[ 84.350977][ T337]
[ 84.357993][ T337] Number of devices: 1
[ 84.357998][ T337]
[ 84.364376][ T337] Devices:
[ 84.364381][ T337]
[ 84.369859][ T337] ID SIZE PATH
[ 84.369864][ T337]
[ 84.376746][ T337] 1 300.00GiB /dev/sdb2
[ 84.376752][ T337]
[ 84.383603][ T337]
[ 84.383608][ T337]
[ 84.388521][ T337] 2022-03-17 03:28:08 sleep 10
[ 84.388526][ T337]
[ 94.181546][ T337] 2022-03-17 03:28:18 btrfs ins dump-tree -t chunk /dev/sdb2
[ 94.181556][ T337]
[ 94.215558][ T337] btrfs-progs v4.20.1
[ 94.215568][ T337]
[ 94.221902][ T337] chunk tree
[ 94.221908][ T337]
[ 94.228420][ T337] leaf 22036480 items 4 free space 15781 generation 6 owner CHUNK_TREE
[ 94.228425][ T337]
[ 94.239630][ T337] leaf 22036480 flags 0x1(WRITTEN) backref revision 1
[ 94.239636][ T337]
[ 94.249280][ T337] fs uuid 3f698242-c4db-4b90-9aef-804b56f2bb6e
[ 94.249286][ T337]
[ 94.258358][ T337] chunk uuid a7c33201-4d1f-44e0-8491-d386f70f1ac7
[ 94.258363][ T337]
[ 94.267903][ T337] item 0 key (DEV_ITEMS DEV_ITEM 1) itemoff 16185 itemsize 98
[ 94.267909][ T337]
[ 94.278519][ T337] devid 1 total_bytes 322122547200 bytes_used 2172649472
[ 94.278524][ T337]
[ 94.288713][ T337] io_align 4096 io_width 4096 sector_size 4096 type 0
[ 94.288718][ T337]
[ 94.298450][ T337] generation 0 start_offset 0 dev_group 0
[ 94.298455][ T337]
[ 94.306862][ T337] seek_speed 0 bandwidth 0
[ 94.306868][ T337]
[ 94.314295][ T337] uuid 2acf3fb5-c521-4863-99c0-2cccde7f72af
[ 94.314300][ T337]
[ 94.323221][ T337] fsid 3f698242-c4db-4b90-9aef-804b56f2bb6e
[ 94.323235][ T337]
[ 94.332728][ T337] item 1 key (FIRST_CHUNK_TREE CHUNK_ITEM 13631488) itemoff 16105 itemsize 80
[ 94.332733][ T337]
[ 94.344629][ T337] length 8388608 owner 2 stripe_len 65536 type DATA
[ 94.344635][ T337]
[ 94.354342][ T337] io_align 65536 io_width 65536 sector_size 4096
[ 94.354348][ T337]
[ 94.363469][ T337] num_stripes 1 sub_stripes 1
[ 94.363475][ T337]
[ 94.370987][ T337] stripe 0 devid 1 offset 13631488
[ 94.370993][ T337]
[ 94.379293][ T337] dev_uuid 2acf3fb5-c521-4863-99c0-2cccde7f72af
[ 94.379298][ T337]
[ 94.389332][ T337] item 2 key (FIRST_CHUNK_TREE CHUNK_ITEM 22020096) itemoff 15993 itemsize 112
[ 94.389337][ T337]
[ 94.401456][ T337] length 8388608 owner 2 stripe_len 65536 type SYSTEM|DUP
[ 94.401461][ T337]
[ 94.411651][ T337] io_align 65536 io_width 65536 sector_size 4096
[ 94.411657][ T337]
[ 94.420718][ T337] num_stripes 2 sub_stripes 1
[ 94.420723][ T337]
[ 94.428297][ T337] stripe 0 devid 1 offset 22020096
[ 94.428302][ T337]
[ 94.436583][ T337] dev_uuid 2acf3fb5-c521-4863-99c0-2cccde7f72af
[ 94.436588][ T337]
[ 94.445784][ T337] stripe 1 devid 1 offset 30408704
[ 94.445789][ T337]
[ 94.454060][ T337] dev_uuid 2acf3fb5-c521-4863-99c0-2cccde7f72af
[ 94.454066][ T337]
[ 94.463995][ T337] item 3 key (FIRST_CHUNK_TREE CHUNK_ITEM 30408704) itemoff 15881 itemsize 112
[ 94.464001][ T337]
[ 94.476279][ T337] length 1073741824 owner 2 stripe_len 65536 type METADATA|DUP
[ 94.476288][ T337]
[ 94.486957][ T337] io_align 65536 io_width 65536 sector_size 4096
[ 94.486963][ T337]
[ 94.496023][ T337] num_stripes 2 sub_stripes 1
[ 94.496029][ T337]
[ 94.503588][ T337] stripe 0 devid 1 offset 38797312
[ 94.503594][ T337]
[ 94.511891][ T337] dev_uuid 2acf3fb5-c521-4863-99c0-2cccde7f72af
[ 94.511897][ T337]
[ 94.521097][ T337] stripe 1 devid 1 offset 1112539136
[ 94.521102][ T337]
[ 94.529560][ T337] dev_uuid 2acf3fb5-c521-4863-99c0-2cccde7f72af
[ 94.529566][ T337]
[ 94.538649][ T337] 2022-03-17 03:28:18 sleep 10
[ 94.538654][ T337]
[ 104.223120][ T337] 2022-03-17 03:28:28 btrfs ins dump-super -f /dev/sdb2
[ 104.223129][ T337]
[ 104.232956][ T337] superblock: bytenr=65536, device=/dev/sdb2
[ 104.232962][ T337]
[ 104.242015][ T337] ---------------------------------------------------------
[ 104.242021][ T337]
[ 104.251907][ T337] csum_type 0 (crc32c)
[ 104.251912][ T337]
[ 104.258378][ T337] csum_size 4
[ 104.258383][ T337]
[ 104.264296][ T337] csum 0xe574a9d1 [match]
[ 104.264300][ T337]
[ 104.271125][ T337] bytenr 65536
[ 104.271130][ T337]
[ 104.276917][ T337] flags 0x1
[ 104.276922][ T337]
[ 104.282504][ T337] ( WRITTEN )
[ 104.282509][ T337]
[ 104.288568][ T337] magic _BHRfS_M [match]
[ 104.288573][ T337]
[ 104.295818][ T337] fsid 3f698242-c4db-4b90-9aef-804b56f2bb6e
[ 104.295823][ T337]
[ 104.304849][ T337] metadata_uuid 3f698242-c4db-4b90-9aef-804b56f2bb6e
[ 104.304854][ T337]
[ 104.313828][ T337] label
[ 104.313833][ T337]
[ 104.319132][ T337] generation 6
[ 104.319136][ T337]
[ 104.324922][ T337] root 30654464
[ 104.324927][ T337]
[ 104.330926][ T337] sys_array_size 129
[ 104.330931][ T337]
[ 104.337401][ T337] chunk_root_generation 6
[ 104.337406][ T337]
[ 104.344026][ T337] root_level 0
[ 104.344031][ T337]
[ 104.349877][ T337] chunk_root 22036480
[ 104.349882][ T337]
[ 104.356346][ T337] chunk_root_level 0
[ 104.356351][ T337]
[ 104.362501][ T337] log_root 0
[ 104.362506][ T337]
[ 104.368192][ T337] log_root_transid 0
[ 104.368197][ T337]
[ 104.374462][ T337] log_root_level 0
[ 104.374467][ T337]
[ 104.380741][ T337] total_bytes 322122547200
[ 104.380746][ T337]
[ 104.387601][ T337] bytes_used 196608
[ 104.387606][ T337]
[ 104.393820][ T337] sectorsize 4096
[ 104.393825][ T337]
[ 104.399864][ T337] nodesize 16384
[ 104.399869][ T337]
[ 104.406022][ T337] leafsize (deprecated) 16384
[ 104.406027][ T337]
[ 104.413112][ T337] stripesize 4096
[ 104.413117][ T337]
[ 104.419095][ T337] root_dir 6
[ 104.419099][ T337]
[ 104.424681][ T337] num_devices 1
[ 104.424686][ T337]
[ 104.430566][ T337] compat_flags 0x0
[ 104.430571][ T337]
[ 104.436779][ T337] compat_ro_flags 0x3
[ 104.436784][ T337]
[ 104.443332][ T337] ( FREE_SPACE_TREE |
[ 104.443337][ T337]
[ 104.450096][ T337] FREE_SPACE_TREE_VALID )
[ 104.450101][ T337]
[ 104.457309][ T337] incompat_flags 0x341
[ 104.457314][ T337]
[ 104.463873][ T337] ( MIXED_BACKREF |
[ 104.463878][ T337]
[ 104.470372][ T337] EXTENDED_IREF |
[ 104.470377][ T337]
[ 104.476866][ T337] SKINNY_METADATA |
[ 104.476871][ T337]
[ 104.483439][ T337] NO_HOLES )
[ 104.483444][ T337]
[ 104.489482][ T337] cache_generation 0
[ 104.489487][ T337]
[ 104.495818][ T337] uuid_tree_generation 0
[ 104.495823][ T337]
[ 104.503027][ T337] dev_item.uuid 2acf3fb5-c521-4863-99c0-2cccde7f72af
[ 104.503032][ T337]
[ 104.512859][ T337] dev_item.fsid 3f698242-c4db-4b90-9aef-804b56f2bb6e [match]
[ 104.512864][ T337]
[ 104.522669][ T337] dev_item.type 0
[ 104.522674][ T337]
[ 104.529015][ T337] dev_item.total_bytes 322122547200
[ 104.529020][ T337]
[ 104.536786][ T337] dev_item.bytes_used 2172649472
[ 104.536791][ T337]
[ 104.544214][ T337] dev_item.io_align 4096
[ 104.544227][ T337]
[ 104.550886][ T337] dev_item.io_width 4096
[ 104.550890][ T337]
[ 104.557600][ T337] dev_item.sector_size 4096
[ 104.557605][ T337]
[ 104.564490][ T337] dev_item.devid 1
[ 104.564495][ T337]
[ 104.570702][ T337] dev_item.dev_group 0
[ 104.570707][ T337]
[ 104.577224][ T337] dev_item.seek_speed 0
[ 104.577229][ T337]
[ 104.583769][ T337] dev_item.bandwidth 0
[ 104.583774][ T337]
[ 104.590288][ T337] dev_item.generation 0
[ 104.590293][ T337]
[ 104.596867][ T337] sys_chunk_array[2048]:
[ 104.596872][ T337]
[ 104.604027][ T337] item 0 key (FIRST_CHUNK_TREE CHUNK_ITEM 22020096)
[ 104.604032][ T337]
[ 104.613761][ T337] length 8388608 owner 2 stripe_len 65536 type SYSTEM|DUP
[ 104.613766][ T337]
[ 104.623962][ T337] io_align 65536 io_width 65536 sector_size 4096
[ 104.623967][ T337]
[ 104.633004][ T337] num_stripes 2 sub_stripes 1
[ 104.633008][ T337]
[ 104.640526][ T337] stripe 0 devid 1 offset 22020096
[ 104.640531][ T337]
[ 104.648803][ T337] dev_uuid 2acf3fb5-c521-4863-99c0-2cccde7f72af
[ 104.648808][ T337]
[ 104.657956][ T337] stripe 1 devid 1 offset 30408704
[ 104.657961][ T337]
[ 104.666236][ T337] dev_uuid 2acf3fb5-c521-4863-99c0-2cccde7f72af
[ 104.666241][ T337]
[ 104.675067][ T337] backup_roots[4]:
[ 104.675072][ T337]
[ 104.681035][ T337] backup 0:
[ 104.681040][ T337]
[ 104.687028][ T337] backup_tree_root: 30490624 gen: 5 level: 0
[ 104.687033][ T337]
[ 104.696005][ T337] backup_chunk_root: 22020096 gen: 5 level: 0
[ 104.696010][ T337]
[ 104.705091][ T337] backup_extent_root: 30507008 gen: 5 level: 0
[ 104.705096][ T337]
[ 104.714236][ T337] backup_fs_root: 30474240 gen: 5 level: 0
[ 104.714241][ T337]
[ 104.723079][ T337] backup_dev_root: 30523392 gen: 5 level: 0
[ 104.723084][ T337]
[ 104.731944][ T337] backup_csum_root: 30539776 gen: 5 level: 0
[ 104.731949][ T337]
[ 104.740749][ T337] backup_total_bytes: 322122547200
[ 104.740754][ T337]
[ 104.748608][ T337] backup_bytes_used: 196608
[ 104.748613][ T337]
[ 104.755736][ T337] backup_num_devices: 1
[ 104.755741][ T337]
[ 104.762131][ T337]
[ 104.762135][ T337]
[ 104.766687][ T337] backup 1:
[ 104.766692][ T337]
[ 104.772697][ T337] backup_tree_root: 30654464 gen: 6 level: 0
[ 104.772702][ T337]
[ 104.781702][ T337] backup_chunk_root: 22036480 gen: 6 level: 0
[ 104.781707][ T337]
[ 104.790822][ T337] backup_extent_root: 30408704 gen: 6 level: 0
[ 104.790827][ T337]
[ 104.799929][ T337] backup_fs_root: 30474240 gen: 5 level: 0
[ 104.799934][ T337]
[ 104.808842][ T337] backup_dev_root: 30425088 gen: 6 level: 0
[ 104.808847][ T337]
[ 104.817759][ T337] backup_csum_root: 30539776 gen: 5 level: 0
[ 104.817764][ T337]
[ 104.826590][ T337] backup_total_bytes: 322122547200
[ 104.826595][ T337]
[ 104.834424][ T337] backup_bytes_used: 196608
[ 104.834429][ T337]
[ 104.841566][ T337] backup_num_devices: 1
[ 104.841571][ T337]
[ 104.847961][ T337]
[ 104.847965][ T337]
[ 104.852537][ T337] backup 2:
[ 104.852542][ T337]
[ 104.858545][ T337] backup_tree_root: 5308416 gen: 3 level: 0
[ 104.858550][ T337]
[ 104.867455][ T337] backup_chunk_root: 1048576 gen: 3 level: 0
[ 104.867460][ T337]
[ 104.876485][ T337] backup_extent_root: 5275648 gen: 3 level: 0
[ 104.876490][ T337]
[ 104.885519][ T337] backup_fs_root: 5324800 gen: 3 level: 0
[ 104.885523][ T337]
[ 104.894298][ T337] backup_dev_root: 5259264 gen: 3 level: 0
[ 104.894303][ T337]
[ 104.903075][ T337] backup_csum_root: 1130496 gen: 1 level: 0
[ 104.903080][ T337]
[ 104.911786][ T337] backup_total_bytes: 322122547200
[ 104.911791][ T337]
[ 104.919634][ T337] backup_bytes_used: 114688
[ 104.919639][ T337]
[ 104.926750][ T337] backup_num_devices: 1
[ 104.926755][ T337]
[ 104.933181][ T337]
[ 104.933194][ T337]
[ 104.937748][ T337] backup 3:
[ 104.937753][ T337]
[ 104.943802][ T337] backup_tree_root: 30457856 gen: 4 level: 0
[ 104.943807][ T337]
[ 104.952813][ T337] backup_chunk_root: 1064960 gen: 4 level: 0
[ 104.952818][ T337]
[ 104.961824][ T337] backup_extent_root: 5341184 gen: 4 level: 0
[ 104.961829][ T337]
[ 104.970886][ T337] backup_fs_root: 5324800 gen: 3 level: 0
[ 104.970891][ T337]
[ 104.979687][ T337] backup_dev_root: 5242880 gen: 4 level: 0
[ 104.979692][ T337]
[ 104.988495][ T337] backup_csum_root: 1130496 gen: 1 level: 0
[ 104.988500][ T337]
[ 104.997229][ T337] backup_total_bytes: 322122547200
[ 104.997234][ T337]
[ 105.005037][ T337] backup_bytes_used: 163840
[ 105.005042][ T337]
[ 105.012209][ T337] backup_num_devices: 1
[ 105.012214][ T337]
[ 105.018623][ T337]
[ 105.018627][ T337]
[ 105.023017][ T337]
[ 105.023022][ T337]
[ 105.027867][ T337] 2022-03-17 03:28:28 sleep 10
[ 105.027872][ T337]
[ 114.237911][ T337] 2022-03-17 03:28:38 ~~~~~~~~~~~~~~ /dev/sdb2 end ~~~~~~~~~~~~~~
......
[ 237.925789][ T337] 2022-03-17 03:30:41 export TEST_DIR=/fs/sdb1
[ 237.925803][ T337]
[ 237.936048][ T337] 2022-03-17 03:30:41 export TEST_DEV=/dev/sdb1
[ 237.936060][ T337]
[ 237.945651][ T337] 2022-03-17 03:30:42 export FSTYP=btrfs
[ 237.945662][ T337]
[ 237.954997][ T337] 2022-03-17 03:30:42 export SCRATCH_MNT=/fs/scratch
[ 237.955008][ T337]
[ 237.965136][ T337] 2022-03-17 03:30:42 mkdir /fs/scratch -p
[ 237.965147][ T337]
[ 237.976340][ T337] 2022-03-17 03:30:42 export SCRATCH_DEV_POOL="/dev/sdb2 /dev/sdb3 /dev/sdb4 /dev/sdb5 /dev/sdb6"
[ 237.976352][ T337]
[ 237.990723][ T337] 2022-03-17 03:30:42 sed "s:^:btrfs/:" //lkp/benchmarks/xfstests/tests/btrfs-group-07
[ 237.990730][ T337]
[ 238.005026][ T337] 2022-03-17 03:30:42 ./check btrfs/070 btrfs/071 btrfs/072 btrfs/073 btrfs/074 btrfs/075 btrfs/076 btrfs/077 btrfs/078 btrfs/079
[ 238.005036][ T337]
[ 238.131570][ T1922] BTRFS info (device sdb1): flagging fs with big metadata feature
[ 238.139579][ T1922] BTRFS info (device sdb1): using free space tree
[ 238.145869][ T1922] BTRFS info (device sdb1): has skinny extents
[ 238.394777][ T337] FSTYP -- btrfs
[ 238.394787][ T337]
[ 238.407841][ T337] PLATFORM -- Linux/x86_64 lkp-hsw-d01 5.17.0-rc4-00095-g7f159e82828e #1 SMP Fri Mar 11 09:25:41 CST 2022
[ 238.407849][ T337]
[ 238.422205][ T337] MKFS_OPTIONS -- /dev/sdb2
[ 238.422213][ T337]
[ 238.429812][ T337] MOUNT_OPTIONS -- /dev/sdb2 /fs/scratch
[ 238.429820][ T337]
[ 238.437551][ T337]
[ 238.437556][ T337]
[ 238.509573][ T2041] BTRFS: device fsid 00974d0e-c70a-4d86-a40a-ad3675406027 devid 1 transid 5 /dev/sdb2 scanned by mkfs.btrfs (2041)
[ 238.543241][ T2052] BTRFS info (device sdb2): flagging fs with big metadata feature
[ 238.550999][ T2052] BTRFS info (device sdb2): disk space caching is enabled
[ 238.557986][ T2052] BTRFS info (device sdb2): has skinny extents
[ 238.565970][ T2052] BTRFS info (device sdb2): leaf 65536 gen 30556160 total ptrs 0 free space 16283 owner 22036480
[ 238.576361][ T2052] ------------[ cut here ]------------
[ 238.581694][ T2052] kernel BUG at fs/btrfs/volumes.c:7157!
[ 238.587222][ T2052] invalid opcode: 0000 [#1] SMP KASAN PTI
[ 238.592808][ T2052] CPU: 5 PID: 2052 Comm: mount Not tainted 5.17.0-rc4-00095-g7f159e82828e #1
[ 238.601424][ T2052] Hardware name: Dell Inc. OptiPlex 9020/0DNKMN, BIOS A05 12/05/2013
[ 238.609347][ T2052] RIP: 0010:read_one_chunk+0xa02/0xc80 [btrfs]
[ 238.615411][ T2052] Code: 03 0f b6 14 02 4c 89 f0 83 e0 07 83 c0 03 38 d0 7c 08 84 d2 0f 85 14 01 00 00 48 8b 44 24 10 8b 50 1c 85 d2 0f 85 19 fb ff ff <0f> 0b 4c 89 c7 e8 f4 b0 fa ff 31 c0 e9 4d ff ff ff 48 8b 7c 24 78
[ 238.634889][ T2052] RSP: 0018:ffffc900033cf6c8 EFLAGS: 00010246
[ 238.640817][ T2052] RAX: ffff8881028b2980 RBX: 0000000000000000 RCX: 0000000000000000
[ 238.648652][ T2052] RDX: 0000000000000000 RSI: 0000000000000008 RDI: fffff52000679e75
[ 238.656487][ T2052] RBP: 000000000000033c R08: 000000000000005e R09: ffffed1034dd6791
[ 238.661055][ T339] 512+0 records in
[ 238.664320][ T2052] R10: ffff8881a6eb3c87 R11: ffffed1034dd6790 R12: ffff88812830c500
[ 238.664322][ T2052] R13: ffff8881028b2998 R14: ffff8881028b299c R15: 0000000000000022
[ 238.664323][ T2052] FS: 00007f66fb9b4100(0000) GS:ffff8881a6e80000(0000) knlGS:0000000000000000
[ 238.664325][ T2052] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 238.664327][ T2052] CR2: 000055f0bbc19d40 CR3: 0000000209c0a005 CR4: 00000000001706e0
[ 238.667935][ T339]
[ 238.675758][ T2052] Call Trace:
[ 238.675761][ T2052] <TASK>
[ 238.675762][ T2052] ? _raw_spin_lock+0x81/0x100
[ 238.719432][ T2052] ? _raw_spin_lock_bh+0x100/0x100
[ 238.724404][ T2052] ? __raw_callee_save___native_queued_spin_unlock+0x11/0x1e
[ 238.731635][ T2052] ? add_missing_dev+0x3c0/0x3c0 [btrfs]
[ 238.731805][ T339] 512+0 records out
[ 238.737188][ T339]
[ 238.737177][ T2052] ? btrfs_get_token_64+0x700/0x700 [btrfs]
[ 238.748791][ T2052] ? memcpy+0x39/0x80
[ 238.752632][ T2052] ? write_extent_buffer+0x192/0x240 [btrfs]
[ 238.758510][ T2052] btrfs_read_sys_array+0x2c7/0x380 [btrfs]
[ 238.764301][ T2052] ? read_one_dev+0x13c0/0x13c0 [btrfs]
[ 238.769742][ T2052] ? mutex_lock+0x80/0x100
[ 238.774016][ T2052] ? __mutex_lock_slowpath+0x40/0x40
[ 238.779169][ T2052] ? btrfs_init_workqueues+0x4c1/0x7ba [btrfs]
[ 238.785244][ T2052] open_ctree+0x16ac/0x2656 [btrfs]
[ 238.790345][ T2052] btrfs_mount_root.cold+0x13/0x192 [btrfs]
[ 238.796139][ T2052] ? arch_stack_walk+0x9e/0x100
[ 238.800848][ T2052] ? parse_rescue_options+0x300/0x300 [btrfs]
[ 238.806803][ T2052] ? vfs_parse_fs_param_source+0x3b/0x1c0
[ 238.812382][ T2052] ? legacy_parse_param+0x6a/0x7c0
[ 238.817352][ T2052] ? parse_rescue_options+0x300/0x300 [btrfs]
[ 238.823313][ T2052] legacy_get_tree+0xef/0x200
[ 238.827848][ T2052] vfs_get_tree+0x84/0x2c0
[ 238.832122][ T2052] fc_mount+0xf/0x80
[ 238.835879][ T2052] vfs_kern_mount+0x71/0xc0
[ 238.840852][ T2052] btrfs_mount+0x1fc/0xa40 [btrfs]
[ 238.845864][ T2052] ? kasan_save_stack+0x1e/0x40
[ 238.850573][ T2052] ? kasan_set_track+0x21/0x40
[ 238.855202][ T2052] ? kasan_set_free_info+0x20/0x40
[ 238.860181][ T2052] ? btrfs_show_options+0xf00/0xf00 [btrfs]
[ 238.865988][ T2052] ? __x64_sys_mount+0x12c/0x1c0
[ 238.870784][ T2052] ? entry_SYSCALL_64_after_hwframe+0x44/0xae
[ 238.876709][ T2052] ? terminate_walk+0x203/0x4c0
[ 238.881415][ T2052] ? vfs_parse_fs_param_source+0x3b/0x1c0
[ 238.886993][ T2052] ? legacy_parse_param+0x6a/0x7c0
[ 238.891963][ T2052] ? vfs_parse_fs_string+0xd7/0x140
[ 238.897021][ T2052] ? btrfs_show_options+0xf00/0xf00 [btrfs]
[ 238.902809][ T2052] ? legacy_get_tree+0xef/0x200
[ 238.907519][ T2052] legacy_get_tree+0xef/0x200
[ 238.912051][ T2052] ? security_capable+0x56/0xc0
[ 238.916761][ T2052] vfs_get_tree+0x84/0x2c0
[ 238.921036][ T2052] ? ns_capable_common+0x57/0x100
[ 238.925921][ T2052] path_mount+0x7fc/0x1a40
[ 238.930205][ T2052] ? kasan_set_track+0x21/0x40
[ 238.934838][ T2052] ? finish_automount+0x600/0x600
[ 238.939722][ T2052] ? kmem_cache_free+0xa1/0x400
[ 238.944434][ T2052] do_mount+0xca/0x100
[ 238.948362][ T2052] ? path_mount+0x1a40/0x1a40
[ 238.952900][ T2052] ? _copy_from_user+0x94/0x100
[ 238.957609][ T2052] ? memdup_user+0x4e/0x80
[ 238.961886][ T2052] __x64_sys_mount+0x12c/0x1c0
[ 238.966510][ T2052] do_syscall_64+0x3b/0xc0
[ 238.970791][ T2052] entry_SYSCALL_64_after_hwframe+0x44/0xae
[ 238.976554][ T2052] RIP: 0033:0x7f66fbbb2fea
[ 238.980840][ T2052] Code: 48 8b 0d a9 0e 0c 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 49 89 ca b8 a5 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 76 0e 0c 00 f7 d8 64 89 01 48
[ 239.000318][ T2052] RSP: 002b:00007fffa196f178 EFLAGS: 00000246 ORIG_RAX: 00000000000000a5
[ 239.008593][ T2052] RAX: ffffffffffffffda RBX: 0000562feab9a970 RCX: 00007f66fbbb2fea
[ 239.016430][ T2052] RDX: 0000562feab9ab80 RSI: 0000562feab9abc0 RDI: 0000562feab9aba0
[ 239.024264][ T2052] RBP: 00007f66fbf001c4 R08: 0000000000000000 R09: 0000562feab9d890
[ 239.032108][ T2052] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
[ 239.039946][ T2052] R13: 0000000000000000 R14: 0000562feab9aba0 R15: 0000562feab9ab80
[ 239.047783][ T2052] </TASK>
[ 239.050664][ T2052] Modules linked in: dm_mod btrfs blake2b_generic xor raid6_pq zstd_compress libcrc32c sd_mod t10_pi sg ipmi_devintf ata_generic ipmi_msghandler intel_rapl_msr intel_rapl_common x86_pkg_temp_thermal intel_powerclamp coretemp i915 kvm_intel kvm intel_gtt ttm drm_kms_helper irqbypass crct10dif_pclmul crc32_pclmul crc32c_intel syscopyarea ghash_clmulni_intel sysfillrect mei_wdt sysimgblt fb_sys_fops ata_piix rapl intel_cstate mei_me drm libata mei intel_uncore video ip_tables
[ 239.094228][ T2052] ---[ end trace 0000000000000000 ]---
[ 239.099560][ T2052] RIP: 0010:read_one_chunk+0xa02/0xc80 [btrfs]
[ 239.105641][ T2052] Code: 03 0f b6 14 02 4c 89 f0 83 e0 07 83 c0 03 38 d0 7c 08 84 d2 0f 85 14 01 00 00 48 8b 44 24 10 8b 50 1c 85 d2 0f 85 19 fb ff ff <0f> 0b 4c 89 c7 e8 f4 b0 fa ff 31 c0 e9 4d ff ff ff 48 8b 7c 24 78
[ 239.125151][ T2052] RSP: 0018:ffffc900033cf6c8 EFLAGS: 00010246
[ 239.131117][ T2052] RAX: ffff8881028b2980 RBX: 0000000000000000 RCX: 0000000000000000
[ 239.138981][ T2052] RDX: 0000000000000000 RSI: 0000000000000008 RDI: fffff52000679e75
[ 239.146847][ T2052] RBP: 000000000000033c R08: 000000000000005e R09: ffffed1034dd6791
[ 239.154710][ T2052] R10: ffff8881a6eb3c87 R11: ffffed1034dd6790 R12: ffff88812830c500
[ 239.162579][ T2052] R13: ffff8881028b2998 R14: ffff8881028b299c R15: 0000000000000022
[ 239.170443][ T2052] FS: 00007f66fb9b4100(0000) GS:ffff8881a6e80000(0000) knlGS:0000000000000000
[ 239.179267][ T2052] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 239.185742][ T2052] CR2: 000055f0bbc19d40 CR3: 0000000209c0a005 CR4: 00000000001706e0
[ 239.193607][ T2052] Kernel panic - not syncing: Fatal exception
[ 239.199567][ T2052] Kernel Offset: disabled
>
> Thanks,
> Qu
>>
>> [ 44.577527][ T1980] ------------[ cut here ]------------
>> [ 44.583552][ T335]
>> [ 44.583990][ T337] 512+0 records out
>> [ 44.583997][ T337]
>> [ 44.593932][ T1980] kernel BUG at fs/btrfs/volumes.c:7157!
>> [ 44.593940][ T1980] invalid opcode: 0000 [#1] SMP KASAN PTI
>> [ 44.598832][ T335] Data: single 8.00MiB
>> [ 44.603293][ T1980] CPU: 5 PID: 1980 Comm: mount Not tainted 5.17.0-rc4-00095-g7f159e82828e #1
>> [ 44.603297][ T1980] Hardware name: Dell Inc. OptiPlex 9020/0DNKMN, BIOS A05 12/05/2013
>> [ 44.603299][ T1980] RIP: 0010:read_one_chunk+0xa02/0xc80 [btrfs]
>> [ 44.605509][ T335]
>> [ 44.609168][ T1980] Code: 03 0f b6 14 02 4c 89 f0 83 e0 07 83 c0 03 38 d0 7c 08 84 d2 0f 85 14 01 00 00 48 8b 44 24 10 8b 50 1c 85 d2 0f 85 19 fb ff ff <0f> 0b 4c
>> 89 c7 e8 f4 b0 fa ff 31 c0 e9 4d ff ff ff 48 8b 7c 24 78
>> [ 44.609171][ T1980] RSP: 0018:ffffc90002be76c8 EFLAGS: 00010246
>> [ 44.609175][ T1980] RAX: ffff888102c98e00 RBX: 0000000000000000 RCX: 0000000000000000
>> [ 44.609178][ T1980] RDX: 0000000000000000 RSI: 0000000000000008 RDI: fffff5200057ce75
>> [ 44.612227][ T335] Metadata: DUP 1.00GiB
>> [ 44.616871][ T1980] RBP: 000000000000033c R08: 000000000000005e R09: ffffed1034dd6791
>> [ 44.616873][ T1980] R10: ffff8881a6eb3c87 R11: ffffed1034dd6790 R12: ffff888214586b40
>> [ 44.616874][ T1980] R13: ffff888102c98e18 R14: ffff888102c98e1c R15: 0000000000000022
>> [ 44.616876][ T1980] FS: 00007fad1bd12100(0000) GS:ffff8881a6e80000(0000) knlGS:0000000000000000
>> [ 44.622475][ T335]
>> [ 44.628578][ T1980] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>> [ 44.628580][ T1980] CR2: 00007fff9d90df68 CR3: 00000001407fc003 CR4: 00000000001706e0
>> [ 44.628583][ T1980] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>> [ 44.628585][ T1980] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
>> [ 44.628588][ T1980] Call Trace:
>> [ 44.638095][ T335] System: DUP 8.00MiB
>> [ 44.645166][ T1980] <TASK>
>> [ 44.645168][ T1980] ? _raw_spin_lock+0x81/0x100
>> [ 44.651206][ T335]
>> [ 44.653388][ T1980] ? _raw_spin_lock_bh+0x100/0x100
>> [ 44.653395][ T1980] ? __raw_callee_save___native_queued_spin_unlock+0x11/0x1e
>> [ 44.673370][ T335] SSD detected: no
>> [ 44.678876][ T1980] ? add_missing_dev+0x3c0/0x3c0 [btrfs]
>> [ 44.686756][ T335]
>> [ 44.694598][ T1980] ? btrfs_get_token_64+0x700/0x700 [btrfs]
>> [ 44.701187][ T335] Zoned device: no
>> [ 44.708574][ T1980] ? memcpy+0x39/0x80
>> [ 44.708581][ T1980] ? write_extent_buffer+0x192/0x240 [btrfs]
>> [ 44.716449][ T335]
>> [ 44.724294][ T1980] btrfs_read_sys_array+0x2c7/0x380 [btrfs]
>> [ 44.734138][ T335] Incompat features: extref, skinny-metadata, no-holes
>> [ 44.735313][ T1980] ? read_one_dev+0x13c0/0x13c0 [btrfs]
>> [ 44.741786][ T335]
>> [ 44.749628][ T1980] ? mutex_lock+0x80/0x100
>> [ 44.749634][ T1980] ? __mutex_lock_slowpath+0x40/0x40
>> [ 44.758164][ T335] Runtime features: free-space-tree
>> [ 44.765352][ T1980] ? btrfs_init_workqueues+0x4c1/0x7ba [btrfs]
>> [ 44.768515][ T335]
>> [ 44.774620][ T1980] open_ctree+0x16ac/0x2656 [btrfs]
>> [ 44.777966][ T335] Checksum: crc32c
>> [ 44.782064][ T1980] btrfs_mount_root.cold+0x13/0x192 [btrfs]
>> [ 44.784268][ T335]
>> [ 44.789241][ T1980] ? arch_stack_walk+0x9e/0x100
>> [ 44.789247][ T1980] ? parse_rescue_options+0x300/0x300 [btrfs]
>> [ 44.796977][ T335] Number of devices: 1
>> [ 44.800614][ T1980] ? vfs_parse_fs_param_source+0x3b/0x1c0
>> [ 44.806131][ T335]
>> [ 44.808314][ T1980] ? legacy_parse_param+0x6a/0x7c0
>> [ 44.808320][ T1980] ? parse_rescue_options+0x300/0x300 [btrfs]
>> [ 44.814273][ T335] Devices:
>> [ 44.818205][ T1980] legacy_get_tree+0xef/0x200
>> [ 44.818210][ T1980] vfs_get_tree+0x84/0x2c0
>> [ 44.822077][ T335]
>> [ 44.827928][ T1980] fc_mount+0xf/0x80
>> [ 44.827934][ T1980] vfs_kern_mount+0x71/0xc0
>> [ 44.830557][ T335] ID SIZE PATH
>> [ 44.835890][ T1980] btrfs_mount+0x1fc/0xa40 [btrfs]
>> [ 44.842730][ T335]
>> [ 44.848134][ T1980] ? kasan_save_stack+0x1e/0x40
>> [ 44.848149][ T1980] ? kasan_set_track+0x21/0x40
>> [ 44.850862][ T335] 1 300.00GiB /dev/sdb4
>> [ 44.854618][ T1980] ? kasan_set_free_info+0x20/0x40
>> [ 44.854624][ T1980] ? btrfs_show_options+0xf00/0xf00 [btrfs]
>> [ 44.859803][ T335]
>> [ 44.865032][ T1980] ? __x64_sys_mount+0x12c/0x1c0
>> [ 44.865036][ T1980] ? entry_SYSCALL_64_after_hwframe+0x44/0xae
>> [ 44.871101][ T335]
>> [ 44.873263][ T1980] ? terminate_walk+0x203/0x4c0
>> [ 44.873268][ T1980] ? vfs_parse_fs_param_source+0x3b/0x1c0
>> [ 44.878354][ T335]
>> [ 44.882803][ T1980] ? legacy_parse_param+0x6a/0x7c0
>> [ 44.882808][ T1980] ? vfs_parse_fs_string+0xd7/0x140
>> [ 44.889280][ T335] 2022-03-14 01:34:21 mkdir -p /fs/sdb1
>> [ 44.890770][ T1980] ? btrfs_show_options+0xf00/0xf00 [btrfs]
>> [ 44.895501][ T335]
>> [ 44.901430][ T1980] ? legacy_get_tree+0xef/0x200
>> [ 44.901435][ T1980] legacy_get_tree+0xef/0x200
>> [ 44.901448][ T1980] ? security_capable+0x56/0xc0
>> [ 44.905612][ T335] btrfs
>> [ 44.911057][ T1980] vfs_get_tree+0x84/0x2c0
>> [ 44.911062][ T1980] ? ns_capable_common+0x57/0x100
>> [ 44.913278][ T335]
>> [ 44.918247][ T1980] path_mount+0x7fc/0x1a40
>> [ 44.918252][ T1980] ? kasan_set_track+0x21/0x40
>> [ 44.925201][ T335] 2022-03-14 01:34:21 mount -t btrfs /dev/sdb1 /fs/sdb1
>> [ 44.927087][ T1980] ? finish_automount+0x600/0x600
>> [ 44.927092][ T1980] ? kmem_cache_free+0xa1/0x400
>> [ 44.931642][ T335]
>> [ 44.935926][ T1980] do_mount+0xca/0x100
>> [ 44.935931][ T1980] ? path_mount+0x1a40/0x1a40
>> [ 44.935933][ T1980] ? _copy_from_user+0x94/0x100
>> [ 44.938799][ T335] 2022-03-14 01:34:21 mkdir -p /fs/sdb2
>> [ 44.941885][ T1980] ? memdup_user+0x4e/0x80
>> [ 44.941890][ T1980] __x64_sys_mount+0x12c/0x1c0
>> [ 44.941893][ T1980] do_syscall_64+0x3b/0xc0
>> [ 44.946884][ T335]
>> [ 44.951068][ T1980] entry_SYSCALL_64_after_hwframe+0x44/0xae
>> [ 44.951074][ T1980] RIP: 0033:0x7fad1bf10fea
>> [ 44.951077][ T1980] Code: 48 8b 0d a9 0e 0c 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 49 89 ca b8 a5 00 00 00 0f 05 <48> 3d 01
>> f0 ff ff 73 01 c3 48 8b 0d 76 0e 0c 00 f7 d8 64 89 01 48
>> [ 44.956197][ T335] btrfs
>> [ 44.958245][ T1980] RSP: 002b:00007fff9d90f878 EFLAGS: 00000246 ORIG_RAX: 00000000000000a5
>> [ 44.958249][ T1980] RAX: ffffffffffffffda RBX: 00005628efc57970 RCX: 00007fad1bf10fea
>> [ 44.958251][ T1980] RDX: 00005628efc57b80 RSI: 00005628efc57bc0 RDI: 00005628efc57ba0
>> [ 44.958263][ T1980] RBP: 00007fad1c25e1c4 R08: 0000000000000000 R09: 00005628efc5a890
>> [ 44.958264][ T1980] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
>> [ 44.962993][ T335]
>> [ 44.967613][ T1980] R13: 0000000000000000 R14: 00005628efc57ba0 R15: 00005628efc57b80
>> [ 44.967616][ T1980] </TASK>
>> [ 44.967617][ T1980] Modules linked in: dm_mod btrfs blake2b_generic xor raid6_pq
>> [ 44.973257][ T335] 2022-03-14 01:34:21 mount -t btrfs /dev/sdb2 /fs/sdb2
>> [ 44.977243][ T1980] zstd_compress libcrc32c sd_mod t10_pi sg
>> [ 44.983019][ T335]
>> [ 44.985203][ T1980] ipmi_devintf ata_generic ipmi_msghandler intel_rapl_msr intel_rapl_common x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel
>> [ 44.990720][ T335] 2022-03-14 01:34:21 mkdir -p /fs/sdb3
>> [ 44.995962][ T1980] i915 kvm intel_gtt ttm drm_kms_helper irqbypass crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel syscopyarea sysfillrect
>> [ 44.998174][ T335]
>> [ 45.002882][ T1980] sysimgblt rapl mei_wdt fb_sys_fops ata_piix intel_cstate libata drm mei_me mei intel_uncore video ip_tables
>> [ 45.002919][ T1980] ---[ end trace 0000000000000000 ]---
>>
>>
>>>
>>> Thanks,
>>> Qu
>>>
>>>>
>>>>
>>>> [ 75.279958][ T3602] ------------[ cut here ]------------
>>>> [ 75.285221][ T3602] kernel BUG at fs/btrfs/scrub.c:3387!
>>>> [ 75.290490][ T3602] invalid opcode: 0000 [#1] SMP KASAN PTI
>>>> [ 75.296010][ T3602] CPU: 2 PID: 3602 Comm: btrfs Not tainted 5.17.0-rc4-00095-g6b837d4c40d5 #1
>>>> [ 75.304521][ T3602] Hardware name: Dell Inc. OptiPlex 9020/0DNKMN, BIOS A05 12/05/2013
>>>> [ 75.312344][ T3602] RIP: 0010:scrub_stripe+0xed3/0x1340 [btrfs]
>>>> [ 75.318250][ T3602] Code: 90 00 00 00 e8 0e f9 96 c0 e9 98 f3 ff ff e8 c4 f9 96 c0 e9 26 f3 ff ff 48 8b bc 24 80 00 00 00 e8 f2 f8 96 c0 e9 3b f4 ff ff <0f> 0b 0f
>>>> 0b 4c 8d a4 24 b8 01 00 00 31 f6 4c 8d bd 20 02 00 00 4c
>>>> [ 75.337480][ T3602] RSP: 0018:ffffc9000b47f550 EFLAGS: 00010246
>>>> [ 75.343340][ T3602] RAX: 0000000000000007 RBX: ffff88810231d600 RCX: ffff88810231d61c
>>>> [ 75.351074][ T3602] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff8881023a2458
>>>> [ 75.358807][ T3602] RBP: ffff8881097ad800 R08: 0000000000000001 R09: ffffed102828100d
>>>> [ 75.366550][ T3602] R10: ffff888141408063 R11: ffffed102828100c R12: 0000000000000000
>>>> [ 75.374282][ T3602] R13: 0000000000100000 R14: ffff888141408000 R15: ffff888129c9c000
>>>> [ 75.382016][ T3602] FS: 00007f94c24ec8c0(0000) GS:ffff8881a6d00000(0000) knlGS:0000000000000000
>>>> [ 75.390691][ T3602] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>>>> [ 75.397054][ T3602] CR2: 00007ffe454aa8e8 CR3: 000000020a796004 CR4: 00000000001706e0
>>>> [ 75.404785][ T3602] Call Trace:
>>>> [ 75.407886][ T3602] <TASK>
>>>> [ 75.410645][ T3602] ? btrfs_wait_ordered_extents+0x9a1/0xe40 [btrfs]
>>>> [ 75.417049][ T3602] ? scrub_raid56_parity+0x5c0/0x5c0 [btrfs]
>>>> [ 75.422853][ T3602] ? btrfs_remove_ordered_extent+0xbc0/0xbc0 [btrfs]
>>>> [ 75.429341][ T3602] ? mutex_unlock+0x80/0x100
>>>> [ 75.433733][ T3602] ? __wake_up_common_lock+0xe3/0x140
>>>> [ 75.438897][ T3602] ? __lookup_extent_mapping+0x215/0x300 [btrfs]
>>>> [ 75.445037][ T3602] scrub_chunk+0x294/0x480 [btrfs]
>>>> [ 75.449984][ T3602] scrub_enumerate_chunks+0x643/0x1340 [btrfs]
>>>> [ 75.455962][ T3602] ? scrub_chunk+0x480/0x480 [btrfs]
>>>> [ 75.461083][ T3602] ? __scrub_blocked_if_needed+0xb9/0x200 [btrfs]
>>>> [ 75.467317][ T3602] ? scrub_checksum_data+0x4c0/0x4c0 [btrfs]
>>>> [ 75.473121][ T3602] ? down_read+0x137/0x240
>>>> [ 75.477339][ T3602] ? mutex_unlock+0x80/0x100
>>>> [ 75.481726][ T3602] ? __mutex_unlock_slowpath+0x300/0x300
>>>> [ 75.487743][ T3602] ? btrfs_find_device+0xac/0x240 [btrfs]
>>>> [ 75.493285][ T3602] btrfs_scrub_dev+0x535/0xc00 [btrfs]
>>>> [ 75.498578][ T3602] ? scrub_enumerate_chunks+0x1340/0x1340 [btrfs]
>>>> [ 75.504812][ T3602] ? btrfs_apply_pending_changes+0x80/0x80 [btrfs]
>>>> [ 75.511120][ T3602] ? btrfs_record_root_in_trans+0x4d/0x180 [btrfs]
>>>> [ 75.517428][ T3602] ? finish_wait+0x280/0x280
>>>> [ 75.521819][ T3602] btrfs_dev_replace_by_ioctl.cold+0x62c/0x720 [btrfs]
>>>> [ 75.528483][ T3602] ? btrfs_finish_block_group_to_copy+0x3c0/0x3c0 [btrfs]
>>>> [ 75.535440][ T3602] ? __raw_callee_save___native_queued_spin_unlock+0x11/0x1e
>>>> [ 75.542575][ T3602] btrfs_ioctl+0x37ee/0x51c0 [btrfs]
>>>> [ 75.547691][ T3602] ? fput_many+0xaa/0x140
>>>> [ 75.551823][ T3602] ? filp_close+0xef/0x140
>>>> [ 75.556041][ T3602] ? __x64_sys_close+0x2d/0x80
>>>> [ 75.560600][ T3602] ? do_syscall_64+0x3b/0xc0
>>>> [ 75.564991][ T3602] ? entry_SYSCALL_64_after_hwframe+0x44/0xae
>>>> [ 75.570838][ T3602] ? btrfs_ioctl_get_supported_features+0x40/0x40 [btrfs]
>>>> [ 75.577756][ T3602] ? _raw_spin_lock_irq+0x82/0xd2
>>>> [ 75.582572][ T3602] ? _raw_spin_lock+0x100/0x100
>>>> [ 75.587218][ T3602] ? fiemap_prep+0x200/0x200
>>>> [ 75.591607][ T3602] ? lockref_put_or_lock+0xc4/0x1c0
>>>> [ 75.596600][ T3602] ? do_sigaction+0x4b3/0x840
>>>> [ 75.601075][ T3602] ? __x64_sys_pidfd_send_signal+0x600/0x600
>>>> [ 75.606837][ T3602] ? __might_fault+0x4d/0x80
>>>> [ 75.611226][ T3602] ? __x64_sys_rt_sigaction+0x1d0/0x240
>>>> [ 75.616558][ T3602] ? __ia32_sys_signal+0x140/0x140
>>>> [ 75.621461][ T3602] ? __fget_light+0x57/0x540
>>>> [ 75.625854][ T3602] __x64_sys_ioctl+0x127/0x1c0
>>>> [ 75.630414][ T3602] do_syscall_64+0x3b/0xc0
>>>> [ 75.634633][ T3602] entry_SYSCALL_64_after_hwframe+0x44/0xae
>>>> [ 75.640307][ T3602] RIP: 0033:0x7f94c25df427
>>>> [ 75.644533][ T3602] Code: 00 00 90 48 8b 05 69 aa 0c 00 64 c7 00 26 00 00 00 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 b8 10 00 00 00 0f 05 <48> 3d 01
>>>> f0 ff ff 73 01 c3 48 8b 0d 39 aa 0c 00 f7 d8 64 89 01 48
>>>> [ 75.663771][ T3602] RSP: 002b:00007ffd06a4acc8 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
>>>> [ 75.671937][ T3602] RAX: ffffffffffffffda RBX: 000055d51e9f72a0 RCX: 00007f94c25df427
>>>> [ 75.679671][ T3602] RDX: 00007ffd06a4b108 RSI: 00000000ca289435 RDI: 0000000000000004
>>>> [ 75.687404][ T3602] RBP: 00000000ffffffff R08: 0000000000000000 R09: 000055d51e9fa580
>>>> [ 75.695137][ T3602] R10: 0000000000000008 R11: 0000000000000246 R12: 00007ffd06a4e97a
>>>> [ 75.702868][ T3602] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000005
>>>> [ 75.710600][ T3602] </TASK>
>>>> [ 75.713445][ T3602] Modules linked in: dm_mod btrfs blake2b_generic xor raid6_pq zstd_compress libcrc32c sd_mod t10_pi sg ata_generic ipmi_devintf ipmi_msghandler
>>>> intel_rapl_msr intel_rapl_common x86_pkg_temp_thermal intel_powerclamp coretemp i915 kvm_intel kvm intel_gtt ttm irqbypass crct10dif_pclmul crc32_pclmul crc32c_intel
>>>> ghash_clmulni_intel drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops rapl ata_piix mei_wdt intel_cstate drm libata mei_me intel_uncore mei video ip_tables
>>>> [ 75.756460][ T3602] ---[ end trace 0000000000000000 ]---
>>>>
>>>>
>>>>>
>>>>> Thanks,
>>>>> Qu
>>>>>
> _______________________________________________
> LKP mailing list -- [email protected]
> To unsubscribe send an email to [email protected]