FYI, we noticed the following commit (built with gcc-7):
commit: e86ee2d44b44056243da17c120ad258717cedf9b ("ipmi: Rework locking and shutdown for hot remove")
https://github.com/cminyard/linux-ipmi master-ipmi-rebase
in testcase: vm-scalability
with following parameters:
runtime: 300
thp_enabled: never
thp_defrag: always
nr_task: 32
nr_pmem: 1
test: swap-w-rand
cpufreq_governor: performance
test-description: The motivation behind this suite is to exercise functions and regions of the mm/ of the Linux kernel which are of interest to us.
test-url: https://git.kernel.org/cgit/linux/kernel/git/wfg/vm-scalability.git/
on test machine: 72 threads Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz with 128G memory
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+------------------------------------------------------------------------------------------+------------+------------+
| | ac93bd0c9e | e86ee2d44b |
+------------------------------------------------------------------------------------------+------------+------------+
| boot_successes | 0 | 0 |
| boot_failures | 26 | 26 |
| WARNING:stack_recursion | 22 | 14 |
| WARNING:at#for_ip_swapgs_restore_regs_and_return_to_usermode/0x | 21 | 12 |
| WARNING:stack_going_in_the_wrong_direction?ip=__schedule/0x | 2 | |
| WARNING:stack_going_in_the_wrong_direction?ip=__slab_free/0x | 2 | 2 |
| WARNING:at#for_ip_error_entry/0x | 1 | 1 |
| invoked_oom-killer:gfp_mask=0x | 3 | 6 |
| Mem-Info | 3 | 26 |
| Kernel_panic-not_syncing:Out_of_memory_and_no_killable_processes | 3 | 4 |
| BUG:kernel_hang_in_boot_stage | 1 | |
| page_allocation_failure:order:#,mode:#(GFP_KERNEL|__GFP_COMP),nodemask=(null) | 0 | 22 |
| page_allocation_failure:order:#,mode:#(GFP_KERNEL|__GFP_NORETRY),nodemask=(null) | 0 | 3 |
| Out_of_memory:Kill_process | 0 | 2 |
| WARNING:at#for_ip_interrupt_entry/0x | 0 | 1 |
| page_allocation_failure:order:#,mode:#(GFP_ATOMIC|__GFP_COMP|__GFP_ZERO),nodemask=(null) | 0 | 3 |
| WARNING:stack_going_in_the_wrong_direction?ip=___slab_alloc/0x | 0 | 1 |
+------------------------------------------------------------------------------------------+------------+------------+
[ 31.758010] XFS (loop0): Ending clean mount
[ 31.766975] 2018-04-25 03:01:44 ./case-swap-w-rand
[ 31.766977]
[ 31.782409] 2018-04-25 03:01:44 ./usemem --runtime 300 -n 32 --random 3113445312
[ 31.782410]
[ 40.877310] bmc-watchdog: page allocation failure: order:4, mode:0x14040c0(GFP_KERNEL|__GFP_COMP), nodemask=(null)
[ 40.890037] bmc-watchdog cpuset=/ mems_allowed=0-1
[ 40.896472] CPU: 1 PID: 1968 Comm: bmc-watchdog Tainted: G O 4.17.0-rc1-00038-ge86ee2d4 #1
[ 40.908271] Hardware name: Intel Corporation S2600WTT/S2600WTT, BIOS SE5C610.86B.01.01.0008.021120151325 02/11/2015
[ 40.921068] Call Trace:
[ 40.924851] dump_stack+0x5c/0x7b
[ 40.929647] warn_alloc+0xbe/0x150
[ 40.934484] __alloc_pages_slowpath+0xd6e/0xdb0
[ 40.940630] ? apic_timer_interrupt+0xa/0x20
[ 40.946494] ? get_page_from_freelist+0x10a8/0x1610
[ 40.953041] __alloc_pages_nodemask+0x23b/0x250
[ 40.959210] kmalloc_order_trace+0x26/0xe0
[ 40.964871] ipmi_create_user+0x4b/0x210 [ipmi_msghandler]
[ 40.972131] ? kmem_cache_alloc_trace+0x3e/0x1e0
[ 40.978460] ipmi_open+0x51/0xd0 [ipmi_devintf]
[ 40.984637] chrdev_open+0xbb/0x1b0
[ 40.989649] ? cdev_default_release+0x20/0x20
[ 40.995624] do_dentry_open+0x1b2/0x340
[ 41.000973] ? security_inode_permission+0x30/0x50
[ 41.007478] path_openat+0x66b/0x1710
[ 41.012648] ? handle_mm_fault+0xf5/0x230
[ 41.018267] ? __perf_sw_event+0x54/0x90
[ 41.023704] ? __do_page_fault+0x479/0x4f0
[ 41.029443] do_filp_open+0x8c/0xf0
[ 41.034362] ? strncpy_from_user+0x46/0x150
[ 41.040145] ? __alloc_fd+0x44/0x180
[ 41.045154] ? do_sys_open+0x1a6/0x230
[ 41.050349] do_sys_open+0x1a6/0x230
[ 41.055368] do_syscall_64+0x5b/0x180
[ 41.060484] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 41.067167] RIP: 0033:0x7f5eabf576ae
[ 41.072132] RSP: 002b:00007fff3ab2a550 EFLAGS: 00000246 ORIG_RAX: 0000000000000101
[ 41.081652] RAX: ffffffffffffffda RBX: 0000000001df96b0 RCX: 00007f5eabf576ae
[ 41.090667] RDX: 0000000000000002 RSI: 00007f5eac330b80 RDI: ffffffffffffff9c
[ 41.099689] RBP: 0000000001df9690 R08: 0000000001df96b0 R09: 00007f5eab8e6c28
[ 41.108704] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
[ 41.117719] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
[ 41.126719] Mem-Info:
[ 41.130172] active_anon:6396554 inactive_anon:608882 isolated_anon:958
[ 41.130172] active_file:8 inactive_file:26 isolated_file:0
[ 41.130172] unevictable:309490 dirty:1 writeback:0 unstable:0
[ 41.130172] slab_reclaimable:286691 slab_unreclaimable:28135
[ 41.130172] mapped:4800 shmem:619 pagetables:48729 bounce:0
[ 41.130172] free:21765 free_pcp:13803 free_cma:128
[ 41.173658] Node 0 active_anon:12094556kB inactive_anon:1209536kB active_file:0kB inactive_file:4kB unevictable:589168kB isolated(anon):2460kB isolated(file):0kB mapped:10004kB dirty:4kB writeback:0kB shmem:456kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no
[ 41.207666] Node 1 active_anon:13322200kB inactive_anon:1210160kB active_file:32kB inactive_file:100kB unevictable:648792kB isolated(anon):1372kB isolated(file):0kB mapped:9648kB dirty:0kB writeback:0kB shmem:2472kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 2048kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no
[ 41.242282] Node 0 DMA free:20kB min:44kB low:56kB high:68kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15976kB managed:15892kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
Thanks,
Xiaolong