Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1752610AbdCFC7i (ORCPT ); Sun, 5 Mar 2017 21:59:38 -0500 Received: from mail.tomasu.net ([192.241.222.217]:58938 "EHLO mail.tomasu.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752542AbdCFC7h (ORCPT ); Sun, 5 Mar 2017 21:59:37 -0500 From: Thomas Fjellstrom To: linux-kernel Subject: Re: nvme, allocation failures, and aborted commands Date: Sun, 05 Mar 2017 19:57:40 -0700 Message-ID: <1898554.3jK49l1AhF@natasha> User-Agent: KMail/5.2.3 (Linux/4.10.0-trunk-amd64; KDE/5.28.0; x86_64; ; ) In-Reply-To: <2324331.vgmPNSfijK@natasha> References: <2324331.vgmPNSfijK@natasha> MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="us-ascii" Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 47287 Lines: 593 On Friday, March 3, 2017 8:27:40 AM MST Thomas Fjellstrom wrote: > I just got a new Samsung 960 Evo 256GB m.2 nvme drive, and put it through > some tests. > > When I run `iozone -a -s 60G` on my desktop (that has 32GB ram and a amd FX > 8320), i run into some errors. One time the drive completely dropped from > the system (ok, only the dev device did, it still appeared in lspci) and I > had to reboot. The later attempt's results can be seen in the attached file > (its 5000 lines, so I didn't think it was good to post inline). > > I realize that iozone isn't a good indicator of real world performance, I > just wanted to see some numbers :D and to stress test the card a bit. > > I doubt this is expected behavior regardless of how pointless the exercise > is. > > I'm running kernel 4.9.13 from debian sid/unstable at the moment. > > Please CC me, as I'm not currently subscribed to the list. > > Thanks. Did some more testing today. Windows seems to be fine with the "same" testing using iozone3. I upgraded to kernel 4.10 and I'm still having issues. Is this a block mq issue? It doesn't even get through the initial (4k) pass before the system starts to lag out. I didn't let it run long enough this time to throw errors from nvme. What can I do to trouble shoot this further? [ 6239.082540] kworker/u16:4: page allocation failure: order:2, mode:0x1284020(GFP_ATOMIC|__GFP_COMP|__GFP_NOTRACK) [ 6239.082547] CPU: 5 PID: 1549 Comm: kworker/u16:4 Tainted: G E 4.10.0-trunk-amd64 #1 Debian 4.10-1~exp1 [ 6239.082548] Hardware name: To be filled by O.E.M. To be filled by O.E.M./970 PRO GAMING/AURA, BIOS 0901 11/07/2016 [ 6239.082553] Workqueue: writeback wb_workfn (flush-259:0) [ 6239.082555] Call Trace: [ 6239.082558] ? dump_stack+0x5c/0x78 [ 6239.082560] ? warn_alloc+0x13a/0x160 [ 6239.082562] ? __alloc_pages_slowpath+0x28f/0xab0 [ 6239.082563] ? get_page_from_freelist+0x464/0xbe0 [ 6239.082565] ? __alloc_pages_nodemask+0x1fe/0x260 [ 6239.082567] ? cache_grow_begin+0x9d/0x550 [ 6239.082568] ? cache_grow_begin+0x9d/0x550 [ 6239.082570] ? fallback_alloc+0x161/0x200 [ 6239.082574] ? nvme_queue_rq+0x131/0x81e [nvme] [ 6239.082575] ? __kmalloc+0x1e1/0x5e0 [ 6239.082577] ? nvme_queue_rq+0x131/0x81e [nvme] [ 6239.082579] ? __sbitmap_queue_get+0x24/0x90 [ 6239.082580] ? bt_get.isra.6+0x61/0x220 [ 6239.082581] ? blk_mq_try_issue_directly+0x7d/0x100 [ 6239.082582] ? blk_mq_make_request+0x35e/0x540 [ 6239.082584] ? generic_make_request+0xe8/0x1c0 [ 6239.082585] ? submit_bio+0x6c/0x140 [ 6239.082636] ? xfs_add_to_ioend+0x109/0x210 [xfs] [ 6239.082659] ? xfs_do_writepage+0x2c7/0x700 [xfs] [ 6239.082660] ? __page_check_address+0x1b0/0x1b0 [ 6239.082662] ? write_cache_pages+0x1b6/0x470 [ 6239.082684] ? xfs_add_to_ioend+0x210/0x210 [xfs] [ 6239.082686] ? nvme_queue_rq+0x1d4/0x81e [nvme] [ 6239.082709] ? xfs_vm_writepages+0xb8/0xe0 [xfs] [ 6239.082711] ? __writeback_single_inode+0x3d/0x310 [ 6239.082712] ? blk_mq_process_rq_list+0x1b0/0x1e0 [ 6239.082713] ? writeback_sb_inodes+0x221/0x4f0 [ 6239.082715] ? __writeback_inodes_wb+0x87/0xb0 [ 6239.082716] ? wb_writeback+0x268/0x300 [ 6239.082718] ? wb_workfn+0x109/0x3e0 [ 6239.082720] ? ttwu_do_wakeup+0x14/0xd0 [ 6239.082721] ? try_to_wake_up+0x54/0x3a0 [ 6239.082723] ? process_one_work+0x197/0x430 [ 6239.082724] ? worker_thread+0x4d/0x4a0 [ 6239.082725] ? kthread+0xf4/0x130 [ 6239.082726] ? process_one_work+0x430/0x430 [ 6239.082727] ? kthread_create_on_node+0x60/0x60 [ 6239.082729] ? do_group_exit+0x3a/0xa0 [ 6239.082730] ? ret_from_fork+0x26/0x40 [ 6239.082731] Mem-Info: [ 6239.082736] active_anon:640028 inactive_anon:155846 isolated_anon:0 active_file:6574947 inactive_file:454965 isolated_file:96 unevictable:16 dirty:301619 writeback:929067 unstable:0 slab_reclaimable:228012 slab_unreclaimable:38764 mapped:78404 shmem:36436 pagetables:22528 bounce:0 free:49532 free_pcp:281 free_cma:0 [ 6239.082741] Node 0 active_anon:2560112kB inactive_anon:623384kB active_file:26299788kB inactive_file:1819860kB unevictable:64kB isolated(anon):0kB isolated(file):384kB mapped:313616kB dirty:1206476kB writeback:3716268kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 145744kB writeback_tmp:0kB unstable:0kB pages_scanned:305967 all_unreclaimable? no [ 6239.082741] Node 0 DMA free:15876kB min:32kB low:44kB high:56kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15996kB managed:15892kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:16kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [ 6239.082744] lowmem_reserve[]: 0 2880 32031 32031 32031 [ 6239.082746] Node 0 DMA32 free:120708kB min:6072kB low:9020kB high:11968kB active_anon:138220kB inactive_anon:1584kB active_file:2307312kB inactive_file:247928kB unevictable:0kB writepending:557264kB present:3040380kB managed:3040380kB mlocked:0kB slab_reclaimable:176668kB slab_unreclaimable:37020kB kernel_stack:272kB pagetables:1256kB bounce:0kB free_pcp:184kB local_pcp:0kB free_cma:0kB [ 6239.082749] lowmem_reserve[]: 0 0 29151 29151 29151 [ 6239.082751] Node 0 Normal free:61544kB min:61476kB low:91324kB high:121172kB active_anon:2421892kB inactive_anon:621800kB active_file:23992368kB inactive_file:1571104kB unevictable:64kB writepending:4366500kB present:30392316kB managed:29855756kB mlocked:64kB slab_reclaimable:735380kB slab_unreclaimable:118020kB kernel_stack:18736kB pagetables:88856kB bounce:0kB free_pcp:940kB local_pcp:112kB free_cma:0kB [ 6239.082754] lowmem_reserve[]: 0 0 0 0 0 [ 6239.082755] Node 0 DMA: 1*4kB (U) 0*8kB 0*16kB 2*32kB (U) 3*64kB (U) 2*128kB (U) 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15876kB [ 6239.082762] Node 0 DMA32: 7427*4kB (UMEH) 11471*8kB (UMEH) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 121476kB [ 6239.082767] Node 0 Normal: 2385*4kB (UMEH) 6487*8kB (UM) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 61436kB [ 6239.082773] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB [ 6239.082774] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [ 6239.082774] 7066856 total pagecache pages [ 6239.082775] 305 pages in swap cache [ 6239.082776] Swap cache stats: add 97127, delete 96822, find 36208/67196 [ 6239.082776] Free swap = 6793020kB [ 6239.082776] Total swap = 6959100kB [ 6239.082777] 8362173 pages RAM [ 6239.082777] 0 pages HighMem/MovableOnly [ 6239.082778] 134166 pages reserved [ 6239.082778] 0 pages hwpoisoned [ 6239.082786] kworker/5:2H: page allocation failure: order:2, mode:0x1284020(GFP_ATOMIC|__GFP_COMP|__GFP_NOTRACK) [ 6239.082789] CPU: 5 PID: 2062 Comm: kworker/5:2H Tainted: G E 4.10.0-trunk-amd64 #1 Debian 4.10-1~exp1 [ 6239.082789] Hardware name: To be filled by O.E.M. To be filled by O.E.M./970 PRO GAMING/AURA, BIOS 0901 11/07/2016 [ 6239.082791] Workqueue: kblockd blk_mq_run_work_fn [ 6239.082791] Call Trace: [ 6239.082793] ? dump_stack+0x5c/0x78 [ 6239.082794] ? warn_alloc+0x13a/0x160 [ 6239.082796] ? __alloc_pages_slowpath+0x28f/0xab0 [ 6239.082797] ? get_page_from_freelist+0x464/0xbe0 [ 6239.082799] ? __alloc_pages_nodemask+0x1fe/0x260 [ 6239.082800] ? cache_grow_begin+0x9d/0x550 [ 6239.082801] ? cache_grow_begin+0x9d/0x550 [ 6239.082803] ? fallback_alloc+0x161/0x200 [ 6239.082805] ? nvme_queue_rq+0x131/0x81e [nvme] [ 6239.082806] ? __kmalloc+0x1e1/0x5e0 [ 6239.082808] ? nvme_queue_rq+0x131/0x81e [nvme] [ 6239.082809] ? cfq_dispatch_requests+0x4f/0x970 [ 6239.082810] ? blk_mq_dispatch_rq_list+0xf7/0x230 [ 6239.082811] ? blk_mq_process_rq_list+0x1b0/0x1e0 [ 6239.082812] ? process_one_work+0x197/0x430 [ 6239.082813] ? worker_thread+0x4d/0x4a0 [ 6239.082814] ? kthread+0xf4/0x130 [ 6239.082815] ? process_one_work+0x430/0x430 [ 6239.082816] ? kthread_create_on_node+0x60/0x60 [ 6239.082817] ? ret_from_fork+0x26/0x40 [ 6239.082818] Mem-Info: [ 6239.082820] active_anon:640028 inactive_anon:155846 isolated_anon:0 active_file:6574947 inactive_file:454965 isolated_file:96 unevictable:16 dirty:301619 writeback:929067 unstable:0 slab_reclaimable:228012 slab_unreclaimable:38764 mapped:78404 shmem:36436 pagetables:22528 bounce:0 free:49532 free_pcp:281 free_cma:0 [ 6239.082824] Node 0 active_anon:2560112kB inactive_anon:623384kB active_file:26299788kB inactive_file:1819860kB unevictable:64kB isolated(anon):0kB isolated(file):384kB mapped:313616kB dirty:1206476kB writeback:3716268kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 145744kB writeback_tmp:0kB unstable:0kB pages_scanned:306351 all_unreclaimable? no [ 6239.082824] Node 0 DMA free:15876kB min:32kB low:44kB high:56kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15996kB managed:15892kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:16kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [ 6239.082826] lowmem_reserve[]: 0 2880 32031 32031 32031 [ 6239.082828] Node 0 DMA32 free:120708kB min:6072kB low:9020kB high:11968kB active_anon:138220kB inactive_anon:1584kB active_file:2307312kB inactive_file:247928kB unevictable:0kB writepending:557264kB present:3040380kB managed:3040380kB mlocked:0kB slab_reclaimable:176668kB slab_unreclaimable:37020kB kernel_stack:272kB pagetables:1256kB bounce:0kB free_pcp:184kB local_pcp:0kB free_cma:0kB [ 6239.082831] lowmem_reserve[]: 0 0 29151 29151 29151 [ 6239.082833] Node 0 Normal free:61544kB min:61476kB low:91324kB high:121172kB active_anon:2421892kB inactive_anon:621800kB active_file:23992368kB inactive_file:1571104kB unevictable:64kB writepending:4366500kB present:30392316kB managed:29855756kB mlocked:64kB slab_reclaimable:735380kB slab_unreclaimable:118020kB kernel_stack:18736kB pagetables:88856kB bounce:0kB free_pcp:940kB local_pcp:112kB free_cma:0kB [ 6239.082836] lowmem_reserve[]: 0 0 0 0 0 [ 6239.082837] Node 0 DMA: 1*4kB (U) 0*8kB 0*16kB 2*32kB (U) 3*64kB (U) 2*128kB (U) 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15876kB [ 6239.082843] Node 0 DMA32: 7427*4kB (UMEH) 11471*8kB (UMEH) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 121476kB [ 6239.082848] Node 0 Normal: 2385*4kB (UMEH) 6487*8kB (UM) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 61436kB [ 6239.082854] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB [ 6239.082854] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [ 6239.082855] 7066856 total pagecache pages [ 6239.082855] 305 pages in swap cache [ 6239.082856] Swap cache stats: add 97127, delete 96822, find 36208/67196 [ 6239.082856] Free swap = 6793020kB [ 6239.082856] Total swap = 6959100kB [ 6239.082857] 8362173 pages RAM [ 6239.082857] 0 pages HighMem/MovableOnly [ 6239.082858] 134166 pages reserved [ 6239.082858] 0 pages hwpoisoned [ 6239.082860] kworker/5:2H: page allocation failure: order:2, mode:0x1284020(GFP_ATOMIC|__GFP_COMP|__GFP_NOTRACK) [ 6239.082862] CPU: 5 PID: 2062 Comm: kworker/5:2H Tainted: G E 4.10.0-trunk-amd64 #1 Debian 4.10-1~exp1 [ 6239.082863] Hardware name: To be filled by O.E.M. To be filled by O.E.M./970 PRO GAMING/AURA, BIOS 0901 11/07/2016 [ 6239.082864] Workqueue: kblockd blk_mq_run_work_fn [ 6239.082865] Call Trace: [ 6239.082866] ? dump_stack+0x5c/0x78 [ 6239.082867] ? warn_alloc+0x13a/0x160 [ 6239.082869] ? __alloc_pages_slowpath+0x28f/0xab0 [ 6239.082870] ? get_page_from_freelist+0x464/0xbe0 [ 6239.082871] ? __alloc_pages_nodemask+0x1fe/0x260 [ 6239.082873] ? cache_grow_begin+0x9d/0x550 [ 6239.082874] ? cache_grow_begin+0x9d/0x550 [ 6239.082876] ? fallback_alloc+0x161/0x200 [ 6239.082877] ? nvme_queue_rq+0x131/0x81e [nvme] [ 6239.082879] ? __kmalloc+0x1e1/0x5e0 [ 6239.082880] ? nvme_queue_rq+0x131/0x81e [nvme] [ 6239.082881] ? cfq_dispatch_requests+0x4f/0x970 [ 6239.082882] ? insert_work+0x69/0xf0 [ 6239.082883] ? blk_mq_dispatch_rq_list+0xf7/0x230 [ 6239.082884] ? blk_mq_process_rq_list+0x1b0/0x1e0 [ 6239.082885] ? process_one_work+0x197/0x430 [ 6239.082886] ? worker_thread+0x4d/0x4a0 [ 6239.082887] ? kthread+0xf4/0x130 [ 6239.082888] ? process_one_work+0x430/0x430 [ 6239.082889] ? kthread_create_on_node+0x60/0x60 [ 6239.082890] ? ret_from_fork+0x26/0x40 [ 6239.082891] Mem-Info: [ 6239.082893] active_anon:640028 inactive_anon:155846 isolated_anon:0 active_file:6574947 inactive_file:454965 isolated_file:96 unevictable:16 dirty:301619 writeback:929067 unstable:0 slab_reclaimable:228012 slab_unreclaimable:38764 mapped:78404 shmem:36436 pagetables:22528 bounce:0 free:49532 free_pcp:282 free_cma:0 [ 6239.082897] Node 0 active_anon:2560112kB inactive_anon:623384kB active_file:26299788kB inactive_file:1819860kB unevictable:64kB isolated(anon):0kB isolated(file):384kB mapped:313616kB dirty:1206476kB writeback:3716268kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 145744kB writeback_tmp:0kB unstable:0kB pages_scanned:306735 all_unreclaimable? no [ 6239.082897] Node 0 DMA free:15876kB min:32kB low:44kB high:56kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15996kB managed:15892kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:16kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [ 6239.082900] lowmem_reserve[]: 0 2880 32031 32031 32031 [ 6239.082902] Node 0 DMA32 free:120708kB min:6072kB low:9020kB high:11968kB active_anon:138220kB inactive_anon:1584kB active_file:2307312kB inactive_file:247928kB unevictable:0kB writepending:557264kB present:3040380kB managed:3040380kB mlocked:0kB slab_reclaimable:176668kB slab_unreclaimable:37020kB kernel_stack:272kB pagetables:1256kB bounce:0kB free_pcp:184kB local_pcp:0kB free_cma:0kB [ 6239.082904] lowmem_reserve[]: 0 0 29151 29151 29151 [ 6239.082906] Node 0 Normal free:61544kB min:61476kB low:91324kB high:121172kB active_anon:2421892kB inactive_anon:621800kB active_file:23992368kB inactive_file:1571104kB unevictable:64kB writepending:4366500kB present:30392316kB managed:29855756kB mlocked:64kB slab_reclaimable:735380kB slab_unreclaimable:118020kB kernel_stack:18736kB pagetables:88856kB bounce:0kB free_pcp:944kB local_pcp:112kB free_cma:0kB [ 6239.082909] lowmem_reserve[]: 0 0 0 0 0 [ 6239.082910] Node 0 DMA: 1*4kB (U) 0*8kB 0*16kB 2*32kB (U) 3*64kB (U) 2*128kB (U) 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15876kB [ 6239.082916] Node 0 DMA32: 7427*4kB (UMEH) 11471*8kB (UMEH) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 121476kB [ 6239.082921] Node 0 Normal: 2385*4kB (UMEH) 6487*8kB (UM) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 61436kB [ 6239.082926] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB [ 6239.082927] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [ 6239.082927] 7066856 total pagecache pages [ 6239.082928] 305 pages in swap cache [ 6239.082928] Swap cache stats: add 97127, delete 96822, find 36208/67196 [ 6239.082929] Free swap = 6793020kB [ 6239.082929] Total swap = 6959100kB [ 6239.082929] 8362173 pages RAM [ 6239.082930] 0 pages HighMem/MovableOnly [ 6239.082930] 134166 pages reserved [ 6239.082930] 0 pages hwpoisoned [ 6239.082932] kworker/5:2H: page allocation failure: order:2, mode:0x1284020(GFP_ATOMIC|__GFP_COMP|__GFP_NOTRACK) [ 6239.082934] CPU: 5 PID: 2062 Comm: kworker/5:2H Tainted: G E 4.10.0-trunk-amd64 #1 Debian 4.10-1~exp1 [ 6239.082935] Hardware name: To be filled by O.E.M. To be filled by O.E.M./970 PRO GAMING/AURA, BIOS 0901 11/07/2016 [ 6239.082936] Workqueue: kblockd blk_mq_run_work_fn [ 6239.082936] Call Trace: [ 6239.082938] ? dump_stack+0x5c/0x78 [ 6239.082939] ? warn_alloc+0x13a/0x160 [ 6239.082940] ? __alloc_pages_slowpath+0x28f/0xab0 [ 6239.082942] ? get_page_from_freelist+0x464/0xbe0 [ 6239.082943] ? __alloc_pages_nodemask+0x1fe/0x260 [ 6239.082945] ? cache_grow_begin+0x9d/0x550 [ 6239.082946] ? cache_grow_begin+0x9d/0x550 [ 6239.082948] ? fallback_alloc+0x161/0x200 [ 6239.082949] ? nvme_queue_rq+0x131/0x81e [nvme] [ 6239.082950] ? __kmalloc+0x1e1/0x5e0 [ 6239.082952] ? nvme_queue_rq+0x131/0x81e [nvme] [ 6239.082953] ? cfq_dispatch_requests+0x4f/0x970 [ 6239.082954] ? insert_work+0x69/0xf0 [ 6239.082955] ? blk_mq_dispatch_rq_list+0xf7/0x230 [ 6239.082956] ? blk_mq_process_rq_list+0x1b0/0x1e0 [ 6239.082957] ? process_one_work+0x197/0x430 [ 6239.082958] ? worker_thread+0x4d/0x4a0 [ 6239.082959] ? kthread+0xf4/0x130 [ 6239.082960] ? process_one_work+0x430/0x430 [ 6239.082961] ? kthread_create_on_node+0x60/0x60 [ 6239.082962] ? ret_from_fork+0x26/0x40 [ 6239.082963] Mem-Info: [ 6239.082965] active_anon:640028 inactive_anon:155846 isolated_anon:0 active_file:6574947 inactive_file:454965 isolated_file:96 unevictable:16 dirty:301619 writeback:929067 unstable:0 slab_reclaimable:228012 slab_unreclaimable:38764 mapped:78404 shmem:36436 pagetables:22528 bounce:0 free:49532 free_pcp:282 free_cma:0 [ 6239.082969] Node 0 active_anon:2560112kB inactive_anon:623384kB active_file:26299788kB inactive_file:1819860kB unevictable:64kB isolated(anon):0kB isolated(file):384kB mapped:313616kB dirty:1206476kB writeback:3716268kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 145744kB writeback_tmp:0kB unstable:0kB pages_scanned:307119 all_unreclaimable? no [ 6239.082969] Node 0 DMA free:15876kB min:32kB low:44kB high:56kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15996kB managed:15892kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:16kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [ 6239.082972] lowmem_reserve[]: 0 2880 32031 32031 32031 [ 6239.082973] Node 0 DMA32 free:120708kB min:6072kB low:9020kB high:11968kB active_anon:138220kB inactive_anon:1584kB active_file:2307312kB inactive_file:247928kB unevictable:0kB writepending:557264kB present:3040380kB managed:3040380kB mlocked:0kB slab_reclaimable:176668kB slab_unreclaimable:37020kB kernel_stack:272kB pagetables:1256kB bounce:0kB free_pcp:184kB local_pcp:0kB free_cma:0kB [ 6239.082976] lowmem_reserve[]: 0 0 29151 29151 29151 [ 6239.082978] Node 0 Normal free:61544kB min:61476kB low:91324kB high:121172kB active_anon:2421892kB inactive_anon:621800kB active_file:23992368kB inactive_file:1571104kB unevictable:64kB writepending:4366500kB present:30392316kB managed:29855756kB mlocked:64kB slab_reclaimable:735380kB slab_unreclaimable:118020kB kernel_stack:18736kB pagetables:88856kB bounce:0kB free_pcp:944kB local_pcp:112kB free_cma:0kB [ 6239.082980] lowmem_reserve[]: 0 0 0 0 0 [ 6239.082982] Node 0 DMA: 1*4kB (U) 0*8kB 0*16kB 2*32kB (U) 3*64kB (U) 2*128kB (U) 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15876kB [ 6239.082988] Node 0 DMA32: 7427*4kB (UMEH) 11471*8kB (UMEH) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 121476kB [ 6239.082993] Node 0 Normal: 2385*4kB (UMEH) 6487*8kB (UM) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 61436kB [ 6239.082998] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB [ 6239.082999] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [ 6239.082999] 7066856 total pagecache pages [ 6239.082999] 305 pages in swap cache [ 6239.083000] Swap cache stats: add 97127, delete 96822, find 36208/67196 [ 6239.083000] Free swap = 6793020kB [ 6239.083001] Total swap = 6959100kB [ 6239.083001] 8362173 pages RAM [ 6239.083001] 0 pages HighMem/MovableOnly [ 6239.083002] 134166 pages reserved [ 6239.083002] 0 pages hwpoisoned [ 6239.083004] kworker/5:2H: page allocation failure: order:2, mode:0x1284020(GFP_ATOMIC|__GFP_COMP|__GFP_NOTRACK) [ 6239.083006] CPU: 5 PID: 2062 Comm: kworker/5:2H Tainted: G E 4.10.0-trunk-amd64 #1 Debian 4.10-1~exp1 [ 6239.083007] Hardware name: To be filled by O.E.M. To be filled by O.E.M./970 PRO GAMING/AURA, BIOS 0901 11/07/2016 [ 6239.083008] Workqueue: kblockd blk_mq_run_work_fn [ 6239.083008] Call Trace: [ 6239.083010] ? dump_stack+0x5c/0x78 [ 6239.083011] ? warn_alloc+0x13a/0x160 [ 6239.083012] ? __alloc_pages_slowpath+0x28f/0xab0 [ 6239.083014] ? get_page_from_freelist+0x464/0xbe0 [ 6239.083015] ? __alloc_pages_nodemask+0x1fe/0x260 [ 6239.083017] ? cache_grow_begin+0x9d/0x550 [ 6239.083018] ? cache_grow_begin+0x9d/0x550 [ 6239.083019] ? fallback_alloc+0x161/0x200 [ 6239.083021] ? nvme_queue_rq+0x131/0x81e [nvme] [ 6239.083022] ? __kmalloc+0x1e1/0x5e0 [ 6239.083024] ? nvme_queue_rq+0x131/0x81e [nvme] [ 6239.083025] ? cfq_dispatch_requests+0x4f/0x970 [ 6239.083025] ? insert_work+0x69/0xf0 [ 6239.083027] ? blk_mq_dispatch_rq_list+0xf7/0x230 [ 6239.083028] ? blk_mq_process_rq_list+0x1b0/0x1e0 [ 6239.083029] ? process_one_work+0x197/0x430 [ 6239.083029] ? worker_thread+0x4d/0x4a0 [ 6239.083031] ? kthread+0xf4/0x130 [ 6239.083031] ? process_one_work+0x430/0x430 [ 6239.083033] ? kthread_create_on_node+0x60/0x60 [ 6239.083034] ? ret_from_fork+0x26/0x40 [ 6239.083034] Mem-Info: [ 6239.083037] active_anon:640028 inactive_anon:155846 isolated_anon:0 active_file:6574947 inactive_file:454965 isolated_file:96 unevictable:16 dirty:301619 writeback:929067 unstable:0 slab_reclaimable:228012 slab_unreclaimable:38764 mapped:78404 shmem:36436 pagetables:22528 bounce:0 free:49532 free_pcp:282 free_cma:0 [ 6239.083040] Node 0 active_anon:2560112kB inactive_anon:623384kB active_file:26299788kB inactive_file:1819860kB unevictable:64kB isolated(anon):0kB isolated(file):384kB mapped:313616kB dirty:1206476kB writeback:3716268kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 145744kB writeback_tmp:0kB unstable:0kB pages_scanned:307503 all_unreclaimable? no [ 6239.083040] Node 0 DMA free:15876kB min:32kB low:44kB high:56kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15996kB managed:15892kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:16kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [ 6239.083043] lowmem_reserve[]: 0 2880 32031 32031 32031 [ 6239.083044] Node 0 DMA32 free:120708kB min:6072kB low:9020kB high:11968kB active_anon:138220kB inactive_anon:1584kB active_file:2307312kB inactive_file:247928kB unevictable:0kB writepending:557264kB present:3040380kB managed:3040380kB mlocked:0kB slab_reclaimable:176668kB slab_unreclaimable:37020kB kernel_stack:272kB pagetables:1256kB bounce:0kB free_pcp:184kB local_pcp:0kB free_cma:0kB [ 6239.083047] lowmem_reserve[]: 0 0 29151 29151 29151 [ 6239.083049] Node 0 Normal free:61544kB min:61476kB low:91324kB high:121172kB active_anon:2421892kB inactive_anon:621800kB active_file:23992368kB inactive_file:1571104kB unevictable:64kB writepending:4366500kB present:30392316kB managed:29855756kB mlocked:64kB slab_reclaimable:735380kB slab_unreclaimable:118020kB kernel_stack:18736kB pagetables:88856kB bounce:0kB free_pcp:944kB local_pcp:112kB free_cma:0kB [ 6239.083051] lowmem_reserve[]: 0 0 0 0 0 [ 6239.083053] Node 0 DMA: 1*4kB (U) 0*8kB 0*16kB 2*32kB (U) 3*64kB (U) 2*128kB (U) 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15876kB [ 6239.083059] Node 0 DMA32: 7427*4kB (UMEH) 11471*8kB (UMEH) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 121476kB [ 6239.083064] Node 0 Normal: 2385*4kB (UMEH) 6487*8kB (UM) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 61436kB [ 6239.083069] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB [ 6239.083069] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [ 6239.083070] 7066856 total pagecache pages [ 6239.083070] 305 pages in swap cache [ 6239.083071] Swap cache stats: add 97127, delete 96822, find 36208/67196 [ 6239.083071] Free swap = 6793020kB [ 6239.083072] Total swap = 6959100kB [ 6239.083072] 8362173 pages RAM [ 6239.083072] 0 pages HighMem/MovableOnly [ 6239.083073] 134166 pages reserved [ 6239.083073] 0 pages hwpoisoned [ 6239.083075] kworker/5:2H: page allocation failure: order:2, mode:0x1284020(GFP_ATOMIC|__GFP_COMP|__GFP_NOTRACK) [ 6239.083077] CPU: 5 PID: 2062 Comm: kworker/5:2H Tainted: G E 4.10.0-trunk-amd64 #1 Debian 4.10-1~exp1 [ 6239.083077] Hardware name: To be filled by O.E.M. To be filled by O.E.M./970 PRO GAMING/AURA, BIOS 0901 11/07/2016 [ 6239.083078] Workqueue: kblockd blk_mq_run_work_fn [ 6239.083079] Call Trace: [ 6239.083080] ? dump_stack+0x5c/0x78 [ 6239.083081] ? warn_alloc+0x13a/0x160 [ 6239.083083] ? __alloc_pages_slowpath+0x28f/0xab0 [ 6239.083084] ? get_page_from_freelist+0x464/0xbe0 [ 6239.083086] ? __alloc_pages_nodemask+0x1fe/0x260 [ 6239.083087] ? cache_grow_begin+0x9d/0x550 [ 6239.083089] ? cache_grow_begin+0x9d/0x550 [ 6239.083090] ? fallback_alloc+0x161/0x200 [ 6239.083091] ? nvme_queue_rq+0x131/0x81e [nvme] [ 6239.083093] ? __kmalloc+0x1e1/0x5e0 [ 6239.083094] ? nvme_queue_rq+0x131/0x81e [nvme] [ 6239.083095] ? cfq_dispatch_requests+0x4f/0x970 [ 6239.083096] ? insert_work+0x69/0xf0 [ 6239.083097] ? blk_mq_dispatch_rq_list+0xf7/0x230 [ 6239.083098] ? blk_mq_process_rq_list+0x1b0/0x1e0 [ 6239.083099] ? process_one_work+0x197/0x430 [ 6239.083100] ? worker_thread+0x4d/0x4a0 [ 6239.083101] ? kthread+0xf4/0x130 [ 6239.083102] ? process_one_work+0x430/0x430 [ 6239.083103] ? kthread_create_on_node+0x60/0x60 [ 6239.083104] ? ret_from_fork+0x26/0x40 [ 6239.083105] Mem-Info: [ 6239.083107] active_anon:640028 inactive_anon:155846 isolated_anon:0 active_file:6574947 inactive_file:454965 isolated_file:96 unevictable:16 dirty:301619 writeback:929067 unstable:0 slab_reclaimable:228012 slab_unreclaimable:38764 mapped:78404 shmem:36436 pagetables:22528 bounce:0 free:49532 free_pcp:283 free_cma:0 [ 6239.083111] Node 0 active_anon:2560112kB inactive_anon:623384kB active_file:26299788kB inactive_file:1819860kB unevictable:64kB isolated(anon):0kB isolated(file):384kB mapped:313616kB dirty:1206476kB writeback:3716268kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 145744kB writeback_tmp:0kB unstable:0kB pages_scanned:307887 all_unreclaimable? no [ 6239.083111] Node 0 DMA free:15876kB min:32kB low:44kB high:56kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15996kB managed:15892kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:16kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [ 6239.083113] lowmem_reserve[]: 0 2880 32031 32031 32031 [ 6239.083115] Node 0 DMA32 free:120708kB min:6072kB low:9020kB high:11968kB active_anon:138220kB inactive_anon:1584kB active_file:2307312kB inactive_file:247928kB unevictable:0kB writepending:557264kB present:3040380kB managed:3040380kB mlocked:0kB slab_reclaimable:176668kB slab_unreclaimable:37020kB kernel_stack:272kB pagetables:1256kB bounce:0kB free_pcp:184kB local_pcp:0kB free_cma:0kB [ 6239.083118] lowmem_reserve[]: 0 0 29151 29151 29151 [ 6239.083119] Node 0 Normal free:61544kB min:61476kB low:91324kB high:121172kB active_anon:2421892kB inactive_anon:621800kB active_file:23992368kB inactive_file:1571104kB unevictable:64kB writepending:4366500kB present:30392316kB managed:29855756kB mlocked:64kB slab_reclaimable:735380kB slab_unreclaimable:118020kB kernel_stack:18736kB pagetables:88856kB bounce:0kB free_pcp:948kB local_pcp:112kB free_cma:0kB [ 6239.083122] lowmem_reserve[]: 0 0 0 0 0 [ 6239.083124] Node 0 DMA: 1*4kB (U) 0*8kB 0*16kB 2*32kB (U) 3*64kB (U) 2*128kB (U) 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15876kB [ 6239.083130] Node 0 DMA32: 7427*4kB (UMEH) 11471*8kB (UMEH) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 121476kB [ 6239.083134] Node 0 Normal: 2385*4kB (UMEH) 6487*8kB (UM) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 61436kB [ 6239.083139] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB [ 6239.083140] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [ 6239.083141] 7066856 total pagecache pages [ 6239.083141] 305 pages in swap cache [ 6239.083142] Swap cache stats: add 97127, delete 96822, find 36208/67196 [ 6239.083142] Free swap = 6793020kB [ 6239.083142] Total swap = 6959100kB [ 6239.083143] 8362173 pages RAM [ 6239.083143] 0 pages HighMem/MovableOnly [ 6239.083143] 134166 pages reserved [ 6239.083144] 0 pages hwpoisoned [ 6239.083145] kworker/5:2H: page allocation failure: order:2, mode:0x1284020(GFP_ATOMIC|__GFP_COMP|__GFP_NOTRACK) [ 6239.083147] CPU: 5 PID: 2062 Comm: kworker/5:2H Tainted: G E 4.10.0-trunk-amd64 #1 Debian 4.10-1~exp1 [ 6239.083148] Hardware name: To be filled by O.E.M. To be filled by O.E.M./970 PRO GAMING/AURA, BIOS 0901 11/07/2016 [ 6239.083149] Workqueue: kblockd blk_mq_run_work_fn [ 6239.083149] Call Trace: [ 6239.083151] ? dump_stack+0x5c/0x78 [ 6239.083152] ? warn_alloc+0x13a/0x160 [ 6239.083153] ? __alloc_pages_slowpath+0x28f/0xab0 [ 6239.083155] ? get_page_from_freelist+0x464/0xbe0 [ 6239.083156] ? __alloc_pages_nodemask+0x1fe/0x260 [ 6239.083158] ? cache_grow_begin+0x9d/0x550 [ 6239.083159] ? cache_grow_begin+0x9d/0x550 [ 6239.083160] ? fallback_alloc+0x161/0x200 [ 6239.083162] ? nvme_queue_rq+0x131/0x81e [nvme] [ 6239.083163] ? __kmalloc+0x1e1/0x5e0 [ 6239.083165] ? nvme_queue_rq+0x131/0x81e [nvme] [ 6239.083166] ? cfq_dispatch_requests+0x4f/0x970 [ 6239.083166] ? insert_work+0x69/0xf0 [ 6239.083168] ? blk_mq_dispatch_rq_list+0xf7/0x230 [ 6239.083169] ? blk_mq_process_rq_list+0x1b0/0x1e0 [ 6239.083170] ? process_one_work+0x197/0x430 [ 6239.083170] ? worker_thread+0x4d/0x4a0 [ 6239.083172] ? kthread+0xf4/0x130 [ 6239.083172] ? process_one_work+0x430/0x430 [ 6239.083174] ? kthread_create_on_node+0x60/0x60 [ 6239.083175] ? ret_from_fork+0x26/0x40 [ 6239.083175] Mem-Info: [ 6239.083178] active_anon:640028 inactive_anon:155846 isolated_anon:0 active_file:6574947 inactive_file:454965 isolated_file:96 unevictable:16 dirty:301619 writeback:929067 unstable:0 slab_reclaimable:228012 slab_unreclaimable:38764 mapped:78404 shmem:36436 pagetables:22528 bounce:0 free:49532 free_pcp:283 free_cma:0 [ 6239.083181] Node 0 active_anon:2560112kB inactive_anon:623384kB active_file:26299788kB inactive_file:1819860kB unevictable:64kB isolated(anon):0kB isolated(file):384kB mapped:313616kB dirty:1206476kB writeback:3716268kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 145744kB writeback_tmp:0kB unstable:0kB pages_scanned:308175 all_unreclaimable? no [ 6239.083181] Node 0 DMA free:15876kB min:32kB low:44kB high:56kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15996kB managed:15892kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:16kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [ 6239.083183] lowmem_reserve[]: 0 2880 32031 32031 32031 [ 6239.083185] Node 0 DMA32 free:120708kB min:6072kB low:9020kB high:11968kB active_anon:138220kB inactive_anon:1584kB active_file:2307312kB inactive_file:247928kB unevictable:0kB writepending:557264kB present:3040380kB managed:3040380kB mlocked:0kB slab_reclaimable:176668kB slab_unreclaimable:37020kB kernel_stack:272kB pagetables:1256kB bounce:0kB free_pcp:184kB local_pcp:0kB free_cma:0kB [ 6239.083188] lowmem_reserve[]: 0 0 29151 29151 29151 [ 6239.083189] Node 0 Normal free:61544kB min:61476kB low:91324kB high:121172kB active_anon:2421892kB inactive_anon:621800kB active_file:23992368kB inactive_file:1571104kB unevictable:64kB writepending:4366500kB present:30392316kB managed:29855756kB mlocked:64kB slab_reclaimable:735380kB slab_unreclaimable:118020kB kernel_stack:18736kB pagetables:88856kB bounce:0kB free_pcp:948kB local_pcp:112kB free_cma:0kB [ 6239.083192] lowmem_reserve[]: 0 0 0 0 0 [ 6239.083194] Node 0 DMA: 1*4kB (U) 0*8kB 0*16kB 2*32kB (U) 3*64kB (U) 2*128kB (U) 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15876kB [ 6239.083200] Node 0 DMA32: 7427*4kB (UMEH) 11471*8kB (UMEH) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 121476kB [ 6239.083204] Node 0 Normal: 2385*4kB (UMEH) 6487*8kB (UM) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 61436kB [ 6239.083210] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB [ 6239.083210] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [ 6239.083211] 7066856 total pagecache pages [ 6239.083211] 305 pages in swap cache [ 6239.083212] Swap cache stats: add 97127, delete 96822, find 36208/67196 [ 6239.083212] Free swap = 6793020kB [ 6239.083212] Total swap = 6959100kB [ 6239.083213] 8362173 pages RAM [ 6239.083213] 0 pages HighMem/MovableOnly [ 6239.083213] 134166 pages reserved [ 6239.083214] 0 pages hwpoisoned [ 6239.083217] kworker/5:2H: page allocation failure: order:2, mode:0x1284020(GFP_ATOMIC|__GFP_COMP|__GFP_NOTRACK) [ 6239.083219] CPU: 5 PID: 2062 Comm: kworker/5:2H Tainted: G E 4.10.0-trunk-amd64 #1 Debian 4.10-1~exp1 [ 6239.083220] Hardware name: To be filled by O.E.M. To be filled by O.E.M./970 PRO GAMING/AURA, BIOS 0901 11/07/2016 [ 6239.083221] Workqueue: kblockd blk_mq_run_work_fn [ 6239.083221] Call Trace: [ 6239.083222] ? dump_stack+0x5c/0x78 [ 6239.083224] ? warn_alloc+0x13a/0x160 [ 6239.083225] ? __alloc_pages_slowpath+0x28f/0xab0 [ 6239.083226] ? get_page_from_freelist+0x464/0xbe0 [ 6239.083228] ? __alloc_pages_nodemask+0x1fe/0x260 [ 6239.083229] ? cache_grow_begin+0x9d/0x550 [ 6239.083231] ? cache_grow_begin+0x9d/0x550 [ 6239.083232] ? fallback_alloc+0x161/0x200 [ 6239.083236] ? nvme_queue_rq+0x131/0x81e [nvme] [ 6239.083238] ? __kmalloc+0x1e1/0x5e0 [ 6239.083241] ? nvme_queue_rq+0x131/0x81e [nvme] [ 6239.083242] ? cfq_dispatch_requests+0x4f/0x970 [ 6239.083243] ? insert_work+0x69/0xf0 [ 6239.083244] ? blk_mq_dispatch_rq_list+0xf7/0x230 [ 6239.083245] ? blk_mq_process_rq_list+0x1b0/0x1e0 [ 6239.083246] ? process_one_work+0x197/0x430 [ 6239.083247] ? worker_thread+0x4d/0x4a0 [ 6239.083248] ? kthread+0xf4/0x130 [ 6239.083249] ? process_one_work+0x430/0x430 [ 6239.083250] ? kthread_create_on_node+0x60/0x60 [ 6239.083251] ? ret_from_fork+0x26/0x40 [ 6239.083252] Mem-Info: [ 6239.083254] active_anon:640028 inactive_anon:155846 isolated_anon:0 active_file:6574947 inactive_file:454965 isolated_file:96 unevictable:16 dirty:301619 writeback:929067 unstable:0 slab_reclaimable:228012 slab_unreclaimable:38764 mapped:78404 shmem:36436 pagetables:22528 bounce:0 free:49532 free_pcp:283 free_cma:0 [ 6239.083258] Node 0 active_anon:2560112kB inactive_anon:623384kB active_file:26299788kB inactive_file:1819860kB unevictable:64kB isolated(anon):0kB isolated(file):384kB mapped:313616kB dirty:1206476kB writeback:3716268kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 145744kB writeback_tmp:0kB unstable:0kB pages_scanned:308655 all_unreclaimable? no [ 6239.083258] Node 0 DMA free:15876kB min:32kB low:44kB high:56kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15996kB managed:15892kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:16kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [ 6239.083261] lowmem_reserve[]: 0 2880 32031 32031 32031 [ 6239.083263] Node 0 DMA32 free:120708kB min:6072kB low:9020kB high:11968kB active_anon:138220kB inactive_anon:1584kB active_file:2307312kB inactive_file:247928kB unevictable:0kB writepending:557264kB present:3040380kB managed:3040380kB mlocked:0kB slab_reclaimable:176668kB slab_unreclaimable:37020kB kernel_stack:272kB pagetables:1256kB bounce:0kB free_pcp:184kB local_pcp:0kB free_cma:0kB [ 6239.083265] lowmem_reserve[]: 0 0 29151 29151 29151 [ 6239.083267] Node 0 Normal free:61544kB min:61476kB low:91324kB high:121172kB active_anon:2421892kB inactive_anon:621800kB active_file:23992368kB inactive_file:1571104kB unevictable:64kB writepending:4366500kB present:30392316kB managed:29855756kB mlocked:64kB slab_reclaimable:735380kB slab_unreclaimable:118020kB kernel_stack:18736kB pagetables:88856kB bounce:0kB free_pcp:948kB local_pcp:112kB free_cma:0kB [ 6239.083270] lowmem_reserve[]: 0 0 0 0 0 [ 6239.083271] Node 0 DMA: 1*4kB (U) 0*8kB 0*16kB 2*32kB (U) 3*64kB (U) 2*128kB (U) 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15876kB [ 6239.083277] Node 0 DMA32: 7427*4kB (UMEH) 11471*8kB (UMEH) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 121476kB [ 6239.083282] Node 0 Normal: 2385*4kB (UMEH) 6487*8kB (UM) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 61436kB [ 6239.083287] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB [ 6239.083288] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [ 6239.083288] 7066856 total pagecache pages [ 6239.083289] 305 pages in swap cache [ 6239.083289] Swap cache stats: add 97127, delete 96822, find 36208/67196 [ 6239.083290] Free swap = 6793020kB [ 6239.083290] Total swap = 6959100kB [ 6239.083290] 8362173 pages RAM [ 6239.083291] 0 pages HighMem/MovableOnly [ 6239.083291] 134166 pages reserved [ 6239.083291] 0 pages hwpoisoned [ 6239.083293] kworker/5:2H: page allocation failure: order:2, mode:0x1284020(GFP_ATOMIC|__GFP_COMP|__GFP_NOTRACK) [ 6239.083295] CPU: 5 PID: 2062 Comm: kworker/5:2H Tainted: G E 4.10.0-trunk-amd64 #1 Debian 4.10-1~exp1 [ 6239.083296] Hardware name: To be filled by O.E.M. To be filled by O.E.M./970 PRO GAMING/AURA, BIOS 0901 11/07/2016 [ 6239.083297] Workqueue: kblockd blk_mq_run_work_fn [ 6239.083298] Call Trace: [ 6239.083299] ? dump_stack+0x5c/0x78 [ 6239.083300] ? warn_alloc+0x13a/0x160 [ 6239.083302] ? __alloc_pages_slowpath+0x28f/0xab0 [ 6239.083303] ? get_page_from_freelist+0x464/0xbe0 [ 6239.083305] ? __alloc_pages_nodemask+0x1fe/0x260 [ 6239.083306] ? cache_grow_begin+0x9d/0x550 [ 6239.083307] ? cache_grow_begin+0x9d/0x550 [ 6239.083309] ? fallback_alloc+0x161/0x200 [ 6239.083310] ? nvme_queue_rq+0x131/0x81e [nvme] [ 6239.083312] ? __kmalloc+0x1e1/0x5e0 [ 6239.083313] ? nvme_queue_rq+0x131/0x81e [nvme] [ 6239.083314] ? cfq_dispatch_requests+0x4f/0x970 [ 6239.083315] ? insert_work+0x69/0xf0 [ 6239.083316] ? blk_mq_dispatch_rq_list+0xf7/0x230 [ 6239.083317] ? blk_mq_process_rq_list+0x1b0/0x1e0 [ 6239.083318] ? process_one_work+0x197/0x430 [ 6239.083319] ? worker_thread+0x4d/0x4a0 [ 6239.083320] ? kthread+0xf4/0x130 [ 6239.083321] ? process_one_work+0x430/0x430 [ 6239.083322] ? kthread_create_on_node+0x60/0x60 [ 6239.083323] ? ret_from_fork+0x26/0x40 [ 6239.083324] Mem-Info: [ 6239.083326] active_anon:640028 inactive_anon:155846 isolated_anon:0 active_file:6574947 inactive_file:454965 isolated_file:96 unevictable:16 dirty:301619 writeback:929067 unstable:0 slab_reclaimable:228012 slab_unreclaimable:38764 mapped:78404 shmem:36436 pagetables:22528 bounce:0 free:49532 free_pcp:283 free_cma:0 [ 6239.083329] Node 0 active_anon:2560112kB inactive_anon:623384kB active_file:26299788kB inactive_file:1819860kB unevictable:64kB isolated(anon):0kB isolated(file):384kB mapped:313616kB dirty:1206476kB writeback:3716268kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 145744kB writeback_tmp:0kB unstable:0kB pages_scanned:308943 all_unreclaimable? no [ 6239.083330] Node 0 DMA free:15876kB min:32kB low:44kB high:56kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15996kB managed:15892kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:16kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [ 6239.083332] lowmem_reserve[]: 0 2880 32031 32031 32031 [ 6239.083334] Node 0 DMA32 free:120708kB min:6072kB low:9020kB high:11968kB active_anon:138220kB inactive_anon:1584kB active_file:2307312kB inactive_file:247928kB unevictable:0kB writepending:557264kB present:3040380kB managed:3040380kB mlocked:0kB slab_reclaimable:176668kB slab_unreclaimable:37020kB kernel_stack:272kB pagetables:1256kB bounce:0kB free_pcp:184kB local_pcp:0kB free_cma:0kB [ 6239.083336] lowmem_reserve[]: 0 0 29151 29151 29151 [ 6239.083338] Node 0 Normal free:61544kB min:61476kB low:91324kB high:121172kB active_anon:2421892kB inactive_anon:621800kB active_file:23992368kB inactive_file:1571104kB unevictable:64kB writepending:4366500kB present:30392316kB managed:29855756kB mlocked:64kB slab_reclaimable:735380kB slab_unreclaimable:118020kB kernel_stack:18736kB pagetables:88856kB bounce:0kB free_pcp:948kB local_pcp:112kB free_cma:0kB [ 6239.083341] lowmem_reserve[]: 0 0 0 0 0 [ 6239.083342] Node 0 DMA: 1*4kB (U) 0*8kB 0*16kB 2*32kB (U) 3*64kB (U) 2*128kB (U) 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15876kB [ 6239.083348] Node 0 DMA32: 7427*4kB (UMEH) 11471*8kB (UMEH) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 121476kB [ 6239.083353] Node 0 Normal: 2385*4kB (UMEH) 6487*8kB (UM) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 61436kB [ 6239.083358] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB [ 6239.083359] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [ 6239.083359] 7066856 total pagecache pages [ 6239.083360] 305 pages in swap cache [ 6239.083360] Swap cache stats: add 97127, delete 96822, find 36208/67196 [ 6239.083361] Free swap = 6793020kB [ 6239.083361] Total swap = 6959100kB [ 6239.083361] 8362173 pages RAM [ 6239.083362] 0 pages HighMem/MovableOnly [ 6239.083362] 134166 pages reserved [ 6239.083362] 0 pages hwpoisoned [ 6239.083364] kworker/5:2H: page allocation failure: order:2, mode:0x1284020(GFP_ATOMIC|__GFP_COMP|__GFP_NOTRACK) [ 6239.083366] CPU: 5 PID: 2062 Comm: kworker/5:2H Tainted: G E 4.10.0-trunk-amd64 #1 Debian 4.10-1~exp1 [ 6239.083367] Hardware name: To be filled by O.E.M. To be filled by O.E.M./970 PRO GAMING/AURA, BIOS 0901 11/07/2016 [ 6239.083368] Workqueue: kblockd blk_mq_run_work_fn [ 6239.083368] Call Trace: [ 6239.083369] ? dump_stack+0x5c/0x78 [ 6239.083371] ? warn_alloc+0x13a/0x160 [ 6239.083372] ? __alloc_pages_slowpath+0x28f/0xab0 [ 6239.083373] ? get_page_from_freelist+0x464/0xbe0 [ 6239.083375] ? __alloc_pages_nodemask+0x1fe/0x260 [ 6239.083376] ? cache_grow_begin+0x9d/0x550 [ 6239.083378] ? cache_grow_begin+0x9d/0x550 [ 6239.083379] ? fallback_alloc+0x161/0x200 [ 6239.083381] ? nvme_queue_rq+0x131/0x81e [nvme] [ 6239.083382] ? __kmalloc+0x1e1/0x5e0 [ 6239.083383] ? nvme_queue_rq+0x131/0x81e [nvme] [ 6239.083384] ? cfq_dispatch_requests+0x4f/0x970 [ 6239.083385] ? insert_work+0x69/0xf0 [ 6239.083386] ? blk_mq_dispatch_rq_list+0xf7/0x230 [ 6239.083387] ? blk_mq_process_rq_list+0x1b0/0x1e0 [ 6239.083388] ? process_one_work+0x197/0x430 [ 6239.083389] ? worker_thread+0x4d/0x4a0 [ 6239.083390] ? kthread+0xf4/0x130 [ 6239.083391] ? process_one_work+0x430/0x430 [ 6239.083392] ? kthread_create_on_node+0x60/0x60 [ 6239.083393] ? ret_from_fork+0x26/0x40 [ 6239.083394] Mem-Info: [ 6239.083397] active_anon:640028 inactive_anon:155846 isolated_anon:0 active_file:6574947 inactive_file:454965 isolated_file:96 unevictable:16 dirty:301619 writeback:929067 unstable:0 slab_reclaimable:228012 slab_unreclaimable:38764 mapped:78404 shmem:36436 pagetables:22528 bounce:0 free:49532 free_pcp:283 free_cma:0 [ 6239.083400] Node 0 active_anon:2560112kB inactive_anon:623384kB active_file:26299788kB inactive_file:1819860kB unevictable:64kB isolated(anon):0kB isolated(file):384kB mapped:313616kB dirty:1206476kB writeback:3716268kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 145744kB writeback_tmp:0kB unstable:0kB pages_scanned:309327 all_unreclaimable? no [ 6239.083400] Node 0 DMA free:15876kB min:32kB low:44kB high:56kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15996kB managed:15892kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:16kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [ 6239.083403] lowmem_reserve[]: 0 2880 32031 32031 32031 [ 6239.083405] Node 0 DMA32 free:120708kB min:6072kB low:9020kB high:11968kB active_anon:138220kB inactive_anon:1584kB active_file:2307312kB inactive_file:247928kB unevictable:0kB writepending:557264kB present:3040380kB managed:3040380kB mlocked:0kB slab_reclaimable:176668kB slab_unreclaimable:37020kB kernel_stack:272kB pagetables:1256kB bounce:0kB free_pcp:184kB local_pcp:0kB free_cma:0kB [ 6239.083408] lowmem_reserve[]: 0 0 29151 29151 29151 [ 6239.083409] Node 0 Normal free:61544kB min:61476kB low:91324kB high:121172kB active_anon:2421892kB inactive_anon:621800kB active_file:23992368kB inactive_file:1571104kB unevictable:64kB writepending:4366500kB present:30392316kB managed:29855756kB mlocked:64kB slab_reclaimable:735380kB slab_unreclaimable:118020kB kernel_stack:18736kB pagetables:88856kB bounce:0kB free_pcp:948kB local_pcp:112kB free_cma:0kB [ 6239.083412] lowmem_reserve[]: 0 0 0 0 0 [ 6239.083414] Node 0 DMA: 1*4kB (U) 0*8kB 0*16kB 2*32kB (U) 3*64kB (U) 2*128kB (U) 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15876kB [ 6239.083420] Node 0 DMA32: 7427*4kB (UMEH) 11471*8kB (UMEH) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 121476kB [ 6239.083424] Node 0 Normal: 2385*4kB (UMEH) 6487*8kB (UM) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 61436kB [ 6239.083430] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB [ 6239.083430] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [ 6239.083431] 7066856 total pagecache pages [ 6239.083431] 305 pages in swap cache [ 6239.083432] Swap cache stats: add 97127, delete 96822, find 36208/67196 [ 6239.083432] Free swap = 6793020kB [ 6239.083432] Total swap = 6959100kB [ 6239.083433] 8362173 pages RAM [ 6239.083433] 0 pages HighMem/MovableOnly [ 6239.083434] 134166 pages reserved -- Thomas Fjellstrom thomas@fjellstrom.ca