Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1753596AbZJQTtJ (ORCPT ); Sat, 17 Oct 2009 15:49:09 -0400 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1751540AbZJQTtI (ORCPT ); Sat, 17 Oct 2009 15:49:08 -0400 Received: from nerdhammel.gnuher.de ([88.198.0.170]:53272 "EHLO nerdhammel.gnuher.de" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752673AbZJQTtF (ORCPT ); Sat, 17 Oct 2009 15:49:05 -0400 X-Greylist: delayed 2748 seconds by postgrey-1.27 at vger.kernel.org; Sat, 17 Oct 2009 15:49:04 EDT To: linux-kernel@vger.kernel.org Path: not-for-mail From: Sven Geggus Subject: Kernel crash on 2.6.31.x (kcryptd: page allocation failure..) Date: Sat, 17 Oct 2009 19:03:16 +0000 (UTC) Organization: Geggus clan, virtual section Message-ID: NNTP-Posting-Host: diesel.geggus.net X-Trace: ultimate100.geggus.net 1255806196 5452 192.168.3.2 (17 Oct 2009 19:03:16 GMT) X-Complaints-To: usenet@geggus.net NNTP-Posting-Date: Sat, 17 Oct 2009 19:03:16 +0000 (UTC) Cancel-Lock: sha1:XpkWbnl3rxq6FWd2A+fHZKoj0L4= X-TERMINAL: rxvt-unicode X-OS: Debian GNU/Linux (Kernel 2.6.31-ztdummy) User-Agent: tin/1.9.5-20090720 ("Rieclachan") (UNIX) (Linux/2.6.31-ztdummy (i686)) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 35828 Lines: 726 Hello, I can reproducible crash my machine by writing bulk data from a socket to an encrypted partition. It always crashes after a few Gigabytes have been written. The Partition in charge is using dm-crypt+xfs filesystem. Here is what I captured using a serial console cable: --cut-- kcryptd: page allocation failure. order:0, mode:0x20 Pid: 4904, comm: kcryptd Not tainted 2.6.31.4-ztdummy #1 Call Trace: [] ? __alloc_pages_nodemask+0x4c5/0x50c [] ? cache_alloc_refill+0x218/0x454 [] ? __kmalloc+0x75/0x9e [] ? __alloc_skb+0x59/0x149 [] ? tcp_v4_rcv+0x448/0x6a5 [] ? __netdev_alloc_skb+0x15/0x2f [] ? e1000_alloc_rx_buffers+0x90/0x374 [] ? e1000_clean_rx_irq+0x3e7/0x429 [] ? e1000_clean+0x318/0x4af [] ? ip_local_deliver_finish+0xf3/0x192 [] ? ip_rcv+0x236/0x269 [] ? net_rx_action+0x71/0x136 [] ? getnstimeofday+0x55/0xaf [] ? __do_softirq+0x7e/0x108 [] ? e1000_intr+0x10a/0x148 [] ? call_softirq+0x1a/0x24 [] ? do_softirq+0x28/0x62 [] ? irq_exit+0x39/0x6d [] ? do_IRQ+0x86/0x9a [] ? ret_from_intr+0x0/0x9 [] ? crypto_cbc_encrypt+0x10f/0x15a [] ? aes_encrypt+0x0/0x9 [] ? async_encrypt+0x35/0x3a [] ? crypt_convert+0x1e9/0x266 [] ? kcryptd_crypt+0x3eb/0x40d [] ? kcryptd_crypt+0x0/0x40d [] ? worker_thread+0x0/0x187 [] ? worker_thread+0x106/0x187 [] ? autoremove_wake_function+0x0/0x2e [] ? worker_thread+0x0/0x187 [] ? kthread+0x85/0x8d [] ? finish_task_switch+0x2a/0x69 [] ? child_rip+0xa/0x20 [] ? kthread+0x0/0x8d [] ? child_rip+0x0/0x20 Mem-Info: DMA per-cpu: CPU 0: hi: 0, btch: 1 usd: 0 DMA32 per-cpu: CPU 0: hi: 186, btch: 31 usd: 184 Active_anon:11837 active_file:39855 inactive_anon:18739 inactive_file:40700 unevictable:0 dirty:7416 writeback:4093 unstable:0 free:759 slab:10144 mapped:2777 pagetables:2524 bounce:0 DMA free:1992kB min:84kB low:104kB high:124kB active_anon:0kB inactive_anon:124kB active_file:4904kB inactive_file:8236kB unevictable:0kB present:15308kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 489 489 489 DMA32 free:1044kB min:2784kB low:3480kB high:4176kB active_anon:47348kB inactive_anon:74832kB active_file:154516kB inactive_file:154564kB unevictable:0kB present:500768kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 DMA: 0*4kB 1*8kB 0*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 1992kB DMA32: 261*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1044kB 95554 total pagecache pages 14741 pages in swap cache Swap cache stats: add 40531, delete 25790, find 57320/57805 Free swap = 856060kB Total swap = 987832kB 131008 pages RAM 4139 pages reserved 92164 pages shared 45322 pages non-shared kcryptd: page allocation failure. order:0, mode:0x20 Pid: 4904, comm: kcryptd Not tainted 2.6.31.4-ztdummy #1 Call Trace: [] ? __alloc_pages_nodemask+0x4c5/0x50c [] ? cache_alloc_refill+0x218/0x454 [] ? __kmalloc+0x75/0x9e [] ? __alloc_skb+0x59/0x149 [] ? __netdev_alloc_skb+0x15/0x2f [] ? rhine_napipoll+0x381/0x490 [] ? net_rx_action+0x71/0x136 [] ? getnstimeofday+0x55/0xaf [] ? __do_softirq+0x7e/0x108 [] ? e1000_intr+0x10a/0x148 [] ? call_softirq+0x1a/0x24 [] ? do_softirq+0x28/0x62 [] ? irq_exit+0x39/0x6d [] ? do_IRQ+0x86/0x9a [] ? ret_from_intr+0x0/0x9 [] ? crypto_cbc_encrypt+0x10f/0x15a [] ? aes_encrypt+0x0/0x9 [] ? async_encrypt+0x35/0x3a [] ? crypt_convert+0x1e9/0x266 [] ? kcryptd_crypt+0x3eb/0x40d [] ? kcryptd_crypt+0x0/0x40d [] ? worker_thread+0x0/0x187 [] ? worker_thread+0x106/0x187 [] ? autoremove_wake_function+0x0/0x2e [] ? worker_thread+0x0/0x187 [] ? kthread+0x85/0x8d [] ? finish_task_switch+0x2a/0x69 [] ? child_rip+0xa/0x20 [] ? kthread+0x0/0x8d [] ? child_rip+0x0/0x20 Mem-Info: DMA per-cpu: CPU 0: hi: 0, btch: 1 usd: 0 DMA32 per-cpu: CPU 0: hi: 186, btch: 31 usd: 184 Active_anon:11837 active_file:39855 inactive_anon:18739 inactive_file:40700 unevictable:0 dirty:7416 writeback:4093 unstable:0 free:759 slab:10144 mapped:2777 pagetables:2524 bounce:0 DMA free:1992kB min:84kB low:104kB high:124kB active_anon:0kB inactive_anon:124kB active_file:4904kB inactive_file:8236kB unevictable:0kB present:15308kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 489 489 489 DMA32 free:1044kB min:2784kB low:3480kB high:4176kB active_anon:47348kB inactive_anon:74832kB active_file:154516kB inactive_file:154564kB unevictable:0kB present:500768kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 DMA: 0*4kB 1*8kB 0*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 1992kB DMA32: 261*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1044kB 95554 total pagecache pages 14741 pages in swap cache Swap cache stats: add 40531, delete 25790, find 57320/57805 Free swap = 856060kB Total swap = 987832kB 131008 pages RAM 4139 pages reserved 92164 pages shared 45322 pages non-shared kcryptd: page allocation failure. order:0, mode:0x20 Pid: 4904, comm: kcryptd Not tainted 2.6.31.4-ztdummy #1 Call Trace: [] ? __alloc_pages_nodemask+0x4c5/0x50c [] ? ata_bmdma_setup+0x53/0x6d [] ? cache_alloc_refill+0x218/0x454 [] ? __kmalloc+0x75/0x9e [] ? __alloc_skb+0x59/0x149 [] ? inet_sk_rebuild_header+0x1b/0x2fa [] ? pskb_copy+0x19/0x166 [] ? tcp_transmit_skb+0x84/0x623 [] ? __blk_run_queue+0x41/0x6e [] ? rb_insert_color+0x66/0xe2 [] ? tcp_current_mss+0x3c/0x57 [] ? tcp_retransmit_skb+0x4a1/0x591 [] ? check_preempt_wakeup+0x22/0x110 [] ? tcp_write_timer+0x3b1/0x590 [] ? tcp_write_timer+0x0/0x590 [] ? run_timer_softirq+0x16c/0x1cb [] ? __do_softirq+0x7e/0x108 [] ? e1000_intr+0x10a/0x148 [] ? call_softirq+0x1a/0x24 [] ? do_softirq+0x28/0x62 [] ? irq_exit+0x39/0x6d [] ? do_IRQ+0x86/0x9a [] ? ret_from_intr+0x0/0x9 [] ? crypto_cbc_encrypt+0x10f/0x15a [] ? aes_encrypt+0x0/0x9 [] ? async_encrypt+0x35/0x3a [] ? crypt_convert+0x1e9/0x266 [] ? kcryptd_crypt+0x3eb/0x40d [] ? kcryptd_crypt+0x0/0x40d [] ? worker_thread+0x0/0x187 [] ? worker_thread+0x106/0x187 [] ? autoremove_wake_function+0x0/0x2e [] ? worker_thread+0x0/0x187 [] ? kthread+0x85/0x8d [] ? finish_task_switch+0x2a/0x69 [] ? child_rip+0xa/0x20 [] ? kthread+0x0/0x8d [] ? child_rip+0x0/0x20 Mem-Info: DMA per-cpu: CPU 0: hi: 0, btch: 1 usd: 0 DMA32 per-cpu: CPU 0: hi: 186, btch: 31 usd: 184 Active_anon:11837 active_file:39855 inactive_anon:18739 inactive_file:40700 unevictable:0 dirty:7416 writeback:4093 unstable:0 free:759 slab:10144 mapped:2777 pagetables:2524 bounce:0 DMA free:1992kB min:84kB low:104kB high:124kB active_anon:0kB inactive_anon:124kB active_file:4904kB inactive_file:8236kB unevictable:0kB present:15308kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 489 489 489 DMA32 free:1044kB min:2784kB low:3480kB high:4176kB active_anon:47348kB inactive_anon:74832kB active_file:154516kB inactive_file:154564kB unevictable:0kB present:500768kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 DMA: 0*4kB 1*8kB 0*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 1992kB DMA32: 261*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1044kB 95554 total pagecache pages 14741 pages in swap cache Swap cache stats: add 40531, delete 25790, find 57320/57805 Free swap = 856060kB Total swap = 987832kB 131008 pages RAM 4139 pages reserved 92164 pages shared 45322 pages non-shared kcryptd: page allocation failure. order:0, mode:0x20 Pid: 4904, comm: kcryptd Not tainted 2.6.31.4-ztdummy #1 Call Trace: [] ? __alloc_pages_nodemask+0x4c5/0x50c [] ? cache_alloc_refill+0x218/0x454 [] ? __kmalloc+0x75/0x9e [] ? __alloc_skb+0x59/0x149 [] ? inet_sk_rebuild_header+0x1b/0x2fa [] ? pskb_copy+0x19/0x166 [] ? tcp_transmit_skb+0x84/0x623 [] ? __blk_run_queue+0x41/0x6e [] ? rb_insert_color+0x66/0xe2 [] ? tcp_current_mss+0x3c/0x57 [] ? tcp_retransmit_skb+0x4a1/0x591 [] ? check_preempt_wakeup+0x22/0x110 [] ? tcp_write_timer+0x3b1/0x590 [] ? tcp_write_timer+0x0/0x590 [] ? run_timer_softirq+0x16c/0x1cb [] ? __do_softirq+0x7e/0x108 [] ? e1000_intr+0x10a/0x148 [] ? call_softirq+0x1a/0x24 [] ? do_softirq+0x28/0x62 [] ? irq_exit+0x39/0x6d [] ? do_IRQ+0x86/0x9a [] ? ret_from_intr+0x0/0x9 [] ? crypto_cbc_encrypt+0x10f/0x15a [] ? aes_encrypt+0x0/0x9 [] ? async_encrypt+0x35/0x3a [] ? crypt_convert+0x1e9/0x266 [] ? kcryptd_crypt+0x3eb/0x40d [] ? kcryptd_crypt+0x0/0x40d [] ? worker_thread+0x0/0x187 [] ? worker_thread+0x106/0x187 [] ? autoremove_wake_function+0x0/0x2e [] ? worker_thread+0x0/0x187 [] ? kthread+0x85/0x8d [] ? finish_task_switch+0x2a/0x69 [] ? child_rip+0xa/0x20 [] ? kthread+0x0/0x8d [] ? child_rip+0x0/0x20 Mem-Info: DMA per-cpu: CPU 0: hi: 0, btch: 1 usd: 0 DMA32 per-cpu: CPU 0: hi: 186, btch: 31 usd: 184 Active_anon:11837 active_file:39855 inactive_anon:18739 inactive_file:40700 unevictable:0 dirty:7416 writeback:4093 unstable:0 free:759 slab:10144 mapped:2777 pagetables:2524 bounce:0 DMA free:1992kB min:84kB low:104kB high:124kB active_anon:0kB inactive_anon:124kB active_file:4904kB inactive_file:8236kB unevictable:0kB present:15308kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 489 489 489 DMA32 free:1044kB min:2784kB low:3480kB high:4176kB active_anon:47348kB inactive_anon:74832kB active_file:154516kB inactive_file:154564kB unevictable:0kB present:500768kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 DMA: 0*4kB 1*8kB 0*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 1992kB DMA32: 261*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1044kB 95554 total pagecache pages 14741 pages in swap cache Swap cache stats: add 40531, delete 25790, find 57320/57805 Free swap = 856060kB Total swap = 987832kB 131008 pages RAM 4139 pages reserved 92164 pages shared 45322 pages non-shared kcryptd: page allocation failure. order:0, mode:0x20 Pid: 4904, comm: kcryptd Not tainted 2.6.31.4-ztdummy #1 Call Trace: [] ? __alloc_pages_nodemask+0x4c5/0x50c [] ? irq_exit+0x40/0x6d [] ? cache_alloc_refill+0x218/0x454 [] ? __kmalloc+0x75/0x9e [] ? __alloc_skb+0x59/0x149 [] ? inet_sk_rebuild_header+0x1b/0x2fa [] ? pskb_copy+0x19/0x166 [] ? tcp_transmit_skb+0x84/0x623 [] ? __blk_run_queue+0x41/0x6e [] ? rb_insert_color+0x66/0xe2 [] ? tcp_current_mss+0x3c/0x57 [] ? tcp_retransmit_skb+0x4a1/0x591 [] ? check_preempt_wakeup+0x22/0x110 [] ? tcp_write_timer+0x3b1/0x590 [] ? tcp_write_timer+0x0/0x590 [] ? run_timer_softirq+0x16c/0x1cb [] ? __do_softirq+0x7e/0x108 [] ? e1000_intr+0x10a/0x148 [] ? call_softirq+0x1a/0x24 [] ? do_softirq+0x28/0x62 [] ? irq_exit+0x39/0x6d [] ? do_IRQ+0x86/0x9a [] ? ret_from_intr+0x0/0x9 [] ? crypto_cbc_encrypt+0x10f/0x15a [] ? aes_encrypt+0x0/0x9 [] ? async_encrypt+0x35/0x3a [] ? crypt_convert+0x1e9/0x266 [] ? kcryptd_crypt+0x3eb/0x40d [] ? kcryptd_crypt+0x0/0x40d [] ? worker_thread+0x0/0x187 [] ? worker_thread+0x106/0x187 [] ? autoremove_wake_function+0x0/0x2e [] ? worker_thread+0x0/0x187 [] ? kthread+0x85/0x8d [] ? finish_task_switch+0x2a/0x69 [] ? child_rip+0xa/0x20 [] ? kthread+0x0/0x8d [] ? child_rip+0x0/0x20 Mem-Info: DMA per-cpu: CPU 0: hi: 0, btch: 1 usd: 0 DMA32 per-cpu: CPU 0: hi: 186, btch: 31 usd: 184 Active_anon:11837 active_file:39855 inactive_anon:18739 inactive_file:40700 unevictable:0 dirty:7416 writeback:4093 unstable:0 free:759 slab:10144 mapped:2777 pagetables:2524 bounce:0 DMA free:1992kB min:84kB low:104kB high:124kB active_anon:0kB inactive_anon:124kB active_file:4904kB inactive_file:8236kB unevictable:0kB present:15308kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 489 489 489 DMA32 free:1044kB min:2784kB low:3480kB high:4176kB active_anon:47348kB inactive_anon:74832kB active_file:154516kB inactive_file:154564kB unevictable:0kB present:500768kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 DMA: 0*4kB 1*8kB 0*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 1992kB DMA32: 261*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1044kB 95554 total pagecache pages 14741 pages in swap cache Swap cache stats: add 40531, delete 25790, find 57320/57805 Free swap = 856060kB Total swap = 987832kB 131008 pages RAM 4139 pages reserved 92164 pages shared 45322 pages non-shared kcryptd: page allocation failure. order:0, mode:0x20 Pid: 4904, comm: kcryptd Not tainted 2.6.31.4-ztdummy #1 Call Trace: [] ? __alloc_pages_nodemask+0x4c5/0x50c [] ? cache_alloc_refill+0x218/0x454 [] ? __kmalloc+0x75/0x9e [] ? __alloc_skb+0x59/0x149 [] ? inet_sk_rebuild_header+0x1b/0x2fa [] ? pskb_copy+0x19/0x166 [] ? tcp_transmit_skb+0x84/0x623 [] ? hrtimer_interrupt+0xf1/0x106 [] ? tcp_current_mss+0x3c/0x57 [] ? tcp_retransmit_skb+0x4a1/0x591 [] ? tcp_write_timer+0x3b1/0x590 [] ? tcp_write_timer+0x0/0x590 [] ? run_timer_softirq+0x16c/0x1cb [] ? __do_softirq+0x7e/0x108 [] ? e1000_intr+0x10a/0x148 [] ? call_softirq+0x1a/0x24 [] ? do_softirq+0x28/0x62 [] ? irq_exit+0x39/0x6d [] ? do_IRQ+0x86/0x9a [] ? ret_from_intr+0x0/0x9 [] ? crypto_cbc_encrypt+0x10f/0x15a [] ? aes_encrypt+0x0/0x9 [] ? async_encrypt+0x35/0x3a [] ? crypt_convert+0x1e9/0x266 [] ? kcryptd_crypt+0x3eb/0x40d [] ? kcryptd_crypt+0x0/0x40d [] ? worker_thread+0x0/0x187 [] ? worker_thread+0x106/0x187 [] ? autoremove_wake_function+0x0/0x2e [] ? worker_thread+0x0/0x187 [] ? kthread+0x85/0x8d [] ? finish_task_switch+0x2a/0x69 [] ? child_rip+0xa/0x20 [] ? kthread+0x0/0x8d [] ? child_rip+0x0/0x20 Mem-Info: DMA per-cpu: CPU 0: hi: 0, btch: 1 usd: 0 DMA32 per-cpu: CPU 0: hi: 186, btch: 31 usd: 184 Active_anon:11837 active_file:39855 inactive_anon:18739 inactive_file:40700 unevictable:0 dirty:7416 writeback:4093 unstable:0 free:759 slab:10144 mapped:2777 pagetables:2524 bounce:0 DMA free:1992kB min:84kB low:104kB high:124kB active_anon:0kB inactive_anon:124kB active_file:4904kB inactive_file:8236kB unevictable:0kB present:15308kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 489 489 489 DMA32 free:1044kB min:2784kB low:3480kB high:4176kB active_anon:47348kB inactive_anon:74832kB active_file:154516kB inactive_file:154564kB unevictable:0kB present:500768kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 DMA: 0*4kB 1*8kB 0*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 1992kB DMA32: 261*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1044kB 95554 total pagecache pages 14741 pages in swap cache Swap cache stats: add 40531, delete 25790, find 57320/57805 Free swap = 856060kB Total swap = 987832kB 131008 pages RAM 4139 pages reserved 92164 pages shared 45322 pages non-shared kcryptd: page allocation failure. order:0, mode:0x20 Pid: 4904, comm: kcryptd Not tainted 2.6.31.4-ztdummy #1 Call Trace: [] ? __alloc_pages_nodemask+0x4c5/0x50c [] ? cache_alloc_refill+0x218/0x454 [] ? __kmalloc+0x75/0x9e [] ? __alloc_skb+0x59/0x149 [] ? inet_sk_rebuild_header+0x1b/0x2fa [] ? pskb_copy+0x19/0x166 [] ? tcp_transmit_skb+0x84/0x623 [] ? hrtimer_interrupt+0xf1/0x106 [] ? tcp_current_mss+0x3c/0x57 [] ? tcp_retransmit_skb+0x4a1/0x591 [] ? check_preempt_wakeup+0x22/0x110 [] ? tcp_write_timer+0x3b1/0x590 [] ? tcp_write_timer+0x0/0x590 [] ? run_timer_softirq+0x16c/0x1cb [] ? __do_softirq+0x7e/0x108 [] ? e1000_intr+0x10a/0x148 [] ? call_softirq+0x1a/0x24 [] ? do_softirq+0x28/0x62 [] ? irq_exit+0x39/0x6d [] ? do_IRQ+0x86/0x9a [] ? ret_from_intr+0x0/0x9 [] ? crypto_cbc_encrypt+0x10f/0x15a [] ? aes_encrypt+0x0/0x9 [] ? async_encrypt+0x35/0x3a [] ? crypt_convert+0x1e9/0x266 [] ? kcryptd_crypt+0x3eb/0x40d [] ? kcryptd_crypt+0x0/0x40d [] ? worker_thread+0x0/0x187 [] ? worker_thread+0x106/0x187 [] ? autoremove_wake_function+0x0/0x2e [] ? worker_thread+0x0/0x187 [] ? kthread+0x85/0x8d [] ? finish_task_switch+0x2a/0x69 [] ? child_rip+0xa/0x20 [] ? kthread+0x0/0x8d [] ? child_rip+0x0/0x20 Mem-Info: DMA per-cpu: CPU 0: hi: 0, btch: 1 usd: 0 DMA32 per-cpu: CPU 0: hi: 186, btch: 31 usd: 184 Active_anon:11837 active_file:39855 inactive_anon:18739 inactive_file:40700 unevictable:0 dirty:7416 writeback:4093 unstable:0 free:759 slab:10144 mapped:2777 pagetables:2524 bounce:0 DMA free:1992kB min:84kB low:104kB high:124kB active_anon:0kB inactive_anon:124kB active_file:4904kB inactive_file:8236kB unevictable:0kB present:15308kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 489 489 489 DMA32 free:1044kB min:2784kB low:3480kB high:4176kB active_anon:47348kB inactive_anon:74832kB active_file:154516kB inactive_file:154564kB unevictable:0kB present:500768kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 DMA: 0*4kB 1*8kB 0*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 1992kB DMA32: 261*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1044kB 95554 total pagecache pages 14741 pages in swap cache Swap cache stats: add 40531, delete 25790, find 57320/57805 Free swap = 856060kB Total swap = 987832kB 131008 pages RAM 4139 pages reserved 92164 pages shared 45322 pages non-shared kcryptd: page allocation failure. order:0, mode:0x20 Pid: 4904, comm: kcryptd Not tainted 2.6.31.4-ztdummy #1 Call Trace: [] ? __alloc_pages_nodemask+0x4c5/0x50c [] ? irq_exit+0x40/0x6d [] ? cache_alloc_refill+0x218/0x454 [] ? __kmalloc+0x75/0x9e [] ? __alloc_skb+0x59/0x149 [] ? inet_sk_rebuild_header+0x1b/0x2fa [] ? pskb_copy+0x19/0x166 [] ? tcp_transmit_skb+0x84/0x623 [] ? tcp_current_mss+0x3c/0x57 [] ? tcp_retransmit_skb+0x4a1/0x591 [] ? tcp_write_timer+0x3b1/0x590 [] ? tcp_write_timer+0x0/0x590 [] ? run_timer_softirq+0x16c/0x1cb [] ? __do_softirq+0x7e/0x108 [] ? e1000_intr+0x10a/0x148 [] ? call_softirq+0x1a/0x24 [] ? do_softirq+0x28/0x62 [] ? irq_exit+0x39/0x6d [] ? do_IRQ+0x86/0x9a [] ? ret_from_intr+0x0/0x9 [] ? crypto_cbc_encrypt+0x10f/0x15a [] ? aes_encrypt+0x0/0x9 [] ? async_encrypt+0x35/0x3a [] ? crypt_convert+0x1e9/0x266 [] ? kcryptd_crypt+0x3eb/0x40d [] ? kcryptd_crypt+0x0/0x40d [] ? worker_thread+0x0/0x187 [] ? worker_thread+0x106/0x187 [] ? autoremove_wake_function+0x0/0x2e [] ? worker_thread+0x0/0x187 [] ? kthread+0x85/0x8d [] ? finish_task_switch+0x2a/0x69 [] ? child_rip+0xa/0x20 [] ? kthread+0x0/0x8d [] ? child_rip+0x0/0x20 Mem-Info: DMA per-cpu: CPU 0: hi: 0, btch: 1 usd: 0 DMA32 per-cpu: CPU 0: hi: 186, btch: 31 usd: 184 Active_anon:11837 active_file:39855 inactive_anon:18739 inactive_file:40700 unevictable:0 dirty:7416 writeback:4093 unstable:0 free:759 slab:10144 mapped:2777 pagetables:2524 bounce:0 DMA free:1992kB min:84kB low:104kB high:124kB active_anon:0kB inactive_anon:124kB active_file:4904kB inactive_file:8236kB unevictable:0kB present:15308kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 489 489 489 DMA32 free:1044kB min:2784kB low:3480kB high:4176kB active_anon:47348kB inactive_anon:74832kB active_file:154516kB inactive_file:154564kB unevictable:0kB present:500768kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 DMA: 0*4kB 1*8kB 0*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 1992kB DMA32: 261*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1044kB 95554 total pagecache pages 14741 pages in swap cache Swap cache stats: add 40531, delete 25790, find 57320/57805 Free swap = 856060kB Total swap = 987832kB 131008 pages RAM 4139 pages reserved 92164 pages shared 45322 pages non-shared kcryptd: page allocation failure. order:0, mode:0x20 Pid: 4904, comm: kcryptd Not tainted 2.6.31.4-ztdummy #1 Call Trace: [] ? __alloc_pages_nodemask+0x4c5/0x50c [] ? irq_exit+0x40/0x6d [] ? cache_alloc_refill+0x218/0x454 [] ? __kmalloc+0x75/0x9e [] ? __alloc_skb+0x59/0x149 [] ? inet_sk_rebuild_header+0x1b/0x2fa [] ? pskb_copy+0x19/0x166 [] ? tcp_transmit_skb+0x84/0x623 [] ? tcp_current_mss+0x3c/0x57 [] ? tcp_retransmit_skb+0x4a1/0x591 [] ? tcp_write_timer+0x3b1/0x590 [] ? tcp_write_timer+0x0/0x590 [] ? run_timer_softirq+0x16c/0x1cb [] ? __do_softirq+0x7e/0x108 [] ? e1000_intr+0x10a/0x148 [] ? call_softirq+0x1a/0x24 [] ? do_softirq+0x28/0x62 [] ? irq_exit+0x39/0x6d [] ? do_IRQ+0x86/0x9a [] ? ret_from_intr+0x0/0x9 [] ? crypto_cbc_encrypt+0x10f/0x15a [] ? aes_encrypt+0x0/0x9 [] ? async_encrypt+0x35/0x3a [] ? crypt_convert+0x1e9/0x266 [] ? kcryptd_crypt+0x3eb/0x40d [] ? kcryptd_crypt+0x0/0x40d [] ? worker_thread+0x0/0x187 [] ? worker_thread+0x106/0x187 [] ? autoremove_wake_function+0x0/0x2e [] ? worker_thread+0x0/0x187 [] ? kthread+0x85/0x8d [] ? finish_task_switch+0x2a/0x69 [] ? child_rip+0xa/0x20 [] ? kthread+0x0/0x8d [] ? child_rip+0x0/0x20 Mem-Info: DMA per-cpu: CPU 0: hi: 0, btch: 1 usd: 0 DMA32 per-cpu: CPU 0: hi: 186, btch: 31 usd: 184 Active_anon:11837 active_file:39855 inactive_anon:18739 inactive_file:40700 unevictable:0 dirty:7416 writeback:4093 unstable:0 free:759 slab:10144 mapped:2777 pagetables:2524 bounce:0 DMA free:1992kB min:84kB low:104kB high:124kB active_anon:0kB inactive_anon:124kB active_file:4904kB inactive_file:8236kB unevictable:0kB present:15308kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 489 489 489 DMA32 free:1044kB min:2784kB low:3480kB high:4176kB active_anon:47348kB inactive_anon:74832kB active_file:154516kB inactive_file:154564kB unevictable:0kB present:500768kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 DMA: 0*4kB 1*8kB 0*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 1992kB DMA32: 261*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1044kB 95554 total pagecache pages 14741 pages in swap cache Swap cache stats: add 40531, delete 25790, find 57320/57805 Free swap = 856060kB Total swap = 987832kB 131008 pages RAM 4139 pages reserved 92164 pages shared 45322 pages non-shared kcryptd: page allocation failure. order:0, mode:0x20 Pid: 4904, comm: kcryptd Not tainted 2.6.31.4-ztdummy #1 Call Trace: [] ? __alloc_pages_nodemask+0x4c5/0x50c [] ? irq_exit+0x40/0x6d [] ? cache_alloc_refill+0x218/0x454 [] ? __kmalloc+0x75/0x9e [] ? __alloc_skb+0x59/0x149 [] ? inet_sk_rebuild_header+0x1b/0x2fa [] ? pskb_copy+0x19/0x166 [] ? tcp_transmit_skb+0x84/0x623 [] ? mdio_ctrl_hw+0xbf/0x122 [] ? tcp_current_mss+0x3c/0x57 [] ? tcp_retransmit_skb+0x4a1/0x591 [] ? tcp_write_timer+0x3b1/0x590 [] ? tcp_write_timer+0x0/0x590 [] ? run_timer_softirq+0x16c/0x1cb [] ? __do_softirq+0x7e/0x108 [] ? e1000_intr+0x10a/0x148 [] ? call_softirq+0x1a/0x24 [] ? do_softirq+0x28/0x62 [] ? irq_exit+0x39/0x6d [] ? do_IRQ+0x86/0x9a [] ? ret_from_intr+0x0/0x9 [] ? crypto_cbc_encrypt+0x10f/0x15a [] ? aes_encrypt+0x0/0x9 [] ? async_encrypt+0x35/0x3a [] ? crypt_convert+0x1e9/0x266 [] ? kcryptd_crypt+0x3eb/0x40d [] ? kcryptd_crypt+0x0/0x40d [] ? worker_thread+0x0/0x187 [] ? worker_thread+0x106/0x187 [] ? autoremove_wake_function+0x0/0x2e [] ? worker_thread+0x0/0x187 [] ? kthread+0x85/0x8d [] ? finish_task_switch+0x2a/0x69 [] ? child_rip+0xa/0x20 [] ? kthread+0x0/0x8d [] ? child_rip+0x0/0x20 Mem-Info: DMA per-cpu: CPU 0: hi: 0, btch: 1 usd: 0 DMA32 per-cpu: CPU 0: hi: 186, btch: 31 usd: 184 Active_anon:11837 active_file:39855 inactive_anon:18739 inactive_file:40700 unevictable:0 dirty:7416 writeback:4093 unstable:0 free:759 slab:10144 mapped:2777 pagetables:2524 bounce:0 DMA free:1992kB min:84kB low:104kB high:124kB active_anon:0kB inactive_anon:124kB active_file:4904kB inactive_file:8236kB unevictable:0kB present:15308kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 489 489 489 DMA32 free:1044kB min:2784kB low:3480kB high:4176kB active_anon:47348kB inactive_anon:74832kB active_file:154516kB inactive_file:154564kB unevictable:0kB present:500768kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 DMA: 0*4kB 1*8kB 0*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 1992kB DMA32: 261*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1044kB 95554 total pagecache pages 14741 pages in swap cache Swap cache stats: add 40531, delete 25790, find 57320/57805 Free swap = 856060kB Total swap = 987832kB 131008 pages RAM 4139 pages reserved 92164 pages shared 45322 pages non-shared kcryptd: page allocation failure. order:0, mode:0x20 Pid: 4904, comm: kcryptd Not tainted 2.6.31.4-ztdummy #1 Call Trace: [] ? __alloc_pages_nodemask+0x4c5/0x50c [] ? cache_alloc_refill+0x218/0x454 [] ? __kmalloc+0x75/0x9e [] ? __alloc_skb+0x59/0x149 [] ? inet_sk_rebuild_header+0x1b/0x2fa [] ? pskb_copy+0x19/0x166 [] ? tcp_transmit_skb+0x84/0x623 [] ? tcp_current_mss+0x3c/0x57 [] ? tcp_retransmit_skb+0x4a1/0x591 [] ? tcp_write_timer+0x3b1/0x590 [] ? tcp_write_timer+0x0/0x590 [] ? run_timer_softirq+0x16c/0x1cb [] ? __do_softirq+0x7e/0x108 [] ? e1000_intr+0x10a/0x148 [] ? call_softirq+0x1a/0x24 [] ? do_softirq+0x28/0x62 [] ? irq_exit+0x39/0x6d [