Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1030198AbWHOKtq (ORCPT ); Tue, 15 Aug 2006 06:49:46 -0400 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1030203AbWHOKtq (ORCPT ); Tue, 15 Aug 2006 06:49:46 -0400 Received: from mtaout03-winn.ispmail.ntl.com ([81.103.221.49]:6390 "EHLO mtaout03-winn.ispmail.ntl.com") by vger.kernel.org with ESMTP id S1030198AbWHOKto (ORCPT ); Tue, 15 Aug 2006 06:49:44 -0400 Message-ID: <44E1A93E.8020701@gentoo.org> Date: Tue, 15 Aug 2006 12:00:14 +0100 From: Daniel Drake User-Agent: Thunderbird 1.5.0.5 (X11/20060811) MIME-Version: 1.0 To: Peter M CC: linux-kernel@vger.kernel.org, Stephen Hemminger , Francois Romieu , ansla80@yahoo.com Subject: Re: Oops in 2.6.17.7 running multiple eth bridges [r8169?] References: <31296a430608101034v2ecfbf8an66510427da49af4d@mail.gmail.com> In-Reply-To: <31296a430608101034v2ecfbf8an66510427da49af4d@mail.gmail.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Sender: linux-kernel-owner@vger.kernel.org X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 33507 Lines: 622 Peter M wrote: > I have built a multi bridge i386 machine with 8 eth devices which > keeps crashing on me. > > Kernel 2.6.7.17 > Below crash came when I unplugged a cable on a running bridge. Today I > have had two crashes without touching the cables but didn't get any > usable syslog. There is a similar report of this on the Gentoo bugzilla: http://bugs.gentoo.org/143867 However the situation is somewhat different: this is a 3ghz system with 896mb RAM. Only one network interface, no bridging in use. The failure occurred while the network switch was being restarted (presumably all the buffers filled up during the "downtime"). It seems to me that such a system should be able to cope. The page allocation failure seems to stem from r8169, however the system was obviously running low on memory at this point (it was under load), so I'm not sure how well we can avoid this. It is not reproducible either. Also, the kernel was tainted by the nvidia module so take this whole report with a pinch of salt... > Aug 8 09:54:04 analyzeTHIS kernel: do_IRQ+0x19/0x24 > common_interrupt+0x1a/0x20 > Aug 8 09:54:11 analyzeTHIS kernel: __kmalloc+0x5a/0x61 > __alloc_skb+0x4c/0xf2 > Aug 8 09:54:54 analyzeTHIS kernel: > rtl8169_alloc_rx_skb+0x19/0xb0 [r8169] > rtl8169_rx_fill+0x45/0x5a [r8169] > Aug 8 09:55:26 analyzeTHIS kernel: > rtl8169_rx_interrupt+0x2af/0x304 [r8169] > pci_unmap_single+0x0/0x10 [r8169] > Aug 8 09:56:07 analyzeTHIS kernel: > rtl8169_interrupt+0xa6/0x103 [r8169] > handle_IRQ_event+0x20/0x4c > Aug 8 09:56:22 analyzeTHIS kernel: __do_IRQ+0x53/0x91 > do_IRQ+0x19/0x24 > Aug 8 09:56:22 analyzeTHIS kernel: > common_interrupt+0x1a/0x20 get_offset_pmtmr+0x44/0xefe > Aug 8 09:56:22 analyzeTHIS kernel: > do_gettimeofday+0x16/0x9d __net_timestamp+0xf/0x22 > Aug 8 09:56:22 analyzeTHIS kernel: > dev_queue_xmit_nit+0x1b/0xec qdisc_restart+0x7b/0xee > Aug 8 09:56:22 analyzeTHIS kernel: > dev_queue_xmit+0xbe/0x186 br_dev_queue_push_xmit+0xc2/0xc9 > [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: > br_nf_post_routing+0x14b/0x158 [bridge] > br_dev_queue_push_xmit+0x0/0xc9 [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: nf_iterate+0x3f/0x6d > br_dev_queue_push_xmit+0x0/0xc9 [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: nf_hook_slow+0x47/0x9d > br_dekB 0*4096kB = 476kB > Aug 8 09:56:22 analyzeTHIS kernel: HighMem: empty > Aug 8 09:56:22 analyzeTHIS kernel: Swap cache: add 0, delete 0, find > 0/0, race 0+0 > Aug 8 09:56:22 analyzeTHIS kernel: Free swap = 506036kB > Aug 8 09:56:22 analyzeTHIS kernel: Total swap = 506036kB > Aug 8 09:56:22 analyzeTHIS kernel: Free swap: 506036kB > Aug 8 09:56:22 analyzeTHIS kernel: 32752 pages of RAM > Aug 8 09:56:22 analyzeTHIS kernel: 0 pages of HIGHMEM > Aug 8 09:56:22 analyzeTHIS kernel: 932 reserved pages > Aug 8 09:56:22 analyzeTHIS kernel: 17487 pages shared > Aug 8 09:56:22 analyzeTHIS kernel: 0 pages swap cached > Aug 8 09:56:22 analyzeTHIS kernel: 0 pages dirty > Aug 8 09:56:22 analyzeTHIS kernel: 0 pages writeback > Aug 8 09:56:22 analyzeTHIS kernel: 1477 pages mapped > Aug 8 09:56:22 analyzeTHIS kernel: 11826 pages slab > Aug 8 09:56:22 analyzeTHIS kernel: 54 pages pagetables > Aug 8 09:56:22 analyzeTHIS kernel: kswapd0: page allocation failure. > order:0, mode:0x20 > Aug 8 09:56:22 analyzeTHIS kernel: > __alloc_pages+0x254/0x266 > smp_local_timer_interrupt+0xb/0x11 > Aug 8 09:56:22 analyzeTHIS kernel: > kmem_getpages+0x39/0x91 cache_grow+0x93/0x122 > Aug 8 09:56:22 analyzeTHIS kernel: > cache_alloc_refill+0x125/0x15e __kmalloc+0x56/0x61 > Aug 8 09:56:22 analyzeTHIS kernel: __alloc_skb+0x4c/0xf2 > rtl8169_alloc_rx_skb+0x19/0xb0 [r8169] > Aug 8 09:56:22 analyzeTHIS kernel: > rtl8169_rx_fill+0x45/0x5a [r8169] > rtl8169_rx_interrupt+0x2af/0x304 [r8169] > Aug 8 09:56:22 analyzeTHIS kernel: > pci_unmap_single+0x0/0x10 [r8169] > rtl8169_interrupt+0xa6/0x103 [r8169] > Aug 8 09:56:22 analyzeTHIS kernel: > handle_IRQ_event+0x20/0x4c __do_IRQ+0x53/0x91 > Aug 8 09:56:22 analyzeTHIS kernel: do_IRQ+0x19/0x24 > common_interrupt+0x1a/0x20 > Aug 8 09:56:22 analyzeTHIS kernel: __kmalloc+0x5a/0x61 > __alloc_skb+0x4c/0xf2 > Aug 8 09:56:22 analyzeTHIS kernel: > rtl8169_alloc_rx_skb+0x19/0xb0 [r8169] > rtl8169_rx_fill+0x45/0x5a [r8169] > Aug 8 09:56:22 analyzeTHIS kernel: > rtl8169_rx_interrupt+0x2af/0x304 [r8169] > pci_unmap_single+0x0/0x10 [r8169] > Aug 8 09:56:22 analyzeTHIS kernel: > rtl8169_interrupt+0xa6/0x103 [r8169] > handle_IRQ_event+0x20/0x4c > Aug 8 09:56:22 analyzeTHIS kernel: __do_IRQ+0x53/0x91 > do_IRQ+0x19/0x24 > Aug 8 09:56:22 analyzeTHIS kernel: > common_interrupt+0x1a/0x20 get_offset_pmtmr+0x44/0xefe > Aug 8 09:56:22 analyzeTHIS kernel: > do_gettimeofday+0x16/0x9d __net_timestamp+0xf/0x22 > Aug 8 09:56:22 analyzeTHIS kernel: > dev_queue_xmit_nit+0x1b/0xec qdisc_restart+0x7b/0xee > Aug 8 09:56:22 analyzeTHIS kernel: > dev_queue_xmit+0xbe/0x186 br_dev_queue_push_xmit+0xc2/0xc9 > [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: > br_nf_post_routing+0x14b/0x158 [bridge] > br_dev_queue_push_xmit+0x0/0xc9 [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: nf_iterate+0x3f/0x6d > br_dev_queue_push_xmit+0x0/0xc9 [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: nf_hook_slow+0x47/0x9d > br_dev_queue_push_xmit+0x0/0xc9 [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: > br_forward_finish+0x0/0x41 [bridge] > br_forward_finish+0x2e/0x41 [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: > br_dev_queue_push_xmit+0x0/0xc9 [bridge] > br_nf_forward_finish+0xc6/0xcb [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: > br_nf_forward_ip+0x120/0x12b [bridge] nf_iterate+0x3f/0x6d > Aug 8 09:56:22 analyzeTHIS kernel: > br_forward_finish+0x0/0x41 [bridge] nf_hook_slow+0x47/0x9d > Aug 8 09:56:22 analyzeTHIS kernel: > br_forward_finish+0x0/0x41 [bridge] __br_forward+0x46/0x57 > [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: > br_forward_finish+0x0/0x41 [bridge] br_flood+0x8e/0xa6 > [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: __br_forward+0x0/0x57 > [bridge] br_flood_forward+0x16/0x1a [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: __br_forward+0x0/0x57 > [bridge] br_handle_frame_finish+0x89/0xe0 [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: > br_nf_pre_routing_finish+0x29b/0x2a9 [bridge] > ip_conntrack_in+0x192/0x21c [ip_conntrer-cpu: > Aug 8 09:56:22 analyzeTHIS kernel: cpu 0 hot: high 42, batch 7 used:30 > Aug 8 09:56:22 analyzeTHIS kernel: cpu 0 cold: high 14, batch 3 used:11 > Aug 8 09:56:22 analyzeTHIS kernel: HighMem per-cpu: empty > Aug 8 09:56:22 analyzeTHIS kernel: Free pages: 976kB (0kB HighMem) > Aug 8 09:56:22 analyzeTHIS kernel: Active:12345 inactive:6399 dirty:1 > writeback:0 unstable:0 free:244 slab:11918 mapped:1477 pagetables:54 > Aug 8 09:56:22 analyzeTHIS kernel: DMA free:516kB min:180kB low:224kB > high:268kB active:3500kB inactive:2724kB present:16384kB > pages_scanned:0 all_unreclaimable? no > Aug 8 09:56:22 analyzeTHIS kernel: lowmem_reserve[]: 0 0 111 111 > Aug 8 09:56:22 analyzeTHIS kernel: DMA32 free:0kB min:0kB low:0kB > high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 > all_unreclaimable? no > Aug 8 09:56:22 analyzeTHIS kernel: lowmem_reserve[]: 0 0 111 111 > Aug 8 09:56:22 analyzeTHIS kernel: Normal free:460kB min:1260kB > low:1572kB high:1888kB active:45880kB inactive:22872kB > present:114624kB pages_scanned:0 all_unreclaimable? no > Aug 8 09:56:22 analyzeTHIS kernel: lowmem_reserve[]: 0 0 0 0 > Aug 8 09:56:22 analyzeTHIS kernel: HighMem free:0kB min:128kB > low:128kB high:128kB active:0kB inactive:0kB present:0kB > pages_scanned:0 all_unreclaimable? no > Aug 8 09:56:22 analyzeTHIS kernel: lowmem_reserve[]: 0 0 0 0 > Aug 8 09:56:22 analyzeTHIS kernel: DMA: 1*4kB 0*8kB 0*16kB 0*32kB > 0*64kB 0*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 516kB > Aug 8 09:56:22 analyzeTHIS kernel: DMA32: empty > Aug 8 09:56:22 analyzeTHIS kernel: Normal: 3*4kB 0*8kB 0*16kB 0*32kB > 1*64kB 1*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 460kB > Aug 8 09:56:22 analyzeTHIS kernel: HighMem: empty > Aug 8 09:56:22 analyzeTHIS kernel: Swap cache: add 0, delete 0, find > 0/0, race 0+0 > Aug 8 09:56:22 analyzeTHIS kernel: Free swap = 506036kB > Aug 8 09:56:22 analyzeTHIS kernel: Total swap = 506036kB > Aug 8 09:56:22 analyzeTHIS kernel: Free swap: 506036kB > Aug 8 09:56:22 analyzeTHIS kernel: 32752 pages of RAM > Aug 8 09:56:22 analyzeTHIS kernel: 0 pages of HIGHMEM > Aug 8 09:56:22 analyzeTHIS kernel: 932 reserved pages > Aug 8 09:56:22 analyzeTHIS kernel: 17391 pages shared > Aug 8 09:56:22 analyzeTHIS kernel: 0 pages swap cached > Aug 8 09:56:22 analyzeTHIS kernel: 1 pages dirty > Aug 8 09:56:22 analyzeTHIS kernel: 0 pages writeback > Aug 8 09:56:22 analyzeTHIS kernel: 1477 pages mapped > Aug 8 09:56:22 analyzeTHIS kernel: 11918 pages slab > Aug 8 09:56:22 analyzeTHIS kernel: 54 pages pagetables > Aug 8 09:56:22 analyzeTHIS kernel: printk: 1908 messages suppressed. > Aug 8 09:56:22 analyzeTHIS kernel: events/0: page allocation failure. > order:0, mode:0x20 > Aug 8 09:56:22 analyzeTHIS kernel: > __alloc_pages+0x254/0x266 kmem_getpages+0x39/0x91 > Aug 8 09:56:22 analyzeTHIS kernel: cache_grow+0x93/0x122 > cache_alloc_refill+0x125/0x15e > Aug 8 09:56:22 analyzeTHIS kernel: __kmalloc+0x56/0x61 > __alloc_skb+0x4c/0xf2 > Aug 8 09:56:22 analyzeTHIS kernel: > rtl8169_alloc_rx_skb+0x19/0xb0 [r8169] > rtl8169_rx_fill+0x45/0x5a [r8169] > Aug 8 09:56:22 analyzeTHIS kernel: > rtl8169_rx_interrupt+0x2af/0x304 [r8169] > pci_unmap_single+0x0/0x10 [r8169] > Aug 8 09:56:22 analyzeTHIS kernel: > rtl8169_interrupt+0xa6/0x103 [r8169] > handle_IRQ_event+0x20/0x4c > Aug 8 09:56:22 analyzeTHIS kernel: __do_IRQ+0x53/0x91 > do_IRQ+0x19/0x24 > Aug 8 09:56:22 analyzeTHIS kernel: > common_interrupt+0x1a/0x20 handle_IRQ_event+0x1a/0x4c > Aug 8 09:56:22 analyzeTHIS kernel: __do_IRQ+0x53/0x91 > do_IRQ+0x19/0x24 > Aug 8 09:56:22 analyzeTHIS kernel: > common_interrupt+0x1a/0x20 br_nf_post_routing+0xf0/0x158 > [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: > br_dev_queue_push_xmit+0x0/0xc9 [bridge] > nf_iterate+0x3f/0x6d > Aug 8 09:56:22 analyzeTHIS kernel: > br_dev_queue_push_xmit+0x0/0xc9 [bridge] > nf_hook_slow+0x47/0x9d > Aug 8 09:56:22 analyzeTHIS kernel: > br_dev_queue_push_xmit+0x0/0xc9 [bridge] > br_forward_finish+0x0/0x41 [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: > br_forward_finish+0x2e/0x41 [bridge] > br_dev_queue_push_xmit+0x0/0xc9 [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: > br_nf_forward_finish+0xc6/0xcb [bridge] > br_nf_forward_ip+0x120/0x12b [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: nf_iterate+0x3f/0x6d > br_forward_finish+0x0/0x41 [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: nf_hook_slow+0x47/0x9d > br_forward_finish+0x0/0x41 [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: __br_forward+0x46/0x57 > [bridge] br_forward_finish+0x0/0x41 [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: br_flood+0x8e/0xa6 > [bridge] __br_forward+0x0/0x57 [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: > br_flood_forward+0x16/0x1a [bridge] __br_forward+0x0/0x57 > [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: > br_handle_frame_finish+0x89/0xe0 [bridge] > br_nf_pre_routing_finish+0x29b/0x2a9 [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: > ip_conntrack_in+0x192/0x21c [ip_conntrack] > br_nf_pre_routing_finish+0x0/0x2a9 [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: nf_iterate+0x3f/0x6d > br_nf_pre_routing_finish+0x0/0x2a9 [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: nf_hook_slow+0x47/0x9d > br_nf_pre_routing_finish+0x0/0x2a9 [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: > br_handle_frame_finish+0x0/0xe0 [bridge] > br_nf_pre_routing+0x2e7/0x305 [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: > br_handle_frame_finish+0x0/0xe0 [bridge] > br_nf_pre_routing+0x2f5/0x305 [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: nf_iterate+0x3f/0x6d > br_handle_frame_finish+0x0/0xe0 [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: nf_hook_slow+0x47/0x9d > br_handle_frame_finish+0x0/0xe0 [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: > br_handle_frame+0x146/0x172 [bridge] > br_handle_frame_finish+0x0/0xe0 [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: > netif_receive_skb+0x1b3/0x25d process_backlog+0x6e/0xd7 > Aug 8 09:56:22 analyzeTHIS kernel: > net_rx_action+0x75/0x105 __do_softirq+0x34/0x7d > Aug 8 09:56:22 analyzeTHIS kernel: do_softirq+0x22/0x26 > do_IRQ+0x1e/0x24 > Aug 8 09:56:22 analyzeTHIS kernel: > common_interrupt+0x1a/0x20 drain_array+0x12/0x7f > Aug 8 09:56:22 analyzeTHIS kernel: cache_reap+0x43/0x11b > run_workqueue+0x6e/0xa2 > Aug 8 09:56:22 analyzeTHIS kernel: cache_reap+0x0/0x11b > worker_thread+0xf8/0x12a > Aug 8 09:56:22 analyzeTHIS kernel: > default_wake_function+0x0/0x12 schedule+0x460/0x4c5 > Aug 8 09:56:22 analyzeTHIS kernel: > default_wake_function+0x0/0x12 worker_thread+0x0/0x12a > Aug 8 09:56:22 analyzeTHIS kernel: kthread+0x79/0xa3 > kthread+0x0/0xa3 > Aug 8 09:56:22 analyzeTHIS kernel: > kernel_thread_helper+0x5/0xb > Aug 8 09:56:22 analyzeTHIS kernel: Mem-info: > Aug 8 09:56:22 analyzeTHIS kernel: DMA per-cpu: > Aug 8 09:56:22 analyzeTHIS kernel: cpu 0 hot: high 0, batch 1 used:0 > Aug 8 09:56:22 analyzeTHIS kernel: cpu 0 cold: high 0, batch 1 used:0 > Aug 8 09:56:22 analyzeTHIS kernel: DMA32 per-cpu: empty > Aug 8 09:56:22 analyzeTHIS kernel: Normal per-cpu: > Aug 8 09:56:22 analyzeTHIS kernel: cpu 0 hot: high 42, batch 7 used:32 > Aug 8 09:56:22 analyzeTHIS kernel: cpu 0 cold: high 14, batch 3 used:11 > Aug 8 09:56:22 analyzeTHIS kernel: HighMem per-cpu: empty > Aug 8 09:56:22 analyzeTHIS kernel: Free pages: 976kB (0kB HighMem) > Aug 8 09:56:22 analyzeTHIS kernel: Active:12345 inactive:6399 dirty:1 > writeback:0 unstable:0 free:244 slab:11916 mapped:1477 pagetables:54 > Aug 8 09:56:22 analyzeTHIS kernel: DMA free:516kB min:180kB low:224kB > high:268kB active:3500kB inactive:2724kB present:16384kB > pages_scanned:0 all_unreclaimable? no > Aug 8 09:56:22 analyzeTHIS kernel: lowmem_reserve[]: 0 0 111 111 > Aug 8 09:56:22 analyzeTHIS kernel: DMA32 free:0kB min:0kB low:0kB > high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 > all_unreclaimable? no > Aug 8 09:56:22 analyzeTHIS kernel: lowmem_reserve[]: 0 0 111 111 > Aug 8 09:56:22 analyzeTHIS kernel: Normal free:460kB min:1260kB > low:1572kB high:1888kB active:45880kB inactive:22872kB > present:114624kB pages_scanned:0 all_unreclaimable? no > Aug 8 09:56:22 analyzeTHIS kernel: lowmem_reserve[]: 0 0 0 0 > Aug 8 09:56:22 analyzeTHIS kernel: HighMem free:0kB min:128kB > low:128kB high:128kB active:0kB inactive:0kB present:0kB > pages_scanned:0 all_unreclaimable? no > Aug 8 09:56:22 analyzeTHIS kernel: lowmem_reserve[]: 0 0 0 0 > Aug 8 09:56:22 analyzeTHIS kernel: DMA: 1*4kB 0*8kB 0*16kB 0*32kB > 0*64kB 0*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 516kB > Aug 8 09:56:22 analyzeTHIS kernel: DMA32: empty > Aug 8 09:56:22 analyzeTHIS kernel: Normal: 3*4kB 0*8kB 0*16kB 0*32kB > 1*64kB 1*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 460kB > Aug 8 09:56:22 analyzeTHIS kernel: HighMem: empty > Aug 8 09:56:22 analyzeTHIS kernel: Swap cache: add 0, delete 0, find > 0/0, race 0+0 > Aug 8 09:56:22 analyzeTHIS kernel: Free swap = 506036kB > Aug 8 09:56:22 analyzeTHIS kernel: Total swap = 506036kB > Aug 8 09:56:22 analyzeTHIS kernel: Free swap: 506036kB > Aug 8 09:56:22 analyzeTHIS kernel: 32752 pages of RAM > Aug 8 09:56:22 analyzeTHIS kernel: 0 pages of HIGHMEM > Aug 8 09:56:22 analyzeTHIS kernel: 932 reserved pages > Aug 8 09:56:22 analyzeTHIS kernel: 17391 pages shared > Aug 8 09:56:22 analyzeTHIS kernel: 0 pages swap cached > Aug 8 09:56:22 analyzeTHIS kernel: 1 pages dirty > Aug 8 09:56:22 analyzeTHIS kernel: 0 pages writeback > Aug 8 09:56:22 analyzeTHIS kernel: 1477 pages mapped > Aug 8 09:56:22 analyzeTHIS kernel: 11916 pages slab > Aug 8 09:56:22 analyzeTHIS kernel: 54 pages pagetables > Aug 8 09:56:22 analyzeTHIS kernel: printk: 1684 messages suppressed. > Aug 8 09:56:22 analyzeTHIS kernel: cron: page allocation failure. > order:0, mode:0x20 > Aug 8 09:56:22 analyzeTHIS kernel: > __alloc_pages+0x254/0x266 __alloc_pages+0xbd/0x266 > Aug 8 09:56:22 analyzeTHIS kernel: > kmem_getpages+0x39/0x91 cache_grow+0x93/0x122 > Aug 8 09:56:22 analyzeTHIS kernel: > cache_alloc_refill+0x125/0x15e __kmalloc+0x56/0x61 > Aug 8 09:56:22 analyzeTHIS kernel: __alloc_skb+0x4c/0xf2 > rtl8169_alloc_rx_skb+0x19/0xb0 [r8169] > Aug 8 09:56:22 analyzeTHIS kernel: > rtl8169_rx_fill+0x45/0x5a [r8169] > rtl8169_rx_interrupt+0x2af/0x304 [r8169] > Aug 8 09:56:22 analyzeTHIS kernel: > pci_unmap_single+0x0/0x10 [r8169] > rtl8169_interrupt+0xa6/0x103 [r8169] > Aug 8 09:56:22 analyzeTHIS kernel: > handle_IRQ_event+0x20/0x4c __do_IRQ+0x53/0x91 > Aug 8 09:56:22 analyzeTHIS kernel: do_IRQ+0x19/0x24 > common_interrupt+0x1a/0x20 > Aug 8 09:56:22 analyzeTHIS kernel: > rtl8169_interrupt+0x29/0x103 [r8169] > handle_IRQ_event+0x20/0x4c > Aug 8 09:56:22 analyzeTHIS kernel: __do_IRQ+0x53/0x91 > do_IRQ+0x19/0x24 > Aug 8 09:56:22 analyzeTHIS kernel: > common_interrupt+0x1a/0x20 get_offset_pmtmr+0x44/0xefe > Aug 8 09:56:22 analyzeTHIS kernel: > do_gettimeofday+0x16/0x9d __net_timestamp+0xf/0x22 > Aug 8 09:56:22 analyzeTHIS kernel: > dev_queue_xmit_nit+0x1b/0xec qdisc_restart+0x7b/0xee > Aug 8 09:56:22 analyzeTHIS kernel: > dev_queue_xmit+0xbe/0x186 br_dev_queue_push_xmit+0xc2/0xc9 > [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: > br_nf_post_routing+0x14b/0x158 [bridge] > br_dev_queue_push_xmit+0x0/0xc9 [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: nf_iterate+0x3f/0x6d > br_dev_queue_push_xmit+0x0/0xc9 [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: nf_hook_slow+0x47/0x9d > br_dev_queue_push_xmit+0x0/0xc9 [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: > br_forward_finish+0x0/0x41 [bridge] > br_forward_finish+0x2e/0x41 [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: > br_dev_queue_push_xmit+0x0/0xc9 [bridge] > br_nf_forward_finish+0xc6/0xcb [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: > br_nf_forward_ip+0x120/0x12b [bridge] nf_iterate+0x3f/0x6d > Aug 8 09:56:22 analyzeTHIS kernel: > br_forward_finish+0x0/0x41 [bridge] nf_hook_slow+0x47/0x9d > Aug 8 09:56:22 analyzeTHIS kernel: > br_forward_finish+0x0/0x41 [bridge] __br_forward+0x46/0x57 > [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: > br_forward_finish+0x0/0x41 [bridge] br_flood+0x8e/0xa6 > [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: __br_forward+0x0/0x57 > [bridge] br_flood_forward+0x16/0x1a [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: __br_forward+0x0/0x57 > [bridge] br_handle_frame_finish+0x89/0xe0 [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: > br_nf_pre_routing_finish+0x29b/0x2a9 [bridge] > ip_conntrack_in+0x192/0x21c [ip_conntrack] > Aug 8 09:56:22 analyzeTHIS kernel: > br_nf_pre_routing_finish+0x0/0x2a9 [bridge] > nf_iterate+0x3f/0x6d > Aug 8 09:56:22 analyzeTHIS kernel: > br_nf_pre_routing_finish+0x0/0x2a9 [bridge] > nf_hook_slow+0x47/0x9d > Aug 8 09:56:22 analyzeTHIS kernel: > br_nf_pre_routing_finish+0x0/0x2a9 [bridge] > br_handle_frame_finish+0x0/0xe0 [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: > br_nf_pre_routing+0x2e7/0x305 [bridge] > br_handle_frame_finish+0x0/0xe0 [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: > br_nf_pre_routing+0x2f5/0x305 [bridge] > nf_iterate+0x3f/0x6d > Aug 8 09:56:22 analyzeTHIS kernel: > br_handle_frame_finish+0x0/0xe0 [bridge] > nf_hook_slow+0x47/0x9d > Aug 8 09:56:22 analyzeTHIS kernel: > br_handle_frame_finish+0x0/0xe0 [bridge] > br_handle_frame+0x146/0x172 [bridge] > Aug 8 09:56:22 analyzeTHIS kernel: > br_handle_frame_finish+0x0/0xe0 [bridge] > netif_receive_skb+0x1b3/0x25d > Aug 8 09:56:22 analyzeTHIS kernel: > process_backlog+0x6e/0xd7 net_rx_action+0x75/0x105 > Aug 8 09:56:22 analyzeTHIS kernel: __do_softirq+0x34/0x7d > do_softirq+0x22/0x26 > Aug 8 09:56:22 analyzeTHIS kernel: do_IRQ+0x1e/0x24 > common_interrupt+0x1a/0x20 > Aug 8 09:56:22 analyzeTHIS kernel: prune_dcache+0x2e/0xf1 > shrink_dcache_memory+0x18/0x30 > Aug 8 09:56:22 analyzeTHIS kernel: > shrink_slab+0x12a/0x190 try_to_free_pages+0xee/0x19a > Aug 8 09:56:22 analyzeTHIS kernel: > __alloc_pages+0x166/0x266 kmem_getpages+0x39/0x91 > Aug 8 09:56:22 analyzeTHIS kernel: cache_grow+0x93/0x122 > cache_alloc_refill+0x125/0x15e > Aug 8 09:56:22 analyzeTHIS kernel: > kmem_cache_alloc+0x2a/0x34 getname+0x13/0x4a > Aug 8 09:56:22 analyzeTHIS kernel: > __user_walk_fd+0xe/0x42 vfs_stat_fd+0x1a/0x45 > Aug 8 09:56:22 analyzeTHIS kernel: > hrtimer_try_to_cancel+0xb/0x32 hrtimer_cancel+0xb/0x16 > Aug 8 09:56:22 analyzeTHIS kernel: do_nanosleep+0x43/0x66 > hrtimer_nanosleep+0x4c/0x103 > Aug 8 09:56:22 analyzeTHIS kernel: vfs_stat+0xf/0x13 > sys_stat64+0x10/0x27 > Aug 8 09:56:22 analyzeTHIS kernel: schedule+0x460/0x4c5 > do_gettimeofday+0x16/0x9d > Aug 8 09:56:22 analyzeTHIS kernel: sys_time+0x13/0x40 > syscall_call+0x7/0xb > Aug 8 09:56:22 analyzeTHIS kernel: Mem-info: > Aug 8 09:56:22 analyzeTHIS kernel: DMA per-cpu: > Aug 8 09:56:22 analyzeTHIS kernel: cpu 0 hot: high 0, batch 1 used:0 > Aug 8 09:56:22 analyzeTHIS kernel: cpu 0 cold: high 0, batch 1 used:0 > Aug 8 09:56:22 analyzeTHIS kernel: DMA32 per-cpu: empty > Aug 8 09:56:22 analyzeTHIS kernel: Normal per-cpu: > Aug 8 09:56:22 analyzeTHIS kernel: cpu 0 hot: high 42, batch 7 used:31 > Aug 8 09:56:22 analyzeTHIS kernel: cpu 0 cold: high 14, batch 3 used:11 > Aug 8 09:56:22 analyzeTHIS kernel: HighMem per-cpu: empty > Aug 8 09:56:22 analyzeTHIS kernel: Free pages: 976kB (0kB HighMem) > Aug 8 09:56:22 analyzeTHIS kernel: Active:12277 inactive:6435 dirty:1 > writeback:0 unstable:0 free:244 slab:11917 mapped:1477 pagetables:54 > Aug 8 09:56:22 analyzeTHIS kernel: DMA free:516kB min:180kB low:224kB > high:268kB active:3500kB inactive:2724kB present:16384kB > pages_scanned:0 all_unreclaimable? no > Aug 8 09:56:22 analyzeTHIS kernel: lowmem_reserve[]: 0 0 111 111 > Aug 8 09:56:22 analyzeTHIS kernel: DMA32 free:0kB min:0kB low:0kB > high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 > all_unreclaimable? no > Aug 8 09:56:22 analyzeTHIS kernel: lowmem_reserve[]: 0 0 111 111 > Aug 8 09:56:22 analyzeTHIS kernel: Normal free:460kB min:1260kB > low:1572kB high:1888kB active:45608kB inactive:23016kB > present:114624kB pages_scanned:0 all_unreclaimable? no > Aug 8 09:56:22 analyzeTHIS kernel: lowmem_reserve[]: 0 0 0 0 > Aug 8 09:56:22 analyzeTHIS kernel: HighMem free:0kB min:128kB > low:128kB high:128kB active:0kB inactive:0kB present:0kB > pages_scanned:0 all_unreclaimable? no > Aug 8 09:56:22 analyzeTHIS kernel: lowmem_reserve[]: 0 0 0 0 > Aug 8 09:56:22 analyzeTHIS kernel: DMA: 1*4kB 0*8kB 0*16kB 0*32kB > 0*64kB 0*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 516kB > Aug 8 09:56:22 analyzeTHIS kernel: DMA32: empty > Aug 8 09:56:22 analyzeTHIS kernel: Normal: 3*4kB 0*8kB 0*16kB 0*32kB > 1*64kB 1*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 460kB > Aug 8 09:56:22 analyzeTHIS kernel: HighMem: empty > Aug 8 09:56:22 analyzeTHIS kernel: Swap cache: add 0, delete 0, find > 0/0, race 0+0 > Aug 8 09:56:22 analyzeTHIS kernel: Free swap = 506036kB > Aug 8 09:56:22 analyzeTHIS kernel: Total swap = 506036kB > Aug 8 09:56:22 analyzeTHIS kernel: Free swap: 506036kB > Aug 8 09:56:22 analyzeTHIS kernel: 32752 pages of RAM > Aug 8 09:56:22 analyzeTHIS kernel: 0 pages of HIGHMEM > Aug 8 09:56:22 analyzeTHIS kernel: 932 reserved pages > Aug 8 09:56:22 analyzeTHIS kernel: 17423 pages shared > Aug 8 09:56:22 analyzeTHIS kernel: 0 pages swap cached > Aug 8 09:56:22 analyzeTHIS kernel: 1 pages dirty > Aug 8 09:56:22 analyzeTHIS kernel: 0 pages writeback > Aug 8 09:56:22 analyzeTHIS kernel: 1477 pages mapped > Aug 8 09:56:22 analyzeTHIS kernel: 11917 pages slab > Aug 8 09:56:22 analyzeTHIS kernel: 54 pages pagetables > Aug 8 09:56:22 analyzeTHIS kernel: printk: 1262 messages suppressed. > Aug 8 09:56:22 analyzeTHIS kernel: init: page allocation failure. > order:0, mode:0x20 > Aug 8 09:56:22 analyzeTHIS kernel: > __alloc_pages+0x254/0x266 kmem_getpages+0x39/0x91 > Aug 8 09:56:22 analyzeTHIS kernel: cache_grow+0x93/0x122 > cache_alloc_refill+0x125/0x15e > Aug 8 09:56:22 analyzeTHIS kernel: __kmalloc+0x56/0x61 > __alloc_skb+0x4c/0xf2 > Aug 8 09:56:22 analyzeTHIS kernel: > rtl8169_alloc_rx_skb+0x19/0xb0 [r8169] > rtl8169_rx_fill+0x45/0x5a [r8169] > Aug 8 09:56:22 analyzeTHIS kernel: > rtl8169_rx_interrupt+0x2af/0x304 [r8169] > pci_unmap_single+0x0/0x10 [r8169] > Aug 8 09:56:22 analyzeTHIS kernel: > rtl8169_interrupt+0xa6/0x103 [r8169] > handle_IRQ_event+0x20/0x4c > Aug 8 09:56:22 analyzeTHIS kernel: __do_IRQ+0x53/0x91 > do_IRQ+0x19/0x24 > Aug 8 09:56:22 analyzeTHIS kernel: > common_interrupt+0x1a/0x20 ioread32+0x22/0x26 > Aug 8 09:56:22 analyzeTHIS kernel: > tulip_interrupt+0x47/0x798 [tulip] > handle_IRQ_event+0x20/0x4c > Aug 8 09:56:22 analyzeTHIS kernel: __do_IRQ+0x53/0x91 > do_IRQ+0x19/0x24 > Aug 8 09:56:22 analyzeTHIS kernel: > common_interrupt+0x1a/0x20 handle_IRQ_event+0x1a/0x4c > Aug 8 09:56:22 analyzeTHIS kernel: __do_IRQ+0x53/0x91 > do_IRQ+0x19/0x24 > Aug 8 09:56:22 analyzeTHIS kernel: > common_interrupt+0x1a/0x20 kfree+0x56/0x5b > Aug 8 09:56:22 analyzeTHIS kernel: kfree_skbmem+0xb/0x6d > ip_rcv+0x3a7/0x3b1 > Aug 8 09:56:22 analyzeTHIS kernel: > netif_receive_skb+0x23f/0x25d process_backlog+0x6e/0xd7 > Aug 8 09:56:22 analyzeTHIS kernel: > net_rx_action+0x75/0x105 __do_softirq+0x34/0x7d > Aug 8 09:56:22 analyzeTHIS kernel: do_softirq+0x22/0x26 > do_IRQ+0x1e/0x24 > Aug 8 09:56:22 analyzeTHIS kernel: > common_interrupt+0x1a/0x20 reiserfs_clear_inode+0x0/0x56 > [reiserfs] > Aug 8 09:56:22 analyzeTHIS kernel: clear_inode+0xb6/0xe4 > dispose_list+0x50/0xaa > Aug 8 09:56:22 analyzeTHIS kernel: > prune_icache+0x11d/0x152 shrink_icache_memory+0x18/0x30 > Aug 8 09:56:22 analyzeTHIS kernel: > shrink_slab+0x12a/0x190 try_to_free_pages+0xee/0x19a > Aug 8 09:56:22 analyzeTHIS kernel: > __alloc_pages+0x166/0x266 kmem_getpages+0x39/0x91 > Aug 8 09:56:22 analyzeTHIS kernel: cache_grow+0x93/0x122 > cache_alloc_refill+0x125/0x15e > Aug 8 09:56:22 analyzeTHIS kernel: > kmem_cache_alloc+0x2a/0x34 getname+0x13/0x4a > Aug 8 09:56:22 analyzeTHIS kernel: > __user_walk_fd+0xe/0x42 vfs_stat_fd+0x1a/0x45 > Aug 8 09:56:22 analyzeTHIS kernel: kfree+0x37/0x5b > kfree_skbmem+0x69/0x6d > Aug 8 09:56:22 analyzeTHIS kernel: ip_rcv+0x3a7/0x3b1 > netif_receive_skb+0x23f/0x25d > Aug 8 09:56:22 analyzeTHIS kernel: vfs_stat+0xf/0x13 > sys_stat64+0x10/0x27 > Aug 8 09:56:22 analyzeTHIS kernel: schedule+0x460/0x4c5 > syscall_call+0x7/0xb > Aug 8 09:56:22 analyzeTHIS kernel: Mem-info: > Aug 8 09:56:22 analyzeTHIS kernel: DMA per-cpu: > Aug 8 09:56:22 analyzeTHIS kernel: cpu 0 hot: high 0, batch 1 used:0 > Aug 8 09:56:22 analyzeTHIS kernel: cpu 0 cold: high 0, batch 1 used:0 > Aug 8 09:56:22 analyzeTHIS kernel: DMA32 per-cpu: empty > Aug 8 09:56:22 analyzeTHIS kernel: Normal per-cpu: > Aug 8 09:56:22 analyzeTHIS kernel: cpu 0 hot: high 42, batch 7 used:34 > Aug 8 09:56:22 analyzeTHIS kernel: cpu 0 cold: high 14, batch 3 used:13 > Aug 8 09:56:22 analyzeTHIS kernel: HighMem per-cpu: empty > Aug 8 09:56:22 analyzeTHIS kernel: Free pages: 968kB (0kB HighMem) > Aug 8 09:56:22 analyzeTHIS kernel: Active:12277 inactive:6435 dirty:1 > writeback:0 unstable:0 free:242 slab:11928 mapped:1477 pagetables:54 > Aug 8 09:56:22 analyzeTHIS kernel: DMA free:516kB min:180kB low:224kB > high:268kB active:3500kB inactive:2724kB present:16384kB > pages_scanned:0 all_unreclaimable? no > Aug 8 09:56:22 analyzeTHIS kernel: lowmem_reserve[]: 0 0 111 111 > Aug 8 09:56:22 analyzeTHIS kernel: DMA32 free:0kB min:0kB low:0kB > high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 > all_unreclaimable? no > Aug 8 09:56:22 analyzeTHIS kernel: lowmem_reserve[]: 0 0 111 111 > Aug 8 09:56:22 analyzeTHIS kernel: Normal free:452kB min:1260kB > low:1572kB high:1888kB active:45608kB inactive:23016kB > present:114624kB pages_scanned:0 all_unreclaimable? no > Aug 8 09:56:22 analyzeTHIS kernel: lowmem_reserve[]: 0 0 0 0 > Aug 8 09:56:22 analyzeTHIS kernel: HighMem free:0kB min:128kB > low:128kB high:128kB active:0kB inactive:0kB present:0kB > pages_scanned:0 all_unreclaimable? no > Aug 8 09:56:22 analyzeTHIS kernel: lowmem_reserve[]: 0 0 0 0 > Aug 8 09:56:22 analyzeTHIS kernel: DMA: 1*4kB 0*8kB 0*16kB 0*32kB > 0*64kB 0*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 516kB > Aug 8 09:56:22 analyzeTHIS kernel: DMA32: empty > Aug 8 09:56:22 analyzeTHIS kernel: Normal: 1*4kB 0*8kB 0*16kB 0*32kB > 1*64kB 1*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 452kB > Aug 8 09:56:22 analyzeTHIS kernel: HighMem: empty > Aug 8 09:56:22 analyzeTHIS kernel: Swap cache: add 0, delete 0, find > 0/0, race 0+0 > Aug 8 09:56:22 analyzeTHIS kernel: Free swap = 506036kB > Aug 8 09:56:22 analyzeTHIS kernel: Total swap = 506036kB > Aug 8 09:56:22 analyzeTHIS kernel: Free swap: 506036kB > Aug 8 09:56:22 analyzeTHIS kernel: 32752 pages of RAM > Aug 8 09:56:22 analyzeTHIS kernel: 0 pages of HIGHMEM > Aug 8 09:56:22 analyzeTHIS kernel: 932 reserved pages > Aug 8 09:56:22 analyzeTHIS kernel: 17395 pages shared > Aug 8 09:56:22 analyzeTHIS kernel: 0 pages swap cached > Aug 8 09:56:22 analyzeTHIS kernel: 1 pages dirty > Aug 8 09:56:22 analyzeTHIS kernel: 0 pages writeback > Aug 8 09:56:22 analyzeTHIS kernel: 1477 pages mapped > Aug 8 09:56:22 analyzeTHIS kernel: 11928 pages slab > Aug 8 09:56:22 analyzeTHIS kernel: 54 pages pagetables - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/