Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1752687Ab0HVTvG (ORCPT ); Sun, 22 Aug 2010 15:51:06 -0400 Received: from mail-iw0-f174.google.com ([209.85.214.174]:34171 "EHLO mail-iw0-f174.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752062Ab0HVTvE convert rfc822-to-8bit (ORCPT ); Sun, 22 Aug 2010 15:51:04 -0400 DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type :content-transfer-encoding; b=YFCgF0pAVGjMpVTA4wtWbu5zJv9VJra5pITApzmwg4fUJ83eIMofH2HA+81zV+HI5z H56uythBNQ2TCqQo0ady+PjZvUI2tWg/uJMNNedfTYJoZI7D+YBAp5gUVSdKQZeiZcdO 7nVRqRYN4xOcmNLv43Q6A8rMKudS8wMMeXQuY= MIME-Version: 1.0 In-Reply-To: References: <4C70BFF3.8030507@hardwarefreak.com> Date: Sun, 22 Aug 2010 22:51:02 +0300 X-Google-Sender-Auth: R8B2YfDeIODOoxHByeGDLrECvhc Message-ID: Subject: Re: 2.6.34.1 page allocation failure From: Pekka Enberg To: Mikael Abrahamsson Cc: Stan Hoeppner , Linux Kernel List , linux-mm@kvack.org, Mel Gorman , Christoph Lameter Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8BIT Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 5798 Lines: 124 On Sun, Aug 22, 2010 at 9:47 AM, Mikael Abrahamsson wrote: > On Sun, 22 Aug 2010, Stan Hoeppner wrote: > >> I'm not subscribed to lkml so please CC me in replies. ?First post. > > I'm seeing similar problems on older kernels (.24 up to .32). > > > > I didn't get any response at all, neither on linux-mm or lkml... Our > problems seem very similar, but I'm running 64bit and I have 8 gigs of ram. > > Personally I can avoid this by tuning down my TCP settings so TCP uses less > memory, but I don't think that workaround is very good, this shouldn't > happen. My machine also freezes up (pressing caps lock doesn't work) > sometimes, sometimes it just logs the error. > >> Mobo: ? ?Abit BP6, dual Celeron 366@500, i440BX chipset, 384MB PC100 >> Disk: ? ?SiI 3512 PCI (sata_sil, libata), 1 x WD5000AAKS 500 GB SATAII >> Kernel: ?vanilla 2.6.34.1, 32 bit x86, SMP, Celeron pre Coppermine >> OS: ? ? ?Debian 5.0.5 (Stable) >> Build: ? kernel configured via make menuconfig >> ? ? ? ?no modules, no initrd >> ? ? ? ?built via "make KDEB_PKGVERSION=" >> ? ? ? ?installed via dpkg, bootloader is LILO >> Role: ? ?headless SOHO server, run level 2, _very_ light load >> ? ? ? ?Postfix, pdns-recursor, Dovecot, Lighttpd, Roundcube, Samba >> ? ? ? ?bulk of system memory (>300MB) is consumed by buffers/cache >> Issue: ? AFAIK, these errors never occurred with any revisions of >> ? ? ? ?2.6.26, .31, or .32. ?After installing 2.6.34.1 I've noticed >> ? ? ? ?the following errors in dmesg. ?I see 6 of these, including >> ? ? ? ?two errors each for kswapd0, lighttpd, and smtpd, all not >> ? ? ? ?tainted. ?AFAICT everything is still running fine. ?Are these >> ? ? ? ?critical errors? ?If so, how do I fix? >> >> kswapd0: page allocation failure. order:1, mode:0x20 >> Pid: 139, comm: kswapd0 Not tainted 2.6.34.1 #1 >> Call Trace: >> [] ? __alloc_pages_nodemask+0x448/0x48a >> [] ? cache_alloc_refill+0x22f/0x422 >> [] ? tcp_v4_send_check+0x6e/0xa4 >> [] ? kmem_cache_alloc+0x41/0x6a >> [] ? sk_prot_alloc+0x19/0x55 >> [] ? sk_clone+0x16/0x1cc >> [] ? inet_csk_clone+0xf/0x80 >> [] ? tcp_create_openreq_child+0x1a/0x3c8 >> [] ? tcp_v4_syn_recv_sock+0x4b/0x151 >> [] ? tcp_check_req+0x209/0x335 >> [] ? tcp_v4_do_rcv+0x8d/0x14d >> [] ? tcp_v4_rcv+0x383/0x56d >> [] ? ip_local_deliver+0x76/0xc0 >> [] ? ip_rcv+0x3dc/0x3fa >> [] ? ktime_get_real+0xf/0x2b >> [] ? netif_receive_skb+0x219/0x234 >> [] ? e100_poll+0x1d0/0x47e >> [] ? net_rx_action+0x58/0xf8 >> [] ? __do_softirq+0x78/0xe5 >> [] ? do_softirq+0x23/0x27 >> [] ? do_IRQ+0x7d/0x8e >> [] ? common_interrupt+0x29/0x30 >> [] ? kmem_cache_free+0xbd/0xc5 >> [] ? __xfs_inode_set_reclaim_tag+0x29/0x2f >> [] ? destroy_inode+0x1c/0x2b >> [] ? dispose_list+0xaa/0xd0 >> [] ? shrink_icache_memory+0x198/0x1c5 >> [] ? shrink_slab+0xda/0x12f >> [] ? kswapd+0x468/0x63b >> [] ? isolate_pages_global+0x0/0x1bc >> [] ? autoremove_wake_function+0x0/0x2d >> [] ? complete+0x28/0x36 >> [] ? kswapd+0x0/0x63b >> [] ? kthread+0x61/0x66 >> [] ? kthread+0x0/0x66 >> [] ? kernel_thread_helper+0x6/0x10 >> Mem-Info: >> DMA per-cpu: >> CPU ? ?0: hi: ? ?0, btch: ? 1 usd: ? 0 >> CPU ? ?1: hi: ? ?0, btch: ? 1 usd: ? 0 >> Normal per-cpu: >> CPU ? ?0: hi: ?186, btch: ?31 usd: 180 >> CPU ? ?1: hi: ?186, btch: ?31 usd: ?29 >> active_anon:646 inactive_anon:4337 isolated_anon:0 >> active_file:27189 inactive_file:35957 isolated_file:0 >> unevictable:0 dirty:56 writeback:0 unstable:0 >> free:1142 slab_reclaimable:25495 slab_unreclaimable:1020 >> mapped:3116 shmem:143 pagetables:123 bounce:0 >> DMA free:1568kB min:100kB low:124kB high:148kB active_anon:0kB >> inactive_anon:4kB active_file:5704kB inactive_file:7732kB >> unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15868kB >> mlocked:0kB dirty:0kB writeback:0kB mapped:28kB shmem:0kB >> slab_reclaimable:912kB slab_unreclaimable:52kB kernel_stack:0kB >> pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 >> all_unreclaimable? no >> lowmem_reserve[]: 0 365 365 >> Normal free:3000kB min:2392kB low:2988kB high:3588kB active_anon:2584kB >> inactive_anon:17344kB active_file:103052kB inactive_file:136096kB >> unevictable:0kB isolated(anon):0kB isolated(file):0kB present:373888kB >> mlocked:0kB dirty:224kB writeback:0kB mapped:12436kB shmem:572kB >> slab_reclaimable:101068kB slab_unreclaimable:4028kB kernel_stack:520kB >> pagetables:492kB unstable:0kB bounce:0kB writeback_tmp:0kB >> pages_scanned:0 all_unreclaimable? no >> lowmem_reserve[]: 0 0 0 >> DMA: 391*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB >> 0*2048kB 0*4096kB = 1564kB >> Normal: 750*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB >> 0*1024kB 0*2048kB 0*4096kB = 3000kB >> 63342 total pagecache pages >> 23 pages in swap cache >> Swap cache stats: add 159, delete 136, find 401/412 >> Free swap ?= 995636kB >> Total swap = 995992kB >> 98303 pages RAM >> 1638 pages reserved >> 22416 pages shared >> 76947 pages non-shared In Stan's case, it's a order-1 GFP_ATOMIC allocation but there are only order-0 pages available. Mel, any recent page allocator fixes in 2.6.35 or 2.6.36-rc1 that Stan/Mikael should test? -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/