Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1755221AbZGMJwK (ORCPT ); Mon, 13 Jul 2009 05:52:10 -0400 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1754975AbZGMJwJ (ORCPT ); Mon, 13 Jul 2009 05:52:09 -0400 Received: from 82-117-125-11.tcdsl.calypso.net ([82.117.125.11]:43622 "EHLO smtp.ossman.eu" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752197AbZGMJwI (ORCPT ); Mon, 13 Jul 2009 05:52:08 -0400 Date: Mon, 13 Jul 2009 11:51:58 +0200 From: Pierre Ossman To: avi@redhat.com, kvm@vger.kernel.org Cc: LKML , linux-mm@kvack.org Subject: Page allocation failures in guest Message-ID: <20090713115158.0a4892b0@mjolnir.ossman.eu> X-Mailer: Claws Mail 3.7.1 (GTK+ 2.16.2; x86_64-redhat-linux-gnu) Mime-Version: 1.0 Content-Type: multipart/signed; micalg=PGP-SHA1; protocol="application/pgp-signature"; boundary="=_freyr.ossman.eu-25674-1247478723-0001-2" Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 6984 Lines: 146 This is a MIME-formatted message. If you see this text it means that your E-mail software does not support MIME-formatted messages. --=_freyr.ossman.eu-25674-1247478723-0001-2 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: quoted-printable I upgraded my Fedora 10 host to 2.6.29 a few days ago and since then one of the guests keeps getting page allocation failures after a few hours. I've upgraded the kernel in the guest from 2.6.27 to 2.6.29 without any change. There are also a few other guests running on the machine that aren't having any issues. The only noticable thing that dies for me is the network. The machine still logs properly and I can attach to the local console and reboot it. This is what I see in dmesg/logs: Jul 12 23:04:54 loki kernel: sshd: page allocation failure. order:0, mode:0= x4020 Jul 12 23:04:54 loki kernel: Pid: 1682, comm: sshd Not tainted 2.6.29.5-84.= fc10.x86_64 #1 Jul 12 23:04:54 loki kernel: Call Trace: Jul 12 23:04:54 loki kernel: [] __alloc_pages_inte= rnal+0x42f/0x451 Jul 12 23:04:54 loki kernel: [] alloc_pages_current+0xb9/= 0xc2 Jul 12 23:04:54 loki kernel: [] alloc_slab_page+0x19/0x69 Jul 12 23:04:54 loki kernel: [] new_slab+0x63/0x1cb Jul 12 23:04:54 loki kernel: [] __slab_alloc+0x23d/0x3ac Jul 12 23:04:54 loki kernel: [] ? __netdev_alloc_skb+0x31= /0x4d Jul 12 23:04:54 loki kernel: [] __kmalloc_node_track_call= er+0xbb/0x11f Jul 12 23:04:54 loki kernel: [] ? __netdev_alloc_skb+0x31= /0x4d Jul 12 23:04:54 loki kernel: [] __alloc_skb+0x6f/0x130 Jul 12 23:04:54 loki kernel: [] __netdev_alloc_skb+0x31/0= x4d Jul 12 23:04:54 loki kernel: [] try_fill_recv_maxbufs+0x5= a/0x20d [virtio_net] Jul 12 23:04:54 loki kernel: [] try_fill_recv+0x22/0x17e = [virtio_net] Jul 12 23:04:54 loki kernel: [] ? netif_receive_skb+0x40a= /0x42f Jul 12 23:04:54 loki kernel: [] virtnet_poll+0x57f/0x5ee = [virtio_net] Jul 12 23:04:54 loki kernel: [] ? _spin_lock_irq+0x21/0x26 Jul 12 23:04:54 loki kernel: [] net_rx_action+0xb3/0x1af Jul 12 23:04:54 loki kernel: [] __do_softirq+0x94/0x150 Jul 12 23:04:54 loki kernel: [] call_softirq+0x1c/0x30 Jul 12 23:04:54 loki kernel: [] do_softirq+0x4d/0x= b4 Jul 12 23:04:54 loki kernel: [] ? release_sock+0xb0/0xbb Jul 12 23:04:54 loki kernel: [] _local_bh_enable_ip+0xc5/= 0xe5 Jul 12 23:04:54 loki kernel: [] local_bh_enable_ip+0x9/0xb Jul 12 23:04:54 loki kernel: [] _spin_unlock_bh+0x13/0x15 Jul 12 23:04:54 loki kernel: [] release_sock+0xb0/0xbb Jul 12 23:04:54 loki kernel: [] ? __kfree_skb+0x82/0x86 Jul 12 23:04:54 loki kernel: [] tcp_recvmsg+0x974/0xa99 Jul 12 23:04:54 loki kernel: [] sock_common_recvmsg+0x32/= 0x47 Jul 12 23:04:54 loki kernel: [] __sock_recvmsg+0x6d/0x7a Jul 12 23:04:54 loki kernel: [] sock_aio_read+0xee/0xfe Jul 12 23:04:54 loki kernel: [] do_sync_read+0xe7/0x12d Jul 12 23:04:54 loki kernel: [] ? rb_erase+0x278/0x2a0 Jul 12 23:04:54 loki kernel: [] ? autoremove_wake_functio= n+0x0/0x38 Jul 12 23:04:54 loki kernel: [] ? _spin_lock+0x9/0xc Jul 12 23:04:54 loki kernel: [] ? security_file_permissio= n+0x11/0x13 Jul 12 23:04:54 loki kernel: [] vfs_read+0xbb/0x102 Jul 12 23:04:54 loki kernel: [] sys_read+0x47/0x6e Jul 12 23:04:54 loki kernel: [] system_call_fastpath+0x16= /0x1b Jul 12 23:04:54 loki kernel: Mem-Info: Jul 12 23:04:54 loki kernel: Node 0 DMA per-cpu: Jul 12 23:04:54 loki kernel: CPU 0: hi: 0, btch: 1 usd: 0 Jul 12 23:04:54 loki kernel: Node 0 DMA32 per-cpu: Jul 12 23:04:54 loki kernel: CPU 0: hi: 186, btch: 31 usd: 119 Jul 12 23:04:54 loki kernel: Active_anon:14065 active_file:87384 inactive_a= non:37480 Jul 12 23:04:54 loki kernel: inactive_file:95821 unevictable:4 dirty:8 writ= eback:0 unstable:0 Jul 12 23:04:54 loki kernel: free:1344 slab:7113 mapped:4283 pagetables:565= 6 bounce:0 Jul 12 23:04:54 loki kernel: Node 0 DMA free:3988kB min:24kB low:28kB high:= 36kB active_anon:0kB inactive_anon:0kB active_file:3532kB inactive_file:103= 2kB unevictable:0kB present:6840kB pages_scanned:0 all_un reclaimable? no Jul 12 23:04:54 loki kernel: lowmem_reserve[]: 0 994 994 994 Jul 12 23:04:54 loki kernel: Node 0 DMA32 free:1388kB min:4020kB low:5024kB= high:6028kB active_anon:56260kB inactive_anon:149920kB active_file:346004k= B inactive_file:382252kB unevictable:16kB present:1018016 kB pages_scanned:96 all_unreclaimable? no Jul 12 23:04:54 loki kernel: lowmem_reserve[]: 0 0 0 0 Jul 12 23:04:54 loki kernel: Node 0 DMA: 1*4kB 0*8kB 1*16kB 0*32kB 0*64kB 1= *128kB 1*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB =3D 3988kB Jul 12 23:04:54 loki kernel: Node 0 DMA32: 4*4kB 77*8kB 3*16kB 0*32kB 1*64k= B 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB =3D 1384kB Jul 12 23:04:54 loki kernel: 183936 total pagecache pages Jul 12 23:04:54 loki kernel: 0 pages in swap cache Jul 12 23:04:54 loki kernel: Swap cache stats: add 0, delete 0, find 0/0 Jul 12 23:04:54 loki kernel: Free swap =3D 1015800kB Jul 12 23:04:54 loki kernel: Total swap =3D 1015800kB Jul 12 23:04:54 loki kernel: 262128 pages RAM Jul 12 23:04:54 loki kernel: 8339 pages reserved Jul 12 23:04:54 loki kernel: 34783 pages shared Jul 12 23:04:54 loki kernel: 245277 pages non-shared It doesn't look like it's out of memory to me, so I'm not sure what is going on. Rgds --=20 -- Pierre Ossman Linux kernel, MMC maintainer http://www.kernel.org rdesktop, core developer http://www.rdesktop.org TigerVNC, core developer http://www.tigervnc.org WARNING: This correspondence is being monitored by the Swedish government. Make sure your server uses encryption for SMTP traffic and consider using PGP for end-to-end encryption. --=_freyr.ossman.eu-25674-1247478723-0001-2 Content-Type: application/pgp-signature; name="signature.asc" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.11 (GNU/Linux) iEYEARECAAYFAkpbA8IACgkQ7b8eESbyJLhTagCcD7ff9lGGHwu5TCtbBG0k8Txc GKkAoODmze/qupVaumUKCbkvD2VMnU6t =D1jk -----END PGP SIGNATURE----- --=_freyr.ossman.eu-25674-1247478723-0001-2-- -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/