Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1754865Ab1FGNiD (ORCPT ); Tue, 7 Jun 2011 09:38:03 -0400 Received: from mail-ww0-f44.google.com ([74.125.82.44]:42879 "EHLO mail-ww0-f44.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1754002Ab1FGNiA (ORCPT ); Tue, 7 Jun 2011 09:38:00 -0400 DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=subject:from:to:cc:in-reply-to:references:content-type:date :message-id:mime-version:x-mailer:content-transfer-encoding; b=VrTYuBMVlqEZr88DvpZs4aP84lEp/BJ7k3tispYrMRPCEd96s30CGFPBf1wRY4+d3f mCAbTM4GYuJan8Pb71dMhk5eStkie+vSJhXjehEQ3hsP/CrGfwTSDOYu0v2Q/TA2G5u4 jKxhUr8L4traSGtq54N5dVW16VWXxTzSp7iVw= Subject: Re: KVM induced panic on 2.6.38[2367] & 2.6.39 From: Eric Dumazet To: Brad Campbell Cc: Avi Kivity , CaT , Borislav Petkov , linux-kernel@vger.kernel.org, kvm@vger.kernel.org, netdev In-Reply-To: <4DEE273F.7090402@fnarfbargle.com> References: <20110601011527.GN19505@random.random> <4DE5DCA8.7070704@fnarfbargle.com> <4DE5E29E.7080009@redhat.com> <4DE60669.9050606@fnarfbargle.com> <4DE60918.3010008@redhat.com> <4DE60940.1070107@redhat.com> <4DE61A2B.7000008@fnarfbargle.com> <20110601111841.GB3956@zip.com.au> <4DE62801.9080804@fnarfbargle.com> <20110601230342.GC3956@zip.com.au> <4DE8E3ED.7080004@fnarfbargle.com> <4DEB3AE4.8040700@redhat.com> <4DEB8872.2060801@fnarfbargle.com> <1307391746.2642.11.camel@edumazet-laptop> <4DEE273F.7090402@fnarfbargle.com> Content-Type: text/plain; charset="UTF-8" Date: Tue, 07 Jun 2011 15:37:54 +0200 Message-ID: <1307453874.3091.14.camel@edumazet-laptop> Mime-Version: 1.0 X-Mailer: Evolution 2.32.2 Content-Transfer-Encoding: 8bit Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 4687 Lines: 107 Le mardi 07 juin 2011 à 21:27 +0800, Brad Campbell a écrit : > On 07/06/11 04:22, Eric Dumazet wrote: > > > Could you please try latest linux-2.6 tree ? > > > > We fixed many networking bugs that could explain your crash. > > > > > > > > > > No good I'm afraid. > > [ 543.040056] > ============================================================================= > [ 543.040136] BUG ip_dst_cache: Padding overwritten. > 0xffff8803e4217ffe-0xffff8803e4217fff > [ 543.040194] Thats pretty strange : These are the last two bytes of a page, set to 0x0000 (a 16 bit value) There is no way a dst field could actually sit on this location (its a padding), since a dst is a bit less than 256 bytes (0xe8), and each entry is aligned on a 64byte address. grep dst /proc/slabinfo ip_dst_cache 32823 62944 256 32 2 : tunables 0 0 0 : slabdata 1967 1967 0 sizeof(struct rtable)=0xe8 > ----------------------------------------------------------------------------- > [ 543.040198] > [ 543.040298] INFO: Slab 0xffffea000d9e74d0 objects=25 used=25 fp=0x > (null) flags=0x8000000000004081 > [ 543.040364] Pid: 4576, comm: kworker/1:2 Not tainted 3.0.0-rc2 #1 > [ 543.040415] Call Trace: > [ 543.040472] [] ? slab_err+0xad/0xd0 > [ 543.040528] [] ? check_preempt_wakeup+0xa4/0x160 > [ 543.040595] [] ? slab_pad_check+0x126/0x170 > [ 543.040650] [] ? dst_destroy+0x8b/0x110 > [ 543.040701] [] ? check_slab+0x4a/0xc0 > [ 543.040753] [] ? free_debug_processing+0x2d/0x250 > [ 543.040808] [] ? __slab_free+0x12b/0x140 > [ 543.040862] [] ? kmem_cache_free+0x99/0xa0 > [ 543.040915] [] ? dst_destroy+0x8b/0x110 > [ 543.040967] [] ? dst_gc_task+0x196/0x1f0 > [ 543.041021] [] ? queue_delayed_work_on+0x154/0x160 > [ 543.041081] [] ? do_dbs_timer+0x20e/0x3d0 > [ 543.041133] [] ? dst_alloc+0x180/0x180 > [ 543.041187] [] ? process_one_work+0xfb/0x3b0 > [ 543.041242] [] ? worker_thread+0x144/0x3d0 > [ 543.041296] [] ? __wake_up_common+0x50/0x80 > [ 543.041678] [] ? rescuer_thread+0x2e0/0x2e0 > [ 543.041729] [] ? rescuer_thread+0x2e0/0x2e0 > [ 543.041782] [] ? kthread+0x96/0xa0 > [ 543.041835] [] ? kernel_thread_helper+0x4/0x10 > [ 543.041890] [] ? kthread_worker_fn+0x120/0x120 > [ 543.041944] [] ? gs_change+0xb/0xb > [ 543.041993] Padding 0xffff8803e4217f40: 5a 5a 5a 5a 5a 5a 5a 5a 5a > 5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ > [ 543.042718] Padding 0xffff8803e4217f50: 5a 5a 5a 5a 5a 5a 5a 5a 5a > 5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ > [ 543.043433] Padding 0xffff8803e4217f60: 5a 5a 5a 5a 5a 5a 5a 5a 5a > 5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ > [ 543.044155] Padding 0xffff8803e4217f70: 5a 5a 5a 5a 5a 5a 5a 5a 5a > 5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ > [ 543.044866] Padding 0xffff8803e4217f80: 5a 5a 5a 5a 5a 5a 5a 5a 5a > 5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ > [ 543.045590] Padding 0xffff8803e4217f90: 5a 5a 5a 5a 5a 5a 5a 5a 5a > 5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ > [ 543.046311] Padding 0xffff8803e4217fa0: 5a 5a 5a 5a 5a 5a 5a 5a 5a > 5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ > [ 543.047034] Padding 0xffff8803e4217fb0: 5a 5a 5a 5a 5a 5a 5a 5a 5a > 5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ > [ 543.047755] Padding 0xffff8803e4217fc0: 5a 5a 5a 5a 5a 5a 5a 5a 5a > 5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ > [ 543.048474] Padding 0xffff8803e4217fd0: 5a 5a 5a 5a 5a 5a 5a 5a 5a > 5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ > [ 543.049203] Padding 0xffff8803e4217fe0: 5a 5a 5a 5a 5a 5a 5a 5a 5a > 5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ > [ 543.049909] Padding 0xffff8803e4217ff0: 5a 5a 5a 5a 5a 5a 5a 5a 5a > 5a 5a 5a 5a 5a 00 00 ZZZZZZZZZZZZZZ.. > [ 543.050021] FIX ip_dst_cache: Restoring > 0xffff8803e4217f40-0xffff8803e4217fff=0x5a > [ 543.050021] > > Dropped -mm, Hugh and Andrea from CC as this does not appear to be mm or > ksm related. > > I'll pare down the firewall and see if I can make it break easier with a > smaller test set. Hmm, not sure now :( Could you reproduce another bug please ? -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/