Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1759365AbXKUJoW (ORCPT ); Wed, 21 Nov 2007 04:44:22 -0500 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1753439AbXKUJoK (ORCPT ); Wed, 21 Nov 2007 04:44:10 -0500 Received: from E23SMTP06.au.ibm.com ([202.81.18.175]:51037 "EHLO e23smtp06.au.ibm.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1753254AbXKUJoI (ORCPT ); Wed, 21 Nov 2007 04:44:08 -0500 Message-ID: <4743FDBF.7010900@linux.vnet.ibm.com> Date: Wed, 21 Nov 2007 15:13:27 +0530 From: Kamalesh Babulal User-Agent: Thunderbird 1.5.0.14pre (X11/20071023) MIME-Version: 1.0 To: Andrew Morton CC: linux-kernel@vger.kernel.org, Andy Whitcroft , Balbir Singh , linux-acpi@vger.kernel.org, Thomas Gleixner , Ingo Molnar Subject: Re: 2.6.24-rc3-mm1 - Kernel Panic on IO-APIC References: <20071120204525.ff27ac98.akpm@linux-foundation.org> <4743CC0B.9000508@linux.vnet.ibm.com> <20071120221839.faab108e.akpm@linux-foundation.org> <4743F8D2.2090302@linux.vnet.ibm.com> <20071121012918.eff93b22.akpm@linux-foundation.org> In-Reply-To: <20071121012918.eff93b22.akpm@linux-foundation.org> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Sender: linux-kernel-owner@vger.kernel.org X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 6600 Lines: 124 Andrew Morton wrote: > On Wed, 21 Nov 2007 14:52:26 +0530 Kamalesh Babulal wrote: > >> Andrew Morton wrote: >>> On Wed, 21 Nov 2007 11:41:23 +0530 Kamalesh Babulal wrote: >>> >>>> Hi Andrew, >>>> >>>> Kernel panic's across different architectures like powerpc, x86_64, >>> powerpc complains about IO-APICs?? >>> >>>> Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes) >>>> Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes) >>>> Mount-cache hash table entries: 256 >>>> SMP alternatives: switching to UP code >>>> ACPI: Core revision 20070126 >>>> ..MP-BIOS bug: 8254 timer not connected to IO-APIC >>>> Kernel panic - not syncing: IO-APIC + timer doesn't work! Try using the 'noapic' kernel parameter >>> ACPI or x86 breakage, I guess. >>> >>> Did 'noapic' work? >> Hi Andrew, >> >> Passing noapic works, > > OK. > >> but the kernel oops's >> >> [ 97.161103] Unable to handle kernel NULL pointer dereference at 0000000000000009 RIP: >> [ 97.193973] [] cpu_to_allnodes_group+0x69/0x7c >> [ 97.245359] PGD 0 >> [ 97.257611] Oops: 0000 [1] SMP >> [ 97.276638] last sysfs file: >> [ 97.294417] CPU 0 >> [ 97.306620] Modules linked in: >> [ 97.325066] Pid: 1, comm: swapper Not tainted 2.6.24-rc3-mm1 #1 >> [ 97.360514] RIP: 0010:[] [] cpu_to_allnodes_group+0x69/0x7c >> [ 97.413287] RSP: 0000:ffff81012fabb650 EFLAGS: 00010286 >> [ 97.445363] RAX: ffffffff809bb060 RBX: ffff81012fabb650 RCX: 00000000000000ff >> [ 97.488378] RDX: 0000000000000001 RSI: 000000000000013e RDI: 0000000000000100 >> [ 97.531413] RBP: ffff81012fabb680 R08: ffff81012fa88180 R09: 0000000000000000 >> [ 97.574428] R10: 0000000000000000 R11: 0000000000000000 R12: ffff810001005f50 >> [ 97.617394] R13: 0000000000000000 R14: ffff81012fa88180 R15: ffff810001005f40 >> [ 97.660421] FS: 0000000000000000(0000) GS:ffffffff806c3000(0000) knlGS:0000000000000000 >> [ 97.709327] CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b >> [ 97.743995] CR2: 0000000000000009 CR3: 0000000000201000 CR4: 00000000000006a0 >> [ 97.787021] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 >> [ 97.830053] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 >> [ 97.873036] Process swapper (pid: 1, threadinfo FFFF81012FABA000, task FFFF81012FAB8040) >> [ 97.921993] Stack: 0000000000000000 0000000000000000 0000000000000000 0000000000000000 >> [ 97.971056] ffff810001005f40 ffff81012fabb700 ffff81012fabbdf0 ffffffff80235487 >> [ 98.016420] 0000000000000000 0000000000000000 0000000000000000 0000000000000000 >> [ 98.060324] Call Trace: >> [ 98.076657] [] build_sched_domains+0x1e1/0xc19 >> [ 98.113383] [] __kernel_text_address+0x22/0x30 >> [ 98.150173] [] check_chain_key+0x9c/0x15f >> [ 98.184355] [] mark_lock+0x3b/0x5b3 >> [ 98.215406] [] mark_held_locks+0x4a/0x6a >> [ 98.249027] [] get_page_from_freelist+0x42a/0x77d >> [ 98.287362] [] trace_hardirqs_on+0x198/0x1c3 >> [ 98.323123] [] get_page_from_freelist+0x75a/0x77d >> [ 98.361429] [] mark_lock+0x3b/0x5b3 >> [ 98.392427] [] check_chain_key+0x9c/0x15f >> [ 98.426621] [] number+0x115/0x21f >> [ 98.456594] [] __kernel_text_address+0x22/0x30 >> [ 98.493362] [] dump_trace+0x248/0x25d >> [ 98.525493] [] check_chain_key+0x9c/0x15f >> [ 98.559678] [] __lock_acquire+0xdee/0xf06 >> [ 98.593868] [] check_chain_key+0x9c/0x15f >> [ 98.628038] [] check_chain_key+0x9c/0x15f >> [ 98.662225] [] check_chain_key+0x9c/0x15f >> [ 98.696370] [] __lock_acquire+0xdee/0xf06 >> [ 98.730563] [] check_chain_key+0x9c/0x15f >> [ 98.764689] [] mark_lock+0x3b/0x5b3 >> [ 98.795767] [] mark_held_locks+0x4a/0x6a >> [ 98.829432] [] number+0x115/0x21f >> [ 98.859460] [] kprobe_flush_task+0x63/0xa9 >> [ 98.894166] [] vsnprintf+0x58f/0x5d5 >> [ 98.925739] [] sprintf+0x68/0x6a >> [ 98.955257] [] lock_acquire+0x72/0xe0 >> [ 98.987363] [] lock_acquired+0x57/0x1d4 >> [ 99.020446] [] lock_release+0x67/0x21a >> [ 99.053079] [] check_chain_key+0x9c/0x15f >> [ 99.087261] [] mark_lock+0x3b/0x5b3 >> [ 99.118328] [] mark_lock+0x3b/0x5b3 >> [ 99.149394] [] arch_init_sched_domains+0x27/0x69 >> [ 99.187217] [] dbg_redzone2+0x2a/0x52 >> [ 99.219320] [] cache_alloc_debugcheck_after+0x16e/0x1cb >> [ 99.260779] [] kmem_cache_alloc+0x15e/0x182 >> [ 99.295944] [] arch_init_sched_domains+0x5c/0x69 >> [ 99.333768] [] sched_init_smp+0x27/0x113 >> [ 99.367400] [] __bitmap_weight+0x78/0x8d >> [ 99.401090] [] kernel_init+0x12d/0x315 >> [ 99.433718] [] _spin_unlock_irq+0x2b/0x30 >> [ 99.467842] [] trace_hardirqs_on+0x198/0x1c3 >> [ 99.503534] [] trace_hardirqs_on+0x198/0x1c3 >> [ 99.539251] [] child_rip+0xa/0x12 >> [ 99.569234] [] restore_args+0x0/0x30 >> [ 99.600845] [] kernel_init+0x0/0x315 >> [ 99.632426] [] child_rip+0x0/0x12 >> [ 99.662455] >> [ 99.671637] INFO: lockdep is turned off. >> [ 99.695385] >> [ 99.695385] Code: 48 03 42 08 49 89 04 24 48 83 c4 20 89 c8 5b 41 5c c9 c3 55 >> [ 99.750603] RIP [] cpu_to_allnodes_group+0x69/0x7c >> [ 99.789632] RSP > > urgh, mess. Enabling frame pointers might help here. > > But we're cc'ing the right guy ;) > The kernel was compiled with frame pointers enabled. -- Thanks & Regards, Kamalesh Babulal, Linux Technology Center, IBM, ISTL. - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/