Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1751300AbWHBHOF (ORCPT ); Wed, 2 Aug 2006 03:14:05 -0400 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1751302AbWHBHOE (ORCPT ); Wed, 2 Aug 2006 03:14:04 -0400 Received: from adsl-69-232-92-238.dsl.sndg02.pacbell.net ([69.232.92.238]:55998 "EHLO gnuppy.monkey.org") by vger.kernel.org with ESMTP id S1751300AbWHBHOD (ORCPT ); Wed, 2 Aug 2006 03:14:03 -0400 Date: Wed, 2 Aug 2006 00:13:48 -0700 To: Steven Rostedt Cc: Ingo Molnar , linux-kernel@vger.kernel.org Subject: Re: 2.6.17-rt8 crash amd64 Message-ID: <20060802071348.GA28653@gnuppy.monkey.org> References: <20060802011809.GA26313@gnuppy.monkey.org> <1154482302.30391.14.camel@localhost.localdomain> <20060802021956.GC26364@gnuppy.monkey.org> <20060802022539.GA26799@gnuppy.monkey.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20060802022539.GA26799@gnuppy.monkey.org> User-Agent: Mutt/1.5.11+cvs20060403 From: Bill Huey (hui) Sender: linux-kernel-owner@vger.kernel.org X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 21140 Lines: 407 On Tue, Aug 01, 2006 at 07:25:39PM -0700, Bill Huey wrote: > On Tue, Aug 01, 2006 at 07:19:56PM -0700, Bill Huey wrote: > > It's already compiling with frame pointers. Unfortunately, this is about > as good it gets for a stack trace unless you've got another suggestion. More of the same. Looks like a lock was missed in the VM. bill * INIT: Id "T4" respawning too fast: disabled for 5 minutes * INIT: Id "T5" respawning too fast: disabled for 5 minutes [ 3254.657547] BUG: scheduling while atomic: mv/0x00000001/5222 [ 3254.663380] [ 3254.663381] Call Trace: [ 3254.667255] {__schedule+155} [ 3254.672491] {_raw_spin_unlock_irqrestore+81} [ 3254.679151] {task_blocks_on_rt_mutex+497} [ 3254.685538] {free_pages_bulk+42} [ 3254.691121] {find_task_by_pid_type+24} [ 3254.697243] {free_pages_bulk+42} [ 3254.702827] {schedule+236} [ 3254.707872] {rt_lock_slowlock+351} [ 3254.713638] {_raw_spin_unlock_irqrestore+81} [ 3254.720296] {__lock_text_start+13} [ 3254.726056] {free_pages_bulk+42} [ 3254.731640] {_raw_spin_unlock_irqrestore+44} [ 3254.738297] {__free_pages_ok+428} [ 3254.743972] {__free_pages+48} [ 3254.749284] {free_pages+133} [ 3254.754508] {free_task+24} [ 3254.759553] {__put_task_struct+189} [ 3254.765404] {thread_return+208} [ 3254.770899] {_raw_spin_unlock_irqrestore+81} [ 3254.777555] {preempt_schedule+85} [ 3254.783226] {_raw_spin_unlock_irqrestore+81} [ 3254.789882] {rt_mutex_adjust_prio+50} [ 3254.795911] {rt_lock_slowunlock+99} [ 3254.801762] {rt_unlock+9} [ 3254.806715] {dput+213} [ 3254.811404] {__fput+293} [ 3254.816272] {fput+20} [ 3254.820869] {remove_vma+74} [ 3254.826005] {do_munmap+631} [ 3254.831143] {sys_munmap+64} [ 3254.836278] {ia32_sysret+0} [ 3254.841606] --------------------------- [ 3254.845554] | preempt count: 00000001 ] [ 3254.849503] | 1-level deep critical section nesting: [ 3254.854614] ---------------------------------------- [ 3254.859725] .. [] .... __schedule+0xb3/0xb2a [ 3254.865743] .....[] .. ( <= preempt_schedule+0x55/0x8f) [ 3254.872923] [ 3254.882567] BUG: scheduling while atomic: mv/0x00000001/5222 [ 3254.888406] [ 3254.888407] Call Trace: [ 3254.892279] {__schedule+155} [ 3254.897508] {_raw_spin_unlock_irqrestore+81} [ 3254.904168] {task_blocks_on_rt_mutex+497} [ 3254.910556] {free_pages_bulk+42} [ 3254.916140] {find_task_by_pid_type+24} [ 3254.922261] {free_pages_bulk+42} [ 3254.927841] {schedule+236} [ 3254.932883] {rt_lock_slowlock+351} [ 3254.938650] {_raw_spin_unlock_irqrestore+81} [ 3254.945308] {__lock_text_start+13} [ 3254.951068] {free_pages_bulk+42} [ 3254.956651] {_raw_spin_unlock_irqrestore+44} [ 3254.963307] {__free_pages_ok+428} [ 3254.968984] {__free_pages+48} [ 3254.974298] {free_pages+133} [ 3254.979523] {free_task+24} [ 3254.984569] {__put_task_struct+189} [ 3254.990420] {thread_return+208} [ 3254.995916] {_raw_spin_unlock_irqrestore+81} [ 3255.002572] {preempt_schedule+85} [ 3255.008244] {_raw_spin_unlock_irqrestore+81} [ 3255.014899] {rt_mutex_adjust_prio+50} [ 3255.020929] {rt_lock_slowunlock+99} [ 3255.026778] {rt_unlock+9} [ 3255.031731] {dput+213} [ 3255.036420] {__fput+293} [ 3255.041287] {fput+20} [ 3255.045882] {remove_vma+74} [ 3255.051015] {do_munmap+631} [ 3255.056151] {sys_munmap+64} [ 3255.061285] {ia32_sysret+0} [ 3255.066616] --------------------------- [ 3255.070563] | preempt count: 00000001 ] [ 3255.074512] | 1-level deep critical section nesting: [ 3255.079623] ---------------------------------------- [ 3255.084734] .. [] .... __schedule+0xb3/0xb2a [ 3255.090753] .....[] .. ( <= preempt_schedule+0x55/0x8f) [ 3255.097932] [ 3255.104620] BUG: scheduling while atomic: mv/0x00000001/5222 [ 3255.110455] [ 3255.110456] Call Trace: [ 3255.114330] {__schedule+155} [ 3255.119556] {_raw_spin_unlock_irqrestore+81} [ 3255.126216] {task_blocks_on_rt_mutex+497} [ 3255.132604] {free_pages_bulk+42} [ 3255.138188] {find_task_by_pid_type+24} [ 3255.144307] {free_pages_bulk+42} [ 3255.149886] {schedule+236} [ 3255.154930] {rt_lock_slowlock+351} [ 3255.160696] {_raw_spin_unlock_irqrestore+81} [ 3255.167352] {__lock_text_start+13} [ 3255.173110] {free_pages_bulk+42} [ 3255.178692] {_raw_spin_unlock_irqrestore+44} [ 3255.185349] {__free_pages_ok+428} [ 3255.191020] {__free_pages+48} [ 3255.196332] {free_pages+133} [ 3255.201556] {free_task+24} [ 3255.206602] {__put_task_struct+189} [ 3255.212451] {thread_return+208} [ 3255.217945] {_raw_spin_unlock_irqrestore+81} [ 3255.224603] {preempt_schedule+85} [ 3255.230273] {_raw_spin_unlock_irqrestore+81} [ 3255.236928] {rt_mutex_adjust_prio+50} [ 3255.242957] {rt_lock_slowunlock+99} [ 3255.248807] {rt_unlock+9} [ 3255.253759] {dput+213} [ 3255.258444] {__fput+293} [ 3255.263311] {fput+20} [ 3255.267906] {remove_vma+74} [ 3255.273041] {do_munmap+631} [ 3255.278177] {sys_munmap+64} [ 3255.283310] {ia32_sysret+0} [ 3255.288638] --------------------------- [ 3255.292586] | preempt count: 00000001 ] [ 3255.296533] | 1-level deep critical section nesting: [ 3255.301646] ---------------------------------------- [ 3255.306759] .. [] .... __schedule+0xb3/0xb2a [ 3255.312777] .....[] .. ( <= preempt_schedule+0x55/0x8f) [ 3255.319959] [ 3256.253417] BUG: scheduling while atomic: cc1/0x00000001/5281 [ 3256.259343] [ 3256.259344] Call Trace: [ 3256.263217] {__schedule+155} [ 3256.268446] {_raw_spin_unlock_irqrestore+72} [ 3256.275103] {task_blocks_on_rt_mutex+497} [ 3256.281490] {free_pages_bulk+42} [ 3256.287073] {find_task_by_pid_type+24} [ 3256.293196] {free_pages_bulk+42} [ 3256.298779] {schedule+236} [ 3256.303824] {rt_lock_slowlock+351} [ 3256.309592] {_raw_spin_unlock_irqrestore+72} [ 3256.316248] {__lock_text_start+13} [ 3256.322006] {free_pages_bulk+42} [ 3256.327588] {_raw_spin_unlock_irqrestore+44} [ 3256.334243] {__free_pages_ok+428} [ 3256.339917] {__free_pages+48} [ 3256.345229] {free_pages+133} [ 3256.350454] {free_task+24} [ 3256.355502] {__put_task_struct+189} [ 3256.361353] {thread_return+208} [ 3256.366852] {schedule+236} [ 3256.371898] {retint_careful+15} [ 3256.377586] --------------------------- [ 3256.381533] | preempt count: 00000001 ] [ 3256.385481] | 1-level deep critical section nesting: [ 3256.390592] ---------------------------------------- [ 3256.395704] .. [] .... __schedule+0xb3/0xb2a [ 3256.401723] .....[] .. ( <= schedule+0xec/0x11e) [ 3256.408278] [ 3256.787232] BUG: scheduling while atomic: make/0x00000001/5314 [ 3256.793246] [ 3256.793247] Call Trace: [ 3256.797118] {__schedule+155} [ 3256.802342] {_raw_spin_unlock_irqrestore+72} [ 3256.808998] {task_blocks_on_rt_mutex+497} [ 3256.815386] {free_pages_bulk+42} [ 3256.820971] {find_task_by_pid_type+24} [ 3256.827090] {free_pages_bulk+42} [ 3256.832671] {schedule+236} [ 3256.837716] {rt_lock_slowlock+351} [ 3256.843480] {_raw_spin_unlock_irqrestore+72} [ 3256.850137] {__lock_text_start+13} [ 3256.855898] {free_pages_bulk+42} [ 3256.861479] {_raw_spin_unlock_irqrestore+44} [ 3256.868135] {__free_pages_ok+428} [ 3256.873807] {__free_pages+48} [ 3256.879121] {free_pages+133} [ 3256.884345] {free_task+24} [ 3256.889391] {__put_task_struct+189} [ 3256.895240] {schedule_tail+184} [ 3256.900732] {ret_from_fork+5} [ 3256.906242] --------------------------- [ 3256.910190] | preempt count: 00000001 ] [ 3256.914140] | 1-level deep critical section nesting: [ 3256.919250] ---------------------------------------- [ 3256.924363] .. [] .... _raw_spin_lock+0x13/0x20 [ 3256.930650] .....[] .. ( <= rt_lock_slowunlock+0xe/0x67) [ 3256.937921] [ 3259.553268] BUG: scheduling while atomic: cc1/0x00000001/5428 [ 3259.559191] [ 3259.559192] Call Trace: [ 3259.563065] {__schedule+155} [ 3259.568292] {_raw_spin_unlock_irqrestore+81} [ 3259.574949] {task_blocks_on_rt_mutex+497} [ 3259.581345] {free_pages_bulk+42} [ 3259.586929] {find_task_by_pid_type+24} [ 3259.593049] {free_pages_bulk+42} [ 3259.598630] {schedule+236} [ 3259.603675] {rt_lock_slowlock+351} [ 3259.609441] {_raw_spin_unlock_irqrestore+81} [ 3259.616100] {__lock_text_start+13} [ 3259.621861] {free_pages_bulk+42} [ 3259.627441] {_raw_spin_unlock_irqrestore+44} [ 3259.634099] {__free_pages_ok+428} [ 3259.639773] {__free_pages+48} [ 3259.645087] {free_pages+133} [ 3259.650312] {free_task+24} [ 3259.655360] {__put_task_struct+189} [ 3259.661209] {thread_return+208} [ 3259.666704] {_raw_spin_unlock_irqrestore+44} [ 3259.673361] {preempt_schedule+85} [ 3259.679032] {_raw_spin_unlock+55} [ 3259.684702] {rt_lock_slowunlock+62} [ 3259.690550] {rt_unlock+9} [ 3259.695503] {atomic_dec_and_spin_lock+44} [ 3259.701893] {dput+57} [ 3259.706490] {__link_path_walk+1617} [ 3259.712347] {link_path_walk+103} [ 3259.717931] {get_unused_fd+251} [ 3259.723430] {do_path_lookup+644} [ 3259.729015] {__path_lookup_intent_open+89} [ 3259.735497] {path_lookup_open+12} [ 3259.741169] {open_namei+144} [ 3259.746398] {do_filp_open+38} [ 3259.751719] {do_sys_open+77} [ 3259.756946] {compat_sys_open+21} [ 3259.762527] {ia32_sysret+0} [ 3259.767859] --------------------------- [ 3259.771807] | preempt count: 00000001 ] [ 3259.775755] | 1-level deep critical section nesting: [ 3259.780867] ---------------------------------------- [ 3259.785977] .. [] .... __schedule+0xb3/0xb2a [ 3259.791996] .....[] .. ( <= preempt_schedule+0x55/0x8f) [ 3259.799176] [ 3259.803837] BUG: scheduling while atomic: cc1/0x00000001/5428 [ 3259.809760] [ 3259.809761] Call Trace: [ 3259.813633] {__schedule+155} [ 3259.818863] {task_blocks_on_rt_mutex+497} [ 3259.825250] {free_pages_bulk+42} [ 3259.830832] {find_task_by_pid_type+24} [ 3259.836953] {free_pages_bulk+42} [ 3259.842535] {schedule+236} [ 3259.847578] {rt_lock_slowlock+351} [ 3259.853351] {_raw_spin_unlock_irqrestore+81} [ 3259.860008] {__lock_text_start+13} [ 3259.865768] {free_pages_bulk+42} [ 3259.871350] {_raw_spin_unlock_irqrestore+44} [ 3259.878008] {__free_pages_ok+428} [ 3259.883683] {__free_pages+48} [ 3259.888995] {free_pages+133} [ 3259.894221] {free_task+24} [ 3259.899266] {__put_task_struct+189} [ 3259.905115] {thread_return+208} [ 3259.910610] {_raw_spin_unlock_irqrestore+44} [ 3259.917271] {preempt_schedule+85} [ 3259.922940] {_raw_spin_unlock+55} [ 3259.928610] {rt_lock_slowunlock+62} [ 3259.934459] {rt_unlock+9} [ 3259.939414] {atomic_dec_and_spin_lock+44} [ 3259.945802] {dput+57} [ 3259.950402] {__link_path_walk+1617} [ 3259.956257] {link_path_walk+103} [ 3259.961841] {get_unused_fd+251} [ 3259.967340] {do_path_lookup+644} [ 3259.972924] {__path_lookup_intent_open+89} [ 3259.979402] {path_lookup_open+12} [ 3259.985073] {open_namei+144} [ 3259.990303] {do_filp_open+38} [ 3259.995622] {do_sys_open+77} [ 3260.000849] {compat_sys_open+21} [ 3260.006431] {ia32_sysret+0} [ 3260.011762] --------------------------- [ 3260.015710] | preempt count: 00000001 ] [ 3260.019657] | 1-level deep critical section nesting: [ 3260.024769] ---------------------------------------- [ 3260.029881] .. [] .... __schedule+0xb3/0xb2a [ 3260.035898] .....[] .. ( <= preempt_schedule+0x55/0x8f) [ 3260.043077] [ 3273.447899] BUG: scheduling while atomic: ld/0x00000001/6045 [ 3273.453733] [ 3273.453734] Call Trace: [ 3273.457608] {__schedule+155} [ 3273.462836] {_raw_spin_unlock_irqrestore+81} [ 3273.469496] {task_blocks_on_rt_mutex+497} [ 3273.475884] {free_pages_bulk+42} [ 3273.481468] {find_task_by_pid_type+24} [ 3273.487589] {free_pages_bulk+42} [ 3273.493172] {schedule+236} [ 3273.498216] {rt_lock_slowlock+351} [ 3273.503985] {_raw_spin_unlock_irqrestore+81} [ 3273.510642] {__lock_text_start+13} [ 3273.516403] {free_pages_bulk+42} [ 3273.521985] {_raw_spin_unlock_irqrestore+44} [ 3273.528641] {__free_pages_ok+428} [ 3273.534317] {__free_pages+48} [ 3273.539630] {free_pages+133} [ 3273.544855] {free_task+24} [ 3273.549900] {__put_task_struct+189} [ 3273.555753] {thread_return+208} [ 3273.561250] {_raw_spin_unlock_irqrestore+81} [ 3273.567907] {preempt_schedule+85} [ 3273.573578] {_raw_spin_unlock_irqrestore+81} [ 3273.580234] {rt_mutex_adjust_prio+50} [ 3273.586264] {rt_lock_slowunlock+99} [ 3273.592114] {rt_unlock+9} [ 3273.597071] {__mod_page_state_offset+100} [ 3273.603466] {mod_page_state_offset+73} [ 3273.609585] {__handle_mm_fault+62} [ 3273.615346] {rt_mutex_slowtrylock+144} [ 3273.621467] {do_page_fault+1072} [ 3273.627054] {thread_return+218} [ 3273.632551] {error_exit+0} [ 3273.637796] --------------------------- [ 3273.641743] | preempt count: 00000001 ] [ 3273.645692] | 1-level deep critical section nesting: [ 3273.650803] ---------------------------------------- [ 3273.655915] .. [] .... __schedule+0xb3/0xb2a [ 3273.661932] .....[] .. ( <= preempt_schedule+0x55/0x8f) [ 3273.669113] [ 3294.784449] BUG: scheduling while atomic: make/0x00000001/7072 [ 3294.790461] [ 3294.790462] Call Trace: [ 3294.794335] {__schedule+155} [ 3294.799564] {_raw_spin_unlock_irqrestore+72} [ 3294.806221] {task_blocks_on_rt_mutex+497} [ 3294.812608] {free_pages_bulk+42} [ 3294.818190] {find_task_by_pid_type+24} [ 3294.824309] {free_pages_bulk+42} [ 3294.829889] {schedule+236} [ 3294.834936] {rt_lock_slowlock+351} [ 3294.840701] {_raw_spin_unlock_irqrestore+72} [ 3294.847356] {__lock_text_start+13} [ 3294.853114] {free_pages_bulk+42} [ 3294.858696] {_raw_spin_unlock_irqrestore+44} [ 3294.865354] {__free_pages_ok+428} [ 3294.871027] {__free_pages+48} [ 3294.876340] {free_pages+133} [ 3294.881565] {free_task+24} [ 3294.886619] {__put_task_struct+189} [ 3294.892471] {schedule_tail+184} [ 3294.897964] {ret_from_fork+5} [ 3294.903475] --------------------------- [ 3294.907424] | preempt count: 00000001 ] [ 3294.911372] | 1-level deep critical section nesting: [ 3294.916484] ---------------------------------------- [ 3294.921595] .. [] .... _raw_spin_lock+0x13/0x20 [ 3294.927883] .....[] .. ( <= rt_lock_slowunlock+0xe/0x67) [ 3294.935155] [ 3309.174697] B - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/