Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1757230AbYAGNY0 (ORCPT ); Mon, 7 Jan 2008 08:24:26 -0500 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1755081AbYAGNYR (ORCPT ); Mon, 7 Jan 2008 08:24:17 -0500 Received: from rosi.naasa.net ([212.8.0.13]:57304 "EHLO rosi.naasa.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1754841AbYAGNYP (ORCPT ); Mon, 7 Jan 2008 08:24:15 -0500 From: Joerg Platte Reply-To: jplatte@naasa.net To: Ingo Molnar Subject: Re: regression: 100% io-wait with 2.6.24-rcX Date: Mon, 7 Jan 2008 14:24:11 +0100 User-Agent: KMail/1.9.7 Cc: linux-kernel@vger.kernel.org References: <200801071151.11200.lists@naasa.net> <20080107111930.GB29973@elte.hu> In-Reply-To: <20080107111930.GB29973@elte.hu> MIME-Version: 1.0 Content-Type: Multipart/Mixed; boundary="Boundary-00=_8figHp8ld9Md860" Message-Id: <200801071424.12448.lists@naasa.net> Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 18590 Lines: 399 --Boundary-00=_8figHp8ld9Md860 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 8bit Content-Disposition: inline Am Montag, 7. Januar 2008 schrieb Ingo Molnar: > do: > > echo t > /proc/sysrq-trigger > > and send us the dmesg output. If the dmesg output does not include the > bootup bits then increase CONFIG_LOG_BUF_SHIFT to 20 or so: > > CONFIG_LOG_BUF_SHIFT=20 > > to have a large enough kernel messages buffer. The buffer was too small, hence I copied the relevant parts of /var/log/kern.log, I hope it contains all required information as well. regards, J?rg --Boundary-00=_8figHp8ld9Md860 Content-Type: text/plain; charset="iso-8859-1"; name="dmesg" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="dmesg" kernel: f509eb84 f50dc700 f50f3be4 00000246 f50f3be4 f5c37b80 c01672ef kernel: Call Trace: kernel: [] schedule_timeout+0x13/0x8b kernel: [] pipe_poll+0x24/0x7f kernel: [] do_select+0x370/0x3b9 kernel: [] __pollwait+0x0/0xa9 kernel: [] default_wake_function+0x0/0x5 last message repeated 4 times kernel: [] __rmqueue+0x14/0x196 kernel: [] enqueue_entity+0x2b/0x3d kernel: [] enqueue_task_fair+0x16/0x24 kernel: [] enqueue_task+0x3f/0x4a kernel: [] __wake_up_common+0x31/0x56 kernel: [] __slab_free+0x5b/0x279 kernel: [] __kfree_skb+0x8/0x63 kernel: [] sock_wfree+0x20/0x34 kernel: [] skb_release_all+0xa1/0xf6 kernel: [] unix_stream_recvmsg+0x3e9/0x4d6 [unix] kernel: [] core_sys_select+0x1ec/0x282 kernel: [] sock_aio_read+0xf2/0xfa kernel: [] recalc_sigpending+0xa/0x2d kernel: [] do_sync_read+0xc6/0x109 kernel: [] autoremove_wake_function+0x0/0x33 kernel: [] unix_ioctl+0xa4/0xac [unix] kernel: [] sock_ioctl+0x1b2/0x1d7 kernel: [] sys_select+0xa0/0x167 kernel: [] sysenter_past_esp+0x5f/0x85 kernel: [] netlbl_unlabel_list+0x9f/0x1bf kernel: ======================= kernel: bash R running 0 8034 7712 kernel: bash S 000000fd 0 8062 7713 kernel: dfcc0a80 00000082 12210264 000000fd f537ace0 01366da4 00000000 7fffffff kernel: dfc77000 00000001 bf9130cf c0271f11 f78127b0 00000000 f535ffb8 f535ff90 kernel: f537b034 00000000 bf9130cf f535ffb8 f535f000 c010348a 00000000 080c5c60 kernel: Call Trace: kernel: [] schedule_timeout+0x13/0x8b kernel: [] do_notify_resume+0x81/0x5f6 kernel: [] read_chan+0x2fc/0x521 kernel: [] default_wake_function+0x0/0x5 kernel: [] read_chan+0x0/0x521 kernel: [] tty_read+0x6f/0xad kernel: [] tty_read+0x0/0xad kernel: [] vfs_read+0x9f/0x149 kernel: [] sys_read+0x41/0x67 kernel: [] sysenter_past_esp+0x5f/0x85 kernel: ======================= kernel: kwalletmanage S 00000648 0 8371 1 kernel: f4128600 00200086 fcf08470 00000648 f52fd860 0006eb74 00000000 7fffffff kernel: f407a500 00000400 f4176f4c c0271f11 f414b200 00000000 00000000 00200200 kernel: 0016e496 c0123251 f4123e00 f4176be4 00200246 f4176be4 f407a500 001672ef kernel: Call Trace: kernel: [] schedule_timeout+0x13/0x8b kernel: [] process_timeout+0x0/0x5 kernel: [] do_select+0x370/0x3b9 kernel: [] __pollwait+0x0/0xa9 kernel: [] default_wake_function+0x0/0x5 last message repeated 4 times kernel: [] elv_insert+0xa6/0x146 kernel: [] enqueue_entity+0x2b/0x3d kernel: [] enqueue_task_fair+0x16/0x24 kernel: [] enqueue_task+0x3f/0x4a kernel: [] enqueue_entity+0x2b/0x3d kernel: [] enqueue_task_fair+0x16/0x24 kernel: [] enqueue_task+0x3f/0x4a kernel: [] __wake_up_common+0x31/0x56 kernel: [] sock_alloc_send_skb+0x7c/0x193 kernel: [] __wake_up_common+0x31/0x56 kernel: [] sock_def_readable+0x31/0x6b kernel: [] unix_stream_sendmsg+0x263/0x32c [unix] kernel: [] core_sys_select+0x1ec/0x282 kernel: [] sock_aio_write+0xe0/0xe8 kernel: [] pipe_read+0x32c/0x338 kernel: [] do_sync_write+0xc6/0x109 kernel: [] autoremove_wake_function+0x0/0x33 kernel: [] free_pgtables+0x90/0xa0 kernel: [] unix_ioctl+0xa4/0xac [unix] kernel: [] sock_ioctl+0x1b2/0x1d7 kernel: [] sys_select+0xa0/0x167 kernel: [] sysenter_past_esp+0x5f/0x85 kernel: ======================= kernel: kttsd S 00000655 0 8384 1 kernel: dfcc0900 00200086 af7cbb2c 00000655 f52bcce0 00044e4d 00000000 7fffffff kernel: f4131180 00000400 f4050f4c c0271f11 c010478b f889407c 00000000 f4ba7000 kernel: f416a600 00000020 f4075c40 f4050be4 00200246 f4050be4 f4131180 c01672ef kernel: Call Trace: kernel: [] schedule_timeout+0x13/0x8b kernel: [] common_interrupt+0x23/0x28 kernel: [] pipe_poll+0x24/0x7f kernel: [] do_select+0x370/0x3b9 kernel: [] __pollwait+0x0/0xa9 kernel: [] default_wake_function+0x0/0x5 last message repeated 4 times kernel: [] __getblk+0x14/0x1cd kernel: [] get_unused_fd_flags+0x55/0xcb kernel: [] ext3_getblk+0xb9/0x173 [ext3] kernel: [] scm_detach_fds+0xec/0x125 kernel: [] __scm_destroy+0x23/0x38 kernel: [] enqueue_entity+0x2b/0x3d kernel: [] enqueue_task_fair+0x16/0x24 kernel: [] enqueue_task+0x3f/0x4a kernel: [] __wake_up_common+0x31/0x56 kernel: [] unix_write_space+0x32/0x6a [unix] kernel: [] sock_wfree+0x20/0x34 kernel: [] skb_release_all+0xa1/0xf6 kernel: [] unix_stream_recvmsg+0x3e9/0x4d6 [unix] kernel: [] core_sys_select+0x1ec/0x282 kernel: [] sock_aio_read+0xf2/0xfa kernel: [] recalc_sigpending+0xa/0x2d kernel: [] do_sync_read+0xc6/0x109 kernel: [] autoremove_wake_function+0x0/0x33 kernel: [] unix_ioctl+0xa4/0xac [unix] kernel: [] sock_ioctl+0x1b2/0x1d7 kernel: [] sys_select+0xa0/0x167 kernel: [] sysenter_past_esp+0x5f/0x85 kernel: [] netlbl_unlabel_list+0x9f/0x1bf kernel: ======================= kernel: konqueror S 00000648 0 8665 7259 kernel: f40fb000 00000086 fa0dc86a 00000648 f418d2a0 00003d78 00000000 7fffffff kernel: f5049c80 00000800 f41b5f4c c0271f11 00000200 f41b5f4c 00000000 00200200 kernel: 0016a41f c0123251 f5cf31c0 00000246 f5cf31c0 f41b5be4 f889106f 001672ef kernel: Call Trace: kernel: [] schedule_timeout+0x13/0x8b kernel: [] process_timeout+0x0/0x5 kernel: [] unix_poll+0x17/0x8b [unix] kernel: [] do_select+0x370/0x3b9 kernel: [] __pollwait+0x0/0xa9 kernel: [] default_wake_function+0x0/0x5 last message repeated 4 times kernel: [] __find_get_block+0x13d/0x147 kernel: [] enqueue_entity+0x2b/0x3d kernel: [] __set_page_dirty+0x125/0x132 kernel: [] enqueue_entity+0x2b/0x3d kernel: [] enqueue_task_fair+0x16/0x24 kernel: [] enqueue_task+0x3f/0x4a kernel: [] __wake_up_common+0x31/0x56 kernel: [] unix_stream_recvmsg+0x3a0/0x4d6 [unix] kernel: [] sock_wfree+0x20/0x34 kernel: [] unix_stream_recvmsg+0x3a0/0x4d6 [unix] kernel: [] unix_stream_recvmsg+0x3a0/0x4d6 [unix] kernel: [] unix_stream_recvmsg+0x3e9/0x4d6 [unix] kernel: [] core_sys_select+0x1ec/0x282 kernel: [] sock_aio_read+0xf2/0xfa kernel: [] do_sync_read+0xc6/0x109 kernel: [] autoremove_wake_function+0x0/0x33 kernel: [] handle_mm_fault+0x268/0x57d kernel: [] unix_ioctl+0xa4/0xac [unix] kernel: [] sock_ioctl+0x1b2/0x1d7 kernel: [] sys_select+0xa0/0x167 kernel: [] sysenter_past_esp+0x5f/0x85 kernel: [] netlbl_unlabel_list+0x9f/0x1bf kernel: ======================= kernel: kio_file S 00000195 0 10548 7259 kernel: f52e0d80 00000082 97e3a48e 00000195 f5032160 00000000 00000000 7fffffff kernel: f4099380 00000020 f509af4c c0271f11 00000000 00000000 00000000 00000000 kernel: 00000000 00000000 f66b1a80 00000246 f66b1a80 f509abe4 f889106f 0009abe4 kernel: Call Trace: kernel: [] schedule_timeout+0x13/0x8b kernel: [] unix_poll+0x17/0x8b [unix] kernel: [] do_select+0x370/0x3b9 kernel: [] __pollwait+0x0/0xa9 kernel: [] default_wake_function+0x0/0x5 kernel: [] __alloc_pages+0x5d/0x2d9 kernel: [] __rmqueue+0x14/0x196 kernel: [] enqueue_entity+0x2b/0x3d kernel: [] enqueue_task_fair+0x16/0x24 kernel: [] enqueue_task+0x3f/0x4a kernel: [] __wake_up_common+0x31/0x56 kernel: [] sock_alloc_send_skb+0x7c/0x193 kernel: [] __wake_up_common+0x31/0x56 kernel: [] sock_def_readable+0x31/0x6b kernel: [] unix_stream_sendmsg+0x263/0x32c [unix] kernel: [] core_sys_select+0x1ec/0x282 kernel: [] sock_aio_write+0xe0/0xe8 kernel: [] do_sync_write+0xc6/0x109 kernel: [] autoremove_wake_function+0x0/0x33 kernel: [] handle_mm_fault+0x1eb/0x57d kernel: [] sys_select+0xa0/0x167 kernel: [] sys_write+0x41/0x67 kernel: [] sysenter_past_esp+0x5f/0x85 kernel: ======================= kernel: pdflush D f41c2f14 0 18822 2 kernel: f673f000 00000046 00000286 f41c2f14 f5194ce0 00000286 00000286 f41c2f14 kernel: 00175279 f41c2f6c 00000000 c0271f6c f5ff363c f5ff3644 c0354a90 c0354a90 kernel: 00175279 c0123251 f5194b80 c03546c0 c0271f67 6c666470 00687375 00000000 kernel: Call Trace: kernel: [] schedule_timeout+0x6e/0x8b kernel: [] process_timeout+0x0/0x5 kernel: [] schedule_timeout+0x69/0x8b kernel: [] __sched_text_start+0x3a/0x70 kernel: [] congestion_wait+0x4e/0x62 kernel: [] autoremove_wake_function+0x0/0x33 kernel: [] pdflush+0x0/0x1bf kernel: [] wb_kupdate+0x8c/0xd1 kernel: [] pdflush+0x0/0x1bf kernel: [] pdflush+0x11b/0x1bf kernel: [] wb_kupdate+0x0/0xd1 kernel: [] kthread+0x36/0x5d kernel: [] kthread+0x0/0x5d kernel: [] kernel_thread_helper+0x7/0x10 kernel: ======================= kernel: Sched Debug Version: v0.07, 2.6.24-rc7 #1 kernel: now at 5394978.742321 msecs kernel: .sysctl_sched_latency : 20.000000 kernel: .sysctl_sched_min_granularity : 4.000000 kernel: .sysctl_sched_wakeup_granularity : 10.000000 kernel: .sysctl_sched_batch_wakeup_granularity : 10.000000 kernel: .sysctl_sched_child_runs_first : 0.000001 kernel: .sysctl_sched_features : 7 kernel: kernel: cpu#0, 599.501 MHz kernel: .nr_running : 3 kernel: .load : 11596 kernel: .nr_switches : 3472897 kernel: .nr_load_updates : 789297 kernel: .nr_uninterruptible : 1 kernel: .jiffies : 1528423 kernel: .next_balance : 0.000000 kernel: .curr->pid : 8034 kernel: .clock : 6967153.202929 kernel: .idle_clock : 4447303.677171 kernel: .prev_clock_raw : 4676606.867330 kernel: .clock_warps : 103 kernel: .clock_overflows : 4982682 kernel: .clock_deep_idle_events : 944576 kernel: .clock_max_delta : 3.333116 kernel: .cpu_load[0] : 11596 kernel: .cpu_load[1] : 5798 kernel: .cpu_load[2] : 2899 kernel: .cpu_load[3] : 1450 kernel: .cpu_load[4] : 744 kernel: kernel: cfs_rq kernel: .exec_clock : 0.000000 kernel: .MIN_vruntime : 0.000001 kernel: .min_vruntime : 616382.544882 kernel: .max_vruntime : 0.000001 kernel: .spread : 0.000000 kernel: .spread0 : 0.000000 kernel: .nr_running : 1 kernel: .load : 2048 kernel: .nr_spread_over : 0 kernel: kernel: cfs_rq kernel: .exec_clock : 0.000000 kernel: .MIN_vruntime : 0.000001 kernel: .min_vruntime : 616382.544882 kernel: .max_vruntime : 0.000001 kernel: .spread : 0.000000 kernel: .spread0 : 0.000000 kernel: .nr_running : 0 kernel: .load : 0 kernel: .nr_spread_over : 0 kernel: kernel: cfs_rq kernel: .exec_clock : 0.000000 kernel: .MIN_vruntime : 0.000001 kernel: .min_vruntime : 616382.544882 kernel: .max_vruntime : 0.000001 kernel: .spread : 0.000000 kernel: .spread0 : 0.000000 kernel: .nr_running : 0 kernel: .load : 0 kernel: .nr_spread_over : 0 kernel: kernel: cfs_rq kernel: .exec_clock : 0.000000 kernel: .MIN_vruntime : 0.000001 kernel: .min_vruntime : 616382.544882 kernel: .max_vruntime : 0.000001 kernel: .spread : 0.000000 kernel: .spread0 : 0.000000 kernel: .nr_running : 0 kernel: .load : 0 kernel: .nr_spread_over : 0 kernel: kernel: cfs_rq kernel: .exec_clock : 0.000000 kernel: .MIN_vruntime : 0.000001 kernel: .min_vruntime : 616382.544882 kernel: .max_vruntime : 0.000001 kernel: .spread : 0.000000 kernel: .spread0 : 0.000000 kernel: .nr_running : 0 kernel: .load : 0 kernel: .nr_spread_over : 0 kernel: kernel: cfs_rq kernel: .exec_clock : 0.000000 kernel: .MIN_vruntime : 0.000001 kernel: .min_vruntime : 616382.544882 kernel: .max_vruntime : 0.000001 kernel: .spread : 0.000000 kernel: .spread0 : 0.000000 kernel: .nr_running : 0 kernel: .load : 0 kernel: .nr_spread_over : 0 kernel: kernel: cfs_rq kernel: .exec_clock : 0.000000 kernel: .MIN_vruntime : 0.000001 kernel: .min_vruntime : 616382.544882 kernel: .max_vruntime : 0.000001 kernel: .spread : 0.000000 kernel: .spread0 : 0.000000 kernel: .nr_running : 0 kernel: .load : 0 kernel: .nr_spread_over : 0 kernel: kernel: cfs_rq kernel: .exec_clock : 0.000000 kernel: .MIN_vruntime : 0.000001 kernel: .min_vruntime : 616382.544882 kernel: .max_vruntime : 0.000001 kernel: .spread : 0.000000 kernel: .spread0 : 0.000000 kernel: .nr_running : 0 kernel: .load : 0 kernel: .nr_spread_over : 0 kernel: kernel: cfs_rq kernel: .exec_clock : 0.000000 kernel: .MIN_vruntime : 0.000001 kernel: .min_vruntime : 616382.544882 kernel: .max_vruntime : 0.000001 kernel: .spread : 0.000000 kernel: .spread0 : 0.000000 kernel: .nr_running : 0 kernel: .load : 0 kernel: .nr_spread_over : 0 kernel: kernel: cfs_rq kernel: .exec_clock : 0.000000 kernel: .MIN_vruntime : 0.000001 kernel: .min_vruntime : 616382.544882 kernel: .max_vruntime : 0.000001 kernel: .spread : 0.000000 kernel: .spread0 : 0.000000 kernel: .nr_running : 0 kernel: .load : 0 kernel: .nr_spread_over : 0 kernel: kernel: cfs_rq kernel: .exec_clock : 0.000000 kernel: .MIN_vruntime : 214548.087264 kernel: .min_vruntime : 616382.544882 kernel: .max_vruntime : 214549.007330 kernel: .spread : 0.920066 kernel: .spread0 : 0.000000 kernel: .nr_running : 3 kernel: .load : 11596 kernel: .nr_spread_over : 0 kernel: kernel: runnable tasks: kernel: task PID tree-key switches prio exec-runtime sum-exec sum-sleep kernel: ---------------------------------------------------------------------------------------------------------- kernel: klogd 4715 214548.087264 4266 120 0 0 0.000000 0.000000 0.000000 kernel: Xorg 5872 214549.007330 983644 110 0 0 0.000000 0.000000 0.000000 kernel: R bash 8034 214548.926777 1418 120 0 0 0.000000 0.000000 0.000000 kernel: --Boundary-00=_8figHp8ld9Md860-- -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/