Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S932092Ab1BWIbo (ORCPT ); Wed, 23 Feb 2011 03:31:44 -0500 Received: from e28smtp07.in.ibm.com ([122.248.162.7]:33215 "EHLO e28smtp07.in.ibm.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S932072Ab1BWIbm (ORCPT ); Wed, 23 Feb 2011 03:31:42 -0500 Date: Wed, 23 Feb 2011 14:01:58 +0530 From: Bharata B Rao To: Paul Turner Cc: balbir@linux.vnet.ibm.com, Xiao Guangrong , linux-kernel@vger.kernel.org, Dhaval Giani , Vaidyanathan Srinivasan , Srivatsa Vaddagiri , Kamalesh Babulal , Ingo Molnar , Peter Zijlstra , Pavel Emelyanov , Herbert Poetzl , Avi Kivity , Chris Friesen Subject: Re: [CFS Bandwidth Control v4 0/7] Introduction Message-ID: <20110223083048.GA3159@in.ibm.com> Reply-To: bharata@linux.vnet.ibm.com References: <20110216031831.571628191@google.com> <4D61D230.907@cn.fujitsu.com> <20110223075121.GI3379@balbir.in.ibm.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 6302 Lines: 159 On Tue, Feb 22, 2011 at 11:56:20PM -0800, Paul Turner wrote: > On Tue, Feb 22, 2011 at 11:51 PM, Balbir Singh > wrote: > > * Paul Turner [2011-02-22 23:42:48]: > > > >> Thanks for the report Xiao -- I wasn't able to reproduce this yet with > >> a simple guest, I will try a more modern image tomorrow. > >> > >> One suspicion is that this might be connected with the missing > >> runnable accounting in sched_stoptask.c. > >> > > > > I can confirm that, my guests work fine after the changes posted this > > morning. I still see some lockdep errors, but none associated with the > > scheduler. > > > > Excellent! > > Ok, if this is resolved I'll roll this up and repost tomorrow, thanks! As I said in an earlier reply, I too saw the lockups in guests. However those lockups didn't occur consistently. After the sched_stoptask.c changes, I haven't seen any lockups till now. BTW, the lockups looked like this for me: ... Mounting sysfs filesystem Creating /dev Creating initial device nodes Loading /lib/kbd/keymaps/i386/qwerty/us.map BUG: soft lockup - CPU#0 stuck for 61s! [init:1] Modules linked in: Pid: 1, comm: init Not tainted (2.6.27.24-170.2.68.fc10.i686 #1) KVM EIP: 0060:[] EFLAGS: 00000297 CPU: 0 EIP is at __ticket_spin_lock+0x13/0x19 EAX: c080ff00 EBX: 00000000 ECX: c05751ca EDX: 00008584 ESI: df92c904 EDI: dd700d80 EBP: df819e50 ESP: df819e50 DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068 CR0: 8005003b CR2: 0805d3dc CR3: 1d706000 CR4: 000006d0 DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000 DR6: ffff0ff0 DR7: 00000400 [] lock_kernel+0x1f/0x2d [] tty_open+0x12/0x2aa [] ? exact_match+0x0/0x7 [] chrdev_open+0x12b/0x142 [] __dentry_open+0x10e/0x1fc [] nameidata_to_filp+0x1f/0x33 [] ? chrdev_open+0x0/0x142 [] do_filp_open+0x31c/0x611 [] ? set_next_entity+0x8b/0xf7 [] ? need_resched+0x18/0x22 [] do_sys_open+0x42/0xb7 [] sys_open+0x1e/0x26 [] syscall_call+0x7/0xb ======================= BUG: soft lockup - CPU#3 stuck for 61s! [plymouthd:562] Modules linked in: Pid: 562, comm: plymouthd Not tainted (2.6.27.24-170.2.68.fc10.i686 #1) KVM EIP: 0060:[] EFLAGS: 00000293 CPU: 3 EIP is at __ticket_spin_lock+0x13/0x19 EAX: c080ff00 EBX: 00000000 ECX: df469198 EDX: 00008684 ESI: df469198 EDI: df424018 EBP: dd6b9dc0 ESP: dd6b9dc0 DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068 CR0: 80050033 CR2: 0804e767 CR3: 1d6b7000 CR4: 000006d0 DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000 DR6: ffff0ff0 DR7: 00000400 [] lock_kernel+0x1f/0x2d [] proc_lookup_de+0x15/0xc0 [] proc_lookup+0x12/0x17 [] proc_root_lookup+0x11/0x2b [] do_lookup+0xae/0x11e [] __link_path_walk+0x57e/0x6b5 [] path_walk+0x4c/0x9b [] do_path_lookup+0x12d/0x175 [] __path_lookup_intent_open+0x45/0x76 [] path_lookup_open+0x10/0x12 [] do_filp_open+0xa1/0x611 [] ? selinux_file_alloc_security+0x22/0x41 [] ? trace_hardirqs_on_thunk+0xc/0x10 [] ? restore_nocheck_notrace+0x0/0xe [] do_sys_open+0x42/0xb7 [] sys_open+0x1e/0x26 [] syscall_call+0x7/0xb ======================= BUG: soft lockup - CPU#2 stuck for 63s! [setfont:559] Modules linked in: Pid: 559, comm: setfont Not tainted (2.6.27.24-170.2.68.fc10.i686 #1) KVM EIP: 0060:[] EFLAGS: 00010283 CPU: 2 EIP is at vgacon_do_font_op+0x177/0x3ec EAX: c095a1f8 EBX: df904000 ECX: 00000001 EDX: 00000043 ESI: 00000004 EDI: c095a1f4 EBP: dd743e0c ESP: dd743df0 DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068 CR0: 8005003b CR2: 0826d000 CR3: 1d73c000 CR4: 000006d0 DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000 DR6: ffff0ff0 DR7: 00000400 [] vgacon_font_set+0x59/0x208 [] ? down+0x2b/0x2f [] ? vgacon_font_set+0x0/0x208 [] con_font_op+0x15c/0x378 [] ? need_resched+0x18/0x22 [] vt_ioctl+0x1338/0x14fd [] ? inode_has_perm+0x5b/0x65 [] ? vt_ioctl+0x0/0x14fd [] tty_ioctl+0x665/0x6cf [] ? file_has_perm+0x7b/0x84 [] ? tty_ioctl+0x0/0x6cf [] vfs_ioctl+0x22/0x69 [] do_vfs_ioctl+0x23b/0x247 [] ? selinux_file_ioctl+0x35/0x38 [] sys_ioctl+0x40/0x5c [] syscall_call+0x7/0xb ======================= BUG: soft lockup - CPU#1 stuck for 63s! [loadkeys:560] Modules linked in: Pid: 560, comm: loadkeys Not tainted (2.6.27.24-170.2.68.fc10.i686 #1) KVM EIP: 0060:[] EFLAGS: 00000282 CPU: 1 EIP is at _spin_unlock_irqrestore+0x2d/0x38 EAX: 00000282 EBX: 00000282 ECX: dd5b7f80 EDX: 00000282 ESI: c096f740 EDI: c096f7fc EBP: c08a5f78 ESP: c08a5f74 DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068 CR0: 8005003b CR2: 009f0210 CR3: 1d73b000 CR4: 000006d0 DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000 DR6: ffff0ff0 DR7: 00000400 [] serial8250_handle_port+0x220/0x230 [] ? serial_in+0x5a/0x61 [] serial8250_interrupt+0x49/0xc9 [] handle_IRQ_event+0x2f/0x64 [] handle_edge_irq+0xb2/0xf4 [] ? handle_edge_irq+0x0/0xf4 [] do_IRQ+0xc7/0xfe [] common_interrupt+0x28/0x30 [] ? _spin_unlock_irqrestore+0x2d/0x38 [] uart_start+0x4e/0x53 [] uart_write+0xce/0xd9 [] write_chan+0x1e5/0x2b0 [] ? default_wake_function+0x0/0xd [] tty_write+0x155/0x1d5 [] ? write_chan+0x0/0x2b0 [] redirected_tty_write+0x60/0x6d [] ? redirected_tty_write+0x0/0x6d [] vfs_write+0x84/0xdf [] sys_write+0x3b/0x60 [] syscall_call+0x7/0xb ======================= input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input3 Setting up hotplug. Creating block device nodes. Creating character device nodes. -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/