Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1754164Ab1DUO3o (ORCPT ); Thu, 21 Apr 2011 10:29:44 -0400 Received: from e9.ny.us.ibm.com ([32.97.182.139]:58919 "EHLO e9.ny.us.ibm.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1753726Ab1DUO3n (ORCPT ); Thu, 21 Apr 2011 10:29:43 -0400 Date: Thu, 21 Apr 2011 07:28:53 -0700 From: "Paul E. McKenney" To: sedat.dilek@gmail.com Cc: Stephen Rothwell , linux-next@vger.kernel.org, LKML Subject: Re: linux-next: Tree for April 14 (Call-traces: RCU/ACPI/WQ related?) Message-ID: <20110421142853.GA2235@linux.vnet.ibm.com> Reply-To: paulmck@linux.vnet.ibm.com References: <20110414224411.GF2141@linux.vnet.ibm.com> <20110421050823.GA4487@linux.vnet.ibm.com> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: Mutt/1.5.20 (2009-06-14) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 42525 Lines: 991 On Thu, Apr 21, 2011 at 02:49:37PM +0200, Sedat Dilek wrote: > On Thu, Apr 21, 2011 at 12:24 PM, Sedat Dilek > wrote: > > On Thu, Apr 21, 2011 at 11:07 AM, Sedat Dilek > > wrote: > >> On Thu, Apr 21, 2011 at 7:08 AM, Paul E. McKenney > >> wrote: > >>> On Thu, Apr 14, 2011 at 03:44:11PM -0700, Paul E. McKenney wrote: > >>>> On Fri, Apr 15, 2011 at 12:19:34AM +0200, Sedat Dilek wrote: > >>>> > On Thu, Apr 14, 2011 at 12:19 PM, Sedat Dilek > >>>> > wrote: > >>>> > > On Thu, Apr 14, 2011 at 11:16 AM, Sedat Dilek > >>>> > > wrote: > >>>> > >> [ Adding CC to RCU maintainer (Hi Paul :-)) ] > >>>> > >> > >>>> > >> Helping me for now with (see also Documentation/RCU/stallwarn.txt): > >>>> > >> > >>>> > >> # cat /sys/module/rcutree/parameters/rcu_cpu_stall_suppress > >>>> > >> 0 > >>>> > >> > >>>> > >> # echo "1" > /sys/module/rcutree/parameters/rcu_cpu_stall_suppress > >>>> > >> > >>>> > >> # cat /sys/module/rcutree/parameters/rcu_cpu_stall_suppress > >>>> > >> 1 > >>>> > >> > >>>> > >> - Sedat - > >>>> > >> > >>>> > > > >>>> > > That workaround helped till a system-freeze when generating a tarball > >>>> > > from my current kernel-tree. > >>>> > > I switched back to my yesterday's linux-next kernel. > >>>> > > > >>>> > > - Sedat - > >>>> > > > >>>> > > >>>> > I isolated the culprit so far: > >>>> > > >>>> > commit 900507fc62d5ba0164c07878dbc36ac97866a858 > >>>> > "rcu: move TREE_RCU from softirq to kthread" > >>>> > > >>>> > With this revert my system does not show the symptoms I have reported. > >>>> > >>>> Hmmm... ?I never was able to reproduce this, but did find a workload > >>>> that slowed up the grace periods. ?I fixed that (which turned out to > >>>> be a wakeup problem), but my hopes that it would also fix your problem > >>>> were clearly unfounded. ?I have once again stopped exporting this commit > >>>> to -next. > >>> > >>> I have added some debug tracing, which are available at branch > >>> "sedat.2011.04.19a" in the git repository at: > >>> > >>> git://git.kernel.org/pub/scm/linux/kernel/git/paulmck/linux-2.6-rcu.git > >>> > >>> Alternatively, if it is easier, the shown below can be used. ?FWIW, > >>> this patch is against 2.6.39-rc3. > >>> > >>> Either way, if you get a chance to run your tests on this, could you > >>> please run the attached script (collectdebugfs.sh) and capture its output? > >>> Sample output is attached as well (collectdebugfs.sh.out): ?the script > >>> should output something vaguely like the sample output every 15 seconds > >>> or so. > >>> > >>> The script assumes that debugfs is enabled (along with CONFIG_RCU_TRACE=y) > >>> and mounted as follows: > >>> > >>> ? ? ? ?mount -t debugfs none /sys/kernel/debug/ > >>> > >>> Or if you mount debugfs somewhere else, please set the script's DEBUGFS_MP > >>> variable accordingly. > >>> > >>> ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?Thanx, Paul > >>> > >>> ------------------------------------------------------------------------ > >>> > >> > >> Welcome to operation "Kill that RCU brainbug" (Starship troopers part X)! Actually, only Part III thus far, but point taken... ;-) > >> Of course I can help with testing. Thank you very much! > >> Paul, did you see recent RCU-related fixes to fs between rc3 and rc4? > >> > >> commit c1530019e311c91d14b24d8e74d233152d806e45 > >> vfs: Fix absolute RCU path walk failures due to uninitialized seq number > >> > >> fff3e5ade4455a4b42a19c95dd7a167a3cb7956a > >> fs: synchronize_rcu when unregister_filesystem success not failure > >> > >> IIRC, Jens has pending block/plugging patches in his for-linus tree. > >> Especially this one (CONFIG_PREEMPT): > >> > >> 5f45c69589b7d2953584e6cd0b31e35dbe960ad0 > >> cfq-iosched: read_lock() does not always imply rcu_read_lock() Thank you for pointing them out, but the diagnostics clearly show that one of the kthreads isn't getting awakened when it should be... More below. > >> Some questions to test-scenario: > >> > >> Shall I test from linux-2.6-rcu.git#sedat.2011.04.19a GIT tree? > >> I think that's the ideal solution. Agreed. > >> Or shall I pull sedat.2011.04.19a GIT branch into "BROKEN" linux-next > >> (next-20110414)? Unnecessarily increasing the number of bugs in the system under test doesn't seem wise to me. ;-) > >> Again, with which RCU/HZ/PREEMPT kernel-config options shall I test? > >> This is from my yesterday's linux-next: > >> > >> # egrep 'RCU|_HZ |PREEMPT' /boot/config-2.6.39-rc4-next20110420.4-686-small > >> # RCU Subsystem > >> CONFIG_TREE_RCU=y > >> # CONFIG_PREEMPT_RCU is not set > >> CONFIG_RCU_TRACE=y > >> CONFIG_RCU_FANOUT=32 > >> # CONFIG_RCU_FANOUT_EXACT is not set > >> CONFIG_RCU_FAST_NO_HZ=y > >> CONFIG_TREE_RCU_TRACE=y > >> # CONFIG_PREEMPT_NONE is not set > >> CONFIG_PREEMPT_VOLUNTARY=y > >> # CONFIG_PREEMPT is not set > >> # CONFIG_SPARSE_RCU_POINTER is not set > >> CONFIG_RCU_TORTURE_TEST=m > >> CONFIG_RCU_CPU_STALL_TIMEOUT=60 The options that were causing you trouble before, but with both CONFIG_TREE_RCU (the one that failed quickly) and with CONFIG_TREE_PREEMPT_RCU (which failed slowly). > >> Regards, > >> - Sedat - > >> > > > > Looks like you want me to test with RCU_BOOST and RCU_TORTURE_TEST :-). No, it is just that my diagnostics don't apply cleanly before the commit that enabled RCU_BOOST. Ah! I see. No, I just made my script dump all the RCU debugfs information, I wasn't trying to provide guidance. ;-) > > Attached is collectdebugfs-dileks.log, my current kernel-config and a > > build-script to generate Debian packages. Hmmmm... The system died within 30 seconds? The usual way that RCU hangs the system is by memory exhaustion: grace periods stop advancing, RCU callbacks therefore never get invoked, and RCU-protected memory therefore never gets freed. But I guess if your workload freed RCU-protected data fast enough, the system could hang quickly. > > $ LANG=C ./collectdebugfs.sh 2>&1 | tee collectdebugfs-dileks.log > > > > I will do a 2nd run with PREEMPT_RCU enabled. > > > > - Sedat - > > > > Here the results from the 2nd-run (PREEMPT_RCU enabled). OK, and the grace periods clearly stopped advancing early on. Beyond that point, the per-CPU kthread is blocked, but RCU has some work for it to do. So someone has called invoke_rcu_cpu_kthread(), but rcu_cpu_kthread() is still blocked. I don't see a bug right off-hand, but it is early in the morning for me, so I might easily be missing something. Hmmm... The synchronization between these two assumes that the per-CPU kthread is always bound to the respective CPU, so if was somehow being migrated off, that might explain these results. I will add some more diagnostics, test them locally, then push out an update. Seem reasonable? And thank you again for the testing!!! Thanx, Paul > - Sedat - > Thu Apr 21 14:37:27 CEST 2011 > rcu_preempt_state: completed=13022 gpnum=13023 age=0 max=54 > rcu_sched_state: completed=-300 gpnum=4294966996 age=0 max=0 > rcu_bh_state: completed=-298 gpnum=4294966998 age=0 max=1 > rcu_preempt: > c=13023 g=13024 s=2 jfq=3 j=4d18 nfqs=731/nfqsng=0(731) fqlh=0 > 1/1 ..>. 0:31 ^0 > 1/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_sched: > c=4294966996 g=4294966996 s=0 jfq=45800 j=4d18 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_bh: > c=4294966998 g=4294966998 s=0 jfq=-24703 j=4d18 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_preempt: > 0 c=13026 g=13027 pq=1 pqc=13026 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=81 qs=N.WD kt=0/W b=10 ci=242547 co=0 ca=0 > rcu_sched: > 0 c=0 g=0 pq=1 pqc=4294967295 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=0/W b=10 ci=0 co=0 ca=0 > rcu_bh: > 0 c=4294966998 g=4294966998 pq=1 pqc=4294966997 qp=0 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=0/W b=10 ci=6 co=0 ca=0 > rcu_preempt: > 0 np=0 qsp=0 rpq=0 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcu_sched: > 0 np=19291 qsp=4 rpq=19287 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=4 > rcu_bh: > 0 np=4 qsp=0 rpq=4 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcutorture test sequence: 0 (test in progress) > rcutorture update version number: 3012 > cat: /sys/kernel/debug/rcu/rcuboost: No such file or directory > no rcuboost > > Thu Apr 21 14:37:42 CEST 2011 > rcu_preempt_state: completed=14707 gpnum=14708 age=0 max=54 > rcu_sched_state: completed=-300 gpnum=4294966996 age=0 max=0 > rcu_bh_state: completed=-298 gpnum=4294966998 age=0 max=1 > rcu_preempt: > c=14708 g=14709 s=2 jfq=3 j=5bd3 nfqs=830/nfqsng=0(830) fqlh=0 > 1/1 ..>. 0:31 ^0 > 1/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_sched: > c=4294966996 g=4294966996 s=0 jfq=42029 j=5bd3 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_bh: > c=4294966998 g=4294966998 s=0 jfq=-28474 j=5bd3 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_preempt: > 0 c=14709 g=14710 pq=1 pqc=14709 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=31 qs=N.W. kt=0/W b=10 ci=263538 co=0 ca=0 > rcu_sched: > 0 c=0 g=0 pq=1 pqc=4294967295 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=0/W b=10 ci=0 co=0 ca=0 > rcu_bh: > 0 c=4294966998 g=4294966998 pq=1 pqc=4294966997 qp=0 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=0/W b=10 ci=6 co=0 ca=0 > rcu_preempt: > 0 np=0 qsp=0 rpq=0 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcu_sched: > 0 np=23057 qsp=4 rpq=23053 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=4 > rcu_bh: > 0 np=4 qsp=0 rpq=4 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcutorture test sequence: 0 (test in progress) > rcutorture update version number: 4691 > cat: /sys/kernel/debug/rcu/rcuboost: No such file or directory > no rcuboost > > Thu Apr 21 14:37:57 CEST 2011 > rcu_preempt_state: completed=16459 gpnum=16460 age=0 max=221 > rcu_sched_state: completed=-300 gpnum=4294966996 age=0 max=0 > rcu_bh_state: completed=-298 gpnum=4294966998 age=0 max=1 > rcu_preempt: > c=16459 g=16460 s=2 jfq=3 j=6a82 nfqs=990/nfqsng=0(990) fqlh=0 > 1/1 ..>. 0:31 ^0 > 1/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_sched: > c=4294966996 g=4294966996 s=0 jfq=38270 j=6a82 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_bh: > c=4294966998 g=4294966998 s=0 jfq=-32233 j=6a82 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_preempt: > 0 c=16460 g=16461 pq=1 pqc=16460 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=120 qs=N.W. kt=0/W b=10 ci=291395 co=0 ca=0 > rcu_sched: > 0 c=0 g=0 pq=1 pqc=4294967295 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=0/W b=10 ci=0 co=0 ca=0 > rcu_bh: > 0 c=4294966998 g=4294966998 pq=1 pqc=4294966997 qp=0 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=0/W b=10 ci=6 co=0 ca=0 > rcu_preempt: > 0 np=0 qsp=0 rpq=0 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcu_sched: > 0 np=26818 qsp=4 rpq=26814 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=4 > rcu_bh: > 0 np=4 qsp=0 rpq=4 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcutorture test sequence: 0 (test in progress) > rcutorture update version number: 6227 > cat: /sys/kernel/debug/rcu/rcuboost: No such file or directory > no rcuboost > > Thu Apr 21 14:38:12 CEST 2011 > rcu_preempt_state: completed=17263 gpnum=17264 age=1644 max=221 > rcu_sched_state: completed=-300 gpnum=4294966996 age=0 max=0 > rcu_bh_state: completed=-298 gpnum=4294966998 age=0 max=1 > rcu_preempt: > c=17263 g=17264 s=3 jfq=2 j=7931 nfqs=1146/nfqsng=0(1146) fqlh=0 > 1/1 ..>. 0:31 ^0 > 1/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_sched: > c=4294966996 g=4294966996 s=0 jfq=34511 j=7931 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_bh: > c=4294966998 g=4294966998 s=0 jfq=-35992 j=7931 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_preempt: > 0 c=17263 g=17264 pq=1 pqc=17263 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=7209 qs=N.W. kt=1/W b=10 ci=299175 co=0 ca=0 > rcu_sched: > 0 c=0 g=0 pq=1 pqc=4294967295 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=0 co=0 ca=0 > rcu_bh: > 0 c=4294966998 g=4294966998 pq=1 pqc=4294966997 qp=0 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=6 co=0 ca=0 > rcu_preempt: > 0 np=0 qsp=0 rpq=0 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcu_sched: > 0 np=30576 qsp=4 rpq=30572 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=4 > rcu_bh: > 0 np=4 qsp=0 rpq=4 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcutorture test sequence: 0 (test in progress) > rcutorture update version number: 7004 > cat: /sys/kernel/debug/rcu/rcuboost: No such file or directory > no rcuboost > > Thu Apr 21 14:38:27 CEST 2011 > rcu_preempt_state: completed=17263 gpnum=17264 age=5400 max=221 > rcu_sched_state: completed=-300 gpnum=4294966996 age=0 max=0 > rcu_bh_state: completed=-298 gpnum=4294966998 age=0 max=1 > rcu_preempt: > c=17263 g=17264 s=3 jfq=2 j=87dc nfqs=1267/nfqsng=0(1267) fqlh=0 > 1/1 ..>. 0:31 ^0 > 1/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_sched: > c=4294966996 g=4294966996 s=0 jfq=30756 j=87dc nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_bh: > c=4294966998 g=4294966998 s=0 jfq=-39747 j=87dc nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_preempt: > 0 c=17263 g=17264 pq=1 pqc=17263 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=14248 qs=N.W. kt=1/W b=2147483647 ci=299175 co=0 ca=0 > rcu_sched: > 0 c=0 g=0 pq=1 pqc=4294967295 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=0 co=0 ca=0 > rcu_bh: > 0 c=4294966998 g=4294966998 pq=1 pqc=4294966997 qp=0 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=6 co=0 ca=0 > rcu_preempt: > 0 np=0 qsp=0 rpq=0 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcu_sched: > 0 np=34330 qsp=4 rpq=34326 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=4 > rcu_bh: > 0 np=4 qsp=0 rpq=4 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcutorture test sequence: 0 (test in progress) > rcutorture update version number: 7004 > cat: /sys/kernel/debug/rcu/rcuboost: No such file or directory > no rcuboost > > Thu Apr 21 14:38:42 CEST 2011 > rcu_preempt_state: completed=17263 gpnum=17264 age=9156 max=221 > rcu_sched_state: completed=-300 gpnum=4294966996 age=0 max=0 > rcu_bh_state: completed=-298 gpnum=4294966998 age=0 max=1 > rcu_preempt: > c=17263 g=17264 s=3 jfq=0 j=9689 nfqs=1544/nfqsng=0(1544) fqlh=0 > 1/1 ..>. 0:31 ^0 > 1/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_sched: > c=4294966996 g=4294966996 s=0 jfq=26999 j=9689 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_bh: > c=4294966998 g=4294966998 s=0 jfq=-43504 j=9689 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_preempt: > 0 c=17263 g=17264 pq=1 pqc=17263 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=27472 qs=N.W. kt=1/W b=2147483647 ci=299175 co=0 ca=0 > rcu_sched: > 0 c=0 g=0 pq=1 pqc=4294967295 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=0 co=0 ca=0 > rcu_bh: > 0 c=4294966998 g=4294966998 pq=1 pqc=4294966997 qp=0 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=6 co=0 ca=0 > rcu_preempt: > 0 np=0 qsp=0 rpq=0 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcu_sched: > 0 np=38089 qsp=4 rpq=38085 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=4 > rcu_bh: > 0 np=4 qsp=0 rpq=4 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcutorture test sequence: 0 (test in progress) > rcutorture update version number: 7004 > cat: /sys/kernel/debug/rcu/rcuboost: No such file or directory > no rcuboost > > Thu Apr 21 14:38:57 CEST 2011 > rcu_preempt_state: completed=17263 gpnum=17264 age=12918 max=221 > rcu_sched_state: completed=-300 gpnum=4294966996 age=0 max=0 > rcu_bh_state: completed=-298 gpnum=4294966998 age=0 max=1 > rcu_preempt: > c=17263 g=17264 s=3 jfq=3 j=a53b nfqs=2120/nfqsng=0(2120) fqlh=0 > 1/1 ..>. 0:31 ^0 > 1/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_sched: > c=4294966996 g=4294966996 s=0 jfq=23237 j=a53b nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_bh: > c=4294966998 g=4294966998 s=0 jfq=-47266 j=a53b nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_preempt: > 0 c=17263 g=17264 pq=1 pqc=17263 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=51443 qs=N.W. kt=1/W b=2147483647 ci=299175 co=0 ca=0 > rcu_sched: > 0 c=0 g=0 pq=1 pqc=4294967295 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=0 co=0 ca=0 > rcu_bh: > 0 c=4294966998 g=4294966998 pq=1 pqc=4294966997 qp=0 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=6 co=0 ca=0 > rcu_preempt: > 0 np=0 qsp=0 rpq=0 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcu_sched: > 0 np=41848 qsp=4 rpq=41844 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=4 > rcu_bh: > 0 np=4 qsp=0 rpq=4 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcutorture test sequence: 0 (test in progress) > rcutorture update version number: 7004 > cat: /sys/kernel/debug/rcu/rcuboost: No such file or directory > no rcuboost > > Thu Apr 21 14:39:12 CEST 2011 > rcu_preempt_state: completed=17263 gpnum=17264 age=16673 max=221 > rcu_sched_state: completed=-300 gpnum=4294966996 age=0 max=0 > rcu_bh_state: completed=-298 gpnum=4294966998 age=0 max=1 > rcu_preempt: > c=17263 g=17264 s=3 jfq=3 j=b3e7 nfqs=2799/nfqsng=0(2799) fqlh=0 > 1/1 ..>. 0:31 ^0 > 1/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_sched: > c=4294966996 g=4294966996 s=0 jfq=19481 j=b3e7 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_bh: > c=4294966998 g=4294966998 s=0 jfq=-51022 j=b3e7 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_preempt: > 0 c=17263 g=17264 pq=1 pqc=17263 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=94614 qs=N.W. kt=1/W b=2147483647 ci=299175 co=0 ca=0 > rcu_sched: > 0 c=0 g=0 pq=1 pqc=4294967295 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=0 co=0 ca=0 > rcu_bh: > 0 c=4294966998 g=4294966998 pq=1 pqc=4294966997 qp=0 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=6 co=0 ca=0 > rcu_preempt: > 0 np=0 qsp=0 rpq=0 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcu_sched: > 0 np=45606 qsp=4 rpq=45602 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=4 > rcu_bh: > 0 np=4 qsp=0 rpq=4 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcutorture test sequence: 0 (test in progress) > rcutorture update version number: 7004 > cat: /sys/kernel/debug/rcu/rcuboost: No such file or directory > no rcuboost > > Thu Apr 21 14:39:27 CEST 2011 > rcu_preempt_state: completed=17263 gpnum=17264 age=20432 max=221 > rcu_sched_state: completed=-300 gpnum=4294966996 age=0 max=0 > rcu_bh_state: completed=-298 gpnum=4294966998 age=0 max=1 > rcu_preempt: > c=17263 g=17264 s=3 jfq=3 j=c297 nfqs=3471/nfqsng=0(3471) fqlh=0 > 1/1 ..>. 0:31 ^0 > 1/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_sched: > c=4294966996 g=4294966996 s=0 jfq=15721 j=c297 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_bh: > c=4294966998 g=4294966998 s=0 jfq=-54782 j=c297 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_preempt: > 0 c=17263 g=17264 pq=1 pqc=17263 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=137507 qs=N.W. kt=1/W b=2147483647 ci=299175 co=0 ca=0 > rcu_sched: > 0 c=0 g=0 pq=1 pqc=4294967295 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=0 co=0 ca=0 > rcu_bh: > 0 c=4294966998 g=4294966998 pq=1 pqc=4294966997 qp=0 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=6 co=0 ca=0 > rcu_preempt: > 0 np=0 qsp=0 rpq=0 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcu_sched: > 0 np=49367 qsp=4 rpq=49363 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=4 > rcu_bh: > 0 np=4 qsp=0 rpq=4 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcutorture test sequence: 0 (test in progress) > rcutorture update version number: 7004 > cat: /sys/kernel/debug/rcu/rcuboost: No such file or directory > no rcuboost > > Thu Apr 21 14:39:42 CEST 2011 > rcu_preempt_state: completed=17263 gpnum=17264 age=24197 max=221 > rcu_sched_state: completed=-300 gpnum=4294966996 age=0 max=0 > rcu_bh_state: completed=-298 gpnum=4294966998 age=0 max=1 > rcu_preempt: > c=17263 g=17264 s=3 jfq=2 j=d14a nfqs=4116/nfqsng=0(4116) fqlh=0 > 1/1 ..>. 0:31 ^0 > 1/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_sched: > c=4294966996 g=4294966996 s=0 jfq=11958 j=d14a nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_bh: > c=4294966998 g=4294966998 s=0 jfq=-58545 j=d14a nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_preempt: > 0 c=17263 g=17264 pq=1 pqc=17263 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=188499 qs=N.W. kt=1/W b=2147483647 ci=299175 co=0 ca=0 > rcu_sched: > 0 c=0 g=0 pq=1 pqc=4294967295 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=0 co=0 ca=0 > rcu_bh: > 0 c=4294966998 g=4294966998 pq=1 pqc=4294966997 qp=0 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=6 co=0 ca=0 > rcu_preempt: > 0 np=0 qsp=0 rpq=0 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcu_sched: > 0 np=53130 qsp=4 rpq=53126 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=4 > rcu_bh: > 0 np=4 qsp=0 rpq=4 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcutorture test sequence: 0 (test in progress) > rcutorture update version number: 7004 > cat: /sys/kernel/debug/rcu/rcuboost: No such file or directory > no rcuboost > > Thu Apr 21 14:39:57 CEST 2011 > rcu_preempt_state: completed=17263 gpnum=17264 age=27964 max=221 > rcu_sched_state: completed=-300 gpnum=4294966996 age=0 max=0 > rcu_bh_state: completed=-298 gpnum=4294966998 age=0 max=1 > rcu_preempt: > c=17263 g=17264 s=3 jfq=1 j=e001 nfqs=4810/nfqsng=0(4810) fqlh=0 > 1/1 ..>. 0:31 ^0 > 1/1 G.>T 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_sched: > c=4294966996 g=4294966996 s=0 jfq=8191 j=e001 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_bh: > c=4294966998 g=4294966998 s=0 jfq=-62312 j=e001 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_preempt: > 0 c=17263 g=17264 pq=1 pqc=17263 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=235065 qs=N.W. kt=1/W b=2147483647 ci=299175 co=0 ca=0 > rcu_sched: > 0 c=0 g=0 pq=1 pqc=4294967295 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=0 co=0 ca=0 > rcu_bh: > 0 c=4294966998 g=4294966998 pq=1 pqc=4294966997 qp=0 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=6 co=0 ca=0 > rcu_preempt: > 0 np=0 qsp=0 rpq=0 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcu_sched: > 0 np=56897 qsp=4 rpq=56893 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=4 > rcu_bh: > 0 np=4 qsp=0 rpq=4 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcutorture test sequence: 0 (test in progress) > rcutorture update version number: 7004 > cat: /sys/kernel/debug/rcu/rcuboost: No such file or directory > no rcuboost > > Thu Apr 21 14:40:12 CEST 2011 > rcu_preempt_state: completed=17263 gpnum=17264 age=31722 max=221 > rcu_sched_state: completed=-300 gpnum=4294966996 age=0 max=0 > rcu_bh_state: completed=-298 gpnum=4294966998 age=0 max=1 > rcu_preempt: > c=17263 g=17264 s=3 jfq=2 j=eeaf nfqs=5478/nfqsng=0(5478) fqlh=0 > 1/1 ..>. 0:31 ^0 > 1/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_sched: > c=4294966996 g=4294966996 s=0 jfq=4433 j=eeaf nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_bh: > c=4294966998 g=4294966998 s=0 jfq=-66070 j=eeaf nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_preempt: > 0 c=17263 g=17264 pq=1 pqc=17263 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=276793 qs=N.W. kt=1/W b=2147483647 ci=299175 co=0 ca=0 > rcu_sched: > 0 c=0 g=0 pq=1 pqc=4294967295 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=0 co=0 ca=0 > rcu_bh: > 0 c=4294966998 g=4294966998 pq=1 pqc=4294966997 qp=0 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=6 co=0 ca=0 > rcu_preempt: > 0 np=0 qsp=0 rpq=0 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcu_sched: > 0 np=60655 qsp=4 rpq=60651 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=4 > rcu_bh: > 0 np=4 qsp=0 rpq=4 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcutorture test sequence: 0 (test in progress) > rcutorture update version number: 7004 > cat: /sys/kernel/debug/rcu/rcuboost: No such file or directory > no rcuboost > > Thu Apr 21 14:40:28 CEST 2011 > rcu_preempt_state: completed=17263 gpnum=17264 age=35486 max=221 > rcu_sched_state: completed=-300 gpnum=4294966996 age=0 max=0 > rcu_bh_state: completed=-298 gpnum=4294966998 age=0 max=1 > rcu_preempt: > c=17263 g=17264 s=3 jfq=3 j=fd63 nfqs=6179/nfqsng=0(6179) fqlh=0 > 1/1 ..>. 0:31 ^0 > 1/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_sched: > c=4294966996 g=4294966996 s=0 jfq=669 j=fd63 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_bh: > c=4294966998 g=4294966998 s=0 jfq=-69834 j=fd63 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_preempt: > 0 c=17263 g=17264 pq=1 pqc=17263 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=319929 qs=N.W. kt=1/W b=2147483647 ci=299175 co=0 ca=0 > rcu_sched: > 0 c=0 g=0 pq=1 pqc=4294967295 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=0 co=0 ca=0 > rcu_bh: > 0 c=4294966998 g=4294966998 pq=1 pqc=4294966997 qp=0 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=6 co=0 ca=0 > rcu_preempt: > 0 np=0 qsp=0 rpq=0 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcu_sched: > 0 np=64416 qsp=4 rpq=64412 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=4 > rcu_bh: > 0 np=4 qsp=0 rpq=4 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcutorture test sequence: 0 (test in progress) > rcutorture update version number: 7004 > cat: /sys/kernel/debug/rcu/rcuboost: No such file or directory > no rcuboost > > Thu Apr 21 14:40:43 CEST 2011 > rcu_preempt_state: completed=17263 gpnum=17264 age=39246 max=221 > rcu_sched_state: completed=-300 gpnum=4294966996 age=0 max=0 > rcu_bh_state: completed=-298 gpnum=4294966998 age=0 max=1 > rcu_preempt: > c=17263 g=17264 s=3 jfq=3 j=c13 nfqs=6856/nfqsng=0(6856) fqlh=0 > 1/1 ..>. 0:31 ^0 > 1/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_sched: > c=4294966996 g=4294966996 s=0 jfq=-3091 j=c13 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_bh: > c=4294966998 g=4294966998 s=0 jfq=-73594 j=c13 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_preempt: > 0 c=17263 g=17264 pq=1 pqc=17263 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=358327 qs=N.W. kt=1/W b=2147483647 ci=299175 co=0 ca=0 > rcu_sched: > 0 c=0 g=0 pq=1 pqc=4294967295 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=0 co=0 ca=0 > rcu_bh: > 0 c=4294966998 g=4294966998 pq=1 pqc=4294966997 qp=0 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=6 co=0 ca=0 > rcu_preempt: > 0 np=0 qsp=0 rpq=0 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcu_sched: > 0 np=68179 qsp=4 rpq=68175 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=4 > rcu_bh: > 0 np=4 qsp=0 rpq=4 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcutorture test sequence: 0 (test in progress) > rcutorture update version number: 7004 > cat: /sys/kernel/debug/rcu/rcuboost: No such file or directory > no rcuboost > > Thu Apr 21 14:40:58 CEST 2011 > rcu_preempt_state: completed=17263 gpnum=17264 age=43011 max=221 > rcu_sched_state: completed=-300 gpnum=4294966996 age=0 max=0 > rcu_bh_state: completed=-298 gpnum=4294966998 age=0 max=1 > rcu_preempt: > c=17263 g=17264 s=3 jfq=2 j=1ac7 nfqs=7535/nfqsng=0(7535) fqlh=0 > 1/1 ..>. 0:31 ^0 > 1/1 G.>T 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_sched: > c=4294966996 g=4294966996 s=0 jfq=-6855 j=1ac7 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_bh: > c=4294966998 g=4294966998 s=0 jfq=-77358 j=1ac7 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_preempt: > 0 c=17263 g=17264 pq=1 pqc=17263 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=413879 qs=N.W. kt=1/W b=2147483647 ci=299175 co=0 ca=0 > rcu_sched: > 0 c=0 g=0 pq=1 pqc=4294967295 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=0 co=0 ca=0 > rcu_bh: > 0 c=4294966998 g=4294966998 pq=1 pqc=4294966997 qp=0 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=6 co=0 ca=0 > rcu_preempt: > 0 np=0 qsp=0 rpq=0 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcu_sched: > 0 np=71941 qsp=4 rpq=71937 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=4 > rcu_bh: > 0 np=4 qsp=0 rpq=4 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcutorture test sequence: 0 (test in progress) > rcutorture update version number: 7004 > cat: /sys/kernel/debug/rcu/rcuboost: No such file or directory > no rcuboost > > Thu Apr 21 14:41:13 CEST 2011 > rcu_preempt_state: completed=17263 gpnum=17264 age=46764 max=221 > rcu_sched_state: completed=-300 gpnum=4294966996 age=0 max=0 > rcu_bh_state: completed=-298 gpnum=4294966998 age=0 max=1 > rcu_preempt: > c=17263 g=17264 s=3 jfq=0 j=2970 nfqs=7888/nfqsng=0(7888) fqlh=0 > 1/1 ..>. 0:31 ^0 > 1/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_sched: > c=4294966996 g=4294966996 s=0 jfq=-10608 j=2970 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_bh: > c=4294966998 g=4294966998 s=0 jfq=-81111 j=2970 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_preempt: > 0 c=17263 g=17264 pq=1 pqc=17263 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=420128 qs=N.W. kt=1/W b=2147483647 ci=299175 co=0 ca=0 > rcu_sched: > 0 c=0 g=0 pq=1 pqc=4294967295 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=0 co=0 ca=0 > rcu_bh: > 0 c=4294966998 g=4294966998 pq=1 pqc=4294966997 qp=0 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=6 co=0 ca=0 > rcu_preempt: > 0 np=0 qsp=0 rpq=0 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcu_sched: > 0 np=75695 qsp=4 rpq=75691 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=4 > rcu_bh: > 0 np=4 qsp=0 rpq=4 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcutorture test sequence: 0 (test in progress) > rcutorture update version number: 7004 > cat: /sys/kernel/debug/rcu/rcuboost: No such file or directory > no rcuboost > > Thu Apr 21 14:41:28 CEST 2011 > rcu_preempt_state: completed=17263 gpnum=17264 age=50519 max=221 > rcu_sched_state: completed=-300 gpnum=4294966996 age=0 max=0 > rcu_bh_state: completed=-298 gpnum=4294966998 age=0 max=1 > rcu_preempt: > c=17263 g=17264 s=3 jfq=2 j=381b nfqs=8327/nfqsng=0(8327) fqlh=0 > 1/1 ..>. 0:31 ^0 > 1/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_sched: > c=4294966996 g=4294966996 s=0 jfq=-14363 j=381b nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_bh: > c=4294966998 g=4294966998 s=0 jfq=-84866 j=381b nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_preempt: > 0 c=17263 g=17264 pq=1 pqc=17263 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=446254 qs=N.W. kt=1/W b=2147483647 ci=299175 co=0 ca=0 > rcu_sched: > 0 c=0 g=0 pq=1 pqc=4294967295 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=0 co=0 ca=0 > rcu_bh: > 0 c=4294966998 g=4294966998 pq=1 pqc=4294966997 qp=0 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=6 co=0 ca=0 > rcu_preempt: > 0 np=0 qsp=0 rpq=0 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcu_sched: > 0 np=79454 qsp=4 rpq=79450 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=4 > rcu_bh: > 0 np=4 qsp=0 rpq=4 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcutorture test sequence: 0 (test in progress) > rcutorture update version number: 7004 > cat: /sys/kernel/debug/rcu/rcuboost: No such file or directory > no rcuboost > > Thu Apr 21 14:41:43 CEST 2011 > rcu_preempt_state: completed=17263 gpnum=17264 age=54286 max=221 > rcu_sched_state: completed=-300 gpnum=4294966996 age=0 max=0 > rcu_bh_state: completed=-298 gpnum=4294966998 age=0 max=1 > rcu_preempt: > c=17263 g=17264 s=3 jfq=2 j=46d2 nfqs=8659/nfqsng=0(8659) fqlh=0 > 1/1 ..>. 0:31 ^0 > 1/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_sched: > c=4294966996 g=4294966996 s=0 jfq=-18130 j=46d2 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_bh: > c=4294966998 g=4294966998 s=0 jfq=-88633 j=46d2 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_preempt: > 0 c=17263 g=17264 pq=1 pqc=17263 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=474722 qs=N.W. kt=1/W b=2147483647 ci=299175 co=0 ca=0 > rcu_sched: > 0 c=0 g=0 pq=1 pqc=4294967295 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=0 co=0 ca=0 > rcu_bh: > 0 c=4294966998 g=4294966998 pq=1 pqc=4294966997 qp=0 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=6 co=0 ca=0 > rcu_preempt: > 0 np=0 qsp=0 rpq=0 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcu_sched: > 0 np=83216 qsp=4 rpq=83212 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=4 > rcu_bh: > 0 np=4 qsp=0 rpq=4 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcutorture test sequence: 0 (test in progress) > rcutorture update version number: 7004 > cat: /sys/kernel/debug/rcu/rcuboost: No such file or directory > no rcuboost > > Thu Apr 21 14:41:58 CEST 2011 > rcu_preempt_state: completed=17263 gpnum=17264 age=58041 max=221 > rcu_sched_state: completed=-300 gpnum=4294966996 age=0 max=0 > rcu_bh_state: completed=-298 gpnum=4294966998 age=0 max=1 > rcu_preempt: > c=17263 g=17264 s=3 jfq=2 j=557d nfqs=8733/nfqsng=0(8733) fqlh=0 > 1/1 ..>. 0:31 ^0 > 1/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_sched: > c=4294966996 g=4294966996 s=0 jfq=-21885 j=557d nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_bh: > c=4294966998 g=4294966998 s=0 jfq=-92388 j=557d nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_preempt: > 0 c=17263 g=17264 pq=1 pqc=17263 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=477483 qs=N.W. kt=1/W b=2147483647 ci=299175 co=0 ca=0 > rcu_sched: > 0 c=0 g=0 pq=1 pqc=4294967295 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=0 co=0 ca=0 > rcu_bh: > 0 c=4294966998 g=4294966998 pq=1 pqc=4294966997 qp=0 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=6 co=0 ca=0 > rcu_preempt: > 0 np=0 qsp=0 rpq=0 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcu_sched: > 0 np=86971 qsp=4 rpq=86967 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=4 > rcu_bh: > 0 np=4 qsp=0 rpq=4 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcutorture test sequence: 0 (test in progress) > rcutorture update version number: 7004 > cat: /sys/kernel/debug/rcu/rcuboost: No such file or directory > no rcuboost > > Thu Apr 21 14:42:13 CEST 2011 > rcu_preempt_state: completed=17263 gpnum=17264 age=61798 max=221 > rcu_sched_state: completed=-300 gpnum=4294966996 age=0 max=0 > rcu_bh_state: completed=-298 gpnum=4294966998 age=0 max=1 > rcu_preempt: > c=17263 g=17264 s=3 jfq=1 j=642b nfqs=8892/nfqsng=0(8892) fqlh=0 > 1/1 ..>. 0:31 ^0 > 1/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_sched: > c=4294966996 g=4294966996 s=0 jfq=-25643 j=642b nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_bh: > c=4294966998 g=4294966998 s=0 jfq=-96146 j=642b nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_preempt: > 0 c=17263 g=17264 pq=1 pqc=17263 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=495375 qs=N.W. kt=1/W b=2147483647 ci=299175 co=0 ca=0 > rcu_sched: > 0 c=0 g=0 pq=1 pqc=4294967295 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=0 co=0 ca=0 > rcu_bh: > 0 c=4294966998 g=4294966998 pq=1 pqc=4294966997 qp=0 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=6 co=0 ca=0 > rcu_preempt: > 0 np=0 qsp=0 rpq=0 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcu_sched: > 0 np=90731 qsp=4 rpq=90727 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=4 > rcu_bh: > 0 np=4 qsp=0 rpq=4 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcutorture test sequence: 0 (test in progress) > rcutorture update version number: 7004 > cat: /sys/kernel/debug/rcu/rcuboost: No such file or directory > no rcuboost > > Thu Apr 21 14:42:28 CEST 2011 > rcu_preempt_state: completed=17263 gpnum=17264 age=65556 max=221 > rcu_sched_state: completed=-300 gpnum=4294966996 age=0 max=0 > rcu_bh_state: completed=-298 gpnum=4294966998 age=0 max=1 > rcu_preempt: > c=17263 g=17264 s=3 jfq=2 j=72d8 nfqs=8973/nfqsng=0(8973) fqlh=0 > 1/1 ..>. 0:31 ^0 > 1/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_sched: > c=4294966996 g=4294966996 s=0 jfq=-29400 j=72d8 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_bh: > c=4294966998 g=4294966998 s=0 jfq=-99903 j=72d8 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_preempt: > 0 c=17263 g=17264 pq=1 pqc=17263 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=500171 qs=N.W. kt=1/W b=2147483647 ci=299175 co=0 ca=0 > rcu_sched: > 0 c=0 g=0 pq=1 pqc=4294967295 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=0 co=0 ca=0 > rcu_bh: > 0 c=4294966998 g=4294966998 pq=1 pqc=4294966997 qp=0 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=6 co=0 ca=0 > rcu_preempt: > 0 np=0 qsp=0 rpq=0 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcu_sched: > 0 np=94486 qsp=4 rpq=94482 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=4 > rcu_bh: > 0 np=4 qsp=0 rpq=4 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcutorture test sequence: 0 (test in progress) > rcutorture update version number: 7004 > cat: /sys/kernel/debug/rcu/rcuboost: No such file or directory > no rcuboost > > Thu Apr 21 14:42:43 CEST 2011 > rcu_preempt_state: completed=17263 gpnum=17264 age=69310 max=221 > rcu_sched_state: completed=-300 gpnum=4294966996 age=0 max=0 > rcu_bh_state: completed=-298 gpnum=4294966998 age=0 max=1 > rcu_preempt: > c=17263 g=17264 s=3 jfq=1 j=8182 nfqs=9071/nfqsng=0(9071) fqlh=0 > 1/1 ..>. 0:31 ^0 > 1/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_sched: > c=4294966996 g=4294966996 s=0 jfq=-33154 j=8182 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_bh: > c=4294966998 g=4294966998 s=0 jfq=-103657 j=8182 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_preempt: > 0 c=17263 g=17264 pq=1 pqc=17263 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=505394 qs=N.W. kt=1/W b=2147483647 ci=299175 co=0 ca=0 > rcu_sched: > 0 c=0 g=0 pq=1 pqc=4294967295 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=0 co=0 ca=0 > rcu_bh: > 0 c=4294966998 g=4294966998 pq=1 pqc=4294966997 qp=0 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=6 co=0 ca=0 > rcu_preempt: > 0 np=0 qsp=0 rpq=0 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcu_sched: > 0 np=98241 qsp=4 rpq=98237 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=4 > rcu_bh: > 0 np=4 qsp=0 rpq=4 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcutorture test sequence: 0 (test in progress) > rcutorture update version number: 7004 > cat: /sys/kernel/debug/rcu/rcuboost: No such file or directory > no rcuboost > > Thu Apr 21 14:42:58 CEST 2011 > rcu_preempt_state: completed=17263 gpnum=17264 age=73066 max=221 > rcu_sched_state: completed=-300 gpnum=4294966996 age=0 max=0 > rcu_bh_state: completed=-298 gpnum=4294966998 age=0 max=1 > rcu_preempt: > c=17263 g=17264 s=3 jfq=2 j=902e nfqs=9232/nfqsng=0(9232) fqlh=0 > 1/1 ..>. 0:31 ^0 > 1/1 G.>T 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_sched: > c=4294966996 g=4294966996 s=0 jfq=-36910 j=902e nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_bh: > c=4294966998 g=4294966998 s=0 jfq=-107413 j=902e nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_preempt: > 0 c=17263 g=17264 pq=1 pqc=17263 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=516914 qs=N.W. kt=1/W b=2147483647 ci=299175 co=0 ca=0 > rcu_sched: > 0 c=0 g=0 pq=1 pqc=4294967295 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=0 co=0 ca=0 > rcu_bh: > 0 c=4294966998 g=4294966998 pq=1 pqc=4294966997 qp=0 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=6 co=0 ca=0 > rcu_preempt: > 0 np=0 qsp=0 rpq=0 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcu_sched: > 0 np=101996 qsp=4 rpq=101992 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=4 > rcu_bh: > 0 np=4 qsp=0 rpq=4 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcutorture test sequence: 0 (test in progress) > rcutorture update version number: 7004 > cat: /sys/kernel/debug/rcu/rcuboost: No such file or directory > no rcuboost > > Thu Apr 21 14:43:13 CEST 2011 > rcu_preempt_state: completed=17263 gpnum=17264 age=76820 max=221 > rcu_sched_state: completed=-300 gpnum=4294966996 age=0 max=0 > rcu_bh_state: completed=-298 gpnum=4294966998 age=0 max=1 > rcu_preempt: > c=17263 g=17264 s=3 jfq=0 j=9ed9 nfqs=9298/nfqsng=0(9298) fqlh=0 > 1/1 ..>. 0:31 ^0 > 1/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_sched: > c=4294966996 g=4294966996 s=0 jfq=-40665 j=9ed9 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_bh: > c=4294966998 g=4294966998 s=0 jfq=-111168 j=9ed9 nfqs=0/nfqsng=0(0) fqlh=0 > 0/1 ..>. 0:31 ^0 > 0/1 ..>. 0:15 ^0 0/0 ..>. 16:31 ^1 > rcu_preempt: > 0 c=17263 g=17264 pq=1 pqc=17263 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=517861 qs=N.W. kt=1/W b=2147483647 ci=299175 co=0 ca=0 > rcu_sched: > 0 c=0 g=0 pq=1 pqc=4294967295 qp=1 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=0 co=0 ca=0 > rcu_bh: > 0 c=4294966998 g=4294966998 pq=1 pqc=4294966997 qp=0 dt=40499/1/0 df=0 of=0 ri=0 ql=0 qs=.... kt=1/W b=10 ci=6 co=0 ca=0 > rcu_preempt: > 0 np=0 qsp=0 rpq=0 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcu_sched: > 0 np=105752 qsp=4 rpq=105748 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=4 > rcu_bh: > 0 np=4 qsp=0 rpq=4 cbr=0 cng=0 gpc=0 gps=0 nf=0 nn=0 > rcutorture test sequence: 0 (test in progress) > rcutorture update version number: 7004 > cat: /sys/kernel/debug/rcu/rcuboost: No such file or directory > no rcuboost > -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/