2013-10-05 23:44:50

by Fengguang Wu

[permalink] [raw]
Subject: [x86] BUG: unable to handle kernel paging request at 00740060

Greetings,

I got the below dmesg and the first bad commit is

commit 0c44c2d0f459cd7e275242b72f500137c4fa834d
Author: Peter Zijlstra <[email protected]>
Date: Wed Sep 11 15:19:24 2013 +0200

x86: Use asm goto to implement better modify_and_test() functions

Linus suggested using asm goto to get rid of the typical SETcc + TEST
instruction pair -- which also clobbers an extra register -- for our
typical modify_and_test() functions.

Because asm goto doesn't allow output fields it has to include an
unconditinal memory clobber when it changes a memory variable to force
a reload.

Luckily all atomic ops already imply a compiler barrier to go along
with their memory barrier semantics.

Suggested-by: Linus Torvalds <[email protected]>
Signed-off-by: Peter Zijlstra <[email protected]>
Link: http://lkml.kernel.org/n/[email protected]
Signed-off-by: Ingo Molnar <[email protected]>

[ 3.336040] Write protecting the kernel read-only data: 2644k
[ 3.336982] NX-protecting the kernel data: 6152k
[ 3.375173] BUG: unable to handle kernel paging request at 00740060
[ 3.376162] IP: [<81053fc4>] task_work_run+0x54/0xa0
[ 3.376837] *pdpt = 00000000072e1001 *pde = 0000000000000000
[ 3.377579] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 3.378158] CPU: 0 PID: 85 Comm: hostname Not tainted 3.12.0-rc2-next-20130927-03100-ga0cf1ab #5
[ 3.378206] task: 8730c000 ti: 8730e000 task.ti: 8730e000
[ 3.378206] EIP: 0060:[<81053fc4>] EFLAGS: 00010206 CPU: 0
[ 3.378206] EIP is at task_work_run+0x54/0xa0
[ 3.378206] EAX: 00740060 EBX: 87309000 ECX: 00000000 EDX: 00740060
[ 3.378206] ESI: 8730c388 EDI: 8730c000 EBP: 8730ff40 ESP: 8730ff34
[ 3.378206] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 3.378206] CR0: 8005003b CR2: 00740060 CR3: 072d7000 CR4: 000006b0
[ 3.378206] Stack:
[ 3.378206] ffffffff 87308058 8730c000 8730ff8c 81039315 77675fb8 8105af7b 00000000
[ 3.378206] 8730ffac 00000001 6c0e41a5 61636f6c 736f686c 6f6c2e74 646c6163 8730c398
[ 3.378206] 815fc8fe 81022f40 00000000 00000000 872f1880 8730c000 8730ffa4 81039a0a
[ 3.378206] Call Trace:
[ 3.378206] [<81039315>] do_exit+0x2a5/0x910
[ 3.378206] [<8105af7b>] ? up_write+0x1b/0x30
[ 3.378206] [<815fc8fe>] ? restore_all+0xf/0xf
[ 3.378206] [<81022f40>] ? kvm_read_and_reset_pf_reason+0x40/0x40
[ 3.378206] [<81039a0a>] do_group_exit+0x4a/0xa0
[ 3.378206] [<81039a78>] SyS_exit_group+0x18/0x20
[ 3.378206] [<815fcf50>] sysenter_do_call+0x12/0x3c
[ 3.378206] Code: 36 31 c9 89 d0 0f b1 0e 39 c2 75 eb 85 d2 74 5c 8d b4 26 00 00 00 00 f3 90 8b 87 c0 03 00 00 85 c0 74 f4 31 db eb 04 89 d3 89 c2 <8b> 02 89 1a 85 c0 75 f4 eb 16 66 90 f6 47 0c 04 74 c4 b9 f0 af
[ 3.378206] EIP: [<81053fc4>] task_work_run+0x54/0xa0 SS:ESP 0068:8730ff34
[ 3.378206] CR2: 0000000000740060
[ 3.394549] ---[ end trace a6f697254c888db0 ]---

git bisect start 45c4ea0c4c1b8abffb575b865243fd1c69bbecd9 v3.11 --
git bisect good 39eda2aba6be642b71f2e0ad623dcb09fd9d79cf # 22:41 20+ Merge branch 'next' of git://git.kernel.org/pub/scm/linux/kernel/git/benh/powerpc
git bisect good bff157b3ad4b9f6be0af6987fcd62deaf0f2b799 # 22:47 20+ Merge branch 'slab/next' of git://git.kernel.org/pub/scm/linux/kernel/git/penberg/linux
git bisect good f659a4f17bbecdbad57dd5c63a1783e5ec5fd792 # 22:51 20+ Merge remote-tracking branch 'drm-intel/for-linux-next'
git bisect bad 6405cd58ac5c0a6ed5f4f1308892147870b9d5cf # 22:54 0- Merge remote-tracking branch 'regmap/for-next'
git bisect good 5094001bc464c12d3e04eb73a5e0d5e8436f09f7 # 22:59 20+ Merge remote-tracking branch 'omap_dss2/for-next'
git bisect good 8f31410ee9917e8648c7cf7f45e22320c166998a # 23:01 20+ Merge remote-tracking branch 'spi/for-next'
git bisect bad 6f014a7ea91f80f765ba700dcd1728680ba5c58e # 23:04 0- Merge remote-tracking branch 'tip/auto-latest'
git bisect bad bce56fbc0f165658f7e0715fedc8d39840bae31c # 23:07 0- Merge branch 'sched/core'
git bisect bad c2daa3bed53a81171cf8c1a36db798e82b91afe8 # 23:10 0- sched, x86: Provide a per-cpu preempt_count implementation
git bisect good 4314895165623879937f46d767673654662b570c # 23:15 20+ sched: Micro-optimize by dropping unnecessary task_rq() calls
git bisect bad 4a2b4b222743bb07fedf985b884550f2ca067ea9 # 23:18 0- sched: Introduce preempt_count accessor functions
git bisect bad b021fe3e25094fbec22d0eff846d2adeee1b9736 # 23:21 0- sched, rcu: Make RCU use resched_cpu()
git bisect bad 0c44c2d0f459cd7e275242b72f500137c4fa834d # 23:22 0- x86: Use asm goto to implement better modify_and_test() functions
git bisect good 4314895165623879937f46d767673654662b570c # 23:25 60+ sched: Micro-optimize by dropping unnecessary task_rq() calls
git bisect bad a0cf1abc25ac197dd97b857c0f6341066a8cb1cf # 23:25 0- Add linux-next specific files for 20130927
git bisect good 7dee8dff47734ee52da2cd8b8ea9736e42c5062f # 23:32 60+ Merge tag 'pm+acpi-3.12-rc4' of git://git.kernel.org/pub/scm/linux/kernel/git/rafael/linux-pm
git bisect bad a0cf1abc25ac197dd97b857c0f6341066a8cb1cf # 23:32 0- Add linux-next specific files for 20130927

Thanks,
Fengguang


Attachments:
(No filename) (5.17 kB)
dmesg-quantal-athens-6:20131005211943:i386-randconfig-j1-10052106:3.12.0-rc2-next-20130927-03100-ga0cf1ab:5 (42.91 kB)
bisect-a0cf1abc25ac197dd97b857c0f6341066a8cb1cf-i386-randconfig-j1-10052106-BUG:-unable-to-handle-kernel-paging-request-at-59612.log (68.25 kB)
config-3.12.0-rc2-next-20130927-03100-ga0cf1ab (73.21 kB)
Download all attachments

2013-10-05 23:48:01

by Fengguang Wu

[permalink] [raw]
Subject: [x86] BUG: unable to handle kernel paging request at 08000060


Hi Peter,

Here is another bisect on a different kconfig.

[ 6.612196] Write protecting the kernel text: 9752k
[ 6.613078] Write protecting the kernel read-only data: 3444k
[ 6.647222] BUG: unable to handle kernel paging request at 08000060
[ 6.648030] IP: [<41046ab0>] task_work_run+0x60/0xa0
[ 6.648030] *pde = 0686f067 *pte = 00000000
[ 6.648030] Oops: 0000 [#1] PREEMPT DEBUG_PAGEALLOC
[ 6.648030] CPU: 0 PID: 131 Comm: rc.local Not tainted 3.12.0-rc2-02842-g45c4ea0 #2
[ 6.648030] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011
[ 6.648030] task: 46865000 ti: 46874000 task.ti: 46874000
[ 6.648030] EIP: 0060:[<41046ab0>] EFLAGS: 00010206 CPU: 0
[ 6.648030] EIP is at task_work_run+0x60/0xa0
[ 6.648030] EAX: 08000060 EBX: 46862f40 ECX: 00000000 EDX: 08000060
[ 6.648030] ESI: 468652ac EDI: 46865000 EBP: 46875f9c ESP: 46875f90
[ 6.648030] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 6.648030] CR0: 8005003b CR2: 08000060 CR3: 0686e000 CR4: 00000690
[ 6.648030] Stack:
[ 6.648030] 396f7903 396e0ee8 37642ff4 46875fac 41002310 41984ebc 4fff01bc 46874000
[ 6.648030] 419848e6 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 6.648030] 0000007b 0000007b 00000000 00000000 0000000b 377a01d0 00000073 00000200
[ 6.648030] Call Trace:
[ 6.648030] [<41002310>] do_notify_resume+0x50/0x60
[ 6.648030] [<41984ebc>] ? sysenter_do_call+0x1e/0x37
[ 6.648030] [<419848e6>] work_notifysig+0x26/0x30
[ 6.648030] Code: eb 0b 89 f6 8d bc 27 00 00 00 00 31 c9 89 d0 0f b1 0e 39 c2 75 d5 85 d2 74 46 90 f3 90 8b 87 e4 02 00 00 85 c0 74 f4 31 db 66 90 <8b> 02 89 1a 85 c0 74 08 89 d3 89 c2 eb f2 66 90 89 d0 ff 52 04
[ 6.648030] EIP: [<41046ab0>] task_work_run+0x60/0xa0 SS:ESP 0068:46875f90
[ 6.648030] CR2: 0000000008000060
[ 6.678032] CRED: Invalid credentials

git bisect start 45c4ea0c4c1b8abffb575b865243fd1c69bbecd9 v3.11 --
git bisect good 39eda2aba6be642b71f2e0ad623dcb09fd9d79cf # 00:42 150+ Merge branch 'next' of git://git.kernel.org/pub/scm/linux/kernel/git/benh/powerpc
git bisect good bff157b3ad4b9f6be0af6987fcd62deaf0f2b799 # 03:47 150+ Merge branch 'slab/next' of git://git.kernel.org/pub/scm/linux/kernel/git/penberg/linux
git bisect good f659a4f17bbecdbad57dd5c63a1783e5ec5fd792 # 09:17 150+ Merge remote-tracking branch 'drm-intel/for-linux-next'
git bisect bad 6405cd58ac5c0a6ed5f4f1308892147870b9d5cf # 09:22 1- Merge remote-tracking branch 'regmap/for-next'
git bisect good 5094001bc464c12d3e04eb73a5e0d5e8436f09f7 # 12:28 150+ Merge remote-tracking branch 'omap_dss2/for-next'
git bisect good 8f31410ee9917e8648c7cf7f45e22320c166998a # 17:48 150+ Merge remote-tracking branch 'spi/for-next'
git bisect bad 6f014a7ea91f80f765ba700dcd1728680ba5c58e # 17:52 0- Merge remote-tracking branch 'tip/auto-latest'
git bisect bad bce56fbc0f165658f7e0715fedc8d39840bae31c # 17:57 0- Merge branch 'sched/core'
git bisect bad c2daa3bed53a81171cf8c1a36db798e82b91afe8 # 18:01 2- sched, x86: Provide a per-cpu preempt_count implementation
git bisect good 4314895165623879937f46d767673654662b570c # 18:18 150+ sched: Micro-optimize by dropping unnecessary task_rq() calls
git bisect bad 4a2b4b222743bb07fedf985b884550f2ca067ea9 # 18:22 2- sched: Introduce preempt_count accessor functions
git bisect bad b021fe3e25094fbec22d0eff846d2adeee1b9736 # 18:26 0- sched, rcu: Make RCU use resched_cpu()
git bisect bad 0c44c2d0f459cd7e275242b72f500137c4fa834d # 18:27 0- x86: Use asm goto to implement better modify_and_test() functions
git bisect good 4314895165623879937f46d767673654662b570c # 21:38 450+ sched: Micro-optimize by dropping unnecessary task_rq() calls
git bisect bad a0cf1abc25ac197dd97b857c0f6341066a8cb1cf # 21:38 0- Add linux-next specific files for 20130927
git bisect good c31eeaced22ce8bd61268a3c595d542bb38c0a4f # 21:59 450+ Merge git://git.kernel.org/pub/scm/linux/kernel/git/davem/net
git bisect bad a0cf1abc25ac197dd97b857c0f6341066a8cb1cf # 21:59 0- Add linux-next specific files for 20130927

Thanks,
Fengguang


Attachments:
(No filename) (4.05 kB)
dmesg-quantal-bay-1:20131001102547:3.12.0-rc2-02842-g45c4ea0:2 (47.82 kB)
bisect-45c4ea0c4c1b8abffb575b865243fd1c69bbecd9-i386-randconfig-j4-09302234-BUG:-unable-to-handle-kernel-7881.log (41.94 kB)
config-3.12.0-rc2-02842-g45c4ea0 (79.36 kB)
Download all attachments

2013-10-06 07:28:12

by Mike Galbraith

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 08000060

On Sun, 2013-10-06 at 07:47 +0800, Fengguang Wu wrote:
> Hi Peter,
>
> Here is another bisect on a different kconfig.

No explosions here, it gives my compiler a terminal tummy ache.

marge:/usr/local/src/kernel/linux-3.x-tip # make net/sunrpc/xprtsock.o
make[1]: Nothing to be done for `all'.
make[1]: Nothing to be done for `relocs'.
CHK include/config/kernel.release
CHK include/generated/uapi/linux/version.h
CHK include/generated/utsrelease.h
CC arch/x86/kernel/asm-offsets.s
GEN include/generated/asm-offsets.h
CALL scripts/checksyscalls.sh
<stdin>:1220:2: warning: #warning syscall kcmp not implemented [-Wcpp]
<stdin>:1223:2: warning: #warning syscall finit_module not implemented [-Wcpp]
CC [M] net/sunrpc/xprtsock.o
net/sunrpc/xprtsock.c: In function ‘xs_setup_tcp’:
net/sunrpc/xprtsock.c:2844:1: internal compiler error: in advance_target_bb, at sched-rgn.c:3486
Please submit a full bug report,
with preprocessed source if appropriate.
See <http://bugs.opensuse.org/> for instructions.
make[1]: *** [net/sunrpc/xprtsock.o] Error 1
make: *** [net/sunrpc/xprtsock.o] Error 2

marge:/usr/local/src/kernel/linux-3.x-tip # gcc -v
Using built-in specs.
COLLECT_GCC=gcc
COLLECT_LTO_WRAPPER=/usr/lib64/gcc/x86_64-suse-linux/4.6/lto-wrapper
Target: x86_64-suse-linux
Configured with: ../configure --prefix=/usr --infodir=/usr/share/info --mandir=/usr/share/man --libdir=/usr/lib64 --libexecdir=/usr/lib64 --enable-languages=c,c++,objc,fortran,obj-c++,java,ada --enable-checking=release --with-gxx-include-dir=/usr/include/c++/4.6 --enable-ssp --disable-libssp --disable-plugin --with-bugurl=http://bugs.opensuse.org/ --with-pkgversion='SUSE Linux' --disable-libgcj --disable-libmudflap --with-slibdir=/lib64 --with-system-zlib --enable-__cxa_atexit --enable-libstdcxx-allocator=new --disable-libstdcxx-pch --enable-version-specific-runtime-libs --program-suffix=-4.6 --enable-linux-futex --without-system-libunwind --with-arch-32=i586 --with-tune=generic --build=x86_64-suse-linux
Thread model: posix
gcc version 4.6.2 (SUSE Linux)

marge:/usr/local/src/kernel/linux-3.x-tip # git bisect good
0c44c2d0f459cd7e275242b72f500137c4fa834d is the first bad commit
commit 0c44c2d0f459cd7e275242b72f500137c4fa834d
Author: Peter Zijlstra <[email protected]>
Date: Wed Sep 11 15:19:24 2013 +0200

x86: Use asm goto to implement better modify_and_test() functions

Linus suggested using asm goto to get rid of the typical SETcc + TEST
instruction pair -- which also clobbers an extra register -- for our
typical modify_and_test() functions.

Because asm goto doesn't allow output fields it has to include an
unconditinal memory clobber when it changes a memory variable to force
a reload.

Luckily all atomic ops already imply a compiler barrier to go along
with their memory barrier semantics.

Suggested-by: Linus Torvalds <[email protected]>
Signed-off-by: Peter Zijlstra <[email protected]>
Link: http://lkml.kernel.org/n/[email protected]
Signed-off-by: Ingo Molnar <[email protected]>

:040000 040000 512c7965864218ef5a40569f80dd617fc75b60f9 22c5286cc1aa1e336c8b0d7efba08f3f3eff0640 M arch

git bisect start
# good: [1da177e4c3f41524e886b7f1b8a0c1fc7321cac2] Linux-2.6.12-rc2
git bisect good 1da177e4c3f41524e886b7f1b8a0c1fc7321cac2
# bad: [5e08c0bc7c26ef5cd1626cf3d56c428d6aa61679] Merge branch 'x86/urgent'
git bisect bad 5e08c0bc7c26ef5cd1626cf3d56c428d6aa61679
# good: [b9f399594d12e353dcb609c25219bdaa76c2a050] Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tiwai/sound-2.6
git bisect good b9f399594d12e353dcb609c25219bdaa76c2a050
# good: [be3eed2e96340d3c7a4d1ea1d63e7bd6095d1e34] netfilter: nf_ct_h323: fix usage of MODULE_ALIAS_NFCT_HELPER
git bisect good be3eed2e96340d3c7a4d1ea1d63e7bd6095d1e34
# good: [ecd9883724b78cc72ed92c98bcb1a46c764fff21] ipv6: fix race condition regarding dst->expires and dst->from.
git bisect good ecd9883724b78cc72ed92c98bcb1a46c764fff21
# good: [359d786b0402bac88d5bd6ad5a02c2a773f1b9f9] Merge tag 'at91-cleanup' of git://github.com/at91linux/linux-at91 into next/cleanup
git bisect good 359d786b0402bac88d5bd6ad5a02c2a773f1b9f9
# good: [97473630c78e687deb59284b19d09a095d38bc36] Merge remote-tracking branch 'asoc/topic/mxs' into asoc-next
git bisect good 97473630c78e687deb59284b19d09a095d38bc36
# good: [cc998ff8811530be521f6b316f37ab7676a07938] Merge git://git.kernel.org/pub/scm/linux/kernel/git/davem/net-next
git bisect good cc998ff8811530be521f6b316f37ab7676a07938
# good: [b0dd663b60944a3ce86430fa35549fb37968bda0] netpoll: Should handle ETH_P_ARP other than ETH_P_IP in netpoll_neigh_reply
git bisect good b0dd663b60944a3ce86430fa35549fb37968bda0
# good: [c31eeaced22ce8bd61268a3c595d542bb38c0a4f] Merge git://git.kernel.org/pub/scm/linux/kernel/git/davem/net
git bisect good c31eeaced22ce8bd61268a3c595d542bb38c0a4f
# good: [9c295bdf93935584839e8b1de23e97898a6b76a0] kvm tools: Add kvm__trigger_irq()
git bisect good 9c295bdf93935584839e8b1de23e97898a6b76a0
# good: [efee6ad6b0aa0899ccad0f379b83ce9c3287dad5] kvm tools: use bitwise 'and' in kvm-ipc
git bisect good efee6ad6b0aa0899ccad0f379b83ce9c3287dad5
# good: [305c6f0770c0420f2c618778517647649c813d23] kvm tools: arm: consolidate CPU node generation
git bisect good 305c6f0770c0420f2c618778517647649c813d23
# bad: [d229a4718e80e8ba0fed36a2702af343ddc71b6c] Merge branch 'x86/uv'
git bisect bad d229a4718e80e8ba0fed36a2702af343ddc71b6c
# bad: [67208898949a3647597f64788147a013906552ef] Merge branch 'timers/core'
git bisect bad 67208898949a3647597f64788147a013906552ef
# bad: [75f93fed50c2abadbab6ef546b265f51ca975b27] sched: Revert need_resched() to look at TIF_NEED_RESCHED
git bisect bad 75f93fed50c2abadbab6ef546b265f51ca975b27
# bad: [0c44c2d0f459cd7e275242b72f500137c4fa834d] x86: Use asm goto to implement better modify_and_test() functions
git bisect bad 0c44c2d0f459cd7e275242b72f500137c4fa834d
# good: [40a0c68ca9b49fb3e7292c1bae035ba5bcb27903] Merge branch 'sched/urgent' into sched/core
git bisect good 40a0c68ca9b49fb3e7292c1bae035ba5bcb27903
# good: [9bd721c55c8a886b938a45198aab0ccb52f1f7fa] sched/balancing: Consider max cost of idle balance per sched domain
git bisect good 9bd721c55c8a886b938a45198aab0ccb52f1f7fa
# good: [4314895165623879937f46d767673654662b570c] sched: Micro-optimize by dropping unnecessary task_rq() calls
git bisect good 4314895165623879937f46d767673654662b570c
# first bad commit: [0c44c2d0f459cd7e275242b72f500137c4fa834d] x86: Use asm goto to implement better modify_and_test() functions

2013-10-06 07:36:46

by Fengguang Wu

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 08000060

Hi Mike,

On Sun, Oct 06, 2013 at 09:27:41AM +0200, Mike Galbraith wrote:
> On Sun, 2013-10-06 at 07:47 +0800, Fengguang Wu wrote:
> > Hi Peter,
> >
> > Here is another bisect on a different kconfig.
>
> No explosions here, it gives my compiler a terminal tummy ache.

Thanks for looking into this! My gcc is

wfg@bee /lkp% gcc -v
Using built-in specs.
COLLECT_GCC=gcc
COLLECT_LTO_WRAPPER=/usr/lib/gcc/x86_64-linux-gnu/4.8/lto-wrapper
Target: x86_64-linux-gnu
Configured with: ../src/configure -v --with-pkgversion='Debian
4.8.1-3' --with-bugurl=file:///usr/share/doc/gcc-4.8/README.Bugs
--enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --prefix=/usr
--program-suffix=-4.8 --enable-shared --enable-linker-build-id
--libexecdir=/usr/lib --without-included-gettext
--enable-threads=posix --with-gxx-include-dir=/usr/include/c++/4.8
--libdir=/usr/lib --enable-nls --with-sysroot=/ --enable-clocale=gnu
--enable-libstdcxx-debug --enable-libstdcxx-time=yes
--enable-gnu-unique-object --enable-plugin --with-system-zlib
--disable-browser-plugin --enable-java-awt=gtk --enable-gtk-cairo
--with-java-home=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64/jre
--enable-java-home
--with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64
--with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-4.8-amd64
--with-arch-directory=amd64
--with-ecj-jar=/usr/share/java/eclipse-ecj.jar --enable-objc-gc
--enable-multiarch --with-arch-32=i586 --with-abi=m64
--with-multilib-list=m32,m64,mx32 --with-tune=generic
--enable-checking=release --build=x86_64-linux-gnu
--host=x86_64-linux-gnu --target=x86_64-linux-gnu
Thread model: posix
gcc version 4.8.1 (Debian 4.8.1-3)

Thanks,
Fengguang

> marge:/usr/local/src/kernel/linux-3.x-tip # make net/sunrpc/xprtsock.o
> make[1]: Nothing to be done for `all'.
> make[1]: Nothing to be done for `relocs'.
> CHK include/config/kernel.release
> CHK include/generated/uapi/linux/version.h
> CHK include/generated/utsrelease.h
> CC arch/x86/kernel/asm-offsets.s
> GEN include/generated/asm-offsets.h
> CALL scripts/checksyscalls.sh
> <stdin>:1220:2: warning: #warning syscall kcmp not implemented [-Wcpp]
> <stdin>:1223:2: warning: #warning syscall finit_module not implemented [-Wcpp]
> CC [M] net/sunrpc/xprtsock.o
> net/sunrpc/xprtsock.c: In function ‘xs_setup_tcp’:
> net/sunrpc/xprtsock.c:2844:1: internal compiler error: in advance_target_bb, at sched-rgn.c:3486
> Please submit a full bug report,
> with preprocessed source if appropriate.
> See <http://bugs.opensuse.org/> for instructions.
> make[1]: *** [net/sunrpc/xprtsock.o] Error 1
> make: *** [net/sunrpc/xprtsock.o] Error 2
>
> marge:/usr/local/src/kernel/linux-3.x-tip # gcc -v
> Using built-in specs.
> COLLECT_GCC=gcc
> COLLECT_LTO_WRAPPER=/usr/lib64/gcc/x86_64-suse-linux/4.6/lto-wrapper
> Target: x86_64-suse-linux
> Configured with: ../configure --prefix=/usr --infodir=/usr/share/info --mandir=/usr/share/man --libdir=/usr/lib64 --libexecdir=/usr/lib64 --enable-languages=c,c++,objc,fortran,obj-c++,java,ada --enable-checking=release --with-gxx-include-dir=/usr/include/c++/4.6 --enable-ssp --disable-libssp --disable-plugin --with-bugurl=http://bugs.opensuse.org/ --with-pkgversion='SUSE Linux' --disable-libgcj --disable-libmudflap --with-slibdir=/lib64 --with-system-zlib --enable-__cxa_atexit --enable-libstdcxx-allocator=new --disable-libstdcxx-pch --enable-version-specific-runtime-libs --program-suffix=-4.6 --enable-linux-futex --without-system-libunwind --with-arch-32=i586 --with-tune=generic --build=x86_64-suse-linux
> Thread model: posix
> gcc version 4.6.2 (SUSE Linux)
>
> marge:/usr/local/src/kernel/linux-3.x-tip # git bisect good
> 0c44c2d0f459cd7e275242b72f500137c4fa834d is the first bad commit
> commit 0c44c2d0f459cd7e275242b72f500137c4fa834d
> Author: Peter Zijlstra <[email protected]>
> Date: Wed Sep 11 15:19:24 2013 +0200
>
> x86: Use asm goto to implement better modify_and_test() functions
>
> Linus suggested using asm goto to get rid of the typical SETcc + TEST
> instruction pair -- which also clobbers an extra register -- for our
> typical modify_and_test() functions.
>
> Because asm goto doesn't allow output fields it has to include an
> unconditinal memory clobber when it changes a memory variable to force
> a reload.
>
> Luckily all atomic ops already imply a compiler barrier to go along
> with their memory barrier semantics.
>
> Suggested-by: Linus Torvalds <[email protected]>
> Signed-off-by: Peter Zijlstra <[email protected]>
> Link: http://lkml.kernel.org/n/[email protected]
> Signed-off-by: Ingo Molnar <[email protected]>
>
> :040000 040000 512c7965864218ef5a40569f80dd617fc75b60f9 22c5286cc1aa1e336c8b0d7efba08f3f3eff0640 M arch
>
> git bisect start
> # good: [1da177e4c3f41524e886b7f1b8a0c1fc7321cac2] Linux-2.6.12-rc2
> git bisect good 1da177e4c3f41524e886b7f1b8a0c1fc7321cac2
> # bad: [5e08c0bc7c26ef5cd1626cf3d56c428d6aa61679] Merge branch 'x86/urgent'
> git bisect bad 5e08c0bc7c26ef5cd1626cf3d56c428d6aa61679
> # good: [b9f399594d12e353dcb609c25219bdaa76c2a050] Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tiwai/sound-2.6
> git bisect good b9f399594d12e353dcb609c25219bdaa76c2a050
> # good: [be3eed2e96340d3c7a4d1ea1d63e7bd6095d1e34] netfilter: nf_ct_h323: fix usage of MODULE_ALIAS_NFCT_HELPER
> git bisect good be3eed2e96340d3c7a4d1ea1d63e7bd6095d1e34
> # good: [ecd9883724b78cc72ed92c98bcb1a46c764fff21] ipv6: fix race condition regarding dst->expires and dst->from.
> git bisect good ecd9883724b78cc72ed92c98bcb1a46c764fff21
> # good: [359d786b0402bac88d5bd6ad5a02c2a773f1b9f9] Merge tag 'at91-cleanup' of git://github.com/at91linux/linux-at91 into next/cleanup
> git bisect good 359d786b0402bac88d5bd6ad5a02c2a773f1b9f9
> # good: [97473630c78e687deb59284b19d09a095d38bc36] Merge remote-tracking branch 'asoc/topic/mxs' into asoc-next
> git bisect good 97473630c78e687deb59284b19d09a095d38bc36
> # good: [cc998ff8811530be521f6b316f37ab7676a07938] Merge git://git.kernel.org/pub/scm/linux/kernel/git/davem/net-next
> git bisect good cc998ff8811530be521f6b316f37ab7676a07938
> # good: [b0dd663b60944a3ce86430fa35549fb37968bda0] netpoll: Should handle ETH_P_ARP other than ETH_P_IP in netpoll_neigh_reply
> git bisect good b0dd663b60944a3ce86430fa35549fb37968bda0
> # good: [c31eeaced22ce8bd61268a3c595d542bb38c0a4f] Merge git://git.kernel.org/pub/scm/linux/kernel/git/davem/net
> git bisect good c31eeaced22ce8bd61268a3c595d542bb38c0a4f
> # good: [9c295bdf93935584839e8b1de23e97898a6b76a0] kvm tools: Add kvm__trigger_irq()
> git bisect good 9c295bdf93935584839e8b1de23e97898a6b76a0
> # good: [efee6ad6b0aa0899ccad0f379b83ce9c3287dad5] kvm tools: use bitwise 'and' in kvm-ipc
> git bisect good efee6ad6b0aa0899ccad0f379b83ce9c3287dad5
> # good: [305c6f0770c0420f2c618778517647649c813d23] kvm tools: arm: consolidate CPU node generation
> git bisect good 305c6f0770c0420f2c618778517647649c813d23
> # bad: [d229a4718e80e8ba0fed36a2702af343ddc71b6c] Merge branch 'x86/uv'
> git bisect bad d229a4718e80e8ba0fed36a2702af343ddc71b6c
> # bad: [67208898949a3647597f64788147a013906552ef] Merge branch 'timers/core'
> git bisect bad 67208898949a3647597f64788147a013906552ef
> # bad: [75f93fed50c2abadbab6ef546b265f51ca975b27] sched: Revert need_resched() to look at TIF_NEED_RESCHED
> git bisect bad 75f93fed50c2abadbab6ef546b265f51ca975b27
> # bad: [0c44c2d0f459cd7e275242b72f500137c4fa834d] x86: Use asm goto to implement better modify_and_test() functions
> git bisect bad 0c44c2d0f459cd7e275242b72f500137c4fa834d
> # good: [40a0c68ca9b49fb3e7292c1bae035ba5bcb27903] Merge branch 'sched/urgent' into sched/core
> git bisect good 40a0c68ca9b49fb3e7292c1bae035ba5bcb27903
> # good: [9bd721c55c8a886b938a45198aab0ccb52f1f7fa] sched/balancing: Consider max cost of idle balance per sched domain
> git bisect good 9bd721c55c8a886b938a45198aab0ccb52f1f7fa
> # good: [4314895165623879937f46d767673654662b570c] sched: Micro-optimize by dropping unnecessary task_rq() calls
> git bisect good 4314895165623879937f46d767673654662b570c
> # first bad commit: [0c44c2d0f459cd7e275242b72f500137c4fa834d] x86: Use asm goto to implement better modify_and_test() functions
>

2013-10-07 08:50:10

by Peter Zijlstra

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 08000060

On Sun, Oct 06, 2013 at 07:47:28AM +0800, Fengguang Wu wrote:
>
> Hi Peter,
>
> Here is another bisect on a different kconfig.
>
> [ 6.612196] Write protecting the kernel text: 9752k
> [ 6.613078] Write protecting the kernel read-only data: 3444k
> [ 6.647222] BUG: unable to handle kernel paging request at 08000060
> [ 6.648030] IP: [<41046ab0>] task_work_run+0x60/0xa0
> [ 6.648030] *pde = 0686f067 *pte = 00000000
> [ 6.648030] Oops: 0000 [#1] PREEMPT DEBUG_PAGEALLOC
> [ 6.648030] CPU: 0 PID: 131 Comm: rc.local Not tainted 3.12.0-rc2-02842-g45c4ea0 #2
> [ 6.648030] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011
> [ 6.648030] task: 46865000 ti: 46874000 task.ti: 46874000
> [ 6.648030] EIP: 0060:[<41046ab0>] EFLAGS: 00010206 CPU: 0
> [ 6.648030] EIP is at task_work_run+0x60/0xa0
> [ 6.648030] EAX: 08000060 EBX: 46862f40 ECX: 00000000 EDX: 08000060
> [ 6.648030] ESI: 468652ac EDI: 46865000 EBP: 46875f9c ESP: 46875f90
> [ 6.648030] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
> [ 6.648030] CR0: 8005003b CR2: 08000060 CR3: 0686e000 CR4: 00000690
> [ 6.648030] Stack:
> [ 6.648030] 396f7903 396e0ee8 37642ff4 46875fac 41002310 41984ebc 4fff01bc 46874000
> [ 6.648030] 419848e6 00000000 00000000 00000000 00000000 00000000 00000000 00000000
> [ 6.648030] 0000007b 0000007b 00000000 00000000 0000000b 377a01d0 00000073 00000200
> [ 6.648030] Call Trace:
> [ 6.648030] [<41002310>] do_notify_resume+0x50/0x60
> [ 6.648030] [<41984ebc>] ? sysenter_do_call+0x1e/0x37
> [ 6.648030] [<419848e6>] work_notifysig+0x26/0x30
> [ 6.648030] Code: eb 0b 89 f6 8d bc 27 00 00 00 00 31 c9 89 d0 0f b1 0e 39 c2 75 d5 85 d2 74 46 90 f3 90 8b 87 e4 02 00 00 85 c0 74 f4 31 db 66 90 <8b> 02 89 1a 85 c0 74 08 89 d3 89 c2 eb f2 66 90 89 d0 ff 52 04
> [ 6.648030] EIP: [<41046ab0>] task_work_run+0x60/0xa0 SS:ESP 0068:46875f90
> [ 6.648030] CR2: 0000000008000060
> [ 6.678032] CRED: Invalid credentials
>
> git bisect start 45c4ea0c4c1b8abffb575b865243fd1c69bbecd9 v3.11 --
> git bisect good 39eda2aba6be642b71f2e0ad623dcb09fd9d79cf # 00:42 150+ Merge branch 'next' of git://git.kernel.org/pub/scm/linux/kernel/git/benh/powerpc
> git bisect good bff157b3ad4b9f6be0af6987fcd62deaf0f2b799 # 03:47 150+ Merge branch 'slab/next' of git://git.kernel.org/pub/scm/linux/kernel/git/penberg/linux
> git bisect good f659a4f17bbecdbad57dd5c63a1783e5ec5fd792 # 09:17 150+ Merge remote-tracking branch 'drm-intel/for-linux-next'
> git bisect bad 6405cd58ac5c0a6ed5f4f1308892147870b9d5cf # 09:22 1- Merge remote-tracking branch 'regmap/for-next'
> git bisect good 5094001bc464c12d3e04eb73a5e0d5e8436f09f7 # 12:28 150+ Merge remote-tracking branch 'omap_dss2/for-next'
> git bisect good 8f31410ee9917e8648c7cf7f45e22320c166998a # 17:48 150+ Merge remote-tracking branch 'spi/for-next'
> git bisect bad 6f014a7ea91f80f765ba700dcd1728680ba5c58e # 17:52 0- Merge remote-tracking branch 'tip/auto-latest'
> git bisect bad bce56fbc0f165658f7e0715fedc8d39840bae31c # 17:57 0- Merge branch 'sched/core'
> git bisect bad c2daa3bed53a81171cf8c1a36db798e82b91afe8 # 18:01 2- sched, x86: Provide a per-cpu preempt_count implementation
> git bisect good 4314895165623879937f46d767673654662b570c # 18:18 150+ sched: Micro-optimize by dropping unnecessary task_rq() calls
> git bisect bad 4a2b4b222743bb07fedf985b884550f2ca067ea9 # 18:22 2- sched: Introduce preempt_count accessor functions
> git bisect bad b021fe3e25094fbec22d0eff846d2adeee1b9736 # 18:26 0- sched, rcu: Make RCU use resched_cpu()
> git bisect bad 0c44c2d0f459cd7e275242b72f500137c4fa834d # 18:27 0- x86: Use asm goto to implement better modify_and_test() functions
> git bisect good 4314895165623879937f46d767673654662b570c # 21:38 450+ sched: Micro-optimize by dropping unnecessary task_rq() calls
> git bisect bad a0cf1abc25ac197dd97b857c0f6341066a8cb1cf # 21:38 0- Add linux-next specific files for 20130927
> git bisect good c31eeaced22ce8bd61268a3c595d542bb38c0a4f # 21:59 450+ Merge git://git.kernel.org/pub/scm/linux/kernel/git/davem/net
> git bisect bad a0cf1abc25ac197dd97b857c0f6341066a8cb1cf # 21:59 0- Add linux-next specific files for 20130927
>

Does this point to the same commit or what? How does one read these
things?

2013-10-07 08:55:47

by Peter Zijlstra

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

On Sun, Oct 06, 2013 at 07:44:30AM +0800, Fengguang Wu wrote:
> Greetings,
>
> I got the below dmesg and the first bad commit is
>
> commit 0c44c2d0f459cd7e275242b72f500137c4fa834d
> Author: Peter Zijlstra <[email protected]>
> Date: Wed Sep 11 15:19:24 2013 +0200
>
> x86: Use asm goto to implement better modify_and_test() functions
>
> Linus suggested using asm goto to get rid of the typical SETcc + TEST
> instruction pair -- which also clobbers an extra register -- for our
> typical modify_and_test() functions.
>
> Because asm goto doesn't allow output fields it has to include an
> unconditinal memory clobber when it changes a memory variable to force
> a reload.
>
> Luckily all atomic ops already imply a compiler barrier to go along
> with their memory barrier semantics.
>
> Suggested-by: Linus Torvalds <[email protected]>
> Signed-off-by: Peter Zijlstra <[email protected]>
> Link: http://lkml.kernel.org/n/[email protected]
> Signed-off-by: Ingo Molnar <[email protected]>


Well that blows,.. Anybody got any clue as to where to start looking?
I've not actually seen anything like this on my own machines.

Wu, do you use the same compiler version for all the builds that crash
like this (I'm assuming the other email was this same commit)? Does a
different compiler make things work again?


> [ 3.336040] Write protecting the kernel read-only data: 2644k
> [ 3.336982] NX-protecting the kernel data: 6152k
> [ 3.375173] BUG: unable to handle kernel paging request at 00740060
> [ 3.376162] IP: [<81053fc4>] task_work_run+0x54/0xa0
> [ 3.376837] *pdpt = 00000000072e1001 *pde = 0000000000000000
> [ 3.377579] Oops: 0000 [#1] DEBUG_PAGEALLOC
> [ 3.378158] CPU: 0 PID: 85 Comm: hostname Not tainted 3.12.0-rc2-next-20130927-03100-ga0cf1ab #5
> [ 3.378206] task: 8730c000 ti: 8730e000 task.ti: 8730e000
> [ 3.378206] EIP: 0060:[<81053fc4>] EFLAGS: 00010206 CPU: 0
> [ 3.378206] EIP is at task_work_run+0x54/0xa0
> [ 3.378206] EAX: 00740060 EBX: 87309000 ECX: 00000000 EDX: 00740060
> [ 3.378206] ESI: 8730c388 EDI: 8730c000 EBP: 8730ff40 ESP: 8730ff34
> [ 3.378206] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
> [ 3.378206] CR0: 8005003b CR2: 00740060 CR3: 072d7000 CR4: 000006b0
> [ 3.378206] Stack:
> [ 3.378206] ffffffff 87308058 8730c000 8730ff8c 81039315 77675fb8 8105af7b 00000000
> [ 3.378206] 8730ffac 00000001 6c0e41a5 61636f6c 736f686c 6f6c2e74 646c6163 8730c398
> [ 3.378206] 815fc8fe 81022f40 00000000 00000000 872f1880 8730c000 8730ffa4 81039a0a
> [ 3.378206] Call Trace:
> [ 3.378206] [<81039315>] do_exit+0x2a5/0x910
> [ 3.378206] [<8105af7b>] ? up_write+0x1b/0x30
> [ 3.378206] [<815fc8fe>] ? restore_all+0xf/0xf
> [ 3.378206] [<81022f40>] ? kvm_read_and_reset_pf_reason+0x40/0x40
> [ 3.378206] [<81039a0a>] do_group_exit+0x4a/0xa0
> [ 3.378206] [<81039a78>] SyS_exit_group+0x18/0x20
> [ 3.378206] [<815fcf50>] sysenter_do_call+0x12/0x3c
> [ 3.378206] Code: 36 31 c9 89 d0 0f b1 0e 39 c2 75 eb 85 d2 74 5c 8d b4 26 00 00 00 00 f3 90 8b 87 c0 03 00 00 85 c0 74 f4 31 db eb 04 89 d3 89 c2 <8b> 02 89 1a 85 c0 75 f4 eb 16 66 90 f6 47 0c 04 74 c4 b9 f0 af
> [ 3.378206] EIP: [<81053fc4>] task_work_run+0x54/0xa0 SS:ESP 0068:8730ff34
> [ 3.378206] CR2: 0000000000740060
> [ 3.394549] ---[ end trace a6f697254c888db0 ]---
>

2013-10-07 09:09:13

by Peter Zijlstra

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

On Mon, Oct 07, 2013 at 10:55:33AM +0200, Peter Zijlstra wrote:
> Wu, do you use the same compiler version for all the builds that crash
> like this (I'm assuming the other email was this same commit)? Does a
> different compiler make things work again?

OK, so in a further email you say you use gcc-4.8.1 (which is actually
newer than the one I used for most of the work although I do have it and
tried it iirc).

2013-10-07 09:17:27

by Fengguang Wu

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 08000060

On Mon, Oct 07, 2013 at 10:49:57AM +0200, Peter Zijlstra wrote:
> On Sun, Oct 06, 2013 at 07:47:28AM +0800, Fengguang Wu wrote:
> >
> > Hi Peter,
> >
> > Here is another bisect on a different kconfig.
> >
> > [ 6.612196] Write protecting the kernel text: 9752k
> > [ 6.613078] Write protecting the kernel read-only data: 3444k
> > [ 6.647222] BUG: unable to handle kernel paging request at 08000060
> > [ 6.648030] IP: [<41046ab0>] task_work_run+0x60/0xa0
> > [ 6.648030] *pde = 0686f067 *pte = 00000000
> > [ 6.648030] Oops: 0000 [#1] PREEMPT DEBUG_PAGEALLOC
> > [ 6.648030] CPU: 0 PID: 131 Comm: rc.local Not tainted 3.12.0-rc2-02842-g45c4ea0 #2
> > [ 6.648030] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011
> > [ 6.648030] task: 46865000 ti: 46874000 task.ti: 46874000
> > [ 6.648030] EIP: 0060:[<41046ab0>] EFLAGS: 00010206 CPU: 0
> > [ 6.648030] EIP is at task_work_run+0x60/0xa0
> > [ 6.648030] EAX: 08000060 EBX: 46862f40 ECX: 00000000 EDX: 08000060
> > [ 6.648030] ESI: 468652ac EDI: 46865000 EBP: 46875f9c ESP: 46875f90
> > [ 6.648030] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
> > [ 6.648030] CR0: 8005003b CR2: 08000060 CR3: 0686e000 CR4: 00000690
> > [ 6.648030] Stack:
> > [ 6.648030] 396f7903 396e0ee8 37642ff4 46875fac 41002310 41984ebc 4fff01bc 46874000
> > [ 6.648030] 419848e6 00000000 00000000 00000000 00000000 00000000 00000000 00000000
> > [ 6.648030] 0000007b 0000007b 00000000 00000000 0000000b 377a01d0 00000073 00000200
> > [ 6.648030] Call Trace:
> > [ 6.648030] [<41002310>] do_notify_resume+0x50/0x60
> > [ 6.648030] [<41984ebc>] ? sysenter_do_call+0x1e/0x37
> > [ 6.648030] [<419848e6>] work_notifysig+0x26/0x30
> > [ 6.648030] Code: eb 0b 89 f6 8d bc 27 00 00 00 00 31 c9 89 d0 0f b1 0e 39 c2 75 d5 85 d2 74 46 90 f3 90 8b 87 e4 02 00 00 85 c0 74 f4 31 db 66 90 <8b> 02 89 1a 85 c0 74 08 89 d3 89 c2 eb f2 66 90 89 d0 ff 52 04
> > [ 6.648030] EIP: [<41046ab0>] task_work_run+0x60/0xa0 SS:ESP 0068:46875f90
> > [ 6.648030] CR2: 0000000008000060
> > [ 6.678032] CRED: Invalid credentials
> >
> > git bisect start 45c4ea0c4c1b8abffb575b865243fd1c69bbecd9 v3.11 --
> > git bisect good 39eda2aba6be642b71f2e0ad623dcb09fd9d79cf # 00:42 150+ Merge branch 'next' of git://git.kernel.org/pub/scm/linux/kernel/git/benh/powerpc
> > git bisect good bff157b3ad4b9f6be0af6987fcd62deaf0f2b799 # 03:47 150+ Merge branch 'slab/next' of git://git.kernel.org/pub/scm/linux/kernel/git/penberg/linux
> > git bisect good f659a4f17bbecdbad57dd5c63a1783e5ec5fd792 # 09:17 150+ Merge remote-tracking branch 'drm-intel/for-linux-next'
> > git bisect bad 6405cd58ac5c0a6ed5f4f1308892147870b9d5cf # 09:22 1- Merge remote-tracking branch 'regmap/for-next'
> > git bisect good 5094001bc464c12d3e04eb73a5e0d5e8436f09f7 # 12:28 150+ Merge remote-tracking branch 'omap_dss2/for-next'
> > git bisect good 8f31410ee9917e8648c7cf7f45e22320c166998a # 17:48 150+ Merge remote-tracking branch 'spi/for-next'
> > git bisect bad 6f014a7ea91f80f765ba700dcd1728680ba5c58e # 17:52 0- Merge remote-tracking branch 'tip/auto-latest'
> > git bisect bad bce56fbc0f165658f7e0715fedc8d39840bae31c # 17:57 0- Merge branch 'sched/core'
> > git bisect bad c2daa3bed53a81171cf8c1a36db798e82b91afe8 # 18:01 2- sched, x86: Provide a per-cpu preempt_count implementation
> > git bisect good 4314895165623879937f46d767673654662b570c # 18:18 150+ sched: Micro-optimize by dropping unnecessary task_rq() calls
> > git bisect bad 4a2b4b222743bb07fedf985b884550f2ca067ea9 # 18:22 2- sched: Introduce preempt_count accessor functions
> > git bisect bad b021fe3e25094fbec22d0eff846d2adeee1b9736 # 18:26 0- sched, rcu: Make RCU use resched_cpu()
> > git bisect bad 0c44c2d0f459cd7e275242b72f500137c4fa834d # 18:27 0- x86: Use asm goto to implement better modify_and_test() functions
> > git bisect good 4314895165623879937f46d767673654662b570c # 21:38 450+ sched: Micro-optimize by dropping unnecessary task_rq() calls
> > git bisect bad a0cf1abc25ac197dd97b857c0f6341066a8cb1cf # 21:38 0- Add linux-next specific files for 20130927
> > git bisect good c31eeaced22ce8bd61268a3c595d542bb38c0a4f # 21:59 450+ Merge git://git.kernel.org/pub/scm/linux/kernel/git/davem/net
> > git bisect bad a0cf1abc25ac197dd97b857c0f6341066a8cb1cf # 21:59 0- Add linux-next specific files for 20130927
> >
>
> Does this point to the same commit or what?

Yes it's bisected to the same commit.

> How does one read these things?

In each report, I'll show a digest of the first call trace and attach
the full dmesg, kconfig and bisect log files.

The numbers in the below two lines mean

> > git bisect good c31eeaced22ce8bd61268a3c595d542bb38c0a4f # 21:59 450+ Merge git://git.kernel.org/pub/scm/linux/kernel/git/davem/net
> > git bisect bad a0cf1abc25ac197dd97b857c0f6341066a8cb1cf # 21:59 0- Add linux-next specific files for 20130927

21:59 => wall time

450+ => this bisect test finishes after 450 good boots; suffix "+" means bisect test result is GOOD
(collected large enough samples to claim it a GOOD kernel/commit)

0- => this bisect test finishes after 0 good boots; suffix "-" means bisect test result is BAD
(it sees the message "BUG: unable to handle kernel ..." on the first boot)

Since all the BAD commits see only 0, 1, or 2 good boots (the lines
with "0-", "1-", "2-") before see the bug message, it means the
problem is pretty reproducible.

Thanks,
Fengguang

2013-10-07 09:27:49

by Fengguang Wu

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

On Mon, Oct 07, 2013 at 10:55:33AM +0200, Peter Zijlstra wrote:
> On Sun, Oct 06, 2013 at 07:44:30AM +0800, Fengguang Wu wrote:
> > Greetings,
> >
> > I got the below dmesg and the first bad commit is
> >
> > commit 0c44c2d0f459cd7e275242b72f500137c4fa834d
> > Author: Peter Zijlstra <[email protected]>
> > Date: Wed Sep 11 15:19:24 2013 +0200
> >
> > x86: Use asm goto to implement better modify_and_test() functions
> >
> > Linus suggested using asm goto to get rid of the typical SETcc + TEST
> > instruction pair -- which also clobbers an extra register -- for our
> > typical modify_and_test() functions.
> >
> > Because asm goto doesn't allow output fields it has to include an
> > unconditinal memory clobber when it changes a memory variable to force
> > a reload.
> >
> > Luckily all atomic ops already imply a compiler barrier to go along
> > with their memory barrier semantics.
> >
> > Suggested-by: Linus Torvalds <[email protected]>
> > Signed-off-by: Peter Zijlstra <[email protected]>
> > Link: http://lkml.kernel.org/n/[email protected]
> > Signed-off-by: Ingo Molnar <[email protected]>
>
>
> Well that blows,.. Anybody got any clue as to where to start looking?
> I've not actually seen anything like this on my own machines.

Perhaps it's related to one of

- the randconfig
- kvm
- gcc

In the end of dmesg file, there is the qemu command line to run the kernel:

qemu-system-x86_64 -cpu kvm64 -enable-kvm -kernel
/kernel/i386-randconfig-j1-10052106/a0cf1abc25ac197dd97b857c0f6341066a8cb1cf/vmlinuz-3.12.0-rc2-next-20130927-03100-ga0cf1ab -append 'hung_task_panic=1
rcutree.rcu_cpu_stall_timeout=100 log_buf_len=8M ignore_loglevel debug sched_debug apic=debug dynamic_printk sysrq_always_enabled panic=10
prompt_ramdisk=0 console=ttyS0,115200 console=tty0 vga=normal root=/dev/ram0 rw
link=/kernel-tests/run-queue/kvm/i386-randconfig-j1-10052106/next:master/.vmlinuz-a0cf1abc25ac197dd97b857c0f6341066a8cb1cf-20131005211923-7-athens
branch=next/master
BOOT_IMAGE=/kernel/i386-randconfig-j1-10052106/a0cf1abc25ac197dd97b857c0f6341066a8cb1cf/vmlinuz-3.12.0-rc2-next-20130927-03100-ga0cf1ab' -initrd
/kernel-tests/initrd/quantal-core-i386.cgz -m 256M -smp 2 -net nic,vlan=0,macaddr=00:00:00:00:00:00,model=virtio -net user,vlan=0,hostfwd=tcp::10661-:22
-net nic,vlan=1,model=e1000 -net user,vlan=1 -boot order=nc -no-reboot -watchdog i6300esb -drive
file=/fs/LABEL=KVM/disk0-quantal-athens-6,media=disk,if=virtio -drive file=/fs/LABEL=KVM/disk1-quantal-athens-6,media=disk,if=virtio -drive
file=/fs/LABEL=KVM/disk2-quantal-athens-6,media=disk,if=virtio -drive file=/fs/LABEL=KVM/disk3-quantal-athens-6,media=disk,if=virtio -drive
file=/fs/LABEL=KVM/disk4-quantal-athens-6,media=disk,if=virtio -drive file=/fs/LABEL=KVM/disk5-quantal-athens-6,media=disk,if=virtio -pidfile
/dev/shm/kboot/pid-quantal-athens-6 -serial file:/dev/shm/kboot/serial-quantal-athens-6 -daemonize -display none -monitor null

> Wu, do you use the same compiler version for all the builds that crash
> like this (I'm assuming the other email was this same commit)? Does a
> different compiler make things work again?

Good point. I'll try a different compiler.

Thanks,
Fengguang

2013-10-07 09:36:26

by Peter Zijlstra

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 08000060

On Mon, Oct 07, 2013 at 05:17:20PM +0800, Fengguang Wu wrote:
> On Mon, Oct 07, 2013 at 10:49:57AM +0200, Peter Zijlstra wrote:
> The numbers in the below two lines mean
>
> > > git bisect good c31eeaced22ce8bd61268a3c595d542bb38c0a4f # 21:59 450+ Merge git://git.kernel.org/pub/scm/linux/kernel/git/davem/net
> > > git bisect bad a0cf1abc25ac197dd97b857c0f6341066a8cb1cf # 21:59 0- Add linux-next specific files for 20130927
>
> 21:59 => wall time
>
> 450+ => this bisect test finishes after 450 good boots; suffix "+" means bisect test result is GOOD
> (collected large enough samples to claim it a GOOD kernel/commit)
>
> 0- => this bisect test finishes after 0 good boots; suffix "-" means bisect test result is BAD
> (it sees the message "BUG: unable to handle kernel ..." on the first boot)
>
> Since all the BAD commits see only 0, 1, or 2 good boots (the lines
> with "0-", "1-", "2-") before see the bug message, it means the
> problem is pretty reproducible.

But the reported bad commit was: 0c44c2d0f459cd7e275242b72f500137c4fa834d
which is not the same number as your last BAD line.


2013-10-07 09:46:59

by Fengguang Wu

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 08000060

On Mon, Oct 07, 2013 at 11:36:17AM +0200, Peter Zijlstra wrote:
> On Mon, Oct 07, 2013 at 05:17:20PM +0800, Fengguang Wu wrote:
> > On Mon, Oct 07, 2013 at 10:49:57AM +0200, Peter Zijlstra wrote:
> > The numbers in the below two lines mean
> >
> > > > git bisect good c31eeaced22ce8bd61268a3c595d542bb38c0a4f # 21:59 450+ Merge git://git.kernel.org/pub/scm/linux/kernel/git/davem/net
> > > > git bisect bad a0cf1abc25ac197dd97b857c0f6341066a8cb1cf # 21:59 0- Add linux-next specific files for 20130927
> >
> > 21:59 => wall time
> >
> > 450+ => this bisect test finishes after 450 good boots; suffix "+" means bisect test result is GOOD
> > (collected large enough samples to claim it a GOOD kernel/commit)
> >
> > 0- => this bisect test finishes after 0 good boots; suffix "-" means bisect test result is BAD
> > (it sees the message "BUG: unable to handle kernel ..." on the first boot)
> >
> > Since all the BAD commits see only 0, 1, or 2 good boots (the lines
> > with "0-", "1-", "2-") before see the bug message, it means the
> > problem is pretty reproducible.
>
> But the reported bad commit was: 0c44c2d0f459cd7e275242b72f500137c4fa834d
> which is not the same number as your last BAD line.

Ah yes, this is because the bisect script will in the end
double check whether the same bug exists in

- first bad commit's parent(s) (with increased boot count)
- first bad commit reverted (if could be reverted)
- branch HEAD (if the tree/branch could be figured out)
- upstream
- linux-next

Thanks,
Fengguang

2013-10-07 11:32:58

by Fengguang Wu

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

On Mon, Oct 07, 2013 at 11:08:56AM +0200, Peter Zijlstra wrote:
> On Mon, Oct 07, 2013 at 10:55:33AM +0200, Peter Zijlstra wrote:
> > Wu, do you use the same compiler version for all the builds that crash
> > like this (I'm assuming the other email was this same commit)? Does a
> > different compiler make things work again?
>
> OK, so in a further email you say you use gcc-4.8.1 (which is actually
> newer than the one I used for most of the work although I do have it and
> tried it iirc).

Right. And I've got the boot result for gcc-4.6.3: the problem is
still there. Here is the qemu cmdline and new dmesg.

=============================================================================
cmd=(
qemu-system-x86_64 -cpu kvm64 -enable-kvm
-kernel $1
-initrd /kernel-tests/initrd/quantal-core-i386.cgz -m 256M -smp 2 -net nic,vlan=0,macaddr=00:00:00:00:00:00,model=virtio -net user,vlan=0,hostfwd=tcp::10661-:22
-net nic,vlan=1,model=e1000 -net user,vlan=1 -boot order=nc -no-reboot -watchdog i6300esb
-serial file:/dev/shm/serial-0day -daemonize -display none -monitor null
)

"${cmd[@]}" -append 'hung_task_panic=1 rcutree.rcu_cpu_stall_timeout=100 log_buf_len=8M ignore_loglevel debug sched_debug apic=debug dynamic_printk sysrq_always_enabled panic=10 prompt_ramdisk=0 console=ttyS0,115200 console=tty0 vga=normal root=/dev/ram0 rw'
=============================================================================

[ 0.000000] Linux version 3.12.0-rc1-00081-g6bfa687 (wfg@bee) (gcc version 4.6.3 (Debian 4.6.3-1) ) #1 Mon Oct 7 19:18:22 CST 2013
[ 0.000000] e820: BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable
[ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000000fffdfff] usable
[ 0.000000] BIOS-e820: [mem 0x000000000fffe000-0x000000000fffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved
[ 0.000000] debug: ignoring loglevel setting.
[ 0.000000] NX (Execute Disable) protection: active
[ 0.000000] Hypervisor detected: KVM
[ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[ 0.000000] e820: last_pfn = 0xfffe max_arch_pfn = 0x1000000
[ 0.000000] Scanning 1 areas for low memory corruption
[ 0.000000] initial memory mapped: [mem 0x00000000-0x029fffff]
[ 0.000000] Base memory trampoline at [8009b000] 9b000 size 16384
[ 0.000000] init_memory_mapping: [mem 0x00000000-0x000fffff]
[ 0.000000] [mem 0x00000000-0x000fffff] page 4k
[ 0.000000] init_memory_mapping: [mem 0x0e400000-0x0e5fffff]
[ 0.000000] [mem 0x0e400000-0x0e5fffff] page 4k
[ 0.000000] BRK [0x020a7000, 0x020a7fff] PGTABLE
[ 0.000000] init_memory_mapping: [mem 0x0c000000-0x0e3fffff]
[ 0.000000] [mem 0x0c000000-0x0e3fffff] page 4k
[ 0.000000] BRK [0x020a8000, 0x020a8fff] PGTABLE
[ 0.000000] BRK [0x020a9000, 0x020a9fff] PGTABLE
[ 0.000000] BRK [0x020aa000, 0x020aafff] PGTABLE
[ 0.000000] BRK [0x020ab000, 0x020abfff] PGTABLE
[ 0.000000] BRK [0x020ac000, 0x020acfff] PGTABLE
[ 0.000000] init_memory_mapping: [mem 0x00100000-0x0bffffff]
[ 0.000000] [mem 0x00100000-0x0bffffff] page 4k
[ 0.000000] init_memory_mapping: [mem 0x0e600000-0x0fffdfff]
[ 0.000000] [mem 0x0e600000-0x0fffdfff] page 4k
[ 0.000000] log_buf_len: 8388608
[ 0.000000] early log buf free: 128876(98%)
[ 0.000000] RAMDISK: [mem 0x0e73f000-0x0ffeffff]
[ 0.000000] ACPI: RSDP 000f16b0 00014 (v00 BOCHS )
[ 0.000000] ACPI: RSDT 0fffe3f0 00034 (v01 BOCHS BXPCRSDT 00000001 BXPC 00000001)
[ 0.000000] ACPI: FACP 0fffff80 00074 (v01 BOCHS BXPCFACP 00000001 BXPC 00000001)
[ 0.000000] ACPI: DSDT 0fffe430 01137 (v01 BXPC BXDSDT 00000001 INTL 20100528)
[ 0.000000] ACPI: FACS 0fffff40 00040
[ 0.000000] ACPI: SSDT 0ffff6a0 00899 (v01 BOCHS BXPCSSDT 00000001 BXPC 00000001)
[ 0.000000] ACPI: APIC 0ffff5b0 00080 (v01 BOCHS BXPCAPIC 00000001 BXPC 00000001)
[ 0.000000] ACPI: HPET 0ffff570 00038 (v01 BOCHS BXPCHPET 00000001 BXPC 00000001)
[ 0.000000] 255MB LOWMEM available.
[ 0.000000] mapped low ram: 0 - 0fffe000
[ 0.000000] low ram: 0 - 0fffe000
[ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00
[ 0.000000] kvm-clock: cpu 0, msr 0:fffd001, boot clock
[ 0.000000] Zone ranges:
[ 0.000000] Normal [mem 0x00001000-0x0fffdfff]
[ 0.000000] Movable zone start for each node
[ 0.000000] Early memory node ranges
[ 0.000000] node 0: [mem 0x00001000-0x0009efff]
[ 0.000000] node 0: [mem 0x00100000-0x0fffdfff]
[ 0.000000] On node 0 totalpages: 65436
[ 0.000000] Normal zone: 576 pages used for memmap
[ 0.000000] Normal zone: 0 pages reserved
[ 0.000000] Normal zone: 65436 pages, LIFO batch:15
[ 0.000000] ACPI: PM-Timer IO Port: 0xb008
[ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[ 0.000000] KVM setup async PF for cpu 0
[ 0.000000] kvm-stealtime: cpu 0, msr 189e3c0
[ 0.000000] e820: [mem 0x10000000-0xfeffbfff] available for PCI devices
[ 0.000000] Booting paravirtualized kernel on KVM
[ 0.000000] pcpu-alloc: s0 r0 d32768 u32768 alloc=1*32768
[ 0.000000] pcpu-alloc: [0] 0
[ 0.000000] Built 1 zonelists in Zone order, mobility grouping on. Total pages: 64860
[ 0.000000] Kernel command line: hung_task_panic=1 rcutree.rcu_cpu_stall_timeout=100 log_buf_len=8M ignore_loglevel debug sched_debug apic=debug dynamic_printk sysrq_always_enabled panic=10 prompt_ramdisk=0 console=ttyS0,115200 console=tty0 vga=normal root=/dev/ram0 rw
[ 0.000000] PID hash table entries: 1024 (order: 0, 4096 bytes)
[ 0.000000] Dentry cache hash table entries: 32768 (order: 5, 131072 bytes)
[ 0.000000] Inode-cache hash table entries: 16384 (order: 4, 65536 bytes)
[ 0.000000] Initializing CPU#0
[ 0.000000] Memory: 205852K/261744K available (6113K kernel code, 2123K rwdata, 2620K rodata, 460K init, 5644K bss, 55892K reserved)
[ 0.000000] virtual kernel memory layout:
[ 0.000000] fixmap : 0xfffe2000 - 0xfffff000 ( 116 kB)
[ 0.000000] vmalloc : 0x907fe000 - 0xfffe0000 (1783 MB)
[ 0.000000] lowmem : 0x80000000 - 0x8fffe000 ( 255 MB)
[ 0.000000] .init : 0x81a9c000 - 0x81b0f000 ( 460 kB)
[ 0.000000] .data : 0x815f8a07 - 0x81a9bf40 (4749 kB)
[ 0.000000] .text : 0x81000000 - 0x815f8a07 (6114 kB)
[ 0.000000] Checking if this processor honours the WP bit even in supervisor mode...Ok.
[ 0.000000] NR_IRQS:16 nr_irqs:16 16
[ 0.000000] CPU 0 irqstacks, hard=80090000 soft=80092000
[ 0.000000] console [ttyS0] enabled
[ 0.000000] Lock dependency validator: Copyright (c) 2006 Red Hat, Inc., Ingo Molnar
[ 0.000000] ... MAX_LOCKDEP_SUBCLASSES: 8
[ 0.000000] ... MAX_LOCK_DEPTH: 48
[ 0.000000] ... MAX_LOCKDEP_KEYS: 8191
[ 0.000000] ... CLASSHASH_SIZE: 4096
[ 0.000000] ... MAX_LOCKDEP_ENTRIES: 16384
[ 0.000000] ... MAX_LOCKDEP_CHAINS: 32768
[ 0.000000] ... CHAINHASH_SIZE: 16384
[ 0.000000] memory used by lock dependency info: 3823 kB
[ 0.000000] per task-struct memory footprint: 1920 bytes
[ 0.000000] ------------------------
[ 0.000000] | Locking API testsuite:
[ 0.000000] ----------------------------------------------------------------------------
[ 0.000000] | spin |wlock |rlock |mutex | wsem | rsem |
[ 0.000000] --------------------------------------------------------------------------
[ 0.000000] A-A deadlock: ok | ok | ok | ok | ok | ok |
[ 0.000000] A-B-B-A deadlock: ok | ok | ok | ok | ok | ok |
[ 0.000000] A-B-B-C-C-A deadlock: ok | ok | ok | ok | ok | ok |
[ 0.000000] A-B-C-A-B-C deadlock: ok | ok | ok | ok | ok | ok |
[ 0.000000] A-B-B-C-C-D-D-A deadlock: ok | ok | ok | ok | ok | ok |
[ 0.000000] A-B-C-D-B-D-D-A deadlock: ok | ok | ok | ok | ok | ok |
[ 0.000000] A-B-C-D-B-C-D-A deadlock: ok | ok | ok | ok | ok | ok |
[ 0.000000] double unlock: ok | ok | ok | ok | ok | ok |
[ 0.000000] initialize held: ok | ok | ok | ok | ok | ok |
[ 0.000000] bad unlock order: ok | ok | ok | ok | ok | ok |
[ 0.000000] --------------------------------------------------------------------------
[ 0.000000] recursive read-lock: | ok | | ok |
[ 0.000000] recursive read-lock #2: | ok | | ok |
[ 0.000000] mixed read-write-lock: | ok | | ok |
[ 0.000000] mixed write-read-lock: | ok | | ok |
[ 0.000000] --------------------------------------------------------------------------
[ 0.000000] hard-irqs-on + irq-safe-A/12: ok | ok | ok |
[ 0.000000] soft-irqs-on + irq-safe-A/12: ok | ok | ok |
[ 0.000000] hard-irqs-on + irq-safe-A/21: ok | ok | ok |
[ 0.000000] soft-irqs-on + irq-safe-A/21: ok | ok | ok |
[ 0.000000] sirq-safe-A => hirqs-on/12: ok | ok | ok |
[ 0.000000] sirq-safe-A => hirqs-on/21: ok | ok | ok |
[ 0.000000] hard-safe-A + irqs-on/12: ok | ok | ok |
[ 0.000000] soft-safe-A + irqs-on/12: ok | ok | ok |
[ 0.000000] hard-safe-A + irqs-on/21: ok | ok | ok |
[ 0.000000] soft-safe-A + irqs-on/21: ok | ok | ok |
[ 0.000000] hard-safe-A + unsafe-B #1/123: ok | ok | ok |
[ 0.000000] soft-safe-A + unsafe-B #1/123: ok | ok | ok |
[ 0.000000] hard-safe-A + unsafe-B #1/132: ok | ok | ok |
[ 0.000000] soft-safe-A + unsafe-B #1/132: ok | ok | ok |
[ 0.000000] hard-safe-A + unsafe-B #1/213: ok | ok | ok |
[ 0.000000] soft-safe-A + unsafe-B #1/213: ok | ok | ok |
[ 0.000000] hard-safe-A + unsafe-B #1/231: ok | ok | ok |
[ 0.000000] soft-safe-A + unsafe-B #1/231: ok | ok | ok |
[ 0.000000] hard-safe-A + unsafe-B #1/312: ok | ok | ok |
[ 0.000000] soft-safe-A + unsafe-B #1/312: ok | ok | ok |
[ 0.000000] hard-safe-A + unsafe-B #1/321: ok | ok | ok |
[ 0.000000] soft-safe-A + unsafe-B #1/321: ok | ok | ok |
[ 0.000000] hard-safe-A + unsafe-B #2/123: ok | ok | ok |
[ 0.000000] soft-safe-A + unsafe-B #2/123: ok | ok | ok |
[ 0.000000] hard-safe-A + unsafe-B #2/132: ok | ok | ok |
[ 0.000000] soft-safe-A + unsafe-B #2/132: ok | ok | ok |
[ 0.000000] hard-safe-A + unsafe-B #2/213: ok | ok | ok |
[ 0.000000] soft-safe-A + unsafe-B #2/213: ok | ok | ok |
[ 0.000000] hard-safe-A + unsafe-B #2/231: ok | ok | ok |
[ 0.000000] soft-safe-A + unsafe-B #2/231: ok | ok | ok |
[ 0.000000] hard-safe-A + unsafe-B #2/312: ok | ok | ok |
[ 0.000000] soft-safe-A + unsafe-B #2/312: ok | ok | ok |
[ 0.000000] hard-safe-A + unsafe-B #2/321: ok | ok | ok |
[ 0.000000] soft-safe-A + unsafe-B #2/321: ok | ok | ok |
[ 0.000000] hard-irq lock-inversion/123: ok | ok | ok |
[ 0.000000] soft-irq lock-inversion/123: ok | ok | ok |
[ 0.000000] hard-irq lock-inversion/132: ok | ok | ok |
[ 0.000000] soft-irq lock-inversion/132: ok | ok | ok |
[ 0.000000] hard-irq lock-inversion/213: ok | ok | ok |
[ 0.000000] soft-irq lock-inversion/213: ok | ok | ok |
[ 0.000000] hard-irq lock-inversion/231: ok | ok | ok |
[ 0.000000] soft-irq lock-inversion/231: ok | ok | ok |
[ 0.000000] hard-irq lock-inversion/312: ok | ok | ok |
[ 0.000000] soft-irq lock-inversion/312: ok | ok | ok |
[ 0.000000] hard-irq lock-inversion/321: ok | ok | ok |
[ 0.000000] soft-irq lock-inversion/321: ok | ok | ok |
[ 0.000000] hard-irq read-recursion/123: ok |
[ 0.000000] soft-irq read-recursion/123: ok |
[ 0.000000] hard-irq read-recursion/132: ok |
[ 0.000000] soft-irq read-recursion/132: ok |
[ 0.000000] hard-irq read-recursion/213: ok |
[ 0.000000] soft-irq read-recursion/213: ok |
[ 0.000000] hard-irq read-recursion/231: ok |
[ 0.000000] soft-irq read-recursion/231: ok |
[ 0.000000] hard-irq read-recursion/312: ok |
[ 0.000000] soft-irq read-recursion/312: ok |
[ 0.000000] hard-irq read-recursion/321: ok |
[ 0.000000] soft-irq read-recursion/321: ok |
[ 0.000000] --------------------------------------------------------------------------
[ 0.000000] | Wound/wait tests |
[ 0.000000] ---------------------
[ 0.000000] ww api failures: ok | ok | ok |
[ 0.000000] ww contexts mixing: ok | ok |
[ 0.000000] finishing ww context: ok | ok | ok | ok |
[ 0.000000] locking mismatches: ok | ok | ok |
[ 0.000000] EDEADLK handling: ok | ok | ok | ok | ok | ok | ok | ok | ok | ok |
[ 0.000000] spinlock nest unlocked: ok |
[ 0.000000] -----------------------------------------------------
[ 0.000000] |block | try |context|
[ 0.000000] -----------------------------------------------------
[ 0.000000] context: ok | ok | ok |
[ 0.000000] try: ok | ok | ok |
[ 0.000000] block: ok | ok | ok |
[ 0.000000] spinlock: ok | ok | ok |
[ 0.000000] -------------------------------------------------------
[ 0.000000] Good, all 253 testcases passed! |
[ 0.000000] ---------------------------------
[ 0.000000] hpet clockevent registered
[ 0.000000] tsc: Detected 2693.508 MHz processor
[ 0.020000] Calibrating delay loop (skipped) preset value.. 5387.01 BogoMIPS (lpj=26935080)
[ 0.020000] pid_max: default: 32768 minimum: 301
[ 0.020000] Mount-cache hash table entries: 512
[ 0.020000] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0
[ 0.020000] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0
[ 0.020000] tlb_flushall_shift: 6
[ 0.020000] CPU: Intel Common KVM processor (fam: 0f, model: 06, stepping: 01)
[ 0.022956] ACPI: Core revision 20130725
[ 0.033753] ACPI: All ACPI Tables successfully acquired
[ 0.034763] ACPI: setting ELCR to 0200 (from 0c00)
[ 0.035542] ftrace: allocating 23377 entries in 46 pages
[ 0.050381] Performance Events: unsupported Netburst CPU model 6 no PMU driver, software events only.
[ 0.060067] NMI watchdog: disabled (cpu0): hardware events not enabled
[ 0.064402] regulator-dummy: no parameters
[ 0.065415] NET: Registered protocol family 16
[ 0.067278] cpuidle: using governor ladder
[ 0.067735] cpuidle: using governor menu
[ 0.068404] ACPI: bus type PCI registered
[ 0.069307] PCI : PCI BIOS area is rw and x. Use pci=nobios if you want it NX.
[ 0.070013] PCI: PCI BIOS revision 2.10 entry at 0xfd4e3, last bus=0
[ 0.071070] PCI: Using configuration type 1 for base access
[ 0.089117] ACPI: Added _OSI(Module Device)
[ 0.089881] ACPI: Added _OSI(Processor Device)
[ 0.090012] ACPI: Added _OSI(3.0 _SCP Extensions)
[ 0.090631] ACPI: Added _OSI(Processor Aggregator Device)
[ 0.096178] ACPI: EC: Look up EC in DSDT
[ 0.115838] ACPI: Interpreter enabled
[ 0.116581] ACPI: (supports S0 S5)
[ 0.117112] ACPI: Using PIC for interrupt routing
[ 0.117834] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[ 0.151281] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[ 0.152335] acpi PNP0A03:00: Unable to request _OSC control (_OSC support mask: 0x08)
[ 0.154411] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ 0.156177] PCI host bridge to bus 0000:00
[ 0.156847] pci_bus 0000:00: root bus resource [bus 00-ff]
[ 0.157399] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7]
[ 0.158287] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff]
[ 0.159220] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff]
[ 0.160016] pci_bus 0000:00: root bus resource [mem 0x80000000-0xfebfffff]
[ 0.161196] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000
[ 0.163474] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100
[ 0.165825] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180
[ 0.170626] pci 0000:00:01.1: reg 0x20: [io 0xc060-0xc06f]
[ 0.174069] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000
[ 0.175269] pci 0000:00:01.3: quirk: [io 0xb000-0xb03f] claimed by PIIX4 ACPI
[ 0.176544] pci 0000:00:01.3: quirk: [io 0xb100-0xb10f] claimed by PIIX4 SMB
[ 0.178543] pci 0000:00:02.0: [1013:00b8] type 00 class 0x030000
[ 0.181660] pci 0000:00:02.0: reg 0x10: [mem 0xfc000000-0xfdffffff pref]
[ 0.190077] pci 0000:00:02.0: reg 0x14: [mem 0xfebe2000-0xfebe2fff]
[ 0.211824] pci 0000:00:02.0: reg 0x30: [mem 0xfebd0000-0xfebdffff pref]
[ 0.214279] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000
[ 0.216819] pci 0000:00:03.0: reg 0x10: [io 0xc040-0xc05f]
[ 0.222049] pci 0000:00:03.0: reg 0x14: [mem 0xfebe1000-0xfebe1fff]
[ 0.234052] pci 0000:00:03.0: reg 0x30: [mem 0xfebc0000-0xfebcffff pref]
[ 0.237266] pci 0000:00:04.0: [8086:100e] type 00 class 0x020000
[ 0.240938] pci 0000:00:04.0: reg 0x10: [mem 0xfeb80000-0xfeb9ffff]
[ 0.244141] pci 0000:00:04.0: reg 0x14: [io 0xc000-0xc03f]
[ 0.254919] pci 0000:00:04.0: reg 0x30: [mem 0xfeba0000-0xfebbffff pref]
[ 0.257620] pci 0000:00:05.0: [8086:25ab] type 00 class 0x088000
[ 0.259920] pci 0000:00:05.0: reg 0x10: [mem 0xfebe0000-0xfebe000f]
[ 0.267967] pci_bus 0000:00: on NUMA node 0
[ 0.274378] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)
[ 0.276511] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
[ 0.278551] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
[ 0.281169] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)
[ 0.282831] ACPI: PCI Interrupt Link [LNKS] (IRQs *9)
[ 0.286803] ACPI: Enabled 16 GPEs in block 00 to 0F
[ 0.287851] ACPI: \_SB_.PCI0: notify handler is installed
[ 0.289291] Found 1 acpi root devices
[ 0.292095] vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
[ 0.293693] vgaarb: loaded
[ 0.294274] vgaarb: bridge control possible 0000:00:02.0
[ 0.296221] ACPI: bus type USB registered
[ 0.297194] usbcore: registered new interface driver usbfs
[ 0.298419] usbcore: registered new interface driver hub
[ 0.299362] usbcore: registered new device driver usb
[ 0.300475] pps_core: LinuxPPS API ver. 1 registered
[ 0.301594] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <[email protected]>
[ 0.303433] PTP clock support registered
[ 0.304427] EDAC MC: Ver: 3.0.0
[ 0.305686] EDAC DEBUG: edac_mc_sysfs_init: device mc created
[ 0.307907] Advanced Linux Sound Architecture Driver Initialized.
[ 0.308508] PCI: Using ACPI for IRQ routing
[ 0.308981] PCI: pci_cache_line_size set to 64 bytes
[ 0.310078] e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff]
[ 0.310735] e820: reserve RAM buffer [mem 0x0fffe000-0x0fffffff]
[ 0.313883] Switched to clocksource kvm-clock
[ 0.316615] Warning: could not register annotated branches stats
[ 0.347872] pnp: PnP ACPI init
[ 0.348235] ACPI: bus type PNP registered
[ 0.348796] pnp 00:00: Plug and Play ACPI device, IDs PNP0b00 (active)
[ 0.349532] pnp 00:01: Plug and Play ACPI device, IDs PNP0303 (active)
[ 0.350357] pnp 00:02: Plug and Play ACPI device, IDs PNP0f13 (active)
[ 0.352097] pnp 00:03: [dma 2]
[ 0.352938] pnp 00:03: Plug and Play ACPI device, IDs PNP0700 (active)
[ 0.353730] pnp 00:04: Plug and Play ACPI device, IDs PNP0400 (active)
[ 0.355281] pnp 00:05: Plug and Play ACPI device, IDs PNP0501 (active)
[ 0.358842] pnp 00:06: Plug and Play ACPI device, IDs PNP0103 (active)
[ 0.360334] pnp: PnP ACPI: found 7 devices
[ 0.361242] ACPI: bus type PNP unregistered
[ 0.397904] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7]
[ 0.398452] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff]
[ 0.398969] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff]
[ 0.399547] pci_bus 0000:00: resource 7 [mem 0x80000000-0xfebfffff]
[ 0.400137] NET: Registered protocol family 1
[ 0.400616] pci 0000:00:00.0: Limiting direct PCI/PCI transfers
[ 0.401210] pci 0000:00:01.0: PIIX3: Enabling Passive Release
[ 0.401780] pci 0000:00:01.0: Activating ISA DMA hang workarounds
[ 0.402380] pci 0000:00:02.0: Boot video device
[ 0.402849] PCI: CLS 0 bytes, default 64
[ 0.403593] Unpacking initramfs...
[ 4.037222] debug: unmapping init [mem 0x8e73f000-0x8ffeffff]
[ 5.080498] DMA-API: preallocated 65536 debug entries
[ 5.081150] DMA-API: debugging enabled by kernel config
[ 5.085943] microcode: CPU0 sig=0xf61, pf=0x1, revision=0x1
[ 5.088639] microcode: Microcode Update Driver: v2.00 <[email protected]>, Peter Oruba
[ 5.090438] Scanning for low memory corruption every 60 seconds
[ 5.092318] cryptomgr_test (14) used greatest stack depth: 7244 bytes left
[ 5.095634] The force parameter has not been set to 1. The Iris poweroff handler will not be installed.
[ 5.097722] NatSemi SCx200 Driver
[ 5.106939] VFS: Disk quotas dquot_6.5.2
[ 5.107857] Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
[ 5.111720] jffs2: version 2.2. © 2001-2006 Red Hat, Inc.
[ 5.113153] ROMFS MTD (C) 2007 Red Hat, Inc.
[ 5.114072] fuse init (API version 7.22)
[ 5.117217] msgmni has been set to 402
[ 5.125805] Key type asymmetric registered
[ 5.126822] Asymmetric key parser 'x509' registered
[ 5.136605] list_sort_test: start testing list_sort()
[ 5.141321] crc32: CRC_LE_BITS = 32, CRC_BE BITS = 32
[ 5.142401] crc32: self tests passed, processed 225944 bytes in 637724 nsec
[ 5.144315] crc32c: CRC_LE_BITS = 32
[ 5.145010] crc32c: self tests passed, processed 225944 bytes in 141853 nsec
[ 5.146590] rbtree testing -> 12500 cycles
[ 5.698682] augmented rbtree testing -> 24366 cycles
[ 6.715342] tsc: Refined TSC clocksource calibration: 2693.464 MHz
[ 6.717936] no IO addresses supplied
[ 6.718461] hgafb: HGA card not detected.
[ 6.718854] hgafb: probe of hgafb.0 failed with error -22
[ 6.719562] usbcore: registered new interface driver udlfb
[ 6.720114] ipmi message handler version 39.2
[ 6.720535] ipmi device interface
[ 6.722655] IPMI System Interface driver.
[ 6.723154] ipmi_si: Adding default-specified kcs state machine
[ 6.723716] ipmi_si: Trying default-specified kcs state machine at i/o address 0xca2, slave address 0x0, irq 0
[ 6.724648] ipmi_si: Interface detection failed
[ 6.725083] ipmi_si: Adding default-specified smic state machine
[ 6.725647] ipmi_si: Trying default-specified smic state machine at i/o address 0xca9, slave address 0x0, irq 0
[ 6.726785] ipmi_si: Interface detection failed
[ 6.727203] ipmi_si: Adding default-specified bt state machine
[ 6.727907] ipmi_si: Trying default-specified bt state machine at i/o address 0xe4, slave address 0x0, irq 0
[ 6.729406] ipmi_si: Interface detection failed
[ 6.730062] ipmi_si: Unable to find any System Interface(s)
[ 6.730593] IPMI Watchdog: driver initialized
[ 6.730991] Copyright (C) 2004 MontaVista Software - IPMI Powerdown via sys_reboot.
[ 6.732068] IPMI poweroff: Unable to register powercycle sysctl
[ 6.733295] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[ 6.734592] ACPI: Power Button [PWRF]
[ 6.736427] r3964: Philips r3964 Driver $Revision: 1.10 $
[ 6.737171] Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled
[ 6.760425] 00:05: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[ 6.772174] lp: driver loaded but no devices found
[ 6.772838] DoubleTalk PC - not found
[ 6.773770] Non-volatile memory driver v1.3
[ 6.774655] toshiba: not a supported Toshiba laptop
[ 6.775966] ppdev: user-space parallel port driver
[ 6.777839] scx200_gpio: no SCx200 gpio present
[ 6.779303] platform pc8736x_gpio.0: NatSemi pc8736x GPIO Driver Initializing
[ 6.781027] platform pc8736x_gpio.0: no device found
[ 6.782029] nsc_gpio initializing
[ 6.782769] telclk_interrupt = 0xf non-mcpbl0010 hw.
[ 6.783853] smapi::smapi_init, ERROR invalid usSmapiID
[ 6.784860] mwave: tp3780i::tp3780I_InitializeBoardData: Error: SMAPI is not available on this machine
[ 6.787469] mwave: mwavedd::mwave_init: Error: Failed to initialize board data
[ 6.788739] mwave: mwavedd::mwave_init: Error: Failed to initialize
[ 6.789307] Hangcheck: starting hangcheck timer 0.9.1 (tick is 180 seconds, margin is 60 seconds).
[ 6.790493] Hangcheck: Using getrawmonotonic().
[ 6.792391] dummy-irq: no IRQ given. Use irq=N
[ 6.794921] usbcore: registered new interface driver viperboard
[ 6.799656] Failed to ioremap_nocache
[ 6.800616] slram: not enough parameters.
[ 6.835859] No valid DiskOnChip devices found
[ 6.837874] [nandsim] warning: read_byte: unexpected data output cycle, state is STATE_READY return 0x0
[ 6.839561] [nandsim] warning: read_byte: unexpected data output cycle, state is STATE_READY return 0x0
[ 6.841425] [nandsim] warning: read_byte: unexpected data output cycle, state is STATE_READY return 0x0
[ 6.843027] [nandsim] warning: read_byte: unexpected data output cycle, state is STATE_READY return 0x0
[ 6.844641] [nandsim] warning: read_byte: unexpected data output cycle, state is STATE_READY return 0x0
[ 6.846607] [nandsim] warning: read_byte: unexpected data output cycle, state is STATE_READY return 0x0
[ 6.848421] NAND device: Manufacturer ID: 0x98, Chip ID: 0x39 (Toshiba NAND 128MiB 1,8V 8-bit), 128MiB, page size: 512, OOB size: 16
[ 6.850970] flash size: 128 MiB
[ 6.851645] page size: 512 bytes
[ 6.852276] OOB area size: 16 bytes
[ 6.853007] sector size: 16 KiB
[ 6.853667] pages number: 262144
[ 6.854345] pages per sector: 32
[ 6.855024] bus width: 8
[ 6.855555] bits in sector size: 14
[ 6.855880] bits in page size: 9
[ 6.856382] bits in OOB size: 4
[ 6.856681] flash size with OOB: 135168 KiB
[ 6.857063] page address bytes: 4
[ 6.857369] sector address bytes: 3
[ 6.858084] options: 0x42
[ 6.861585] Scanning device for bad blocks
[ 6.928354] Creating 1 MTD partitions on "NAND 128MiB 1,8V 8-bit":
[ 6.928983] 0x000000000000-0x000008000000 : "NAND simulator partition 0"
[ 6.933140] fotg210_hcd: FOTG210 Host Controller (EHCI) Driver
[ 6.933804] usbcore: registered new interface driver cdc_wdm
[ 6.934363] usbcore: registered new interface driver mdc800
[ 6.934881] mdc800: v0.7.5 (30/10/2000):USB Driver for Mustek MDC800 Digital Camera
[ 6.938836] usbcore: registered new interface driver usbserial
[ 6.939449] usbcore: registered new interface driver aircable
[ 6.940069] usbserial: USB Serial support registered for aircable
[ 6.940900] usbcore: registered new interface driver belkin_sa
[ 6.942417] usbserial: USB Serial support registered for Belkin / Peracom / GoHubs USB Serial Adapter
[ 6.943755] usbcore: registered new interface driver ch341
[ 6.944319] usbserial: USB Serial support registered for ch341-uart
[ 6.944926] usbcore: registered new interface driver cyberjack
[ 6.945599] usbserial: USB Serial support registered for Reiner SCT Cyberjack USB card reader
[ 6.946888] usbcore: registered new interface driver usb_debug
[ 6.947601] usbserial: USB Serial support registered for debug
[ 6.948202] usbcore: registered new interface driver digi_acceleport
[ 6.949240] usbserial: USB Serial support registered for Digi 2 port USB adapter
[ 6.949950] usbserial: USB Serial support registered for Digi 4 port USB adapter
[ 6.950651] usbcore: registered new interface driver io_ti
[ 6.951255] usbserial: USB Serial support registered for Edgeport TI 1 port adapter
[ 6.952094] usbserial: USB Serial support registered for Edgeport TI 2 port adapter
[ 6.952909] usbcore: registered new interface driver f81232
[ 6.953448] usbserial: USB Serial support registered for f81232
[ 6.954221] usbcore: registered new interface driver ftdi_sio
[ 6.954999] usbserial: USB Serial support registered for FTDI USB Serial Device
[ 6.956307] usbcore: registered new interface driver ipaq
[ 6.956954] usbserial: USB Serial support registered for PocketPC PDA
[ 6.957642] usbcore: registered new interface driver ir_usb
[ 6.958262] usbserial: USB Serial support registered for IR Dongle
[ 6.959048] usbcore: registered new interface driver iuu_phoenix
[ 6.959625] usbserial: USB Serial support registered for iuu_phoenix
[ 6.960271] usbcore: registered new interface driver keyspan
[ 6.961145] usbserial: USB Serial support registered for Keyspan - (without firmware)
[ 6.962165] usbserial: USB Serial support registered for Keyspan 1 port adapter
[ 6.963371] usbserial: USB Serial support registered for Keyspan 2 port adapter
[ 6.964267] usbserial: USB Serial support registered for Keyspan 4 port adapter
[ 6.965995] usbcore: registered new interface driver kl5kusb105
[ 6.967858] usbserial: USB Serial support registered for KL5KUSB105D / PalmConnect
[ 6.971077] usbcore: registered new interface driver kobil_sct
[ 6.972422] usbserial: USB Serial support registered for KOBIL USB smart card terminal
[ 6.974546] usbcore: registered new interface driver mos7720
[ 6.975164] usbserial: USB Serial support registered for Moschip 2 port adapter
[ 6.975878] usbcore: registered new interface driver mos7840
[ 6.977411] usbserial: USB Serial support registered for Moschip 7840/7820 USB Serial Driver
[ 6.981304] usbcore: registered new interface driver navman
[ 6.982617] usbserial: USB Serial support registered for navman
[ 6.983311] usbcore: registered new interface driver omninet
[ 6.983855] usbserial: USB Serial support registered for ZyXEL - omni.net lcd plus usb
[ 6.985640] usbcore: registered new interface driver opticon
[ 6.986735] usbserial: USB Serial support registered for opticon
[ 6.990513] usbcore: registered new interface driver oti6858
[ 6.992070] usbserial: USB Serial support registered for oti6858
[ 6.992687] usbcore: registered new interface driver qcaux
[ 6.993360] usbserial: USB Serial support registered for qcaux
[ 6.994325] usbcore: registered new interface driver qcserial
[ 6.995046] usbserial: USB Serial support registered for Qualcomm USB modem
[ 6.998341] usbcore: registered new interface driver quatech2
[ 6.999933] usbserial: USB Serial support registered for Quatech 2nd gen USB to Serial Driver
[ 7.000758] usbcore: registered new interface driver safe_serial
[ 7.001503] usbserial: USB Serial support registered for safe_serial
[ 7.002777] usbcore: registered new interface driver sierra
[ 7.004519] usbserial: USB Serial support registered for Sierra USB modem
[ 7.008017] usbcore: registered new interface driver usb_serial_simple
[ 7.008722] usbserial: USB Serial support registered for zio
[ 7.009291] usbserial: USB Serial support registered for funsoft
[ 7.009929] usbserial: USB Serial support registered for flashloader
[ 7.010672] usbserial: USB Serial support registered for vivopay
[ 7.011616] usbserial: USB Serial support registered for moto_modem
[ 7.012365] usbserial: USB Serial support registered for hp4x
[ 7.012941] usbserial: USB Serial support registered for suunto
[ 7.014066] usbserial: USB Serial support registered for siemens_mpi
[ 7.015277] usbcore: registered new interface driver spcp8x5
[ 7.016693] usbserial: USB Serial support registered for SPCP8x5
[ 7.017729] usbcore: registered new interface driver symbolserial
[ 7.018690] usbserial: USB Serial support registered for symbol
[ 7.019315] usbcore: registered new interface driver visor
[ 7.020082] usbserial: USB Serial support registered for Handspring Visor / Palm OS
[ 7.020862] usbserial: USB Serial support registered for Sony Clie 5.0
[ 7.021490] usbserial: USB Serial support registered for Sony Clie 3.5
[ 7.024603] usbcore: registered new interface driver whiteheat
[ 7.025516] usbserial: USB Serial support registered for Connect Tech - WhiteHEAT - (prerenumeration)
[ 7.028060] usbserial: USB Serial support registered for Connect Tech - WhiteHEAT
[ 7.029654] usbcore: registered new interface driver keyspan_pda
[ 7.030675] usbserial: USB Serial support registered for Keyspan PDA
[ 7.031754] usbserial: USB Serial support registered for Xircom / Entregra PGS - (prerenumeration)
[ 7.035509] usbcore: registered new interface driver xsens_mt
[ 7.037315] usbserial: USB Serial support registered for xsens_mt
[ 7.038572] usbcore: registered new interface driver zte_ev
[ 7.040254] usbserial: USB Serial support registered for zte_ev
[ 7.041317] usbcore: registered new interface driver adutux
[ 7.042927] usbcore: registered new interface driver appledisplay
[ 7.044247] usbcore: registered new interface driver cytherm
[ 7.045644] usbcore: registered new interface driver emi26 - firmware loader
[ 7.047358] usbcore: registered new interface driver emi62 - firmware loader
[ 7.049752] usbcore: registered new interface driver idmouse
[ 7.051044] usbcore: registered new interface driver iowarrior
[ 7.051606] usbcore: registered new interface driver isight_firmware
[ 7.052732] usbcore: registered new interface driver usbled
[ 7.054223] usbcore: registered new interface driver rio500
[ 7.055721] usbcore: registered new interface driver trancevibrator
[ 7.057825] usbcore: registered new interface driver uss720
[ 7.058790] uss720: v0.6:USB Parport Cable driver for Cables using the Lucent Technologies USS720 Chip
[ 7.061093] uss720: NOTE: this is a special purpose driver to allow nonstandard
[ 7.062279] uss720: protocols (eg. bitbang) over USS720 usb to parallel cables
[ 7.062924] uss720: If you just want to connect to a printer, use usblp instead
[ 7.064435] usbcore: registered new interface driver usbsevseg
[ 7.067683] userial_init: registered 4 ttyGS* devices
[ 7.068486] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
[ 7.071996] serio: i8042 KBD port at 0x60,0x64 irq 1
[ 7.073187] serio: i8042 AUX port at 0x60,0x64 irq 12
[ 7.077874] usbcore: registered new interface driver appletouch
[ 7.078461] usbcore: registered new interface driver bcm5974
[ 7.079722] logibm.c: Didn't find Logitech busmouse at 0x23c
[ 7.085490] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1
[ 7.090318] usbcore: registered new interface driver xpad
[ 7.094526] usbcore: registered new interface driver ati_remote2
[ 7.095547] cm109: Keymap for Komunikate KIP1000 phone loaded
[ 7.103015] usbcore: registered new interface driver cm109
[ 7.104744] cm109: CM109 phone driver: 20080805 (C) Alfred E. Heggestad
[ 7.106135] usbcore: registered new interface driver ims_pcu
[ 7.112730] input: PC Speaker as /devices/platform/pcspkr/input/input2
[ 7.114002] usbcore: registered new interface driver powermate
[ 7.114959] wistron_btns: System unknown
[ 7.115359] ideapad_slidebar: DMI does not match
[ 7.115818] i2c /dev entries driver
[ 7.119698] i2c-parport-light: adapter type unspecified
[ 7.121505] usbcore: registered new interface driver i2c-tiny-usb
[ 7.125950] scx200_i2c: no SCx200 gpio pins available
[ 7.126718] pps_ldisc: PPS line discipline registered
[ 7.127184] pps_parport: parallel port PPS client
[ 7.127645] Driver for 1-wire Dallas network protocol.
[ 7.129758] usbcore: registered new interface driver DS9490R
[ 7.131783] 1-Wire driver for the DS2760 battery monitor chip - (c) 2004-2005, Szabolcs Gyurko
[ 7.136990] applesmc: supported laptop not found!
[ 7.137441] applesmc: driver init failed (ret=-19)!
[ 7.150470] intel_powerclamp: Intel powerclamp does not run on family 15 model 6
[ 7.152116] mixcomwd: No card detected, or port not available
[ 7.152815] usbcore: registered new interface driver pcwd_usb
[ 7.154245] acquirewdt: WDT driver for Acquire single board computer initialising
[ 7.155369] acquirewdt: I/O address 0x0043 already in use
[ 7.155953] acquirewdt: probe of acquirewdt failed with error -5
[ 7.158166] sc1200wdt: build 20020303
[ 7.161698] sc1200wdt: io parameter must be specified
[ 7.162908] pc87413_wdt: Version 1.1 at io 0x2E
[ 7.166079] pc87413_wdt: initialized. timeout=1 min
[ 7.167339] pc87413_wdt: cannot request SWC region at 0xffff
[ 7.169083] sbc8360: Timeout set at 60000 ms
[ 7.169810] w83627hf_wdt: WDT driver for the Winbond(TM) W83627HF/THF/HG/DHG Super I/O chip initialising
[ 7.171547] w83627hf_wdt: Watchdog already running. Resetting timeout to 60 sec
[ 7.172885] w83627hf_wdt: cannot register miscdev on minor=130 (err=-16)
[ 7.173890] w83697ug_wdt: WDT driver for the Winbond(TM) W83697UG/UF Super I/O chip initialising
[ 7.174782] w83697ug_wdt: No W83697UG/UF could be found
[ 7.175302] w83977f_wdt: driver v1.00
[ 7.176042] w83977f_wdt: cannot register miscdev on minor=130 (err=-16)
[ 7.177472] machzwd: MachZ ZF-Logic Watchdog driver initializing
[ 7.178627] machzwd: no ZF-Logic found
[ 7.179455] wbsd: Winbond W83L51xD SD/MMC card interface driver
[ 7.180528] wbsd: Copyright(c) Pierre Ossman
[ 7.181105] VUB300 Driver rom wait states = 1C irqpoll timeout = 0400
[ 7.185276] usbcore: registered new interface driver vub300
[ 7.187240] usbcore: registered new interface driver ushc
[ 7.193051] ledtrig-cpu: registered to indicate activity on CPUs
[ 7.197787] dcdbas dcdbas: Dell Systems Management Base Driver (version 5.6.0-3.2)
[ 7.212856] usbcore: registered new interface driver usbhid
[ 7.214049] usbhid: USB HID core driver
[ 7.216540] goldfish_pdev_bus goldfish_pdev_bus: unable to reserve Goldfish MMIO.
[ 7.217947] goldfish_pdev_bus: probe of goldfish_pdev_bus failed with error -16
[ 7.235804] fake-fmc-carrier: mezzanine 0
[ 7.236506] Manufacturer: fake-vendor
[ 7.237148] Product name: fake-design-for-testing
[ 7.238295] fmc fake-design-for-testing-f001: Driver has no ID: matches all
[ 7.239607] fmc_trivial: probe of fake-design-for-testing-f001 failed with error -95
[ 7.240862] fmc fake-design-for-testing-f001: Driver has no ID: matches all
[ 7.242270] fmc_chardev fake-design-for-testing-f001: Created misc device "fake-design-for-testing-f001"
[ 7.251115] usbcore: registered new interface driver snd-usb-audio
[ 7.252042] usbcore: registered new interface driver snd-ua101
[ 7.253244] usbcore: registered new interface driver snd-usb-usx2y
[ 7.254467] usbcore: registered new interface driver snd-usb-caiaq
[ 7.255764] usbcore: registered new interface driver snd-usb-6fire
[ 7.271905] ALSA device list:
[ 7.272233] No soundcards found.
[ 7.273917] debug: unmapping init [mem 0x81a9c000-0x81b0efff]
[ 7.275030] Write protecting the kernel text: 6116k
[ 7.275992] Write protecting the kernel read-only data: 2624k
[ 7.277371] NX-protecting the kernel data: 6172k
[ 7.330701] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 7.331718] IP: [< (null)>] (null)
[ 7.332189] *pdpt = 00000000072f0001 *pde = 0000000000000000
[ 7.332946] Oops: 0010 [#1] DEBUG_PAGEALLOC
[ 7.333507] CPU: 0 PID: 84 Comm: rc.local Not tainted 3.12.0-rc1-00081-g6bfa687 #1
[ 7.334828] task: 872fa000 ti: 872fc000 task.ti: 872fc000
[ 7.335776] EIP: 0060:[<00000000>] EFLAGS: 00010246 CPU: 0
[ 7.336128] EIP is at 0x0
[ 7.336128] EAX: 82078134 EBX: 872e5780 ECX: 00000000 EDX: 82078134
[ 7.336128] ESI: 872fa000 EDI: 872fa388 EBP: 872fdf9c ESP: 872fdf8c
[ 7.336128] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 7.336128] CR0: 8005003b CR2: 00000000 CR3: 072e6000 CR4: 000006b0
[ 7.336128] Stack:
[ 7.336128] 810545c9 00000001 77edff58 776efff4 872fdfac 81002358 00000000 77ef6903
[ 7.336128] 872fc000 815f74a0 00000000 00000000 00000000 00000000 00000000 00000000
[ 7.336128] 00000000 0000007b 0000007b 00000000 00000000 0000000b 777951d0 00000073
[ 7.336128] Call Trace:
[ 7.336128] [<810545c9>] ? task_work_run+0x79/0xb0
[ 7.336128] [<81002358>] do_notify_resume+0x58/0x70
[ 7.336128] [<815f74a0>] work_notifysig+0x2b/0x3b
[ 7.336128] Code: Bad EIP value.
[ 7.336128] EIP: [<00000000>] 0x0 SS:ESP 0068:872fdf8c
[ 7.336128] CR2: 0000000000000000
[ 7.350759] ---[ end trace c4767ad881866043 ]---
[ 7.362185] BUG: unable to handle kernel paging request at 01ce0060
[ 7.363460] IP: [<810545a4>] task_work_run+0x54/0xb0
[ 7.364454] *pdpt = 00000000072d6001 *pde = 0000000000000000
[ 7.365574] Oops: 0000 [#2] DEBUG_PAGEALLOC
[ 7.366102] CPU: 0 PID: 85 Comm: hostname Tainted: G D 3.12.0-rc1-00081-g6bfa687 #1
[ 7.366102] task: 872fe000 ti: 87300000 task.ti: 87300000
[ 7.366102] EIP: 0060:[<810545a4>] EFLAGS: 00010206 CPU: 0
[ 7.366102] EIP is at task_work_run+0x54/0xb0
[ 7.366102] EAX: 01ce0060 EBX: 872ef280 ECX: 00000000 EDX: 01ce0060
[ 7.366102] ESI: 872fe000 EDI: 872fe388 EBP: 87301f3c ESP: 87301f30
[ 7.366102] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 7.366102] CR0: 8005003b CR2: 01ce0060 CR3: 072d1000 CR4: 000006b0
[ 7.366102] Stack:
[ 7.366102] ffffffff 872e9580 872fe000 87301f8c 8103a03a 00000014 775fcfb8 8105b4ab
[ 7.366102] 00000000 87301fac 00000001 00000015 61636f6c 736f686c 6f6c2e74 872e95d8
[ 7.366102] 69616d6f 872e956e 872e95d8 00000000 00000000 872e9000 872fe000 87301fa4
[ 7.366102] Call Trace:
[ 7.366102] [<8103a03a>] do_exit+0x2aa/0x920
[ 7.366102] [<8105b4ab>] ? up_write+0x1b/0x30
[ 7.366102] [<8103a742>] do_group_exit+0x52/0xb0
[ 7.366102] [<8103a7b8>] SyS_exit_group+0x18/0x20
[ 7.366102] [<815f7a10>] sysenter_do_call+0x12/0x3c
[ 7.366102] Code: 36 31 c9 89 d0 0f b1 0f 39 c2 75 eb 85 d2 74 67 8d b4 26 00 00 00 00 f3 90 8b 86 c0 03 00 00 85 c0 74 f4 31 db eb 04 89 d3 89 c2 <8b> 02 89 1a 85 c0 75 f4 eb 16 66 90 f6 46 0c 04 74 c4 b9 04 f0
[ 7.366102] EIP: [<810545a4>] task_work_run+0x54/0xb0 SS:ESP 0068:87301f30
[ 7.366102] CR2: 0000000001ce0060
[ 7.394265] ---[ end trace c4767ad881866044 ]---
[ 7.395167] Fixing recursive fault but reboot is needed!

2013-10-07 18:47:43

by Linus Torvalds

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

On Sat, Oct 5, 2013 at 4:44 PM, Fengguang Wu <[email protected]> wrote:
>
> I got the below dmesg and the first bad commit is
>
> commit 0c44c2d0f459 ("x86: Use asm goto to implement better modify_and_test() functions"

Hmm. I'm looking at the final version of that patch, and I'm not
seeing anything wrong. It may trigger a compiler bug - there aren't
that many "asm goto" users, and using them for the bitops adds a lot
of new cases.

Your oops makes very little sense, it looks like task_work_run() just
called out to random crap, probably because the work was already
released, so "work->func()" ends up being bad. I'm adding Oleg to the
participants anyway, just in case there is some race. The comment says
that it can race with task_work_cancel() playing with *work. Oleg,
comments?

However, I don't see any actual bit-op code in task_work_run() itself,
so it's something else that got miscompiled and corrupted memory. In
that respect, the oops you have looks more like the oopses you got
with DEBUG_KOBJECT_RELEASE. Are you sure that wasn't set?

That said, Fengguang, can you try two things just to check:

- add "cc" to the clobbers list for the asm goto (technically it
should be on the non-asm-goto as well, but we never had that, and
maybe the fact that gcc always ends up testing a register afterwards
hides the need for the clobber).

So it would look like this in arch/x86/include/asm/rmwcc.h

#define __GEN_RMWcc(fullop, var, cc, ...) \
do { \
asm volatile goto (fullop "; j" cc " %l[cc_label]" \
: : "m" (var), ## __VA_ARGS__ \
: "memory", "cc" : cc_label); \
return 0; \
cc_label: \
return 1; \

(where that "cc" thing is new). I'm not sure if "cc" really matters on
x86 at all (it didn't use to, long long ago), but maybe it does these
days..

If that makes no difference, please just verify that the non-asm-goto
version works fine, by changing the

#ifdef CC_HAVE_ASM_GOTO

into a simple "#if 0" to disable the asm-goto version.

Linus

2013-10-08 07:52:14

by Fengguang Wu

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

Hi Linus,

On Mon, Oct 07, 2013 at 11:47:39AM -0700, Linus Torvalds wrote:
> On Sat, Oct 5, 2013 at 4:44 PM, Fengguang Wu <[email protected]> wrote:
> >
> > I got the below dmesg and the first bad commit is
> >
> > commit 0c44c2d0f459 ("x86: Use asm goto to implement better modify_and_test() functions"
>
> Hmm. I'm looking at the final version of that patch, and I'm not
> seeing anything wrong. It may trigger a compiler bug - there aren't
> that many "asm goto" users, and using them for the bitops adds a lot
> of new cases.
>
> Your oops makes very little sense, it looks like task_work_run() just
> called out to random crap, probably because the work was already
> released, so "work->func()" ends up being bad. I'm adding Oleg to the
> participants anyway, just in case there is some race. The comment says
> that it can race with task_work_cancel() playing with *work. Oleg,
> comments?
>
> However, I don't see any actual bit-op code in task_work_run() itself,
> so it's something else that got miscompiled and corrupted memory. In
> that respect, the oops you have looks more like the oopses you got
> with DEBUG_KOBJECT_RELEASE. Are you sure that wasn't set?

The options was set:

DEBUG_KOBJECT_RELEASE=y

I tried disabled it, and find the error still remains:

[ 9.719060] Write protecting the kernel text: 6116k
[ 9.720356] Write protecting the kernel read-only data: 2616k
[ 9.721586] NX-protecting the kernel data: 6172k
[ 9.750420] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 9.750870] IP: [< (null)>] (null)
[ 9.750870] *pdpt = 00000000072be001 *pde = 0000000000000000
[ 9.750870] Oops: 0010 [#1] DEBUG_PAGEALLOC
[ 9.750870] CPU: 0 PID: 84 Comm: rc.local Not tainted 3.12.0-rc1-00081-g6bfa687 #4
[ 9.750870] task: 872c4000 ti: 872c6000 task.ti: 872c6000
[ 9.750870] EIP: 0060:[<00000000>] EFLAGS: 00010246 CPU: 0
[ 9.750870] EIP is at 0x0
[ 9.750870] EAX: 82076134 EBX: 872b2780 ECX: 00000000 EDX: 82076134
[ 9.750870] ESI: 872c4000 EDI: 872c4388 EBP: 872c7f9c ESP: 872c7f8c
[ 9.750870] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 9.750870] CR0: 8005003b CR2: 00000000 CR3: 072bd000 CR4: 000006b0
[ 9.750870] Stack:
[ 9.750870] 810545b9 00000001 789ecf58 7767dff4 872c7fac 81002358 00000000 78a03903
[ 9.750870] 872c6000 815f6bd0 00000000 00000000 00000000 00000000 00000000 00000000
[ 9.750870] 00000000 0000007b 0000007b 00000000 00000000 0000000b 777d81d0 00000073
[ 9.750870] Call Trace:
[ 9.750870] [<810545b9>] ? task_work_run+0x79/0xb0
[ 9.750870] [<81002358>] do_notify_resume+0x58/0x70
[ 9.750870] [<815f6bd0>] work_notifysig+0x2b/0x3b
[ 9.750870] Code: Bad EIP value.
[ 9.750870] EIP: [<00000000>] 0x0 SS:ESP 0068:872c7f8c
[ 9.750870] CR2: 0000000000000000
[ 9.769399] ---[ end trace da54692b95c91495 ]---
[ 9.777566] BUG: unable to handle kernel paging request at 05140060
[ 9.778845] IP: [<81054594>] task_work_run+0x54/0xb0
[ 9.779774] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 9.780708] Oops: 0000 [#2] DEBUG_PAGEALLOC
[ 9.781431] CPU: 0 PID: 85 Comm: hostname Tainted: G D 3.12.0-rc1-00081-g6bfa687 #4
[ 9.781721] task: 872c8000 ti: 872ca000 task.ti: 872ca000
[ 9.781721] EIP: 0060:[<81054594>] EFLAGS: 00010206 CPU: 0
[ 9.781721] EIP is at task_work_run+0x54/0xb0
[ 9.781721] EAX: 05140060 EBX: 8729b900 ECX: 00000000 EDX: 05140060
[ 9.781721] ESI: 872c8000 EDI: 872c8388 EBP: 872cbf3c ESP: 872cbf30
[ 9.781721] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 9.781721] CR0: 8005003b CR2: 05140060 CR3: 072cc000 CR4: 000006b0
[ 9.781721] Stack:
[ 9.781721] ffffffff 872af400 872c8000 872cbf8c 8103a02a 00000014 776cefb8 8105b49b
[ 9.781721] 00000000 872cbfac 00000001 00000015 61636f6c 736f686c 6f6c2e74 872af458
[ 9.781721] 69616d6f 872af46e 872af458 00000000 00000000 872ae980 872c8000 872cbfa4
[ 9.781721] Call Trace:
[ 9.781721] [<8103a02a>] do_exit+0x2aa/0x920
[ 9.781721] [<8105b49b>] ? up_write+0x1b/0x30
[ 9.781721] [<8103a732>] do_group_exit+0x52/0xb0
[ 9.781721] [<8103a7a8>] SyS_exit_group+0x18/0x20
[ 9.781721] [<815f7130>] sysenter_do_call+0x12/0x3c
[ 9.781721] Code: 36 31 c9 89 d0 0f b1 0f 39 c2 75 eb 85 d2 74 67 8d b4 26 00 00 00 00 f3 90 8b 86 c0 03 00 00 85 c0 74 f4 31 db eb 04 89 d3 89 c2 <8b> 02 89 1a 85 c0 75 f4 eb 16 66 90 f6 46 0c 04 74 c4 b9 04 d0
[ 9.781721] EIP: [<81054594>] task_work_run+0x54/0xb0 SS:ESP 0068:872cbf30
[ 9.781721] CR2: 0000000005140060
[ 9.802246] ---[ end trace da54692b95c91496 ]---
[ 9.802881] Fixing recursive fault but reboot is needed!
[ 9.811986] BUG: unable to handle kernel paging request at 0805a000
[ 9.812911] IP: [<81054594>] task_work_run+0x54/0xb0
[ 9.813683] *pdpt = 00000000072e2001 *pde = 00000000072cf067 *pte = 0000000000000000
[ 9.815024] Oops: 0000 [#3] DEBUG_PAGEALLOC
[ 9.815623] CPU: 0 PID: 86 Comm: plymouthd Tainted: G D 3.12.0-rc1-00081-g6bfa687 #4
[ 9.816819] task: 872da000 ti: 872dc000 task.ti: 872dc000
[ 9.817617] EIP: 0060:[<81054594>] EFLAGS: 00010206 CPU: 0
[ 9.818394] EIP is at task_work_run+0x54/0xb0
[ 9.819000] EAX: 0805a000 EBX: 872d3060 ECX: 00000000 EDX: 0805a000
[ 9.819864] ESI: 872da000 EDI: 872da388 EBP: 872ddf3c ESP: 872ddf30
[ 9.820769] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 9.820908] CR0: 8005003b CR2: 0805a000 CR3: 072b8000 CR4: 000006b0
[ 9.820908] Stack:
[ 9.820908] 00000001 00000405 00000000 872ddf4c 8104738c 872da000 00000001 872ddf94
[ 9.820908] 810fb04b 00000002 00000001 00000000 810faf3a 872b92d8 872b9280 00000056
[ 9.820908] 00000001 872d3408 00000056 085c82a8 00000000 872da214 00000000 872d2000
[ 9.820908] Call Trace:
[ 9.820908] [<8104738c>] ptrace_notify+0x5c/0xa0
[ 9.820908] [<810fb04b>] do_execve+0x5fb/0x6f0
[ 9.820908] [<810faf3a>] ? do_execve+0x4ea/0x6f0
[ 9.820908] [<810fb37c>] SyS_execve+0x5c/0x70
[ 9.820908] [<815f7130>] sysenter_do_call+0x12/0x3c
[ 9.820908] Code: 36 31 c9 89 d0 0f b1 0f 39 c2 75 eb 85 d2 74 67 8d b4 26 00 00 00 00 f3 90 8b 86 c0 03 00 00 85 c0 74 f4 31 db eb 04 89 d3 89 c2 <8b> 02 89 1a 85 c0 75 f4 eb 16 66 90 f6 46 0c 04 74 c4 b9 04 d0
[ 9.820908] EIP: [<81054594>] task_work_run+0x54/0xb0 SS:ESP 0068:872ddf30
[ 9.820908] CR2: 000000000805a000
[ 9.836265] ---[ end trace da54692b95c91497 ]---
[ 9.842439] BUG: unable to handle kernel paging request at 02c00060
[ 9.843426] IP: [<81054594>] task_work_run+0x54/0xb0
[ 9.844709] *pdpt = 00000000072c1001 *pde = 0000000000000000

> That said, Fengguang, can you try two things just to check:
>
> - add "cc" to the clobbers list for the asm goto (technically it
> should be on the non-asm-goto as well, but we never had that, and
> maybe the fact that gcc always ends up testing a register afterwards
> hides the need for the clobber).
>
> So it would look like this in arch/x86/include/asm/rmwcc.h
>
> #define __GEN_RMWcc(fullop, var, cc, ...) \
> do { \
> asm volatile goto (fullop "; j" cc " %l[cc_label]" \
> : : "m" (var), ## __VA_ARGS__ \
> : "memory", "cc" : cc_label); \
> return 0; \
> cc_label: \
> return 1; \
>
> (where that "cc" thing is new). I'm not sure if "cc" really matters on
> x86 at all (it didn't use to, long long ago), but maybe it does these
> days..

Tests show that it makes no difference by adding the "cc" this way:

- : "memory" : cc_label); \
+ : "memory", "cc" : cc_label); \

> If that makes no difference, please just verify that the non-asm-goto
> version works fine, by changing the
>
> #ifdef CC_HAVE_ASM_GOTO
>
> into a simple "#if 0" to disable the asm-goto version.

Yeah, this will quiet the oops messages:

-#ifdef CC_HAVE_ASM_GOTO
+#if 0

#define __GEN_RMWcc(fullop, var, cc, ...) \

Thanks,
Fengguang

2013-10-08 14:41:07

by Oleg Nesterov

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

I'll try to find other messages to understand what you are talking
about, just one note for now....

On 10/07, Linus Torvalds wrote:
>
> Your oops makes very little sense, it looks like task_work_run() just
> called out to random crap, probably because the work was already
> released, so "work->func()" ends up being bad.

Or task_work_run() can hit work->func == NULL if do_exit() is called
twice if, say, the task does BUG() after exit_task_work().

> participants anyway, just in case there is some race. The comment says
> that it can race with task_work_cancel() playing with *work. Oleg,
> comments?

The comment tries to say that if we are racing with task_work_cancel()
it can't delete the first entry == work, we won the race, its
cmpxchg(task->task_works) should fail.

Howver, task_work_cancel() can delete one of the next entries and
change, say, work->next. And we need to wait anyway if it scans this
list.

I'll try to recheck, but so far I do not see anything wrong.

Oleg.

2013-10-08 16:21:55

by Linus Torvalds

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

[ Richard and Jakub added to cc, they can perhaps help or at least
point us to the right gcc person.

Richard, Jakub, the bug is triggered by kernel commit 0c44c2d0f459
(not yet merged), see:

http://git.kernel.org/cgit/linux/kernel/git/tip/tip.git/commit/?id=0c44c2d0f459cd7e275242b72f500137c4fa834d

for the patch. The actual inline asm is pretty dang small, and the
non-asm-goto version works fine. Can you take a look? ]

On Tue, Oct 8, 2013 at 12:51 AM, Fengguang Wu <[email protected]> wrote:
> [ 9.844709] *pdpt = 00000000072c1001 *pde = 0000000000000000
>
>> That said, Fengguang, can you try two things just to check:
>>
>> - add "cc" to the clobbers list for the asm goto (technically it
>> should be on the non-asm-goto as well, but we never had that, and
>> maybe the fact that gcc always ends up testing a register afterwards
>> hides the need for the clobber).
>>
>> So it would look like this in arch/x86/include/asm/rmwcc.h
>>
>> #define __GEN_RMWcc(fullop, var, cc, ...) \
>> do { \
>> asm volatile goto (fullop "; j" cc " %l[cc_label]" \
>> : : "m" (var), ## __VA_ARGS__ \
>> : "memory", "cc" : cc_label); \
>> return 0; \
>> cc_label: \
>> return 1; \
>>
>> (where that "cc" thing is new). I'm not sure if "cc" really matters on
>> x86 at all (it didn't use to, long long ago), but maybe it does these
>> days..
>
> Tests show that it makes no difference by adding the "cc" this way:
>
> - : "memory" : cc_label); \
> + : "memory", "cc" : cc_label); \

Ok, that was a long shot, I don't think gcc actually ever assumes cc
is live over an asm on x86.

>> If that makes no difference, please just verify that the non-asm-goto
>> version works fine, by changing the
>>
>> #ifdef CC_HAVE_ASM_GOTO
>>
>> into a simple "#if 0" to disable the asm-goto version.
>
> Yeah, this will quiet the oops messages:
>
> -#ifdef CC_HAVE_ASM_GOTO
> +#if 0

Ok. So it looks very much like "asm goto()" is simply buggered. Too
bad, since it generated nice clear code.

I suspect it's the memory clobber - maybe it only marks memory as
clobbered for the fallthrough case, and the actual "goto" case might
used old cached values? What do I know, it's just a theory.

We do have "asm goto" with memory clobbers elsewhere (our x86 version
of __mutex_fastpath_lock()), but that use is very limited and only
gets expanded in a single place. The new bitop cases get expanded
*everywhere*, so if there is something subtly wrong wrt code
generation that requires some particular pattern, they'd trigger it
much more easily.

Anybody have any ideas?

Linus

2013-10-08 16:54:12

by Oleg Nesterov

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

On 10/08, Fengguang Wu wrote:
>
> Yeah, this will quiet the oops messages:
>
> -#ifdef CC_HAVE_ASM_GOTO
> +#if 0

Can't understand how this can affect task_work.c...

Well, task_work_add() does test_and_set_bit(), so that patch actually
changes this code, but still I can't see how this can lead to these
OOPSes.

Fengguang, I do not think this will help, but just in case. Could you
show the result of

$ kernel/task_work.s

?

Oleg.

2013-10-08 17:15:40

by Fengguang Wu

[permalink] [raw]
Subject: [x86] BUG: unable to handle kernel NULL pointer dereference at (null)

Hi all,

I managed to find and bisect down some more different call traces to
the same commit 0c44c2d0f ("x86: Use asm goto to implement better
modify_and_test() functions"). Hope this helps.

The below dmesg chunks represent 25 bad kernel boots. This is an very
reproducible bug: this kernel has no good boots at all.

The kernel is compiled from 0c44c2d0f with kconfig
i386-randconfig-r8-1005 (attached). Also attached one full dmesg and
the bisect log.

dmesg-quantal-ant-2:20131009002432:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:391

[ 27.865422] ------------[ cut here ]------------
[ 27.865982] Kernel BUG at c10563af [verbose debug info unavailable]
[ 27.866625] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 27.867363] Modules linked in:
[ 27.867363] CPU: 0 PID: 40 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #391
[ 27.867363] task: c6c33420 ti: c6d44000 task.ti: c6d44000
[ 27.867363] EIP: 0060:[<c10563af>] EFLAGS: 00000202 CPU: 0
[ 27.867363] EIP is at __put_cred+0x2f/0x90
[ 27.867363] EAX: c14bb720 EBX: c6d28380 ECX: 00000000 EDX: 00000001
[ 27.867363] ESI: c6c33420 EDI: 00000001 EBP: c6d45f24 ESP: c6d45f18
[ 27.867363] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 27.867363] CR0: 8005003b CR2: b768d000 CR3: 06d57000 CR4: 000006b0
[ 27.867363] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
[ 27.867363] DR6: 00000000 DR7: 00000000
[ 27.867363] Stack:
[ 27.867363] c6d27000 c6c336b8 c6c33420 c6d45f30 c110a408 c6d27f00 c6d45f44 c104d499
[ 27.867363] c6c336d0 c6d1c480 c6c33420 c6d45f8c c1031202 c6d44000 c6c33420 c1075fab
[ 27.867363] c6d45f78 00000001 00000100 00000000 00000046 00000030 c6d1c4d0 c6c33420
[ 27.867363] Call Trace:
[ 27.867363] [<c110a408>] file_free_rcu+0x28/0x40
[ 27.867363] [<c104d499>] task_work_run+0x79/0xa0
[ 27.867363] [<c1031202>] do_exit+0x2f2/0x950
[ 27.867363] [<c1075fab>] ? trace_hardirqs_off+0xb/0x10
[ 27.867363] [<c10327ea>] do_group_exit+0x4a/0xa0
[ 27.867363] [<c1032858>] SyS_exit_group+0x18/0x20
[ 27.867363] [<c130ee30>] sysenter_do_call+0x12/0x3c
[ 27.867363] Code: 56 53 e8 35 8f 2b 00 89 c3 8b 00 8b 03 85 c0 0f 95 c0 25 ff 00 00 00 89 c6 31 c9 89 c2 b8 34 b7 4b c1 e8 25 1a 05 00 85 f6 74 02 <0f> 0b 8b 35 88 d7 46 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7
[ 27.867363] EIP: [<c10563af>] __put_cred+0x2f/0x90 SS:ESP 0068:c6d45f18
[ 27.891948] ---[ end trace f04df4e1fba40cb1 ]---
[ 27.892595] Fixing recursive fault but reboot is needed!

dmesg-quantal-ant-9:20131009002506:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:391

[ 27.856676] debug: unmapping init [mem 0xc14d7000-0xc151bfff]
[ 28.193490] ------------[ cut here ]------------
[ 28.194993] WARNING: CPU: 0 PID: 39 at lib/list_debug.c:36 __list_add+0x141/0x180()
[ 28.195809] list_add double add: new=c6d1e368, prev=c6d58324, next=c6d1e368.
[ 28.196480] Modules linked in:
[ 28.197809] CPU: 0 PID: 39 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #391
[ 28.199056] c141a43f c6d43d10 c1301315 c6d43d40 c10304aa c141af68 c6d43d6c 00000027
[ 28.201674] c141a43f 00000024 c11a08c1 c11a08c1 c6d58324 c6d1e368 c6d1e368 c6d43d58
[ 28.203312] c1030503 00000009 c6d43d50 c141af68 c6d43d6c c6d43d8c c11a08c1 c141a43f
[ 28.205715] Call Trace:
[ 28.206656] [<c1301315>] dump_stack+0x16/0x18
[ 28.208033] [<c10304aa>] warn_slowpath_common+0x7a/0xa0
[ 28.208966] [<c11a08c1>] ? __list_add+0x141/0x180
[ 28.209759] [<c11a08c1>] ? __list_add+0x141/0x180
[ 28.211208] [<c1030503>] warn_slowpath_fmt+0x33/0x40
[ 28.212113] [<c11a08c1>] __list_add+0x141/0x180
[ 28.212949] [<c11fd745>] tty_add_file+0x35/0x50
[ 28.213881] [<c11ff526>] tty_open+0x1b6/0x7f0
[ 28.215102] [<c110cfae>] chrdev_open+0x6e/0x170
[ 28.215897] [<c110cf40>] ? exact_lock+0x20/0x20
[ 28.216694] [<c1106f31>] do_dentry_open+0x2d1/0x370
[ 28.218077] [<c110cf40>] ? exact_lock+0x20/0x20
[ 28.218911] [<c1107019>] finish_open+0x49/0x60
[ 28.219690] [<c1119308>] do_last.isra.27+0xa88/0x10b0
[ 28.221002] [<c1114d92>] ? link_path_walk+0x122/0x1010
[ 28.221890] [<c1114a0d>] ? path_init+0x34d/0x5b0
[ 28.222714] [<c1119b8c>] path_openat+0x25c/0x770
[ 28.223522] [<c111a774>] do_filp_open+0x34/0xb0
[ 28.224851] [<c110847d>] do_sys_open+0x19d/0x250
[ 28.225661] [<c1307a7e>] ? restore_all+0xf/0xf
[ 28.226408] [<c1108552>] SyS_open+0x22/0x30
[ 28.227668] [<c130ee30>] sysenter_do_call+0x12/0x3c
[ 28.228719] ---[ end trace 080224f174f53ed2 ]---
[ 52.287137] BUG: soft lockup - CPU#0 stuck for 22s! [modprobe:39]

dmesg-quantal-athens-19:20131009003413:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:391

[ 1.490835] ------------[ cut here ]------------
[ 1.491578] Kernel BUG at c10563af [verbose debug info unavailable]
[ 1.492534] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 1.493063] Modules linked in:
[ 1.493063] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #391
[ 1.493063] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 1.493063] EIP: 0060:[<c10563af>] EFLAGS: 00010202 CPU: 0
[ 1.493063] EIP is at __put_cred+0x2f/0x90
[ 1.493063] EAX: c14bb720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 1.493063] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 1.493063] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.493063] CR0: 8005003b CR2: b7756000 CR3: 06d1e000 CR4: 000006b0
[ 1.493063] Stack:
[ 1.493063] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a408 c006ed00 c6d1bf44 c104d499
[ 1.493063] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c1031202 00000000 c6d1bf80 c110a636
[ 1.493063] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 1.493063] Call Trace:
[ 1.493063] [<c110a408>] file_free_rcu+0x28/0x40
[ 1.493063] [<c104d499>] task_work_run+0x79/0xa0
[ 1.493063] [<c1031202>] do_exit+0x2f2/0x950
[ 1.493063] [<c110a636>] ? __fput+0x216/0x380
[ 1.493063] [<c10327ea>] do_group_exit+0x4a/0xa0
[ 1.493063] [<c1032858>] SyS_exit_group+0x18/0x20
[ 1.493063] [<c130ee30>] sysenter_do_call+0x12/0x3c
[ 1.493063] Code: 56 53 e8 35 8f 2b 00 89 c3 8b 00 8b 03 85 c0 0f 95 c0 25 ff 00 00 00 89 c6 31 c9 89 c2 b8 34 b7 4b c1 e8 25 1a 05 00 85 f6 74 02 <0f> 0b 8b 35 88 d7 46 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7
[ 1.493063] EIP: [<c10563af>] __put_cred+0x2f/0x90 SS:ESP 0068:c6d1bf18
[ 1.511493] ---[ end trace d0b4907160520dd2 ]---
[ 1.512226] Fixing recursive fault but reboot is needed!

dmesg-quantal-cairo-12:20131009003424:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:391

[ 1.666630] ------------[ cut here ]------------
[ 1.667251] Kernel BUG at c10563af [verbose debug info unavailable]
[ 1.668098] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 1.668885] Modules linked in:
[ 1.669147] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #391
[ 1.669147] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 1.669147] EIP: 0060:[<c10563af>] EFLAGS: 00010202 CPU: 0
[ 1.669147] EIP is at __put_cred+0x2f/0x90
[ 1.669147] EAX: c14bb720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 1.669147] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 1.669147] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.669147] CR0: 8005003b CR2: b773d000 CR3: 06d1e000 CR4: 000006b0
[ 1.669147] Stack:
[ 1.669147] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a408 c006ed00 c6d1bf44 c104d499
[ 1.669147] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c1031202 00000000 c6d1bf80 c110a636
[ 1.669147] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 1.669147] Call Trace:
[ 1.669147] [<c110a408>] file_free_rcu+0x28/0x40
[ 1.669147] [<c104d499>] task_work_run+0x79/0xa0
[ 1.669147] [<c1031202>] do_exit+0x2f2/0x950
[ 1.669147] [<c110a636>] ? __fput+0x216/0x380
[ 1.669147] [<c10327ea>] do_group_exit+0x4a/0xa0
[ 1.669147] [<c1032858>] SyS_exit_group+0x18/0x20
[ 1.669147] [<c130ee30>] sysenter_do_call+0x12/0x3c
[ 1.669147] Code: 56 53 e8 35 8f 2b 00 89 c3 8b 00 8b 03 85 c0 0f 95 c0 25 ff 00 00 00 89 c6 31 c9 89 c2 b8 34 b7 4b c1 e8 25 1a 05 00 85 f6 74 02 <0f> 0b 8b 35 88 d7 46 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7
[ 1.669147] EIP: [<c10563af>] __put_cred+0x2f/0x90 SS:ESP 0068:c6d1bf18
[ 1.687323] ---[ end trace 0d9dbb73e2934b28 ]---
[ 1.687769] Fixing recursive fault but reboot is needed!

dmesg-quantal-cairo-23:20131009003413:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:391

[ 1.660398] ------------[ cut here ]------------
[ 1.661181] Kernel BUG at c10563af [verbose debug info unavailable]
[ 1.662218] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 1.663116] Modules linked in:
[ 1.663358] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #391
[ 1.663358] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 1.663358] EIP: 0060:[<c10563af>] EFLAGS: 00010202 CPU: 0
[ 1.663358] EIP is at __put_cred+0x2f/0x90
[ 1.663358] EAX: c14bb720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 1.663358] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 1.663358] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.663358] CR0: 8005003b CR2: b76ee000 CR3: 06d1e000 CR4: 000006b0
[ 1.663358] Stack:
[ 1.663358] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a408 c006ed00 c6d1bf44 c104d499
[ 1.663358] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c1031202 00000000 c6d1bf80 c110a636
[ 1.663358] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 1.663358] Call Trace:
[ 1.663358] [<c110a408>] file_free_rcu+0x28/0x40
[ 1.663358] [<c104d499>] task_work_run+0x79/0xa0
[ 1.663358] [<c1031202>] do_exit+0x2f2/0x950
[ 1.663358] [<c110a636>] ? __fput+0x216/0x380
[ 1.663358] [<c10327ea>] do_group_exit+0x4a/0xa0
[ 1.663358] [<c1032858>] SyS_exit_group+0x18/0x20
[ 1.663358] [<c130ee30>] sysenter_do_call+0x12/0x3c
[ 1.663358] Code: 56 53 e8 35 8f 2b 00 89 c3 8b 00 8b 03 85 c0 0f 95 c0 25 ff 00 00 00 89 c6 31 c9 89 c2 b8 34 b7 4b c1 e8 25 1a 05 00 85 f6 74 02 <0f> 0b 8b 35 88 d7 46 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7
[ 1.663358] EIP: [<c10563af>] __put_cred+0x2f/0x90 SS:ESP 0068:c6d1bf18
[ 1.688713] ---[ end trace 09588e96c335cb0f ]---
[ 1.689507] Fixing recursive fault but reboot is needed!

dmesg-quantal-jaketown-31:20131009003413:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:391

[ 3.623281] ------------[ cut here ]------------
[ 3.624356] Kernel BUG at c10563af [verbose debug info unavailable]
[ 3.624356] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 3.624356] Modules linked in:
[ 3.624356] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #391
[ 3.624356] task: c6c2a2c0 ti: c6d16000 task.ti: c6d16000
[ 3.624356] EIP: 0060:[<c10563af>] EFLAGS: 00010202 CPU: 0
[ 3.624356] EIP is at __put_cred+0x2f/0x90
[ 3.624356] EAX: c14bb720 EBX: c6d11080 ECX: 00000000 EDX: 00000001
[ 3.624356] ESI: c6c2a2c0 EDI: 00000001 EBP: c6d17f24 ESP: c6d17f18
[ 3.624356] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 3.624356] CR0: 8005003b CR2: b77db000 CR3: 06d12000 CR4: 000006b0
[ 3.624356] Stack:
[ 3.624356] c006ee00 c6c2a558 c6c2a2c0 c6d17f30 c110a408 c006ed00 c6d17f44 c104d499
[ 3.624356] c6c2a570 c6d18000 c6c2a2c0 c6d17f8c c1031202 00000000 c6d17f80 c110a636
[ 3.624356] 00000001 00000001 00000000 00000246 00000001 c6c2a558 c6d18050 c6c2a2c0
[ 3.624356] Call Trace:
[ 3.624356] [<c110a408>] file_free_rcu+0x28/0x40
[ 3.624356] [<c104d499>] task_work_run+0x79/0xa0
[ 3.624356] [<c1031202>] do_exit+0x2f2/0x950
[ 3.624356] [<c110a636>] ? __fput+0x216/0x380
[ 3.624356] [<c10327ea>] do_group_exit+0x4a/0xa0
[ 3.624356] [<c1032858>] SyS_exit_group+0x18/0x20
[ 3.624356] [<c130ee30>] sysenter_do_call+0x12/0x3c
[ 3.624356] Code: 56 53 e8 35 8f 2b 00 89 c3 8b 00 8b 03 85 c0 0f 95 c0 25 ff 00 00 00 89 c6 31 c9 89 c2 b8 34 b7 4b c1 e8 25 1a 05 00 85 f6 74 02 <0f> 0b 8b 35 88 d7 46 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7
[ 3.624356] EIP: [<c10563af>] __put_cred+0x2f/0x90 SS:ESP 0068:c6d17f18
[ 3.698673] ---[ end trace 1b998c263f6d23dd ]---
[ 3.700715] Fixing recursive fault but reboot is needed!

dmesg-quantal-lkp-st01-11:20131009003427:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:391

[ 2.203638] ------------[ cut here ]------------
[ 2.204376] Kernel BUG at c10563af [verbose debug info unavailable]
[ 2.205357] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 2.206198] Modules linked in:
[ 2.206708] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #391
[ 2.206795] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 2.206795] EIP: 0060:[<c10563af>] EFLAGS: 00010202 CPU: 0
[ 2.206795] EIP is at __put_cred+0x2f/0x90
[ 2.206795] EAX: c14bb720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 2.206795] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 2.206795] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 2.206795] CR0: 8005003b CR2: b77cc000 CR3: 06d1e000 CR4: 000006b0
[ 2.206795] Stack:
[ 2.206795] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a408 c006ed00 c6d1bf44 c104d499
[ 2.206795] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c1031202 00000000 c6d1bf80 c110a636
[ 2.206795] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 2.206795] Call Trace:
[ 2.206795] [<c110a408>] file_free_rcu+0x28/0x40
[ 2.206795] [<c104d499>] task_work_run+0x79/0xa0
[ 2.206795] [<c1031202>] do_exit+0x2f2/0x950
[ 2.206795] [<c110a636>] ? __fput+0x216/0x380
[ 2.206795] [<c10327ea>] do_group_exit+0x4a/0xa0
[ 2.206795] [<c1032858>] SyS_exit_group+0x18/0x20
[ 2.206795] [<c130ee30>] sysenter_do_call+0x12/0x3c
[ 2.206795] Code: 56 53 e8 35 8f 2b 00 89 c3 8b 00 8b 03 85 c0 0f 95 c0 25 ff 00 00 00 89 c6 31 c9 89 c2 b8 34 b7 4b c1 e8 25 1a 05 00 85 f6 74 02 <0f> 0b 8b 35 88 d7 46 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7
[ 2.206795] EIP: [<c10563af>] __put_cred+0x2f/0x90 SS:ESP 0068:c6d1bf18
[ 2.229464] ---[ end trace 923a2748b0895c86 ]---
[ 2.230243] Fixing recursive fault but reboot is needed!

dmesg-quantal-lkp-st01-9:20131009003354:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:391

[ 2.198579] ------------[ cut here ]------------
[ 2.199309] Kernel BUG at c10563af [verbose debug info unavailable]
[ 2.200292] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 2.200773] Modules linked in:
[ 2.200773] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #391
[ 2.200773] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 2.200773] EIP: 0060:[<c10563af>] EFLAGS: 00010202 CPU: 0
[ 2.200773] EIP is at __put_cred+0x2f/0x90
[ 2.200773] EAX: c14bb720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 2.200773] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 2.200773] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 2.200773] CR0: 8005003b CR2: b7762000 CR3: 06d1e000 CR4: 000006b0
[ 2.200773] Stack:
[ 2.200773] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a408 c006ed00 c6d1bf44 c104d499
[ 2.200773] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c1031202 00000000 c6d1bf80 c110a636
[ 2.200773] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 2.200773] Call Trace:
[ 2.200773] [<c110a408>] file_free_rcu+0x28/0x40
[ 2.200773] [<c104d499>] task_work_run+0x79/0xa0
[ 2.200773] [<c1031202>] do_exit+0x2f2/0x950
[ 2.200773] [<c110a636>] ? __fput+0x216/0x380
[ 2.200773] [<c10327ea>] do_group_exit+0x4a/0xa0
[ 2.200773] [<c1032858>] SyS_exit_group+0x18/0x20
[ 2.200773] [<c130ee30>] sysenter_do_call+0x12/0x3c
[ 2.200773] Code: 56 53 e8 35 8f 2b 00 89 c3 8b 00 8b 03 85 c0 0f 95 c0 25 ff 00 00 00 89 c6 31 c9 89 c2 b8 34 b7 4b c1 e8 25 1a 05 00 85 f6 74 02 <0f> 0b 8b 35 88 d7 46 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7
[ 2.200773] EIP: [<c10563af>] __put_cred+0x2f/0x90 SS:ESP 0068:c6d1bf18
[ 2.224358] ---[ end trace d92dad60f62732f8 ]---
[ 2.225080] Fixing recursive fault but reboot is needed!

dmesg-quantal-lkp-tt02-3:20131008150513:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:391

[ 2.468734] ------------[ cut here ]------------
[ 2.469698] Kernel BUG at c10563af [verbose debug info unavailable]
[ 2.470992] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 2.471993] Modules linked in:
[ 2.471993] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #391
[ 2.471993] task: c6c2a2c0 ti: c6d16000 task.ti: c6d16000
[ 2.471993] EIP: 0060:[<c10563af>] EFLAGS: 00010202 CPU: 0
[ 2.471993] EIP is at __put_cred+0x2f/0x90
[ 2.471993] EAX: c14bb720 EBX: c6d11080 ECX: 00000000 EDX: 00000001
[ 2.471993] ESI: c6c2a2c0 EDI: 00000001 EBP: c6d17f24 ESP: c6d17f18
[ 2.471993] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 2.471993] CR0: 8005003b CR2: b7748000 CR3: 06d12000 CR4: 000006b0
[ 2.471993] Stack:
[ 2.471993] c006ee00 c6c2a558 c6c2a2c0 c6d17f30 c110a408 c006ed00 c6d17f44 c104d499
[ 2.471993] c6c2a570 c6d18000 c6c2a2c0 c6d17f8c c1031202 00000000 c6d17f80 c110a636
[ 2.471993] 00000001 00000001 00000000 00000246 00000001 c6c2a558 c6d18050 c6c2a2c0
[ 2.471993] Call Trace:
[ 2.471993] [<c110a408>] file_free_rcu+0x28/0x40
[ 2.471993] [<c104d499>] task_work_run+0x79/0xa0
[ 2.471993] [<c1031202>] do_exit+0x2f2/0x950
[ 2.471993] [<c110a636>] ? __fput+0x216/0x380
[ 2.471993] [<c10327ea>] do_group_exit+0x4a/0xa0
[ 2.471993] [<c1032858>] SyS_exit_group+0x18/0x20
[ 2.471993] [<c130ee30>] sysenter_do_call+0x12/0x3c
[ 2.471993] Code: 56 53 e8 35 8f 2b 00 89 c3 8b 00 8b 03 85 c0 0f 95 c0 25 ff 00 00 00 89 c6 31 c9 89 c2 b8 34 b7 4b c1 e8 25 1a 05 00 85 f6 74 02 <0f> 0b 8b 35 88 d7 46 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7
[ 2.471993] EIP: [<c10563af>] __put_cred+0x2f/0x90 SS:ESP 0068:c6d17f18
[ 2.503251] ---[ end trace 3b2042225c4df31d ]---
[ 2.504205] Fixing recursive fault but reboot is needed!

dmesg-quantal-lkp-tt02-7:20131008150522:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:391

[ 2.428135] ------------[ cut here ]------------
[ 2.429119] Kernel BUG at c10563af [verbose debug info unavailable]
[ 2.430431] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 2.431049] Modules linked in:
[ 2.431049] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #391
[ 2.431049] task: c6c2a2c0 ti: c6d16000 task.ti: c6d16000
[ 2.431049] EIP: 0060:[<c10563af>] EFLAGS: 00010202 CPU: 0
[ 2.431049] EIP is at __put_cred+0x2f/0x90
[ 2.431049] EAX: c14bb720 EBX: c6d11080 ECX: 00000000 EDX: 00000001
[ 2.431049] ESI: c6c2a2c0 EDI: 00000001 EBP: c6d17f24 ESP: c6d17f18
[ 2.431049] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 2.431049] CR0: 8005003b CR2: b7732000 CR3: 06d12000 CR4: 000006b0
[ 2.431049] Stack:
[ 2.431049] c006ee00 c6c2a558 c6c2a2c0 c6d17f30 c110a408 c006ed00 c6d17f44 c104d499
[ 2.431049] c6c2a570 c6d18000 c6c2a2c0 c6d17f8c c1031202 00000000 c6d17f80 c110a636
[ 2.431049] 00000001 00000001 00000000 00000246 00000001 c6c2a558 c6d18050 c6c2a2c0
[ 2.431049] Call Trace:
[ 2.431049] [<c110a408>] file_free_rcu+0x28/0x40
[ 2.431049] [<c104d499>] task_work_run+0x79/0xa0
[ 2.431049] [<c1031202>] do_exit+0x2f2/0x950
[ 2.431049] [<c110a636>] ? __fput+0x216/0x380
[ 2.431049] [<c10327ea>] do_group_exit+0x4a/0xa0
[ 2.431049] [<c1032858>] SyS_exit_group+0x18/0x20
[ 2.431049] [<c130ee30>] sysenter_do_call+0x12/0x3c
[ 2.431049] Code: 56 53 e8 35 8f 2b 00 89 c3 8b 00 8b 03 85 c0 0f 95 c0 25 ff 00 00 00 89 c6 31 c9 89 c2 b8 34 b7 4b c1 e8 25 1a 05 00 85 f6 74 02 <0f> 0b 8b 35 88 d7 46 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7
[ 2.431049] EIP: [<c10563af>] __put_cred+0x2f/0x90 SS:ESP 0068:c6d17f18
[ 2.470717] ---[ end trace 49b1330184d07147 ]---
[ 2.472096] Fixing recursive fault but reboot is needed!

dmesg-quantal-snb-10:20131009003411:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:391

[ 2.004517] ------------[ cut here ]------------
[ 2.005444] Kernel BUG at c10563af [verbose debug info unavailable]
[ 2.006199] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 2.006199] Modules linked in:
[ 2.006199] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #391
[ 2.006199] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 2.006199] EIP: 0060:[<c10563af>] EFLAGS: 00010202 CPU: 0
[ 2.006199] EIP is at __put_cred+0x2f/0x90
[ 2.006199] EAX: c14bb720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 2.006199] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 2.006199] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 2.006199] CR0: 8005003b CR2: b7751000 CR3: 06d1e000 CR4: 000006b0
[ 2.006199] Stack:
[ 2.006199] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a408 c006ed00 c6d1bf44 c104d499
[ 2.006199] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c1031202 00000000 c6d1bf80 c110a636
[ 2.006199] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 2.006199] Call Trace:
[ 2.006199] [<c110a408>] file_free_rcu+0x28/0x40
[ 2.006199] [<c104d499>] task_work_run+0x79/0xa0
[ 2.006199] [<c1031202>] do_exit+0x2f2/0x950
[ 2.006199] [<c110a636>] ? __fput+0x216/0x380
[ 2.006199] [<c10327ea>] do_group_exit+0x4a/0xa0
[ 2.006199] [<c1032858>] SyS_exit_group+0x18/0x20
[ 2.006199] [<c130ee30>] sysenter_do_call+0x12/0x3c
[ 2.006199] Code: 56 53 e8 35 8f 2b 00 89 c3 8b 00 8b 03 85 c0 0f 95 c0 25 ff 00 00 00 89 c6 31 c9 89 c2 b8 34 b7 4b c1 e8 25 1a 05 00 85 f6 74 02 <0f> 0b 8b 35 88 d7 46 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7
[ 2.006199] EIP: [<c10563af>] __put_cred+0x2f/0x90 SS:ESP 0068:c6d1bf18
[ 2.035701] ---[ end trace 7c659a37d71008c4 ]---
[ 2.036575] Fixing recursive fault but reboot is needed!

dmesg-quantal-snb-14:20131009003352:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:391

[ 1.873594] ------------[ cut here ]------------
[ 1.874449] Kernel BUG at c10563af [verbose debug info unavailable]
[ 1.875562] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 1.876517] Modules linked in:
[ 1.876825] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #391
[ 1.876825] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 1.876825] EIP: 0060:[<c10563af>] EFLAGS: 00010202 CPU: 0
[ 1.876825] EIP is at __put_cred+0x2f/0x90
[ 1.876825] EAX: c14bb720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 1.876825] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 1.876825] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.876825] CR0: 8005003b CR2: b775c000 CR3: 06d1e000 CR4: 000006b0
[ 1.876825] Stack:
[ 1.876825] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a408 c006ed00 c6d1bf44 c104d499
[ 1.876825] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c1031202 00000000 c6d1bf80 c110a636
[ 1.876825] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 1.876825] Call Trace:
[ 1.876825] [<c110a408>] file_free_rcu+0x28/0x40
[ 1.876825] [<c104d499>] task_work_run+0x79/0xa0
[ 1.876825] [<c1031202>] do_exit+0x2f2/0x950
[ 1.876825] [<c110a636>] ? __fput+0x216/0x380
[ 1.876825] [<c10327ea>] do_group_exit+0x4a/0xa0
[ 1.876825] [<c1032858>] SyS_exit_group+0x18/0x20
[ 1.876825] [<c130ee30>] sysenter_do_call+0x12/0x3c
[ 1.876825] Code: 56 53 e8 35 8f 2b 00 89 c3 8b 00 8b 03 85 c0 0f 95 c0 25 ff 00 00 00 89 c6 31 c9 89 c2 b8 34 b7 4b c1 e8 25 1a 05 00 85 f6 74 02 <0f> 0b 8b 35 88 d7 46 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7
[ 1.876825] EIP: [<c10563af>] __put_cred+0x2f/0x90 SS:ESP 0068:c6d1bf18
[ 1.904117] ---[ end trace 751354922a6f111b ]---
[ 1.904956] Fixing recursive fault but reboot is needed!

dmesg-quantal-snb-5:20131009003359:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:391

[ 1.939202] ------------[ cut here ]------------
[ 1.940093] Kernel BUG at c10563af [verbose debug info unavailable]
[ 1.940937] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 1.940937] Modules linked in:
[ 1.940937] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #391
[ 1.940937] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 1.940937] EIP: 0060:[<c10563af>] EFLAGS: 00010202 CPU: 0
[ 1.940937] EIP is at __put_cred+0x2f/0x90
[ 1.940937] EAX: c14bb720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 1.940937] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 1.940937] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.940937] CR0: 8005003b CR2: b7751000 CR3: 06d1e000 CR4: 000006b0
[ 1.940937] Stack:
[ 1.940937] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a408 c006ed00 c6d1bf44 c104d499
[ 1.940937] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c1031202 00000000 c6d1bf80 c110a636
[ 1.940937] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 1.940937] Call Trace:
[ 1.940937] [<c110a408>] file_free_rcu+0x28/0x40
[ 1.940937] [<c104d499>] task_work_run+0x79/0xa0
[ 1.940937] [<c1031202>] do_exit+0x2f2/0x950
[ 1.940937] [<c110a636>] ? __fput+0x216/0x380
[ 1.940937] [<c10327ea>] do_group_exit+0x4a/0xa0
[ 1.940937] [<c1032858>] SyS_exit_group+0x18/0x20
[ 1.940937] [<c130ee30>] sysenter_do_call+0x12/0x3c
[ 1.940937] Code: 56 53 e8 35 8f 2b 00 89 c3 8b 00 8b 03 85 c0 0f 95 c0 25 ff 00 00 00 89 c6 31 c9 89 c2 b8 34 b7 4b c1 e8 25 1a 05 00 85 f6 74 02 <0f> 0b 8b 35 88 d7 46 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7
[ 1.940937] EIP: [<c10563af>] __put_cred+0x2f/0x90 SS:ESP 0068:c6d1bf18
[ 1.968415] ---[ end trace 8c5056fc7a63be1b ]---
[ 1.969230] Fixing recursive fault but reboot is needed!

dmesg-quantal-stoakley-7:20131009003427:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:391

[ 2.027904] ------------[ cut here ]------------
[ 2.028164] Kernel BUG at c10563af [verbose debug info unavailable]
[ 2.028164] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 2.028164] Modules linked in:
[ 2.028164] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #391
[ 2.028164] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 2.028164] EIP: 0060:[<c10563af>] EFLAGS: 00010202 CPU: 0
[ 2.028164] EIP is at __put_cred+0x2f/0x90
[ 2.028164] EAX: c14bb720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 2.028164] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 2.028164] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 2.028164] CR0: 8005003b CR2: b77af000 CR3: 06d1e000 CR4: 000006b0
[ 2.028164] Stack:
[ 2.028164] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a408 c006ed00 c6d1bf44 c104d499
[ 2.028164] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c1031202 00000000 c6d1bf80 c110a636
[ 2.028164] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 2.028164] Call Trace:
[ 2.028164] [<c110a408>] file_free_rcu+0x28/0x40
[ 2.028164] [<c104d499>] task_work_run+0x79/0xa0
[ 2.028164] [<c1031202>] do_exit+0x2f2/0x950
[ 2.028164] [<c110a636>] ? __fput+0x216/0x380
[ 2.028164] [<c10327ea>] do_group_exit+0x4a/0xa0
[ 2.028164] [<c1032858>] SyS_exit_group+0x18/0x20
[ 2.028164] [<c130ee30>] sysenter_do_call+0x12/0x3c
[ 2.028164] Code: 56 53 e8 35 8f 2b 00 89 c3 8b 00 8b 03 85 c0 0f 95 c0 25 ff 00 00 00 89 c6 31 c9 89 c2 b8 34 b7 4b c1 e8 25 1a 05 00 85 f6 74 02 <0f> 0b 8b 35 88 d7 46 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7
[ 2.028164] EIP: [<c10563af>] __put_cred+0x2f/0x90 SS:ESP 0068:c6d1bf18
[ 2.050744] ---[ end trace 2e535460ae08e2e8 ]---
[ 2.051392] Fixing recursive fault but reboot is needed!

dmesg-quantal-waimea-10:20131009083054:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:391

[ 0.933170] ------------[ cut here ]------------
[ 0.933702] Kernel BUG at c10563af [verbose debug info unavailable]
[ 0.934452] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 0.934728] Modules linked in:
[ 0.934728] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #391
[ 0.934728] task: c6c322c0 ti: c6d2a000 task.ti: c6d2a000
[ 0.934728] EIP: 0060:[<c10563af>] EFLAGS: 00010202 CPU: 0
[ 0.934728] EIP is at __put_cred+0x2f/0x90
[ 0.934728] EAX: c14bb720 EBX: c6d17400 ECX: 00000000 EDX: 00000001
[ 0.934728] ESI: c6c322c0 EDI: 00000001 EBP: c6d2bf24 ESP: c6d2bf18
[ 0.934728] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.934728] CR0: 8005003b CR2: b7793000 CR3: 06d19000 CR4: 000006b0
[ 0.934728] Stack:
[ 0.934728] c006ee00 c6c32558 c6c322c0 c6d2bf30 c110a408 c006ed00 c6d2bf44 c104d499
[ 0.934728] c6c32570 c6d2c000 c6c322c0 c6d2bf8c c1031202 00000000 c6d2bf80 c110a636
[ 0.934728] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d2c050 c6c322c0
[ 0.934728] Call Trace:
[ 0.934728] [<c110a408>] file_free_rcu+0x28/0x40
[ 0.934728] [<c104d499>] task_work_run+0x79/0xa0
[ 0.934728] [<c1031202>] do_exit+0x2f2/0x950
[ 0.934728] [<c110a636>] ? __fput+0x216/0x380
[ 0.934728] [<c10327ea>] do_group_exit+0x4a/0xa0
[ 0.934728] [<c1032858>] SyS_exit_group+0x18/0x20
[ 0.934728] [<c130ee30>] sysenter_do_call+0x12/0x3c
[ 0.934728] Code: 56 53 e8 35 8f 2b 00 89 c3 8b 00 8b 03 85 c0 0f 95 c0 25 ff 00 00 00 89 c6 31 c9 89 c2 b8 34 b7 4b c1 e8 25 1a 05 00 85 f6 74 02 <0f> 0b 8b 35 88 d7 46 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7
[ 0.934728] EIP: [<c10563af>] __put_cred+0x2f/0x90 SS:ESP 0068:c6d2bf18
[ 0.952083] ---[ end trace e034291e60bada3a ]---
[ 0.952608] Fixing recursive fault but reboot is needed!

dmesg-quantal-xian-31:20131009003413:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:391

[ 1.615252] ------------[ cut here ]------------
[ 1.616087] Kernel BUG at c10563af [verbose debug info unavailable]
[ 1.617129] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 1.618032] Modules linked in:
[ 1.618136] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #391
[ 1.618136] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 1.618136] EIP: 0060:[<c10563af>] EFLAGS: 00010202 CPU: 0
[ 1.618136] EIP is at __put_cred+0x2f/0x90
[ 1.618136] EAX: c14bb720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 1.618136] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 1.618136] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.618136] CR0: 8005003b CR2: b775f000 CR3: 06d1e000 CR4: 000006b0
[ 1.618136] Stack:
[ 1.618136] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a408 c006ed00 c6d1bf44 c104d499
[ 1.618136] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c1031202 00000000 c6d1bf80 c110a636
[ 1.618136] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 1.618136] Call Trace:
[ 1.618136] [<c110a408>] file_free_rcu+0x28/0x40
[ 1.618136] [<c104d499>] task_work_run+0x79/0xa0
[ 1.618136] [<c1031202>] do_exit+0x2f2/0x950
[ 1.618136] [<c110a636>] ? __fput+0x216/0x380
[ 1.618136] [<c10327ea>] do_group_exit+0x4a/0xa0
[ 1.618136] [<c1032858>] SyS_exit_group+0x18/0x20
[ 1.618136] [<c130ee30>] sysenter_do_call+0x12/0x3c
[ 1.618136] Code: 56 53 e8 35 8f 2b 00 89 c3 8b 00 8b 03 85 c0 0f 95 c0 25 ff 00 00 00 89 c6 31 c9 89 c2 b8 34 b7 4b c1 e8 25 1a 05 00 85 f6 74 02 <0f> 0b 8b 35 88 d7 46 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7
[ 1.618136] EIP: [<c10563af>] __put_cred+0x2f/0x90 SS:ESP 0068:c6d1bf18
[ 1.640485] ---[ end trace 544ba4c9cb172e4b ]---
[ 1.641182] Fixing recursive fault but reboot is needed!

dmesg-quantal-xian-43:20131009003355:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:391

[ 1.638354] ------------[ cut here ]------------
[ 1.639150] Kernel BUG at c10563af [verbose debug info unavailable]
[ 1.639256] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 1.639256] Modules linked in:
[ 1.639256] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #391
[ 1.639256] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 1.639256] EIP: 0060:[<c10563af>] EFLAGS: 00010202 CPU: 0
[ 1.639256] EIP is at __put_cred+0x2f/0x90
[ 1.639256] EAX: c14bb720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 1.639256] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 1.639256] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.639256] CR0: 8005003b CR2: b77ac000 CR3: 06d1e000 CR4: 000006b0
[ 1.639256] Stack:
[ 1.639256] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a408 c006ed00 c6d1bf44 c104d499
[ 1.639256] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c1031202 00000000 c6d1bf80 c110a636
[ 1.639256] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 1.639256] Call Trace:
[ 1.639256] [<c110a408>] file_free_rcu+0x28/0x40
[ 1.639256] [<c104d499>] task_work_run+0x79/0xa0
[ 1.639256] [<c1031202>] do_exit+0x2f2/0x950
[ 1.639256] [<c110a636>] ? __fput+0x216/0x380
[ 1.639256] [<c10327ea>] do_group_exit+0x4a/0xa0
[ 1.639256] [<c1032858>] SyS_exit_group+0x18/0x20
[ 1.639256] [<c130ee30>] sysenter_do_call+0x12/0x3c
[ 1.639256] Code: 56 53 e8 35 8f 2b 00 89 c3 8b 00 8b 03 85 c0 0f 95 c0 25 ff 00 00 00 89 c6 31 c9 89 c2 b8 34 b7 4b c1 e8 25 1a 05 00 85 f6 74 02 <0f> 0b 8b 35 88 d7 46 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7
[ 1.639256] EIP: [<c10563af>] __put_cred+0x2f/0x90 SS:ESP 0068:c6d1bf18
[ 1.665505] ---[ end trace 0e638a59e536f317 ]---
[ 1.666366] Fixing recursive fault but reboot is needed!

dmesg-yocto-lkp-tt02-2:20131008145515:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:391


mount: mounting proc on /proc failed: No such device
[ 0.997823] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.999402] IP: [< (null)>] (null)
[ 1.000224] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 1.000712] Oops: 0010 [#1] DEBUG_PAGEALLOC
[ 1.000712] Modules linked in:
[ 1.000712] CPU: 0 PID: 46 Comm: mount Not tainted 3.12.0-rc1-00050-g0c44c2d #391
[ 1.000712] task: cd7c3cd0 ti: cd10a000 task.ti: cd10a000
[ 1.000712] EIP: 0060:[<00000000>] EFLAGS: 00010246 CPU: 0
[ 1.000712] EIP is at 0x0
[ 1.000712] EAX: cd0dc500 EBX: cd0dce00 ECX: 00000000 EDX: cd0dc500
[ 1.000712] ESI: cd7c3f68 EDI: cd7c3cd0 EBP: cd10bf44 ESP: cd10bf34
[ 1.000712] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.000712] CR0: 8005003b CR2: 00000000 CR3: 0d102000 CR4: 000006b0
[ 1.000712] Stack:
[ 1.000712] c104d499 cd7c3f80 cd0d6a00 cd7c3cd0 cd10bf8c c1031202 00000000 00000000
[ 1.000712] cee9d000 00000035 00000001 cd10bf88 c1109351 00000001 00000000 cd0d6a50
[ 1.000712] cd7c3cd0 080d3208 cd10bf9c 0000ff00 cd0ea600 cd7c3cd0 cd10bfa4 c10327ea
[ 1.000712] Call Trace:
[ 1.000712] [<c104d499>] ? task_work_run+0x79/0xa0
[ 1.000712] [<c1031202>] do_exit+0x2f2/0x950
[ 1.000712] [<c1109351>] ? vfs_write+0x161/0x1a0
[ 1.000712] [<c10327ea>] do_group_exit+0x4a/0xa0
[ 1.000712] [<c1032858>] SyS_exit_group+0x18/0x20
[ 1.000712] [<c1307a45>] syscall_call+0x7/0xb
[ 1.000712] Code: Bad EIP value.
[ 1.000712] EIP: [<00000000>] 0x0 SS:ESP 0068:cd10bf34
[ 1.000712] CR2: 0000000000000000

dmesg-yocto-nhm4-1:20131008162924:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:391


mount: mounting proc on /proc failed: No such device
[ 0.441443] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.442048] IP: [<c110a470>] __fput+0x50/0x380
[ 0.442432] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.442928] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.443319] Modules linked in:
[ 0.443524] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #391
[ 0.443524] Workqueue: events delayed_fput
[ 0.443524] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.443524] EIP: 0060:[<c110a470>] EFLAGS: 00010212 CPU: 0
[ 0.443524] EIP is at __fput+0x50/0x380
[ 0.443524] EAX: 00000000 EBX: cd0e3200 ECX: 00000000 EDX: 0000001d
[ 0.443524] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.443524] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.443524] CR0: 8005003b CR2: 00000000 CR3: 0d10b000 CR4: 000006b0
[ 0.443524] Stack:
[ 0.443524] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.443524] 00000000 c0124540 ce867ea4 c110a7c9 c148d640 ce867efc c1048fb9 00000000
[ 0.443524] 00000002 00000000 c1048f81 00000000 00000000 00000000 0019ebc7 c0083400
[ 0.443524] Call Trace:
[ 0.443524] [<c110a7c9>] delayed_fput+0x29/0x30
[ 0.443524] [<c1048fb9>] process_one_work+0x2f9/0x650
[ 0.443524] [<c1048f81>] ? process_one_work+0x2c1/0x650
[ 0.443524] [<c104a8ef>] worker_thread+0x28f/0x610
[ 0.443524] [<c104a660>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.443524] [<c1050902>] kthread+0x92/0xa0
[ 0.443524] [<c130ed9b>] ret_from_kernel_thread+0x1b/0x30
[ 0.443524] [<c1050870>] ? kthread_create_on_node+0xd0/0xd0
[ 0.443524] Code: 00 b8 ad 5e 41 c1 e8 b0 fe f4 ff e8 fb b1 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.443524] EIP: [<c110a470>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.443524] CR2: 0000000000000000
[ 0.456633] ---[ end trace 904c44bc0abd3aee ]---
[ 0.460187] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6d00 with usage -1

dmesg-yocto-snb-38:20131009002344:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:391


mount: mounting proc on /proc failed: No such device
[ 0.918117] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.919547] IP: [< (null)>] (null)
[ 0.919794] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.919794] Oops: 0010 [#1] DEBUG_PAGEALLOC
[ 0.919794] Modules linked in:
[ 0.919794] CPU: 0 PID: 46 Comm: mount Not tainted 3.12.0-rc1-00050-g0c44c2d #391
[ 0.919794] task: cd7cbcd0 ti: cd10e000 task.ti: cd10e000
[ 0.919794] EIP: 0060:[<00000000>] EFLAGS: 00010246 CPU: 0
[ 0.919794] EIP is at 0x0
[ 0.919794] EAX: cd0e3500 EBX: cd0e3e00 ECX: 00000000 EDX: cd0e3500
[ 0.919794] ESI: cd7cbf68 EDI: cd7cbcd0 EBP: cd10ff44 ESP: cd10ff34
[ 0.919794] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.919794] CR0: 8005003b CR2: 00000000 CR3: 0d10a000 CR4: 000006b0
[ 0.919794] Stack:
[ 0.919794] c104d499 cd7cbf80 cd0daa00 cd7cbcd0 cd10ff8c c1031202 00000000 00000000
[ 0.919794] cee9d000 00000035 00000001 cd10ff88 c1109351 00000001 00000000 cd0daa50
[ 0.919794] cd7cbcd0 080d3208 cd10ff9c 0000ff00 cd0ee600 cd7cbcd0 cd10ffa4 c10327ea
[ 0.919794] Call Trace:
[ 0.919794] [<c104d499>] ? task_work_run+0x79/0xa0
[ 0.919794] [<c1031202>] do_exit+0x2f2/0x950
[ 0.919794] [<c1109351>] ? vfs_write+0x161/0x1a0
[ 0.919794] [<c10327ea>] do_group_exit+0x4a/0xa0
[ 0.919794] [<c1032858>] SyS_exit_group+0x18/0x20
[ 0.919794] [<c1307a45>] syscall_call+0x7/0xb
[ 0.919794] Code: Bad EIP value.
[ 0.919794] EIP: [<00000000>] 0x0 SS:ESP 0068:cd10ff34
[ 0.919794] CR2: 0000000000000000

dmesg-yocto-snb-43:20131009002416:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:391


mount: mounting proc on /proc failed: No such device
[ 0.873183] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.874508] IP: [< (null)>] (null)
[ 0.874688] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.874688] Oops: 0010 [#1] DEBUG_PAGEALLOC
[ 0.874688] Modules linked in:
[ 0.874688] CPU: 0 PID: 46 Comm: mount Not tainted 3.12.0-rc1-00050-g0c44c2d #391
[ 0.874688] task: cd7cbcd0 ti: cd10e000 task.ti: cd10e000
[ 0.874688] EIP: 0060:[<00000000>] EFLAGS: 00010246 CPU: 0
[ 0.874688] EIP is at 0x0
[ 0.874688] EAX: cd0e3100 EBX: cd0e3e00 ECX: 00000000 EDX: cd0e3100
[ 0.874688] ESI: cd7cbf68 EDI: cd7cbcd0 EBP: cd10ff44 ESP: cd10ff34
[ 0.874688] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.874688] CR0: 8005003b CR2: 00000000 CR3: 0d10a000 CR4: 000006b0
[ 0.874688] Stack:
[ 0.874688] c104d499 cd7cbf80 cd0daa00 cd7cbcd0 cd10ff8c c1031202 00000000 00000000
[ 0.874688] cee9d000 00000035 00000001 cd10ff88 c1109351 00000001 00000000 cd0daa50
[ 0.874688] cd7cbcd0 080d3208 cd10ff9c 0000ff00 cd0ee600 cd7cbcd0 cd10ffa4 c10327ea
[ 0.874688] Call Trace:
[ 0.874688] [<c104d499>] ? task_work_run+0x79/0xa0
[ 0.874688] [<c1031202>] do_exit+0x2f2/0x950
[ 0.874688] [<c1109351>] ? vfs_write+0x161/0x1a0
[ 0.874688] [<c10327ea>] do_group_exit+0x4a/0xa0
[ 0.874688] [<c1032858>] SyS_exit_group+0x18/0x20
[ 0.874688] [<c1307a45>] syscall_call+0x7/0xb
[ 0.874688] Code: Bad EIP value.
[ 0.874688] EIP: [<00000000>] 0x0 SS:ESP 0068:cd10ff34
[ 0.874688] CR2: 0000000000000000

dmesg-yocto-stoakley-3:20131009002418:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:391

mount: mounting proc on /proc failed: No such device
[ 0.831874] kernel tried to execute NX-protected page - exploit attempt? (uid: 0)
[ 0.832409] BUG: unable to handle kernel paging request at cd0e3a08
[ 0.832409] IP: [<cd0e3a08>] 0xcd0e3a07
[ 0.832409] *pdpt = 000000000151c001 *pde = 000000000fbfc067 *pte = 800000000d0e3163
[ 0.832409] Oops: 0011 [#1] DEBUG_PAGEALLOC
[ 0.832409] Modules linked in:
[ 0.832409] CPU: 0 PID: 46 Comm: mount Not tainted 3.12.0-rc1-00050-g0c44c2d #391
[ 0.832409] task: cd7cbcd0 ti: cd10e000 task.ti: cd10e000
[ 0.832409] EIP: 0060:[<cd0e3a08>] EFLAGS: 00010246 CPU: 0
[ 0.832409] EIP is at 0xcd0e3a08
[ 0.832409] EAX: cd0e3a00 EBX: cd0e3800 ECX: 00000000 EDX: cd0e3a00
[ 0.832409] ESI: cd7cbf68 EDI: cd7cbcd0 EBP: cd10ff44 ESP: cd10ff34
[ 0.832409] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.832409] CR0: 8005003b CR2: cd0e3a08 CR3: 0d10a000 CR4: 000006b0
[ 0.832409] Stack:
[ 0.832409] c104d499 cd7cbf80 cd0daa00 cd7cbcd0 cd10ff8c c1031202 00000000 00000000
[ 0.832409] cee9d000 00000035 00000001 cd10ff88 c1109351 00000001 00000000 cd0daa50
[ 0.832409] cd7cbcd0 080d3208 cd10ff9c 0000ff00 cd0ee600 cd7cbcd0 cd10ffa4 c10327ea
[ 0.832409] Call Trace:
[ 0.832409] [<c104d499>] ? task_work_run+0x79/0xa0
[ 0.832409] [<c1031202>] do_exit+0x2f2/0x950
[ 0.832409] [<c1109351>] ? vfs_write+0x161/0x1a0
[ 0.832409] [<c10327ea>] do_group_exit+0x4a/0xa0
[ 0.832409] [<c1032858>] SyS_exit_group+0x18/0x20
[ 0.832409] [<c1307a45>] syscall_call+0x7/0xb
[ 0.832409] Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 38 0e cd 08 3a 0e cd <20> 00 00 00 4c 3a 0e cd 44 3a 0e cd 48 3a 0e cd 01 00 00 00 ad
[ 0.832409] EIP: [<cd0e3a08>] 0xcd0e3a08 SS:ESP 0068:cd10ff34
[ 0.832409] CR2: 00000000cd0e3a08

dmesg-yocto-stoakley-4:20131009002412:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:391


mount: mounting proc on /proc failed: No such device
[ 0.840034] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.841074] IP: [< (null)>] (null)
[ 0.841610] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.841824] Oops: 0010 [#1] DEBUG_PAGEALLOC
[ 0.841824] Modules linked in:
[ 0.841824] CPU: 0 PID: 46 Comm: mount Not tainted 3.12.0-rc1-00050-g0c44c2d #391
[ 0.841824] task: cd7cbcd0 ti: cd10e000 task.ti: cd10e000
[ 0.841824] EIP: 0060:[<00000000>] EFLAGS: 00010246 CPU: 0
[ 0.841824] EIP is at 0x0
[ 0.841824] EAX: cd0e3100 EBX: cd0e3e00 ECX: 00000000 EDX: cd0e3100
[ 0.841824] ESI: cd7cbf68 EDI: cd7cbcd0 EBP: cd10ff44 ESP: cd10ff34
[ 0.841824] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.841824] CR0: 8005003b CR2: 00000000 CR3: 0d10a000 CR4: 000006b0
[ 0.841824] Stack:
[ 0.841824] c104d499 cd7cbf80 cd0daa00 cd7cbcd0 cd10ff8c c1031202 00000000 00000000
[ 0.841824] cee9d000 00000035 00000001 cd10ff88 c1109351 00000001 00000000 cd0daa50
[ 0.841824] cd7cbcd0 080d3208 cd10ff9c 0000ff00 cd0ee600 cd7cbcd0 cd10ffa4 c10327ea
[ 0.841824] Call Trace:
[ 0.841824] [<c104d499>] ? task_work_run+0x79/0xa0
[ 0.841824] [<c1031202>] do_exit+0x2f2/0x950
[ 0.841824] [<c1109351>] ? vfs_write+0x161/0x1a0
[ 0.841824] [<c10327ea>] do_group_exit+0x4a/0xa0
[ 0.841824] [<c1032858>] SyS_exit_group+0x18/0x20
[ 0.841824] [<c1307a45>] syscall_call+0x7/0xb
[ 0.841824] Code: Bad EIP value.
[ 0.841824] EIP: [<00000000>] 0x0 SS:ESP 0068:cd10ff34
[ 0.841824] CR2: 0000000000000000

dmesg-yocto-xian-45:20131009002407:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:391


mount: mounting proc on /proc failed: No such device
[ 0.780760] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.781899] IP: [<c110a470>] __fput+0x50/0x380
[ 0.782253] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.782253] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.782253] Modules linked in:
[ 0.782253] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #391
[ 0.782253] Workqueue: events delayed_fput
[ 0.782253] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.782253] EIP: 0060:[<c110a470>] EFLAGS: 00010212 CPU: 0
[ 0.782253] EIP is at __fput+0x50/0x380
[ 0.782253] EAX: 00000000 EBX: cd0e3700 ECX: 00000000 EDX: 0000001d
[ 0.782253] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.782253] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.782253] CR0: 8005003b CR2: 00000000 CR3: 0d10a000 CR4: 000006b0
[ 0.782253] Stack:
[ 0.782253] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.782253] 00000000 c0124540 ce867ea4 c110a7c9 c148d640 ce867efc c1048fb9 00000000
[ 0.782253] 00000002 00000000 c1048f81 00000000 00000000 00000000 0019ebc7 c0083400
[ 0.782253] Call Trace:
[ 0.782253] [<c110a7c9>] delayed_fput+0x29/0x30
[ 0.782253] [<c1048fb9>] process_one_work+0x2f9/0x650
[ 0.782253] [<c1048f81>] ? process_one_work+0x2c1/0x650
[ 0.782253] [<c104a8ef>] worker_thread+0x28f/0x610
[ 0.782253] [<c104a660>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.782253] [<c1050902>] kthread+0x92/0xa0
[ 0.782253] [<c130ed9b>] ret_from_kernel_thread+0x1b/0x30
[ 0.782253] [<c1050870>] ? kthread_create_on_node+0xd0/0xd0
[ 0.782253] Code: 00 b8 ad 5e 41 c1 e8 b0 fe f4 ff e8 fb b1 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.782253] EIP: [<c110a470>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.782253] CR2: 0000000000000000
[ 0.810230] ---[ end trace 30f0c5539123580d ]---
[ 0.815604] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6c00 with usage -1

dmesg-yocto-xps-4:20131009081942:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:391


mount: mounting proc on /proc failed: No such device
[ 0.510689] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.511333] IP: [<c110a470>] __fput+0x50/0x380
[ 0.511670] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.511670] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.511670] Modules linked in:
[ 0.511670] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #391
[ 0.511670] Workqueue: events delayed_fput
[ 0.511670] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.511670] EIP: 0060:[<c110a470>] EFLAGS: 00010212 CPU: 0
[ 0.511670] EIP is at __fput+0x50/0x380
[ 0.511670] EAX: 00000000 EBX: cd0e3200 ECX: 00000000 EDX: 0000001d
[ 0.511670] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.511670] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.511670] CR0: 8005003b CR2: 00000000 CR3: 0d10b000 CR4: 000006b0
[ 0.511670] Stack:
[ 0.511670] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.511670] 00000000 c0124540 ce867ea4 c110a7c9 c148d640 ce867efc c1048fb9 00000000
[ 0.511670] 00000002 00000000 c1048f81 00000000 00000000 00000000 0019ebc7 c0083400
[ 0.511670] Call Trace:
[ 0.511670] [<c110a7c9>] delayed_fput+0x29/0x30
[ 0.511670] [<c1048fb9>] process_one_work+0x2f9/0x650
[ 0.511670] [<c1048f81>] ? process_one_work+0x2c1/0x650
[ 0.511670] [<c104a8ef>] worker_thread+0x28f/0x610
[ 0.511670] [<c104a660>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.511670] [<c1050902>] kthread+0x92/0xa0
[ 0.511670] [<c130ed9b>] ret_from_kernel_thread+0x1b/0x30
[ 0.511670] [<c1050870>] ? kthread_create_on_node+0xd0/0xd0
[ 0.511670] Code: 00 b8 ad 5e 41 c1 e8 b0 fe f4 ff e8 fb b1 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.511670] EIP: [<c110a470>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.511670] CR2: 0000000000000000
[ 0.526608] ---[ end trace 490bc283e6fc34f9 ]---
[ 0.530504] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6d00 with usage -1


Attachments:
(No filename) (47.72 kB)
dmesg-yocto-waimea-12:20131005100755:i386-randconfig-r8-1005:3.12.0-rc1-00080-gfb869b6:3 (21.88 kB)
bisect-fb869b6e91a3ac235f237f73305ecf34cdc4969b-i386-randconfig-r8-1005-BUG:-unable-to-handle-kernel-18490.log (31.11 kB)
config-3.12.0-rc1-00080-gfb869b6 (49.92 kB)
Download all attachments

2013-10-08 17:31:59

by Linus Torvalds

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel NULL pointer dereference at (null)

On Tue, Oct 8, 2013 at 10:15 AM, Fengguang Wu <[email protected]> wrote:
>
> [ 27.865982] Kernel BUG at c10563af [verbose debug info unavailable]

Ugh, you've turned off DEBUG_BUGVERBOSE.

We probably shouldn't even allow that. The space savings aren't worth the pain.

I'm not seeing the pattern in your oopses, there's at least three
different cases. At a guess, it's some lock - or a memory allocator -
that is broken by the bitop breakage, and then the oopses are just
fallout from that..

Linus

2013-10-08 18:59:13

by Oleg Nesterov

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

On 10/08, Linus Torvalds wrote:
>
> (not yet merged), see:
>
> http://git.kernel.org/cgit/linux/kernel/git/tip/tip.git/commit/?id=0c44c2d0f459cd7e275242b72f500137c4fa834d

I do not really understand inline assembly constraints, but I'll ask
anyway.

+#define __GEN_RMWcc(fullop, var, cc, ...) \
+do { \
+ asm volatile goto (fullop "; j" cc " %l[cc_label]" \
+ : : "m" (var), ## __VA_ARGS__ \
^^^^^^^^^

don't we need

"+m" (var)

here?

Oleg.

2013-10-08 19:05:34

by Linus Torvalds

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

On Tue, Oct 8, 2013 at 11:51 AM, Oleg Nesterov <[email protected]> wrote:
>
> I do not really understand inline assembly constraints, but I'll ask
> anyway.
>
> +#define __GEN_RMWcc(fullop, var, cc, ...) \
> +do { \
> + asm volatile goto (fullop "; j" cc " %l[cc_label]" \
> + : : "m" (var), ## __VA_ARGS__ \
> ^^^^^^^^^
>
> don't we need
>
> "+m" (var)

We have a memory clobber instead. So the memory is marked as input and
clobbered.

And we'd love to mark it "+m", but "ask goto" cannot have outputs.

For the serializing ones, the memory clobber is ok - they have barrier
semantics anyway. But we'd actually *want* to use "asm goto" for some
cases where the memory clobber is too big of a hammer, so if we ever
get input/output constraints to "asm goto" we'll be happy.

Of course, right now it looks like we shouldn't be in a rush to use
"asm goto" at all...

Linus

2013-10-08 19:06:10

by Jakub Jelinek

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

On Tue, Oct 08, 2013 at 08:51:54PM +0200, Oleg Nesterov wrote:
> On 10/08, Linus Torvalds wrote:
> >
> > (not yet merged), see:
> >
> > http://git.kernel.org/cgit/linux/kernel/git/tip/tip.git/commit/?id=0c44c2d0f459cd7e275242b72f500137c4fa834d
>
> I do not really understand inline assembly constraints, but I'll ask
> anyway.
>
> +#define __GEN_RMWcc(fullop, var, cc, ...) \
> +do { \
> + asm volatile goto (fullop "; j" cc " %l[cc_label]" \
> + : : "m" (var), ## __VA_ARGS__ \
> ^^^^^^^^^
>
> don't we need
>
> "+m" (var)
>
> here?

You actually can't have output operands with asm goto, only inputs
and clobbers. But the "memory" clobber should be enough here.

If you suspect a compiler bug, can somebody please narrow it down to
a single object file (if I've skimmed the patch right, it is just an
optimization, where object files compiled without and with the patch
should actually coexist fine in the same kernel), ideally to a single
routine if possible and post a preprocessed source + gcc command line
+ version of gcc?

Jakub

2013-10-08 19:20:29

by Linus Torvalds

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

On Tue, Oct 8, 2013 at 12:05 PM, Jakub Jelinek <[email protected]> wrote:
>
> If you suspect a compiler bug, can somebody please narrow it down to
> a single object file (if I've skimmed the patch right, it is just an
> optimization, where object files compiled without and with the patch
> should actually coexist fine in the same kernel), ideally to a single
> routine if possible and post a preprocessed source + gcc command line
> + version of gcc?

It is indeed just an optimization, and we could in theory switch
between the two versions on a case-by-case basis, but we don't have
any sane way to really do that.

I'll try to see if I can reproduce this on my hardware (just applying
that patch on top of my own tip) and see if I can try to narrow things
down. But I looked at the assembly for a couple of files, and it all
looked good, and I know this patch works fine for others (ie all the
normal -tip testing), so I suspect it's something specific to what
Fengguang does.

Linus

2013-10-08 19:34:38

by Linus Torvalds

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

On Tue, Oct 8, 2013 at 12:20 PM, Linus Torvalds
<[email protected]> wrote:
>
> I'll try to see if I can reproduce this on my hardware

Yeah, doesn't reproduce here..

Linus

2013-10-08 19:42:13

by Oleg Nesterov

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

On 10/08, Jakub Jelinek wrote:
>
> On Tue, Oct 08, 2013 at 08:51:54PM +0200, Oleg Nesterov wrote:
> >
> > I do not really understand inline assembly constraints, but I'll ask
> > anyway.
> >
> > +#define __GEN_RMWcc(fullop, var, cc, ...) \
> > +do { \
> > + asm volatile goto (fullop "; j" cc " %l[cc_label]" \
> > + : : "m" (var), ## __VA_ARGS__ \
> > ^^^^^^^^^
> >
> > don't we need
> >
> > "+m" (var)
> >
> > here?
>
> You actually can't have output operands with asm goto, only inputs
> and clobbers. But the "memory" clobber should be enough here.

Thanks Jakub and Linus.

Cough... sorry for off-topic question,

static inline int test_and_set_bit(long nr, volatile unsigned long *addr)
{
int oldbit;

asm volatile(LOCK_PREFIX "bts %2,%1\n\t"
"sbb %0,%0" : "=r" (oldbit), ADDR : "Ir" (nr) : "memory");

doesn't this mean that "ADDR" doesn't need "+" as well?


> If you suspect a compiler bug, can somebody please narrow it down to
> a single object file (if I've skimmed the patch right, it is just an
> optimization, where object files compiled without and with the patch
> should actually coexist fine in the same kernel), ideally to a single
> routine if possible and post a preprocessed source + gcc command line
> + version of gcc?

Or at least, perhaps it makes sense to identify the include file which
makes the difference. Say, revert the changes in bitops.h, retest, then
in atomic.h if the kernel still fails, etc.

Oleg.

2013-10-08 19:49:31

by Linus Torvalds

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

On Tue, Oct 8, 2013 at 12:35 PM, Oleg Nesterov <[email protected]> wrote:
>
> Cough... sorry for off-topic question,
>
> static inline int test_and_set_bit(long nr, volatile unsigned long *addr)
> {
> int oldbit;
>
> asm volatile(LOCK_PREFIX "bts %2,%1\n\t"
> "sbb %0,%0" : "=r" (oldbit), ADDR : "Ir" (nr) : "memory");
>
> doesn't this mean that "ADDR" doesn't need "+" as well?

We use ADDR for some of the non-barrier ones too, that don't have the
barrier. See clear_bit() and friends..

> Or at least, perhaps it makes sense to identify the include file which
> makes the difference. Say, revert the changes in bitops.h, retest, then
> in atomic.h if the kernel still fails, etc.

Yeah, except Fengguang is the only one seeing this in his automated tests..

Linus

2013-10-09 01:09:25

by Fengguang Wu

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel NULL pointer dereference at (null)

On Tue, Oct 08, 2013 at 10:31:57AM -0700, Linus Torvalds wrote:
> On Tue, Oct 8, 2013 at 10:15 AM, Fengguang Wu <[email protected]> wrote:
> >
> > [ 27.865982] Kernel BUG at c10563af [verbose debug info unavailable]
>
> Ugh, you've turned off DEBUG_BUGVERBOSE.
>
> We probably shouldn't even allow that. The space savings aren't worth the pain.

Ah yes, will always turn it on in future. (Was randomly turned on/off due to randconfig..)

> I'm not seeing the pattern in your oopses, there's at least three
> different cases. At a guess, it's some lock - or a memory allocator -
> that is broken by the bitop breakage, and then the oopses are just
> fallout from that..

Here I got the new set of 100 dmesgs with DEBUG_BUGVERBOSE.

Summary:

53 kernel BUG at kernel/cred.c:138!
53 invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
42 BUG: unable to handle kernel NULL pointer dereference at (null)
31 Oops: 0000 [#1] DEBUG_PAGEALLOC
19 Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6c80 with usage -1
13 Oops: 0010 [#1] DEBUG_PAGEALLOC
7 Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6d00 with usage -1
2 Oops: 0011 [#1] DEBUG_PAGEALLOC
2 BUG: unable to handle kernel NULL pointer dereference at 00000108
1 Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6b00 with usage -2
1 Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6a80 with usage -2
1 Kernel panic - not syncing: CRED: put_cred_rcu() sees c6d29280 with usage -184
1 Kernel panic - not syncing: CRED: put_cred_rcu() sees c6d28100 with usage -233
1 BUG: unable to handle kernel paging request at cd0dcc08
1 BUG: unable to handle kernel paging request at cd0dc408

First oops dump in each dmesg:

dmesg-quantal-ant-12:20131009083033:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 26.874938] No soundcards found.
[ 26.947413] debug: unmapping init [mem 0xc14df000-0xc1524fff]
modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory
[ 27.189229] BUG: unable to handle kernel NULL pointer dereference at 00000108
[ 27.190165] IP: [<c1109200>] rw_verify_area+0xa0/0x1b0
[ 27.190529] *pdpt = 0000000006d2c001 *pde = 0000000000000000
[ 27.190529] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 27.190529] Modules linked in:
[ 27.190529] CPU: 0 PID: 37 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 27.190529] task: c6c31160 ti: c6d18000 task.ti: c6d18000
[ 27.190529] EIP: 0060:[<c1109200>] EFLAGS: 00000246 CPU: 0
[ 27.190529] EIP is at rw_verify_area+0xa0/0x1b0
[ 27.190529] EAX: 00000000 EBX: 00000000 ECX: 00000000 EDX: 00000000
[ 27.190529] ESI: 00000000 EDI: c0064cc0 EBP: c6d19f60 ESP: c6d19f38
[ 27.190529] DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 0068
[ 27.190529] CR0: 8005003b CR2: 00000108 CR3: 06d2b000 CR4: 000006b0
[ 27.190529] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
[ 27.190529] DR6: 00000000 DR7: 00000000
[ 27.190529] Stack:
[ 27.190529] 00000000 c6c70c00 000000a9 00000001 00000000 00000000 00000000 0000006e
[ 27.190529] 00000000 c0064cc0 c6d19f88 c1109519 0000006e 00000030 c1307b0e c6d19f98
[ 27.190529] b7772000 c0064cc0 00000000 b7772000 c6d19fac c1109b79 c6d19f98 0000006e
[ 27.190529] Call Trace:
[ 27.190529] [<c1109519>] vfs_write+0xb9/0x1a0
[ 27.190529] [<c1307b0e>] ? restore_all+0xf/0xf
[ 27.190529] [<c1109b79>] SyS_write+0x49/0xa0
[ 27.190529] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 27.190529] Code: d6 c1 ee 1f 89 f2 81 e2 ff 00 00 00 31 c9 b8 04 e9 4c c1 e8 d3 ee f9 ff 89 f0 84 c0 74 0a f6 47 41 20 0f 84 03 01 00 00 8b 45 f0 <8b> 80 08 01 00 00 85 c0 74 0c 8b 45 f0 8b 40 14 f6 40 30 40 75
[ 27.190529] EIP: [<c1109200>] rw_verify_area+0xa0/0x1b0 SS:ESP 0068:c6d19f38
[ 27.190529] CR2: 0000000000000108
[ 27.216510] ---[ end trace 22befdde0740782e ]---


dmesg-quantal-ant-13:20131009083038:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory


[ 27.092532] BUG: unable to handle kernel NULL pointer dereference at 00000108
[ 27.093449] IP: [<c1109200>] rw_verify_area+0xa0/0x1b0
[ 27.094162] *pdpt = 0000000006d2c001 *pde = 0000000000000000
[ 27.094162] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 27.094162] Modules linked in:
[ 27.094162] CPU: 0 PID: 37 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 27.094162] task: c6c31160 ti: c6d18000 task.ti: c6d18000
[ 27.094162] EIP: 0060:[<c1109200>] EFLAGS: 00000246 CPU: 0
[ 27.094162] EIP is at rw_verify_area+0xa0/0x1b0
[ 27.094162] EAX: 00000000 EBX: 00000000 ECX: 00000000 EDX: 00000000
[ 27.094162] ESI: 00000000 EDI: c0064cc0 EBP: c6d19f60 ESP: c6d19f38
[ 27.094162] DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 0068
[ 27.094162] CR0: 8005003b CR2: 00000108 CR3: 06d2b000 CR4: 000006b0
[ 27.094162] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
[ 27.094162] DR6: 00000000 DR7: 00000000
[ 27.094162] Stack:
[ 27.094162] 00000002 00000000 00000000 00000001 00000000 00000000 00000000 00000002
[ 27.094162] 00000000 c0064cc0 c6d19f88 c1109519 00000002 00000000 c1307b0e c6d19f98
[ 27.094162] b7792000 c0064cc0 00000000 b7792000 c6d19fac c1109b79 c6d19f98 00000002
[ 27.094162] Call Trace:
[ 27.094162] [<c1109519>] vfs_write+0xb9/0x1a0
[ 27.094162] [<c1307b0e>] ? restore_all+0xf/0xf
[ 27.094162] [<c1109b79>] SyS_write+0x49/0xa0
[ 27.094162] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 27.094162] Code: d6 c1 ee 1f 89 f2 81 e2 ff 00 00 00 31 c9 b8 04 e9 4c c1 e8 d3 ee f9 ff 89 f0 84 c0 74 0a f6 47 41 20 0f 84 03 01 00 00 8b 45 f0 <8b> 80 08 01 00 00 85 c0 74 0c 8b 45 f0 8b 40 14 f6 40 30 40 75
[ 27.094162] EIP: [<c1109200>] rw_verify_area+0xa0/0x1b0 SS:ESP 0068:c6d19f38
[ 27.094162] CR2: 0000000000000108
[ 27.119392] ---[ end trace 2bb714af200792b7 ]---
[ 27.144424] Kernel panic - not syncing: CRED: put_cred_rcu() sees c6d28100 with usage -233

dmesg-quantal-ant-9:20131009083014:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1


[ 26.385658] VFS: Close: file count is 0

[ 26.427323] Kernel panic - not syncing: CRED: put_cred_rcu() sees c6d29280 with usage -184
[ 26.427323]
[ 26.428852] CPU: 0 PID: 3 Comm: ksoftirqd/0 Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 26.429851] c6d29280 c0041e6c c1301381 c0041e8c c12fdceb c1402ea8 c1533f80 00000293
[ 26.429851] c6d292d8 c6d29280 00000293 c0041ea8 c1056641 c1403e6c c6d29280 ffffff48
[ 26.429851] c6d292d8 c6d29158 c0041ebc c1092942 c0031160 00000009 c0040000 c0041ec4
[ 26.429851] Call Trace:
[ 26.429851] [<c1301381>] dump_stack+0x16/0x18
[ 26.429851] [<c12fdceb>] panic+0x8c/0x17c
[ 26.429851] [<c1056641>] put_cred_rcu+0x91/0xa0
[ 26.429851] [<c1092942>] __rcu_process_callbacks+0x62/0xc0
[ 26.429851] [<c10929b2>] rcu_process_callbacks+0x12/0x20
[ 26.429851] [<c10351c8>] __do_softirq+0xc8/0x210
[ 26.429851] [<c1196294>] ? trace_hardirqs_on_thunk+0xc/0x10
[ 26.429851] [<c109313e>] ? rcu_irq_exit+0xee/0x130
[ 26.429851] [<c1035351>] ? run_ksoftirqd+0x41/0x60
[ 26.429851] [<c1035345>] run_ksoftirqd+0x35/0x60
[ 26.429851] [<c10587d3>] smpboot_thread_fn+0xf3/0x190
[ 26.429851] [<c10586e0>] ? lg_global_unlock+0x30/0x30
[ 26.429851] [<c1050c42>] kthread+0x92/0xa0
[ 26.429851] [<c130ee1b>] ret_from_kernel_thread+0x1b/0x30
[ 26.429851] [<c1050bb0>] ? kthread_create_on_node+0xd0/0xd0


dmesg-quantal-bens-3:20131009082943:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 2.268582] ------------[ cut here ]------------
[ 2.269353] kernel BUG at kernel/cred.c:138!
[ 2.270402] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 2.271287] Modules linked in:
[ 2.271456] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 2.271456] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 2.271456] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 2.271456] EIP is at __put_cred+0x56/0x90
[ 2.271456] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 2.271456] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 2.271456] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 2.271456] CR0: 8005003b CR2: b779e000 CR3: 06d1e000 CR4: 000006b0
[ 2.271456] Stack:
[ 2.271456] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 2.271456] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 2.271456] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 2.271456] Call Trace:
[ 2.271456] [<c110a678>] file_free_rcu+0x28/0x40
[ 2.271456] [<c104d7d9>] task_work_run+0x79/0xa0
[ 2.271456] [<c10311d2>] do_exit+0x2f2/0x960
[ 2.271456] [<c110a8a6>] ? __fput+0x216/0x380
[ 2.271456] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 2.271456] [<c1032838>] SyS_exit_group+0x18/0x20
[ 2.271456] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 2.271456] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 2.271456] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 2.295544] ---[ end trace a3de6cf436968a03 ]---
[ 2.296305] Fixing recursive fault but reboot is needed!

dmesg-quantal-cairo-13:20131009082930:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 1.135621] ------------[ cut here ]------------
[ 1.135783] kernel BUG at kernel/cred.c:138!
[ 1.135783] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 1.135783] Modules linked in:
[ 1.135783] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.135783] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 1.135783] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 1.135783] EIP is at __put_cred+0x56/0x90
[ 1.135783] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 1.135783] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 1.135783] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.135783] CR0: 8005003b CR2: b7737000 CR3: 06d1e000 CR4: 000006b0
[ 1.135783] Stack:
[ 1.135783] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 1.135783] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 1.135783] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 1.135783] Call Trace:
[ 1.135783] [<c110a678>] file_free_rcu+0x28/0x40
[ 1.135783] [<c104d7d9>] task_work_run+0x79/0xa0
[ 1.135783] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.135783] [<c110a8a6>] ? __fput+0x216/0x380
[ 1.135783] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.135783] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.135783] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 1.135783] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 1.135783] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 1.151317] ---[ end trace 38eec569d1938da4 ]---
[ 1.151773] Fixing recursive fault but reboot is needed!

dmesg-quantal-cairo-22:20131009083037:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 1.112717] ------------[ cut here ]------------
[ 1.112954] kernel BUG at kernel/cred.c:138!
[ 1.112954] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 1.112954] Modules linked in:
[ 1.112954] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.112954] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 1.112954] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 1.112954] EIP is at __put_cred+0x56/0x90
[ 1.112954] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 1.112954] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 1.112954] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.112954] CR0: 8005003b CR2: b7728000 CR3: 06d1e000 CR4: 000006b0
[ 1.112954] Stack:
[ 1.112954] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 1.112954] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 1.112954] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 1.112954] Call Trace:
[ 1.112954] [<c110a678>] file_free_rcu+0x28/0x40
[ 1.112954] [<c104d7d9>] task_work_run+0x79/0xa0
[ 1.112954] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.112954] [<c110a8a6>] ? __fput+0x216/0x380
[ 1.112954] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.112954] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.112954] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 1.112954] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 1.112954] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 1.128337] ---[ end trace fd184ac698a97fbc ]---
[ 1.128782] Fixing recursive fault but reboot is needed!

dmesg-quantal-cairo-24:20131009083033:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 1.153145] ------------[ cut here ]------------
[ 1.153623] kernel BUG at kernel/cred.c:138!
[ 1.154236] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 1.154236] Modules linked in:
[ 1.154236] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.154236] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 1.154236] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 1.154236] EIP is at __put_cred+0x56/0x90
[ 1.154236] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 1.154236] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 1.154236] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.154236] CR0: 8005003b CR2: b777a000 CR3: 06d1e000 CR4: 000006b0
[ 1.154236] Stack:
[ 1.154236] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 1.154236] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 1.154236] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 1.154236] Call Trace:
[ 1.154236] [<c110a678>] file_free_rcu+0x28/0x40
[ 1.154236] [<c104d7d9>] task_work_run+0x79/0xa0
[ 1.154236] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.154236] [<c110a8a6>] ? __fput+0x216/0x380
[ 1.154236] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.154236] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.154236] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 1.154236] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 1.154236] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 1.169448] ---[ end trace 50e2047aac671e3f ]---
[ 1.169900] Fixing recursive fault but reboot is needed!

dmesg-quantal-cairo-33:20131009082955:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 1.123293] ------------[ cut here ]------------
[ 1.123563] kernel BUG at kernel/cred.c:138!
[ 1.123563] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 1.123563] Modules linked in:
[ 1.123563] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.123563] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 1.123563] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 1.123563] EIP is at __put_cred+0x56/0x90
[ 1.123563] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 1.123563] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 1.123563] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.123563] CR0: 8005003b CR2: b77ae000 CR3: 06d1e000 CR4: 000006b0
[ 1.123563] Stack:
[ 1.123563] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 1.123563] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 1.123563] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 1.123563] Call Trace:
[ 1.123563] [<c110a678>] file_free_rcu+0x28/0x40
[ 1.123563] [<c104d7d9>] task_work_run+0x79/0xa0
[ 1.123563] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.123563] [<c110a8a6>] ? __fput+0x216/0x380
[ 1.123563] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.123563] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.123563] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 1.123563] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 1.123563] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 1.143604] ---[ end trace 91b0b65f94c59b56 ]---
[ 1.144073] Fixing recursive fault but reboot is needed!

dmesg-quantal-inn-10:20131009083017:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 0.962733] ------------[ cut here ]------------
[ 0.963146] kernel BUG at kernel/cred.c:138!
[ 0.963693] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 0.964156] Modules linked in:
[ 0.964437] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.964711] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 0.964711] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 0.964711] EIP is at __put_cred+0x56/0x90
[ 0.964711] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 0.964711] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 0.964711] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.964711] CR0: 8005003b CR2: b77b6000 CR3: 06d1e000 CR4: 000006b0
[ 0.964711] Stack:
[ 0.964711] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 0.964711] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 0.964711] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 0.964711] Call Trace:
[ 0.964711] [<c110a678>] file_free_rcu+0x28/0x40
[ 0.964711] [<c104d7d9>] task_work_run+0x79/0xa0
[ 0.964711] [<c10311d2>] do_exit+0x2f2/0x960
[ 0.964711] [<c110a8a6>] ? __fput+0x216/0x380
[ 0.964711] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 0.964711] [<c1032838>] SyS_exit_group+0x18/0x20
[ 0.964711] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 0.964711] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 0.964711] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 0.976567] ---[ end trace 0cff5600ae12fa6a ]---
[ 0.976970] Fixing recursive fault but reboot is needed!

dmesg-quantal-inn-10:20131009083046:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 0.998718] ------------[ cut here ]------------
[ 0.999107] kernel BUG at kernel/cred.c:138!
[ 0.999617] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 1.000053] Modules linked in:
[ 1.000315] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.000917] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 1.001354] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 1.001354] EIP is at __put_cred+0x56/0x90
[ 1.001354] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 1.001354] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 1.001354] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.001354] CR0: 8005003b CR2: b7725000 CR3: 06d1e000 CR4: 000006b0
[ 1.001354] Stack:
[ 1.001354] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 1.001354] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 1.001354] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 1.001354] Call Trace:
[ 1.001354] [<c110a678>] file_free_rcu+0x28/0x40
[ 1.001354] [<c104d7d9>] task_work_run+0x79/0xa0
[ 1.001354] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.001354] [<c110a8a6>] ? __fput+0x216/0x380
[ 1.001354] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.001354] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.001354] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 1.001354] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 1.001354] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 1.011887] ---[ end trace 3d22c23b9f09a820 ]---
[ 1.012260] Fixing recursive fault but reboot is needed!

dmesg-quantal-inn-11:20131009082919:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 0.888031] ------------[ cut here ]------------
[ 0.888200] kernel BUG at kernel/cred.c:138!
[ 0.888200] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 0.888200] Modules linked in:
[ 0.888200] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.888200] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 0.888200] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 0.888200] EIP is at __put_cred+0x56/0x90
[ 0.888200] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 0.888200] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 0.888200] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.888200] CR0: 8005003b CR2: b77d1000 CR3: 06d1e000 CR4: 000006b0
[ 0.888200] Stack:
[ 0.888200] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 0.888200] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 0.888200] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 0.888200] Call Trace:
[ 0.888200] [<c110a678>] file_free_rcu+0x28/0x40
[ 0.888200] [<c104d7d9>] task_work_run+0x79/0xa0
[ 0.888200] [<c10311d2>] do_exit+0x2f2/0x960
[ 0.888200] [<c110a8a6>] ? __fput+0x216/0x380
[ 0.888200] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 0.888200] [<c1032838>] SyS_exit_group+0x18/0x20
[ 0.888200] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 0.888200] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 0.888200] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 0.899760] ---[ end trace 9a6328c0b52429fd ]---
[ 0.900100] Fixing recursive fault but reboot is needed!

dmesg-quantal-inn-11:20131009082959:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 0.952986] ------------[ cut here ]------------
[ 0.953386] kernel BUG at kernel/cred.c:138!
[ 0.953592] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 0.953592] Modules linked in:
[ 0.953592] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.953592] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 0.953592] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 0.953592] EIP is at __put_cred+0x56/0x90
[ 0.953592] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 0.953592] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 0.953592] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.953592] CR0: 8005003b CR2: b773a000 CR3: 06d1e000 CR4: 000006b0
[ 0.953592] Stack:
[ 0.953592] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 0.953592] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 0.953592] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 0.953592] Call Trace:
[ 0.953592] [<c110a678>] file_free_rcu+0x28/0x40
[ 0.953592] [<c104d7d9>] task_work_run+0x79/0xa0
[ 0.953592] [<c10311d2>] do_exit+0x2f2/0x960
[ 0.953592] [<c110a8a6>] ? __fput+0x216/0x380
[ 0.953592] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 0.953592] [<c1032838>] SyS_exit_group+0x18/0x20
[ 0.953592] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 0.953592] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 0.953592] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 0.966456] ---[ end trace c173b35c9b101412 ]---
[ 0.966844] Fixing recursive fault but reboot is needed!

dmesg-quantal-inn-11:20131009083034:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 0.955160] ------------[ cut here ]------------
[ 0.955536] kernel BUG at kernel/cred.c:138!
[ 0.956108] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 0.956531] Modules linked in:
[ 0.956809] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.957415] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 0.957875] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 0.958307] EIP is at __put_cred+0x56/0x90
[ 0.958432] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 0.958432] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 0.958432] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.958432] CR0: 8005003b CR2: b775b000 CR3: 06d1e000 CR4: 000006b0
[ 0.958432] Stack:
[ 0.958432] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 0.958432] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 0.958432] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 0.958432] Call Trace:
[ 0.958432] [<c110a678>] file_free_rcu+0x28/0x40
[ 0.958432] [<c104d7d9>] task_work_run+0x79/0xa0
[ 0.958432] [<c10311d2>] do_exit+0x2f2/0x960
[ 0.958432] [<c110a8a6>] ? __fput+0x216/0x380
[ 0.958432] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 0.958432] [<c1032838>] SyS_exit_group+0x18/0x20
[ 0.958432] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 0.958432] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 0.958432] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 0.968706] ---[ end trace 2a42ce5a98fb95b1 ]---
[ 0.969107] Fixing recursive fault but reboot is needed!

dmesg-quantal-inn-19:20131009083025:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 0.991460] ------------[ cut here ]------------
[ 0.991864] kernel BUG at kernel/cred.c:138!
[ 0.992413] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 0.992866] Modules linked in:
[ 0.992985] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.992985] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 0.992985] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 0.992985] EIP is at __put_cred+0x56/0x90
[ 0.992985] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 0.992985] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 0.992985] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.992985] CR0: 8005003b CR2: b77a3000 CR3: 06d1e000 CR4: 000006b0
[ 0.992985] Stack:
[ 0.992985] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 0.992985] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 0.992985] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 0.992985] Call Trace:
[ 0.992985] [<c110a678>] file_free_rcu+0x28/0x40
[ 0.992985] [<c104d7d9>] task_work_run+0x79/0xa0
[ 0.992985] [<c10311d2>] do_exit+0x2f2/0x960
[ 0.992985] [<c110a8a6>] ? __fput+0x216/0x380
[ 0.992985] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 0.992985] [<c1032838>] SyS_exit_group+0x18/0x20
[ 0.992985] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 0.992985] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 0.992985] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 1.005137] ---[ end trace 20d6a5e900451e9c ]---
[ 1.005534] Fixing recursive fault but reboot is needed!

dmesg-quantal-inn-23:20131009083004:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 0.882992] ------------[ cut here ]------------
[ 0.883362] kernel BUG at kernel/cred.c:138!
[ 0.883483] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 0.883483] Modules linked in:
[ 0.883483] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.883483] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 0.883483] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 0.883483] EIP is at __put_cred+0x56/0x90
[ 0.883483] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 0.883483] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 0.883483] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.883483] CR0: 8005003b CR2: b775e000 CR3: 06d1e000 CR4: 000006b0
[ 0.883483] Stack:
[ 0.883483] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 0.883483] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 0.883483] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 0.883483] Call Trace:
[ 0.883483] [<c110a678>] file_free_rcu+0x28/0x40
[ 0.883483] [<c104d7d9>] task_work_run+0x79/0xa0
[ 0.883483] [<c10311d2>] do_exit+0x2f2/0x960
[ 0.883483] [<c110a8a6>] ? __fput+0x216/0x380
[ 0.883483] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 0.883483] [<c1032838>] SyS_exit_group+0x18/0x20
[ 0.883483] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 0.883483] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 0.883483] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 0.895298] ---[ end trace 5ff84eada961bbe0 ]---
[ 0.895657] Fixing recursive fault but reboot is needed!

dmesg-quantal-inn-27:20131009082953:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 0.894829] ------------[ cut here ]------------
[ 0.895201] kernel BUG at kernel/cred.c:138!
[ 0.895709] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 0.896127] Modules linked in:
[ 0.896383] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.896974] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 0.897393] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 0.897708] EIP is at __put_cred+0x56/0x90
[ 0.897708] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 0.897708] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 0.897708] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.897708] CR0: 8005003b CR2: b7715000 CR3: 06d1e000 CR4: 000006b0
[ 0.897708] Stack:
[ 0.897708] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 0.897708] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 0.897708] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 0.897708] Call Trace:
[ 0.897708] [<c110a678>] file_free_rcu+0x28/0x40
[ 0.897708] [<c104d7d9>] task_work_run+0x79/0xa0
[ 0.897708] [<c10311d2>] do_exit+0x2f2/0x960
[ 0.897708] [<c110a8a6>] ? __fput+0x216/0x380
[ 0.897708] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 0.897708] [<c1032838>] SyS_exit_group+0x18/0x20
[ 0.897708] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 0.897708] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 0.897708] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 0.907572] ---[ end trace 1d83451c0cb952ef ]---
[ 0.908004] Fixing recursive fault but reboot is needed!

dmesg-quantal-inn-28:20131009083000:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 0.988359] ------------[ cut here ]------------
[ 0.988513] kernel BUG at kernel/cred.c:138!
[ 0.988513] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 0.988513] Modules linked in:
[ 0.988513] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.988513] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 0.988513] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 0.988513] EIP is at __put_cred+0x56/0x90
[ 0.988513] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 0.988513] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 0.988513] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.988513] CR0: 8005003b CR2: b76f0000 CR3: 06d1e000 CR4: 000006b0
[ 0.988513] Stack:
[ 0.988513] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 0.988513] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 0.988513] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 0.988513] Call Trace:
[ 0.988513] [<c110a678>] file_free_rcu+0x28/0x40
[ 0.988513] [<c104d7d9>] task_work_run+0x79/0xa0
[ 0.988513] [<c10311d2>] do_exit+0x2f2/0x960
[ 0.988513] [<c110a8a6>] ? __fput+0x216/0x380
[ 0.988513] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 0.988513] [<c1032838>] SyS_exit_group+0x18/0x20
[ 0.988513] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 0.988513] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 0.988513] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 1.001452] ---[ end trace 9ac2dd9a66eec0e0 ]---
[ 1.001898] Fixing recursive fault but reboot is needed!

dmesg-quantal-inn-2:20131009082911:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 1.108180] ------------[ cut here ]------------
[ 1.108621] kernel BUG at kernel/cred.c:138!
[ 1.109218] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 1.109715] Modules linked in:
[ 1.110023] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.110711] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 1.111209] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 1.111319] EIP is at __put_cred+0x56/0x90
[ 1.111319] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 1.111319] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 1.111319] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.111319] CR0: 8005003b CR2: b76f5000 CR3: 06d1e000 CR4: 000006b0
[ 1.111319] Stack:
[ 1.111319] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 1.111319] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 1.111319] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 1.111319] Call Trace:
[ 1.111319] [<c110a678>] file_free_rcu+0x28/0x40
[ 1.111319] [<c104d7d9>] task_work_run+0x79/0xa0
[ 1.111319] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.111319] [<c110a8a6>] ? __fput+0x216/0x380
[ 1.111319] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.111319] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.111319] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 1.111319] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 1.111319] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 1.123117] ---[ end trace 9e8ea8004d1d2e91 ]---
[ 1.123548] Fixing recursive fault but reboot is needed!

dmesg-quantal-inn-2:20131009082950:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 0.925433] ------------[ cut here ]------------
[ 0.925785] kernel BUG at kernel/cred.c:138!
[ 0.926256] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 0.926654] Modules linked in:
[ 0.926896] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.927451] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 0.927943] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 0.928141] EIP is at __put_cred+0x56/0x90
[ 0.928141] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 0.928141] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 0.928141] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.928141] CR0: 8005003b CR2: b771d000 CR3: 06d1e000 CR4: 000006b0
[ 0.928141] Stack:
[ 0.928141] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 0.928141] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 0.928141] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 0.928141] Call Trace:
[ 0.928141] [<c110a678>] file_free_rcu+0x28/0x40
[ 0.928141] [<c104d7d9>] task_work_run+0x79/0xa0
[ 0.928141] [<c10311d2>] do_exit+0x2f2/0x960
[ 0.928141] [<c110a8a6>] ? __fput+0x216/0x380
[ 0.928141] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 0.928141] [<c1032838>] SyS_exit_group+0x18/0x20
[ 0.928141] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 0.928141] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 0.928141] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 0.937198] ---[ end trace ddb5714942bd4736 ]---
[ 0.937544] Fixing recursive fault but reboot is needed!

dmesg-quantal-inn-34:20131009083013:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 1.037940] ------------[ cut here ]------------
[ 1.038094] kernel BUG at kernel/cred.c:138!
[ 1.038094] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 1.038094] Modules linked in:
[ 1.038094] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.038094] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 1.038094] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 1.038094] EIP is at __put_cred+0x56/0x90
[ 1.038094] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 1.038094] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 1.038094] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.038094] CR0: 8005003b CR2: b7782000 CR3: 06d1e000 CR4: 000006b0
[ 1.038094] Stack:
[ 1.038094] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 1.038094] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 1.038094] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 1.038094] Call Trace:
[ 1.038094] [<c110a678>] file_free_rcu+0x28/0x40
[ 1.038094] [<c104d7d9>] task_work_run+0x79/0xa0
[ 1.038094] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.038094] [<c110a8a6>] ? __fput+0x216/0x380
[ 1.038094] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.038094] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.038094] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 1.038094] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 1.038094] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 1.051035] ---[ end trace b78a771439c9a685 ]---
[ 1.051451] Fixing recursive fault but reboot is needed!

dmesg-quantal-inn-39:20131009083045:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 1.015270] ------------[ cut here ]------------
[ 1.015695] kernel BUG at kernel/cred.c:138!
[ 1.016189] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 1.016189] Modules linked in:
[ 1.016189] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.016189] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 1.016189] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 1.016189] EIP is at __put_cred+0x56/0x90
[ 1.016189] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 1.016189] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 1.016189] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.016189] CR0: 8005003b CR2: b7775000 CR3: 06d1e000 CR4: 000006b0
[ 1.016189] Stack:
[ 1.016189] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 1.016189] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 1.016189] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 1.016189] Call Trace:
[ 1.016189] [<c110a678>] file_free_rcu+0x28/0x40
[ 1.016189] [<c104d7d9>] task_work_run+0x79/0xa0
[ 1.016189] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.016189] [<c110a8a6>] ? __fput+0x216/0x380
[ 1.016189] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.016189] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.016189] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 1.016189] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 1.016189] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 1.028301] ---[ end trace 989bdfa831fbd776 ]---
[ 1.028745] Fixing recursive fault but reboot is needed!

dmesg-quantal-inn-44:20131009083043:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 0.926919] ------------[ cut here ]------------
[ 0.927291] kernel BUG at kernel/cred.c:138!
[ 0.927707] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 0.927707] Modules linked in:
[ 0.927707] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.927707] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 0.927707] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 0.927707] EIP is at __put_cred+0x56/0x90
[ 0.927707] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 0.927707] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 0.927707] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.927707] CR0: 8005003b CR2: b77cb000 CR3: 06d1e000 CR4: 000006b0
[ 0.927707] Stack:
[ 0.927707] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 0.927707] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 0.927707] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 0.927707] Call Trace:
[ 0.927707] [<c110a678>] file_free_rcu+0x28/0x40
[ 0.927707] [<c104d7d9>] task_work_run+0x79/0xa0
[ 0.927707] [<c10311d2>] do_exit+0x2f2/0x960
[ 0.927707] [<c110a8a6>] ? __fput+0x216/0x380
[ 0.927707] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 0.927707] [<c1032838>] SyS_exit_group+0x18/0x20
[ 0.927707] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 0.927707] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 0.927707] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 0.939538] ---[ end trace 799bfb3cd9dae4f8 ]---
[ 0.939907] Fixing recursive fault but reboot is needed!

dmesg-quantal-inn-46:20131009083026:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 0.939364] ------------[ cut here ]------------
[ 0.939749] kernel BUG at kernel/cred.c:138!
[ 0.940241] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 0.940433] Modules linked in:
[ 0.940433] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.940433] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 0.940433] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 0.940433] EIP is at __put_cred+0x56/0x90
[ 0.940433] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 0.940433] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 0.940433] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.940433] CR0: 8005003b CR2: b7772000 CR3: 06d1e000 CR4: 000006b0
[ 0.940433] Stack:
[ 0.940433] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 0.940433] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 0.940433] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 0.940433] Call Trace:
[ 0.940433] [<c110a678>] file_free_rcu+0x28/0x40
[ 0.940433] [<c104d7d9>] task_work_run+0x79/0xa0
[ 0.940433] [<c10311d2>] do_exit+0x2f2/0x960
[ 0.940433] [<c110a8a6>] ? __fput+0x216/0x380
[ 0.940433] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 0.940433] [<c1032838>] SyS_exit_group+0x18/0x20
[ 0.940433] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 0.940433] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 0.940433] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 0.951713] ---[ end trace c8ed5a640a0f5929 ]---
[ 0.952074] Fixing recursive fault but reboot is needed!

dmesg-quantal-inn-47:20131009083039:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 0.981110] ------------[ cut here ]------------
[ 0.981492] kernel BUG at kernel/cred.c:138!
[ 0.982018] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 0.982446] Modules linked in:
[ 0.982750] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.982750] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 0.982750] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 0.982750] EIP is at __put_cred+0x56/0x90
[ 0.982750] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 0.982750] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 0.982750] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.982750] CR0: 8005003b CR2: b776f000 CR3: 06d1e000 CR4: 000006b0
[ 0.982750] Stack:
[ 0.982750] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 0.982750] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 0.982750] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 0.982750] Call Trace:
[ 0.982750] [<c110a678>] file_free_rcu+0x28/0x40
[ 0.982750] [<c104d7d9>] task_work_run+0x79/0xa0
[ 0.982750] [<c10311d2>] do_exit+0x2f2/0x960
[ 0.982750] [<c110a8a6>] ? __fput+0x216/0x380
[ 0.982750] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 0.982750] [<c1032838>] SyS_exit_group+0x18/0x20
[ 0.982750] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 0.982750] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 0.982750] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 0.994204] ---[ end trace 0be85597c1e160f7 ]---
[ 0.994578] Fixing recursive fault but reboot is needed!

dmesg-quantal-inn-6:20131009083024:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 0.940191] ------------[ cut here ]------------
[ 0.940466] kernel BUG at kernel/cred.c:138!
[ 0.940466] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 0.940466] Modules linked in:
[ 0.940466] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.940466] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 0.940466] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 0.940466] EIP is at __put_cred+0x56/0x90
[ 0.940466] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 0.940466] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 0.940466] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.940466] CR0: 8005003b CR2: b7778000 CR3: 06d1e000 CR4: 000006b0
[ 0.940466] Stack:
[ 0.940466] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 0.940466] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 0.940466] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 0.940466] Call Trace:
[ 0.940466] [<c110a678>] file_free_rcu+0x28/0x40
[ 0.940466] [<c104d7d9>] task_work_run+0x79/0xa0
[ 0.940466] [<c10311d2>] do_exit+0x2f2/0x960
[ 0.940466] [<c110a8a6>] ? __fput+0x216/0x380
[ 0.940466] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 0.940466] [<c1032838>] SyS_exit_group+0x18/0x20
[ 0.940466] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 0.940466] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 0.940466] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 0.952421] ---[ end trace f6790d9b0982f4ad ]---
[ 0.952766] Fixing recursive fault but reboot is needed!

dmesg-quantal-jaketown-14:20131009083036:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 3.729442] ------------[ cut here ]------------
[ 3.731501] kernel BUG at kernel/cred.c:138!
[ 3.731646] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 3.731646] Modules linked in:
[ 3.731646] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 3.731646] task: c6c2a2c0 ti: c6d16000 task.ti: c6d16000
[ 3.731646] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 3.731646] EIP is at __put_cred+0x56/0x90
[ 3.731646] EAX: c14c3720 EBX: c6d11080 ECX: 00000000 EDX: 00000001
[ 3.731646] ESI: c6c2a2c0 EDI: 00000001 EBP: c6d17f24 ESP: c6d17f18
[ 3.731646] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 3.731646] CR0: 8005003b CR2: b77af000 CR3: 06d12000 CR4: 000006b0
[ 3.731646] Stack:
[ 3.731646] c006ee00 c6c2a558 c6c2a2c0 c6d17f30 c110a678 c006ed00 c6d17f44 c104d7d9
[ 3.731646] c6c2a570 c6d18000 c6c2a2c0 c6d17f8c c10311d2 00000000 c6d17f80 c110a8a6
[ 3.731646] 00000001 00000001 00000000 00000246 00000001 c6c2a558 c6d18050 c6c2a2c0
[ 3.731646] Call Trace:
[ 3.731646] [<c110a678>] file_free_rcu+0x28/0x40
[ 3.731646] [<c104d7d9>] task_work_run+0x79/0xa0
[ 3.731646] [<c10311d2>] do_exit+0x2f2/0x960
[ 3.731646] [<c110a8a6>] ? __fput+0x216/0x380
[ 3.731646] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 3.731646] [<c1032838>] SyS_exit_group+0x18/0x20
[ 3.731646] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 3.731646] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 3.731646] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d17f18
[ 3.798770] ---[ end trace d4ea3bd32256ce77 ]---
[ 3.800768] Fixing recursive fault but reboot is needed!

dmesg-quantal-jaketown-24:20131009082937:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 3.101013] ------------[ cut here ]------------
[ 3.102243] kernel BUG at kernel/cred.c:138!
[ 3.103409] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 3.103409] Modules linked in:
[ 3.103409] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 3.103409] task: c6c2a2c0 ti: c6d16000 task.ti: c6d16000
[ 3.103409] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 3.103409] EIP is at __put_cred+0x56/0x90
[ 3.103409] EAX: c14c3720 EBX: c6d11080 ECX: 00000000 EDX: 00000001
[ 3.103409] ESI: c6c2a2c0 EDI: 00000001 EBP: c6d17f24 ESP: c6d17f18
[ 3.103409] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 3.103409] CR0: 8005003b CR2: bfab1fe8 CR3: 06d12000 CR4: 000006b0
[ 3.103409] Stack:
[ 3.103409] c006ee00 c6c2a558 c6c2a2c0 c6d17f30 c110a678 c006ed00 c6d17f44 c104d7d9
[ 3.103409] c6c2a570 c6d18000 c6c2a2c0 c6d17f8c c10311d2 00000000 c6d17f80 c110a8a6
[ 3.103409] 00000001 00000001 00000000 00000246 00000001 c6c2a558 c6d18050 c6c2a2c0
[ 3.103409] Call Trace:
[ 3.103409] [<c110a678>] file_free_rcu+0x28/0x40
[ 3.103409] [<c104d7d9>] task_work_run+0x79/0xa0
[ 3.103409] [<c10311d2>] do_exit+0x2f2/0x960
[ 3.103409] [<c110a8a6>] ? __fput+0x216/0x380
[ 3.103409] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 3.103409] [<c1032838>] SyS_exit_group+0x18/0x20
[ 3.103409] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 3.103409] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 3.103409] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d17f18
[ 3.142873] ---[ end trace 93e1e854462d0bf5 ]---
[ 3.144183] Fixing recursive fault but reboot is needed!

dmesg-quantal-jaketown-36:20131009082956:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 3.597372] ------------[ cut here ]------------
[ 3.599193] kernel BUG at kernel/cred.c:138!
[ 3.600469] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 3.600469] Modules linked in:
[ 3.600469] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 3.600469] task: c6c2a2c0 ti: c6d16000 task.ti: c6d16000
[ 3.600469] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 3.600469] EIP is at __put_cred+0x56/0x90
[ 3.600469] EAX: c14c3720 EBX: c6d11080 ECX: 00000000 EDX: 00000001
[ 3.600469] ESI: c6c2a2c0 EDI: 00000001 EBP: c6d17f24 ESP: c6d17f18
[ 3.600469] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 3.600469] CR0: 8005003b CR2: b7778000 CR3: 06d12000 CR4: 000006b0
[ 3.600469] Stack:
[ 3.600469] c006ee00 c6c2a558 c6c2a2c0 c6d17f30 c110a678 c006ed00 c6d17f44 c104d7d9
[ 3.600469] c6c2a570 c6d18000 c6c2a2c0 c6d17f8c c10311d2 00000000 c6d17f80 c110a8a6
[ 3.600469] 00000001 00000001 00000000 00000246 00000001 c6c2a558 c6d18050 c6c2a2c0
[ 3.600469] Call Trace:
[ 3.600469] [<c110a678>] file_free_rcu+0x28/0x40
[ 3.600469] [<c104d7d9>] task_work_run+0x79/0xa0
[ 3.600469] [<c10311d2>] do_exit+0x2f2/0x960
[ 3.600469] [<c110a8a6>] ? __fput+0x216/0x380
[ 3.600469] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 3.600469] [<c1032838>] SyS_exit_group+0x18/0x20
[ 3.600469] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 3.600469] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 3.600469] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d17f18
[ 3.660723] ---[ end trace a74e540bbc8c14e0 ]---
[ 3.662884] Fixing recursive fault but reboot is needed!

dmesg-quantal-jaketown-3:20131009083032:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 3.635049] ------------[ cut here ]------------
[ 3.637062] kernel BUG at kernel/cred.c:138!
[ 3.637162] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 3.637162] Modules linked in:
[ 3.637162] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 3.637162] task: c6c2a2c0 ti: c6d16000 task.ti: c6d16000
[ 3.637162] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 3.637162] EIP is at __put_cred+0x56/0x90
[ 3.637162] EAX: c14c3720 EBX: c6d11080 ECX: 00000000 EDX: 00000001
[ 3.637162] ESI: c6c2a2c0 EDI: 00000001 EBP: c6d17f24 ESP: c6d17f18
[ 3.637162] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 3.637162] CR0: 8005003b CR2: b7787000 CR3: 06d12000 CR4: 000006b0
[ 3.637162] Stack:
[ 3.637162] c006ee00 c6c2a558 c6c2a2c0 c6d17f30 c110a678 c006ed00 c6d17f44 c104d7d9
[ 3.637162] c6c2a570 c6d18000 c6c2a2c0 c6d17f8c c10311d2 00000000 c6d17f80 c110a8a6
[ 3.637162] 00000001 00000001 00000000 00000246 00000001 c6c2a558 c6d18050 c6c2a2c0
[ 3.637162] Call Trace:
[ 3.637162] [<c110a678>] file_free_rcu+0x28/0x40
[ 3.637162] [<c104d7d9>] task_work_run+0x79/0xa0
[ 3.637162] [<c10311d2>] do_exit+0x2f2/0x960
[ 3.637162] [<c110a8a6>] ? __fput+0x216/0x380
[ 3.637162] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 3.637162] [<c1032838>] SyS_exit_group+0x18/0x20
[ 3.637162] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 3.637162] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 3.637162] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d17f18
[ 3.703278] ---[ end trace 6a2dbe544903d737 ]---
[ 3.705295] Fixing recursive fault but reboot is needed!

dmesg-quantal-jaketown-43:20131009083041:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 3.606671] ------------[ cut here ]------------
[ 3.608216] kernel BUG at kernel/cred.c:138!
[ 3.608216] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 3.608216] Modules linked in:
[ 3.608216] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 3.608216] task: c6c2a2c0 ti: c6d16000 task.ti: c6d16000
[ 3.608216] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 3.608216] EIP is at __put_cred+0x56/0x90
[ 3.608216] EAX: c14c3720 EBX: c6d11080 ECX: 00000000 EDX: 00000001
[ 3.608216] ESI: c6c2a2c0 EDI: 00000001 EBP: c6d17f24 ESP: c6d17f18
[ 3.608216] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 3.608216] CR0: 8005003b CR2: b77a4000 CR3: 06d12000 CR4: 000006b0
[ 3.608216] Stack:
[ 3.608216] c006ee00 c6c2a558 c6c2a2c0 c6d17f30 c110a678 c006ed00 c6d17f44 c104d7d9
[ 3.608216] c6c2a570 c6d18000 c6c2a2c0 c6d17f8c c10311d2 00000000 c6d17f80 c110a8a6
[ 3.608216] 00000001 00000001 00000000 00000246 00000001 c6c2a558 c6d18050 c6c2a2c0
[ 3.608216] Call Trace:
[ 3.608216] [<c110a678>] file_free_rcu+0x28/0x40
[ 3.608216] [<c104d7d9>] task_work_run+0x79/0xa0
[ 3.608216] [<c10311d2>] do_exit+0x2f2/0x960
[ 3.608216] [<c110a8a6>] ? __fput+0x216/0x380
[ 3.608216] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 3.608216] [<c1032838>] SyS_exit_group+0x18/0x20
[ 3.608216] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 3.608216] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 3.608216] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d17f18
[ 3.677889] ---[ end trace 3635cf3e99716285 ]---
[ 3.680041] Fixing recursive fault but reboot is needed!

dmesg-quantal-jaketown-45:20131009083009:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 3.654877] ------------[ cut here ]------------
[ 3.656772] kernel BUG at kernel/cred.c:138!
[ 3.656772] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 3.656772] Modules linked in:
[ 3.656772] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 3.656772] task: c6c2a2c0 ti: c6d16000 task.ti: c6d16000
[ 3.656772] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 3.656772] EIP is at __put_cred+0x56/0x90
[ 3.656772] EAX: c14c3720 EBX: c6d11080 ECX: 00000000 EDX: 00000001
[ 3.656772] ESI: c6c2a2c0 EDI: 00000001 EBP: c6d17f24 ESP: c6d17f18
[ 3.656772] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 3.656772] CR0: 8005003b CR2: b76f3000 CR3: 06d12000 CR4: 000006b0
[ 3.656772] Stack:
[ 3.656772] c006ee00 c6c2a558 c6c2a2c0 c6d17f30 c110a678 c006ed00 c6d17f44 c104d7d9
[ 3.656772] c6c2a570 c6d18000 c6c2a2c0 c6d17f8c c10311d2 00000000 c6d17f80 c110a8a6
[ 3.656772] 00000001 00000001 00000000 00000246 00000001 c6c2a558 c6d18050 c6c2a2c0
[ 3.656772] Call Trace:
[ 3.656772] [<c110a678>] file_free_rcu+0x28/0x40
[ 3.656772] [<c104d7d9>] task_work_run+0x79/0xa0
[ 3.656772] [<c10311d2>] do_exit+0x2f2/0x960
[ 3.656772] [<c110a8a6>] ? __fput+0x216/0x380
[ 3.656772] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 3.656772] [<c1032838>] SyS_exit_group+0x18/0x20
[ 3.656772] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 3.656772] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 3.656772] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d17f18
[ 3.722735] ---[ end trace 3f09cc8c57ae58ba ]---
[ 3.724859] Fixing recursive fault but reboot is needed!

dmesg-quantal-lkp-st01-8:20131009083023:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 2.192466] ------------[ cut here ]------------
[ 2.193203] kernel BUG at kernel/cred.c:138!
[ 2.194201] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 2.194739] Modules linked in:
[ 2.194739] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 2.194739] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 2.194739] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 2.194739] EIP is at __put_cred+0x56/0x90
[ 2.194739] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 2.194739] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 2.194739] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 2.194739] CR0: 8005003b CR2: b76ee000 CR3: 06d1e000 CR4: 000006b0
[ 2.194739] Stack:
[ 2.194739] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 2.194739] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 2.194739] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 2.194739] Call Trace:
[ 2.194739] [<c110a678>] file_free_rcu+0x28/0x40
[ 2.194739] [<c104d7d9>] task_work_run+0x79/0xa0
[ 2.194739] [<c10311d2>] do_exit+0x2f2/0x960
[ 2.194739] [<c110a8a6>] ? __fput+0x216/0x380
[ 2.194739] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 2.194739] [<c1032838>] SyS_exit_group+0x18/0x20
[ 2.194739] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 2.194739] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 2.194739] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 2.218314] ---[ end trace 366043f64f01e8ee ]---
[ 2.219045] Fixing recursive fault but reboot is needed!

dmesg-quantal-lkp-tt02-15:20131008230210:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 2.379238] ------------[ cut here ]------------
[ 2.380183] kernel BUG at kernel/cred.c:138!
[ 2.381466] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 2.381912] Modules linked in:
[ 2.381912] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 2.381912] task: c6c2a2c0 ti: c6d16000 task.ti: c6d16000
[ 2.381912] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 2.381912] EIP is at __put_cred+0x56/0x90
[ 2.381912] EAX: c14c3720 EBX: c6d11080 ECX: 00000000 EDX: 00000001
[ 2.381912] ESI: c6c2a2c0 EDI: 00000001 EBP: c6d17f24 ESP: c6d17f18
[ 2.381912] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 2.381912] CR0: 8005003b CR2: b770d000 CR3: 06d12000 CR4: 000006b0
[ 2.381912] Stack:
[ 2.381912] c006ee00 c6c2a558 c6c2a2c0 c6d17f30 c110a678 c006ed00 c6d17f44 c104d7d9
[ 2.381912] c6c2a570 c6d18000 c6c2a2c0 c6d17f8c c10311d2 00000000 c6d17f80 c110a8a6
[ 2.381912] 00000001 00000001 00000000 00000246 00000001 c6c2a558 c6d18050 c6c2a2c0
[ 2.381912] Call Trace:
[ 2.381912] [<c110a678>] file_free_rcu+0x28/0x40
[ 2.381912] [<c104d7d9>] task_work_run+0x79/0xa0
[ 2.381912] [<c10311d2>] do_exit+0x2f2/0x960
[ 2.381912] [<c110a8a6>] ? __fput+0x216/0x380
[ 2.381912] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 2.381912] [<c1032838>] SyS_exit_group+0x18/0x20
[ 2.381912] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 2.381912] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 2.381912] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d17f18
[ 2.413399] ---[ end trace a336c8b3db89df5e ]---
[ 2.414332] Fixing recursive fault but reboot is needed!

dmesg-quantal-lkp-tt02-1:20131008230114:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 2.375013] ------------[ cut here ]------------
[ 2.376110] kernel BUG at kernel/cred.c:138!
[ 2.376223] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 2.376223] Modules linked in:
[ 2.376223] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 2.376223] task: c6c2a2c0 ti: c6d16000 task.ti: c6d16000
[ 2.376223] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 2.376223] EIP is at __put_cred+0x56/0x90
[ 2.376223] EAX: c14c3720 EBX: c6d11080 ECX: 00000000 EDX: 00000001
[ 2.376223] ESI: c6c2a2c0 EDI: 00000001 EBP: c6d17f24 ESP: c6d17f18
[ 2.376223] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 2.376223] CR0: 8005003b CR2: b779c000 CR3: 06d12000 CR4: 000006b0
[ 2.376223] Stack:
[ 2.376223] c006ee00 c6c2a558 c6c2a2c0 c6d17f30 c110a678 c006ed00 c6d17f44 c104d7d9
[ 2.376223] c6c2a570 c6d18000 c6c2a2c0 c6d17f8c c10311d2 00000000 c6d17f80 c110a8a6
[ 2.376223] 00000001 00000001 00000000 00000246 00000001 c6c2a558 c6d18050 c6c2a2c0
[ 2.376223] Call Trace:
[ 2.376223] [<c110a678>] file_free_rcu+0x28/0x40
[ 2.376223] [<c104d7d9>] task_work_run+0x79/0xa0
[ 2.376223] [<c10311d2>] do_exit+0x2f2/0x960
[ 2.376223] [<c110a8a6>] ? __fput+0x216/0x380
[ 2.376223] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 2.376223] [<c1032838>] SyS_exit_group+0x18/0x20
[ 2.376223] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 2.376223] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 2.376223] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d17f18
[ 2.409111] ---[ end trace 15e91cbb155c85af ]---
[ 2.410031] Fixing recursive fault but reboot is needed!

dmesg-quantal-lkp-tt02-3:20131008230155:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 2.378589] ------------[ cut here ]------------
[ 2.379533] kernel BUG at kernel/cred.c:138!
[ 2.380830] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 2.381639] Modules linked in:
[ 2.381639] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 2.381639] task: c6c2a2c0 ti: c6d16000 task.ti: c6d16000
[ 2.381639] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 2.381639] EIP is at __put_cred+0x56/0x90
[ 2.381639] EAX: c14c3720 EBX: c6d11080 ECX: 00000000 EDX: 00000001
[ 2.381639] ESI: c6c2a2c0 EDI: 00000001 EBP: c6d17f24 ESP: c6d17f18
[ 2.381639] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 2.381639] CR0: 8005003b CR2: b779f000 CR3: 06d12000 CR4: 000006b0
[ 2.381639] Stack:
[ 2.381639] c006ee00 c6c2a558 c6c2a2c0 c6d17f30 c110a678 c006ed00 c6d17f44 c104d7d9
[ 2.381639] c6c2a570 c6d18000 c6c2a2c0 c6d17f8c c10311d2 00000000 c6d17f80 c110a8a6
[ 2.381639] 00000001 00000001 00000000 00000246 00000001 c6c2a558 c6d18050 c6c2a2c0
[ 2.381639] Call Trace:
[ 2.381639] [<c110a678>] file_free_rcu+0x28/0x40
[ 2.381639] [<c104d7d9>] task_work_run+0x79/0xa0
[ 2.381639] [<c10311d2>] do_exit+0x2f2/0x960
[ 2.381639] [<c110a8a6>] ? __fput+0x216/0x380
[ 2.381639] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 2.381639] [<c1032838>] SyS_exit_group+0x18/0x20
[ 2.381639] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 2.381639] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 2.381639] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d17f18
[ 2.412645] ---[ end trace 3eed1ab81a840f9b ]---
[ 2.413568] Fixing recursive fault but reboot is needed!

dmesg-quantal-nhm4-3:20131009003525:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 0.925097] ------------[ cut here ]------------
[ 0.925493] kernel BUG at kernel/cred.c:138!
[ 0.926026] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 0.926466] Modules linked in:
[ 0.926740] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.927357] task: c6c322c0 ti: c6d2a000 task.ti: c6d2a000
[ 0.927806] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 0.927866] EIP is at __put_cred+0x56/0x90
[ 0.927866] EAX: c14c3720 EBX: c6d17400 ECX: 00000000 EDX: 00000001
[ 0.927866] ESI: c6c322c0 EDI: 00000001 EBP: c6d2bf24 ESP: c6d2bf18
[ 0.927866] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.927866] CR0: 8005003b CR2: bfce7ff0 CR3: 06d19000 CR4: 000006b0
[ 0.927866] Stack:
[ 0.927866] c006ee00 c6c32558 c6c322c0 c6d2bf30 c110a678 c006ed00 c6d2bf44 c104d7d9
[ 0.927866] c6c32570 c6d2c000 c6c322c0 c6d2bf8c c10311d2 00000000 c6d2bf80 c110a8a6
[ 0.927866] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d2c050 c6c322c0
[ 0.927866] Call Trace:
[ 0.927866] [<c110a678>] file_free_rcu+0x28/0x40
[ 0.927866] [<c104d7d9>] task_work_run+0x79/0xa0
[ 0.927866] [<c10311d2>] do_exit+0x2f2/0x960
[ 0.927866] [<c110a8a6>] ? __fput+0x216/0x380
[ 0.927866] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 0.927866] [<c1032838>] SyS_exit_group+0x18/0x20
[ 0.927866] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 0.927866] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 0.927866] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d2bf18
[ 0.938659] ---[ end trace 3b2f487beedf4727 ]---
[ 0.939045] Fixing recursive fault but reboot is needed!

dmesg-quantal-nhm4-5:20131009003430:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 0.924386] ------------[ cut here ]------------
[ 0.924582] kernel BUG at kernel/cred.c:138!
[ 0.924582] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 0.924582] Modules linked in:
[ 0.924582] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.924582] task: c6c322c0 ti: c6d2a000 task.ti: c6d2a000
[ 0.924582] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 0.924582] EIP is at __put_cred+0x56/0x90
[ 0.924582] EAX: c14c3720 EBX: c6d17400 ECX: 00000000 EDX: 00000001
[ 0.924582] ESI: c6c322c0 EDI: 00000001 EBP: c6d2bf24 ESP: c6d2bf18
[ 0.924582] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.924582] CR0: 8005003b CR2: b7793000 CR3: 06d19000 CR4: 000006b0
[ 0.924582] Stack:
[ 0.924582] c006ee00 c6c32558 c6c322c0 c6d2bf30 c110a678 c006ed00 c6d2bf44 c104d7d9
[ 0.924582] c6c32570 c6d2c000 c6c322c0 c6d2bf8c c10311d2 00000000 c6d2bf80 c110a8a6
[ 0.924582] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d2c050 c6c322c0
[ 0.924582] Call Trace:
[ 0.924582] [<c110a678>] file_free_rcu+0x28/0x40
[ 0.924582] [<c104d7d9>] task_work_run+0x79/0xa0
[ 0.924582] [<c10311d2>] do_exit+0x2f2/0x960
[ 0.924582] [<c110a8a6>] ? __fput+0x216/0x380
[ 0.924582] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 0.924582] [<c1032838>] SyS_exit_group+0x18/0x20
[ 0.924582] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 0.924582] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 0.924582] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d2bf18
[ 0.937680] ---[ end trace 7f0ecf16967dcc43 ]---
[ 0.938100] Fixing recursive fault but reboot is needed!

dmesg-quantal-nhm4-5:20131009003511:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 0.924555] ------------[ cut here ]------------
[ 0.924949] kernel BUG at kernel/cred.c:138!
[ 0.925469] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 0.925910] Modules linked in:
[ 0.926178] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.926793] task: c6c322c0 ti: c6d2a000 task.ti: c6d2a000
[ 0.927232] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 0.927679] EIP is at __put_cred+0x56/0x90
[ 0.927881] EAX: c14c3720 EBX: c6d17400 ECX: 00000000 EDX: 00000001
[ 0.927881] ESI: c6c322c0 EDI: 00000001 EBP: c6d2bf24 ESP: c6d2bf18
[ 0.927881] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.927881] CR0: 8005003b CR2: b7726000 CR3: 06d19000 CR4: 000006b0
[ 0.927881] Stack:
[ 0.927881] c006ee00 c6c32558 c6c322c0 c6d2bf30 c110a678 c006ed00 c6d2bf44 c104d7d9
[ 0.927881] c6c32570 c6d2c000 c6c322c0 c6d2bf8c c10311d2 00000000 c6d2bf80 c110a8a6
[ 0.927881] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d2c050 c6c322c0
[ 0.927881] Call Trace:
[ 0.927881] [<c110a678>] file_free_rcu+0x28/0x40
[ 0.927881] [<c104d7d9>] task_work_run+0x79/0xa0
[ 0.927881] [<c10311d2>] do_exit+0x2f2/0x960
[ 0.927881] [<c110a8a6>] ? __fput+0x216/0x380
[ 0.927881] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 0.927881] [<c1032838>] SyS_exit_group+0x18/0x20
[ 0.927881] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 0.927881] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 0.927881] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d2bf18
[ 0.937979] ---[ end trace 9f56434269907c1f ]---
[ 0.938358] Fixing recursive fault but reboot is needed!

dmesg-quantal-roam-1:20131009083030:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 1.130287] ------------[ cut here ]------------
[ 1.130741] kernel BUG at kernel/cred.c:138!
[ 1.131345] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 1.131508] Modules linked in:
[ 1.131508] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.131508] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 1.131508] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 1.131508] EIP is at __put_cred+0x56/0x90
[ 1.131508] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 1.131508] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 1.131508] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.131508] CR0: 8005003b CR2: b77a9000 CR3: 06d1e000 CR4: 000006b0
[ 1.131508] Stack:
[ 1.131508] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 1.131508] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 1.131508] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 1.131508] Call Trace:
[ 1.131508] [<c110a678>] file_free_rcu+0x28/0x40
[ 1.131508] [<c104d7d9>] task_work_run+0x79/0xa0
[ 1.131508] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.131508] [<c110a8a6>] ? __fput+0x216/0x380
[ 1.131508] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.131508] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.131508] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 1.131508] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 1.131508] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 1.145451] ---[ end trace 18ee4133d403afe6 ]---
[ 1.145894] Fixing recursive fault but reboot is needed!

dmesg-quantal-snb-10:20131009082954:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 1.267650] ------------[ cut here ]------------
[ 1.268157] kernel BUG at kernel/cred.c:138!
[ 1.268839] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 1.269410] Modules linked in:
[ 1.269757] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.270560] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 1.270907] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 1.270907] EIP is at __put_cred+0x56/0x90
[ 1.270907] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 1.270907] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 1.270907] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.270907] CR0: 8005003b CR2: b76f0000 CR3: 06d1e000 CR4: 000006b0
[ 1.270907] Stack:
[ 1.270907] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 1.270907] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 1.270907] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 1.270907] Call Trace:
[ 1.270907] [<c110a678>] file_free_rcu+0x28/0x40
[ 1.270907] [<c104d7d9>] task_work_run+0x79/0xa0
[ 1.270907] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.270907] [<c110a8a6>] ? __fput+0x216/0x380
[ 1.270907] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.270907] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.270907] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 1.270907] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 1.270907] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 1.285006] ---[ end trace 2a08b659136e771e ]---
[ 1.285506] Fixing recursive fault but reboot is needed!

dmesg-quantal-snb-11:20131009083046:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 1.267812] ------------[ cut here ]------------
[ 1.268328] kernel BUG at kernel/cred.c:138!
[ 1.268463] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 1.268463] Modules linked in:
[ 1.268463] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.268463] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 1.268463] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 1.268463] EIP is at __put_cred+0x56/0x90
[ 1.268463] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 1.268463] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 1.268463] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.268463] CR0: 8005003b CR2: b7760000 CR3: 06d1e000 CR4: 000006b0
[ 1.268463] Stack:
[ 1.268463] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 1.268463] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 1.268463] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 1.268463] Call Trace:
[ 1.268463] [<c110a678>] file_free_rcu+0x28/0x40
[ 1.268463] [<c104d7d9>] task_work_run+0x79/0xa0
[ 1.268463] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.268463] [<c110a8a6>] ? __fput+0x216/0x380
[ 1.268463] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.268463] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.268463] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 1.268463] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 1.268463] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 1.285133] ---[ end trace b2bca5ffc6ea2c3f ]---
[ 1.285653] Fixing recursive fault but reboot is needed!

dmesg-quantal-snb-21:20131009082917:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 1.282220] ------------[ cut here ]------------
[ 1.282756] kernel BUG at kernel/cred.c:138!
[ 1.283288] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 1.283288] Modules linked in:
[ 1.283288] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.283288] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 1.283288] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 1.283288] EIP is at __put_cred+0x56/0x90
[ 1.283288] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 1.283288] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 1.283288] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.283288] CR0: 8005003b CR2: b775e000 CR3: 06d1e000 CR4: 000006b0
[ 1.283288] Stack:
[ 1.283288] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 1.283288] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 1.283288] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 1.283288] Call Trace:
[ 1.283288] [<c110a678>] file_free_rcu+0x28/0x40
[ 1.283288] [<c104d7d9>] task_work_run+0x79/0xa0
[ 1.283288] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.283288] [<c110a8a6>] ? __fput+0x216/0x380
[ 1.283288] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.283288] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.283288] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 1.283288] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 1.283288] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 1.299898] ---[ end trace fa556be854dc3398 ]---
[ 1.300431] Fixing recursive fault but reboot is needed!

dmesg-quantal-snb-24:20131009083041:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 1.262976] ------------[ cut here ]------------
[ 1.263491] kernel BUG at kernel/cred.c:138!
[ 1.263599] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 1.263599] Modules linked in:
[ 1.263599] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.263599] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 1.263599] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 1.263599] EIP is at __put_cred+0x56/0x90
[ 1.263599] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 1.263599] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 1.263599] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.263599] CR0: 8005003b CR2: bfc89ff8 CR3: 06d1e000 CR4: 000006b0
[ 1.263599] Stack:
[ 1.263599] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 1.263599] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 1.263599] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 1.263599] Call Trace:
[ 1.263599] [<c110a678>] file_free_rcu+0x28/0x40
[ 1.263599] [<c104d7d9>] task_work_run+0x79/0xa0
[ 1.263599] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.263599] [<c110a8a6>] ? __fput+0x216/0x380
[ 1.263599] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.263599] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.263599] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 1.263599] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 1.263599] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 1.280144] ---[ end trace 3122307b9f7be18f ]---
[ 1.280666] Fixing recursive fault but reboot is needed!

dmesg-quantal-snb-25:20131009083041:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 1.263536] ------------[ cut here ]------------
[ 1.264035] kernel BUG at kernel/cred.c:138!
[ 1.264711] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 1.265276] Modules linked in:
[ 1.265639] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.265978] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 1.265978] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 1.265978] EIP is at __put_cred+0x56/0x90
[ 1.265978] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 1.265978] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 1.265978] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.265978] CR0: 8005003b CR2: b779e000 CR3: 06d1e000 CR4: 000006b0
[ 1.265978] Stack:
[ 1.265978] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 1.265978] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 1.265978] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 1.265978] Call Trace:
[ 1.265978] [<c110a678>] file_free_rcu+0x28/0x40
[ 1.265978] [<c104d7d9>] task_work_run+0x79/0xa0
[ 1.265978] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.265978] [<c110a8a6>] ? __fput+0x216/0x380
[ 1.265978] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.265978] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.265978] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 1.265978] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 1.265978] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 1.280305] ---[ end trace db43d2964c13d3c6 ]---
[ 1.280794] Fixing recursive fault but reboot is needed!

dmesg-quantal-snb-31:20131009083030:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 1.268757] ------------[ cut here ]------------
[ 1.269290] kernel BUG at kernel/cred.c:138!
[ 1.269995] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 1.270320] Modules linked in:
[ 1.270320] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.270320] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 1.270320] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 1.270320] EIP is at __put_cred+0x56/0x90
[ 1.270320] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 1.270320] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 1.270320] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.270320] CR0: 8005003b CR2: b77c9000 CR3: 06d1e000 CR4: 000006b0
[ 1.270320] Stack:
[ 1.270320] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 1.270320] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 1.270320] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 1.270320] Call Trace:
[ 1.270320] [<c110a678>] file_free_rcu+0x28/0x40
[ 1.270320] [<c104d7d9>] task_work_run+0x79/0xa0
[ 1.270320] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.270320] [<c110a8a6>] ? __fput+0x216/0x380
[ 1.270320] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.270320] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.270320] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 1.270320] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 1.270320] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 1.286494] ---[ end trace cfea269f1eaa7443 ]---
[ 1.287052] Fixing recursive fault but reboot is needed!

dmesg-quantal-snb-33:20131009083029:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 1.263869] ------------[ cut here ]------------
[ 1.264376] kernel BUG at kernel/cred.c:138!
[ 1.265055] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 1.265236] Modules linked in:
[ 1.265236] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.265236] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 1.265236] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 1.265236] EIP is at __put_cred+0x56/0x90
[ 1.265236] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 1.265236] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 1.265236] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.265236] CR0: 8005003b CR2: b770c000 CR3: 06d1e000 CR4: 000006b0
[ 1.265236] Stack:
[ 1.265236] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 1.265236] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 1.265236] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 1.265236] Call Trace:
[ 1.265236] [<c110a678>] file_free_rcu+0x28/0x40
[ 1.265236] [<c104d7d9>] task_work_run+0x79/0xa0
[ 1.265236] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.265236] [<c110a8a6>] ? __fput+0x216/0x380
[ 1.265236] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.265236] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.265236] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 1.265236] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 1.265236] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 1.280632] ---[ end trace fad9b18b03fcbc65 ]---
[ 1.281122] Fixing recursive fault but reboot is needed!

dmesg-quantal-snb-35:20131009082924:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 1.283238] ------------[ cut here ]------------
[ 1.283747] kernel BUG at kernel/cred.c:138!
[ 1.284453] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 1.285035] Modules linked in:
[ 1.285450] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.285683] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 1.285683] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 1.285683] EIP is at __put_cred+0x56/0x90
[ 1.285683] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 1.285683] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 1.285683] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.285683] CR0: 8005003b CR2: b7721000 CR3: 06d1e000 CR4: 000006b0
[ 1.285683] Stack:
[ 1.285683] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 1.285683] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 1.285683] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 1.285683] Call Trace:
[ 1.285683] [<c110a678>] file_free_rcu+0x28/0x40
[ 1.285683] [<c104d7d9>] task_work_run+0x79/0xa0
[ 1.285683] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.285683] [<c110a8a6>] ? __fput+0x216/0x380
[ 1.285683] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.285683] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.285683] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 1.285683] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 1.285683] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 1.300758] ---[ end trace e06a35604c6d002c ]---
[ 1.301265] Fixing recursive fault but reboot is needed!

dmesg-quantal-snb-35:20131009083027:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 1.289153] ------------[ cut here ]------------
[ 1.289669] kernel BUG at kernel/cred.c:138!
[ 1.290371] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 1.290952] Modules linked in:
[ 1.291312] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.291604] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 1.291604] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 1.291604] EIP is at __put_cred+0x56/0x90
[ 1.291604] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 1.291604] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 1.291604] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.291604] CR0: 8005003b CR2: b7777000 CR3: 06d1e000 CR4: 000006b0
[ 1.291604] Stack:
[ 1.291604] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 1.291604] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 1.291604] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 1.291604] Call Trace:
[ 1.291604] [<c110a678>] file_free_rcu+0x28/0x40
[ 1.291604] [<c104d7d9>] task_work_run+0x79/0xa0
[ 1.291604] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.291604] [<c110a8a6>] ? __fput+0x216/0x380
[ 1.291604] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.291604] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.291604] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 1.291604] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 1.291604] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 1.306635] ---[ end trace 2355eb76f3d67d41 ]---
[ 1.307144] Fixing recursive fault but reboot is needed!

dmesg-quantal-snb-39:20131009082957:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 1.271515] ------------[ cut here ]------------
[ 1.272027] kernel BUG at kernel/cred.c:138!
[ 1.272717] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 1.273295] Modules linked in:
[ 1.273645] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.274228] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 1.274228] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 1.274228] EIP is at __put_cred+0x56/0x90
[ 1.274228] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 1.274228] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 1.274228] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.274228] CR0: 8005003b CR2: b7748000 CR3: 06d1e000 CR4: 000006b0
[ 1.274228] Stack:
[ 1.274228] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 1.274228] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 1.274228] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 1.274228] Call Trace:
[ 1.274228] [<c110a678>] file_free_rcu+0x28/0x40
[ 1.274228] [<c104d7d9>] task_work_run+0x79/0xa0
[ 1.274228] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.274228] [<c110a8a6>] ? __fput+0x216/0x380
[ 1.274228] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.274228] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.274228] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 1.274228] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 1.274228] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 1.289221] ---[ end trace 0e8d6bb3d3b9eed9 ]---
[ 1.289715] Fixing recursive fault but reboot is needed!

dmesg-quantal-snb-48:20131009083032:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 1.290473] ------------[ cut here ]------------
[ 1.290999] kernel BUG at kernel/cred.c:138!
[ 1.291715] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 1.292306] Modules linked in:
[ 1.292673] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.293513] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 1.293631] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 1.293631] EIP is at __put_cred+0x56/0x90
[ 1.293631] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 1.293631] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 1.293631] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.293631] CR0: 8005003b CR2: b7742000 CR3: 06d1e000 CR4: 000006b0
[ 1.293631] Stack:
[ 1.293631] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 1.293631] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 1.293631] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 1.293631] Call Trace:
[ 1.293631] [<c110a678>] file_free_rcu+0x28/0x40
[ 1.293631] [<c104d7d9>] task_work_run+0x79/0xa0
[ 1.293631] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.293631] [<c110a8a6>] ? __fput+0x216/0x380
[ 1.293631] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.293631] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.293631] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 1.293631] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 1.293631] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 1.308539] ---[ end trace a20bc4a5948506b8 ]---
[ 1.309055] Fixing recursive fault but reboot is needed!

dmesg-quantal-snb-8:20131009083035:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 1.271191] ------------[ cut here ]------------
[ 1.271732] kernel BUG at kernel/cred.c:138!
[ 1.272444] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 1.273030] Modules linked in:
[ 1.273394] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.274258] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 1.274413] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 1.274413] EIP is at __put_cred+0x56/0x90
[ 1.274413] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 1.274413] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 1.274413] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.274413] CR0: 8005003b CR2: b77cd000 CR3: 06d1e000 CR4: 000006b0
[ 1.274413] Stack:
[ 1.274413] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 1.274413] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 1.274413] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 1.274413] Call Trace:
[ 1.274413] [<c110a678>] file_free_rcu+0x28/0x40
[ 1.274413] [<c104d7d9>] task_work_run+0x79/0xa0
[ 1.274413] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.274413] [<c110a8a6>] ? __fput+0x216/0x380
[ 1.274413] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.274413] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.274413] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 1.274413] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 1.274413] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 1.289024] ---[ end trace 98ba9fd422ad8aea ]---
[ 1.289537] Fixing recursive fault but reboot is needed!

dmesg-quantal-stoakley-1:20131009082944:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 2.023245] ------------[ cut here ]------------
[ 2.023898] kernel BUG at kernel/cred.c:138!
[ 2.024787] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 2.025523] Modules linked in:
[ 2.025979] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 2.026303] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 2.026303] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 2.026303] EIP is at __put_cred+0x56/0x90
[ 2.026303] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 2.026303] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 2.026303] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 2.026303] CR0: 8005003b CR2: bfd7fffc CR3: 06d1e000 CR4: 000006b0
[ 2.026303] Stack:
[ 2.026303] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 2.026303] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 2.026303] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 2.026303] Call Trace:
[ 2.026303] [<c110a678>] file_free_rcu+0x28/0x40
[ 2.026303] [<c104d7d9>] task_work_run+0x79/0xa0
[ 2.026303] [<c10311d2>] do_exit+0x2f2/0x960
[ 2.026303] [<c110a8a6>] ? __fput+0x216/0x380
[ 2.026303] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 2.026303] [<c1032838>] SyS_exit_group+0x18/0x20
[ 2.026303] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 2.026303] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 2.026303] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 2.045970] ---[ end trace f238037b91c10924 ]---
[ 2.046641] Fixing recursive fault but reboot is needed!

dmesg-quantal-stoakley-3:20131009083031:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 2.033152] ------------[ cut here ]------------
[ 2.033813] kernel BUG at kernel/cred.c:138!
[ 2.034716] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 2.035103] Modules linked in:
[ 2.035103] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 2.035103] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 2.035103] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 2.035103] EIP is at __put_cred+0x56/0x90
[ 2.035103] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 2.035103] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 2.035103] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 2.035103] CR0: 8005003b CR2: b76ff000 CR3: 06d1e000 CR4: 000006b0
[ 2.035103] Stack:
[ 2.035103] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 2.035103] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 2.035103] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 2.035103] Call Trace:
[ 2.035103] [<c110a678>] file_free_rcu+0x28/0x40
[ 2.035103] [<c104d7d9>] task_work_run+0x79/0xa0
[ 2.035103] [<c10311d2>] do_exit+0x2f2/0x960
[ 2.035103] [<c110a8a6>] ? __fput+0x216/0x380
[ 2.035103] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 2.035103] [<c1032838>] SyS_exit_group+0x18/0x20
[ 2.035103] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 2.035103] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 2.035103] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 2.056055] ---[ end trace b431bddf9fc347bf ]---
[ 2.056710] Fixing recursive fault but reboot is needed!

dmesg-quantal-waimea-11:20131009162710:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 0.887588] ------------[ cut here ]------------
[ 0.888068] kernel BUG at kernel/cred.c:138!
[ 0.888726] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 0.889276] Modules linked in:
[ 0.889554] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.889554] task: c6c322c0 ti: c6d2a000 task.ti: c6d2a000
[ 0.889554] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 0.889554] EIP is at __put_cred+0x56/0x90
[ 0.889554] EAX: c14c3720 EBX: c6d17400 ECX: 00000000 EDX: 00000001
[ 0.889554] ESI: c6c322c0 EDI: 00000001 EBP: c6d2bf24 ESP: c6d2bf18
[ 0.889554] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.889554] CR0: 8005003b CR2: b77d2000 CR3: 06d19000 CR4: 000006b0
[ 0.889554] Stack:
[ 0.889554] c006ee00 c6c32558 c6c322c0 c6d2bf30 c110a678 c006ed00 c6d2bf44 c104d7d9
[ 0.889554] c6c32570 c6d2c000 c6c322c0 c6d2bf8c c10311d2 00000000 c6d2bf80 c110a8a6
[ 0.889554] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d2c050 c6c322c0
[ 0.889554] Call Trace:
[ 0.889554] [<c110a678>] file_free_rcu+0x28/0x40
[ 0.889554] [<c104d7d9>] task_work_run+0x79/0xa0
[ 0.889554] [<c10311d2>] do_exit+0x2f2/0x960
[ 0.889554] [<c110a8a6>] ? __fput+0x216/0x380
[ 0.889554] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 0.889554] [<c1032838>] SyS_exit_group+0x18/0x20
[ 0.889554] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 0.889554] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 0.889554] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d2bf18
[ 0.904450] ---[ end trace 000353ff35790159 ]---
[ 0.904925] Fixing recursive fault but reboot is needed!

dmesg-quantal-xian-21:20131009083032:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 1.240102] ------------[ cut here ]------------
[ 1.240374] kernel BUG at kernel/cred.c:138!
[ 1.240374] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 1.240374] Modules linked in:
[ 1.240374] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.240374] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 1.240374] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 1.240374] EIP is at __put_cred+0x56/0x90
[ 1.240374] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 1.240374] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 1.240374] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.240374] CR0: 8005003b CR2: b7710000 CR3: 06d1e000 CR4: 000006b0
[ 1.240374] Stack:
[ 1.240374] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 1.240374] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 1.240374] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 1.240374] Call Trace:
[ 1.240374] [<c110a678>] file_free_rcu+0x28/0x40
[ 1.240374] [<c104d7d9>] task_work_run+0x79/0xa0
[ 1.240374] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.240374] [<c110a8a6>] ? __fput+0x216/0x380
[ 1.240374] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.240374] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.240374] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 1.240374] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 1.240374] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 1.255823] ---[ end trace d6c84abf11088fa0 ]---
[ 1.256281] Fixing recursive fault but reboot is needed!

dmesg-quantal-xian-23:20131009082947:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

modprobe: FATAL: Could not load /lib/modules/3.12.0-rc1-00050-g0c44c2d/modules.dep: No such file or directory

[ 1.501753] ------------[ cut here ]------------
[ 1.502309] kernel BUG at kernel/cred.c:138!
[ 1.503038] invalid opcode: 0000 [#1] DEBUG_PAGEALLOC
[ 1.503719] Modules linked in:
[ 1.504090] CPU: 0 PID: 36 Comm: modprobe Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.504117] task: c6c322c0 ti: c6d1a000 task.ti: c6d1a000
[ 1.504117] EIP: 0060:[<c1056716>] EFLAGS: 00010202 CPU: 0
[ 1.504117] EIP is at __put_cred+0x56/0x90
[ 1.504117] EAX: c14c3720 EBX: c6d17380 ECX: 00000000 EDX: 00000001
[ 1.504117] ESI: c6c322c0 EDI: 00000001 EBP: c6d1bf24 ESP: c6d1bf18
[ 1.504117] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.504117] CR0: 8005003b CR2: b776d000 CR3: 06d1e000 CR4: 000006b0
[ 1.504117] Stack:
[ 1.504117] c006ee00 c6c32558 c6c322c0 c6d1bf30 c110a678 c006ed00 c6d1bf44 c104d7d9
[ 1.504117] c6c32570 c6d1c000 c6c322c0 c6d1bf8c c10311d2 00000000 c6d1bf80 c110a8a6
[ 1.504117] 00000001 00000001 00000000 00000246 00000001 c6c32558 c6d1c050 c6c322c0
[ 1.504117] Call Trace:
[ 1.504117] [<c110a678>] file_free_rcu+0x28/0x40
[ 1.504117] [<c104d7d9>] task_work_run+0x79/0xa0
[ 1.504117] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.504117] [<c110a8a6>] ? __fput+0x216/0x380
[ 1.504117] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.504117] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.504117] [<c130eeb0>] sysenter_do_call+0x12/0x3c
[ 1.504117] Code: 85 f6 74 02 0f 0b 8b 35 88 57 47 c1 31 c0 39 9e a4 01 00 00 0f 94 c0 89 c7 31 c9 89 fa b8 20 37 4c c1 e8 ae 19 05 00 85 ff 74 02 <0f> 0b 31 c0 3b 9e a0 01 00 00 0f 94 c0 89 c6 31 c9 89 f2 b8 0c
[ 1.504117] EIP: [<c1056716>] __put_cred+0x56/0x90 SS:ESP 0068:c6d1bf18
[ 1.518217] ---[ end trace 3ef53dce4d64dd7a ]---
[ 1.518644] Fixing recursive fault but reboot is needed!

dmesg-yocto-ant-15:20131009082944:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 7.680434] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 8.182500] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 8.183571] IP: [< (null)>] (null)
[ 8.184160] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 8.185292] Oops: 0010 [#1] DEBUG_PAGEALLOC
[ 8.185292] Modules linked in:
[ 8.185292] CPU: 0 PID: 46 Comm: mount Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 8.185292] task: cd7cbcd0 ti: cd10c000 task.ti: cd10c000
[ 8.185292] EIP: 0060:[<00000000>] EFLAGS: 00000246 CPU: 0
[ 8.185292] EIP is at 0x0
[ 8.185292] EAX: cd0def00 EBX: cd0dee40 ECX: 00000000 EDX: cd0def00
[ 8.185292] ESI: cd7cbf68 EDI: cd7cbcd0 EBP: cd10df44 ESP: cd10df34
[ 8.185292] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 8.185292] CR0: 8005003b CR2: 00000000 CR3: 0d108000 CR4: 000006b0
[ 8.185292] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
[ 8.185292] DR6: 00000000 DR7: 00000000
[ 8.185292] Stack:
[ 8.185292] c104d7d9 cd7cbf80 cd0da900 cd7cbcd0 cd10df8c c10311d2 00000000 cd10df58
[ 8.185292] c10762db cd10df78 00000001 00000100 00000000 00000046 00000030 cd0da950
[ 8.185292] cd7cbcd0 ffffffff cd10df9c 0000ff00 ce867b80 cd7cbcd0 cd10dfa4 c10327ca
[ 8.185292] Call Trace:
[ 8.185292] [<c104d7d9>] ? task_work_run+0x79/0xa0
[ 8.185292] [<c10311d2>] do_exit+0x2f2/0x960
[ 8.185292] [<c10762db>] ? trace_hardirqs_off+0xb/0x10
[ 8.185292] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 8.185292] [<c1032838>] SyS_exit_group+0x18/0x20
[ 8.185292] [<c1307ad5>] syscall_call+0x7/0xb
[ 8.185292] Code: Bad EIP value.
[ 8.185292] EIP: [<00000000>] 0x0 SS:ESP 0068:cd10df34
[ 8.185292] CR2: 0000000000000000
[ 8.206298] ---[ end trace 5ac61493344427c5 ]---
[ 8.206999] Fixing recursive fault but reboot is needed!

dmesg-yocto-cairo-25:20131009083038:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.501170] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.509709] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.510451] IP: [<c110a6e0>] __fput+0x50/0x380
[ 0.510904] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.511500] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.511937] Modules linked in:
[ 0.512160] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.512160] Workqueue: events delayed_fput
[ 0.512160] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.512160] EIP: 0060:[<c110a6e0>] EFLAGS: 00010212 CPU: 0
[ 0.512160] EIP is at __fput+0x50/0x380
[ 0.512160] EAX: 00000000 EBX: cd0e3200 ECX: 00000000 EDX: 0000001d
[ 0.512160] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.512160] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.512160] CR0: 8005003b CR2: 00000000 CR3: 0d10a000 CR4: 000006b0
[ 0.512160] Stack:
[ 0.512160] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.512160] 00000000 c0124540 ce867ea4 c110aa39 c1495640 ce867efc c10492f9 00000000
[ 0.512160] 00000002 00000000 c10492c1 00000000 00000000 00000000 0019f047 c0083400
[ 0.512160] Call Trace:
[ 0.512160] [<c110aa39>] delayed_fput+0x29/0x30
[ 0.512160] [<c10492f9>] process_one_work+0x2f9/0x650
[ 0.512160] [<c10492c1>] ? process_one_work+0x2c1/0x650
[ 0.512160] [<c104ac2f>] worker_thread+0x28f/0x610
[ 0.512160] [<c104a9a0>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.512160] [<c1050c42>] kthread+0x92/0xa0
[ 0.512160] [<c130ee1b>] ret_from_kernel_thread+0x1b/0x30
[ 0.512160] [<c1050bb0>] ? kthread_create_on_node+0xd0/0xd0
[ 0.512160] Code: 00 b8 a0 53 41 c1 e8 80 ff f4 ff e8 1b b0 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.512160] EIP: [<c110a6e0>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.512160] CR2: 0000000000000000
[ 0.527574] ---[ end trace 5cd69806bf0ab30d ]---
[ 0.531770] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6c80 with usage -1

dmesg-yocto-inn-11:20131009082955:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.430180] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.437632] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.438241] IP: [<c110a6e0>] __fput+0x50/0x380
[ 0.438614] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.439112] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.439477] Modules linked in:
[ 0.439748] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.440371] Workqueue: events delayed_fput
[ 0.440719] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.440920] EIP: 0060:[<c110a6e0>] EFLAGS: 00010212 CPU: 0
[ 0.440920] EIP is at __fput+0x50/0x380
[ 0.440920] EAX: 00000000 EBX: cd0e3200 ECX: 00000000 EDX: 0000001d
[ 0.440920] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.440920] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.440920] CR0: 8005003b CR2: 00000000 CR3: 0d10a000 CR4: 000006b0
[ 0.440920] Stack:
[ 0.440920] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.440920] 00000000 c0124540 ce867ea4 c110aa39 c1495640 ce867efc c10492f9 00000000
[ 0.440920] 00000002 00000000 c10492c1 00000000 00000000 00000000 0019f047 c0083400
[ 0.440920] Call Trace:
[ 0.440920] [<c110aa39>] delayed_fput+0x29/0x30
[ 0.440920] [<c10492f9>] process_one_work+0x2f9/0x650
[ 0.440920] [<c10492c1>] ? process_one_work+0x2c1/0x650
[ 0.440920] [<c104ac2f>] worker_thread+0x28f/0x610
[ 0.440920] [<c104a9a0>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.440920] [<c1050c42>] kthread+0x92/0xa0
[ 0.440920] [<c130ee1b>] ret_from_kernel_thread+0x1b/0x30
[ 0.440920] [<c1050bb0>] ? kthread_create_on_node+0xd0/0xd0
[ 0.440920] Code: 00 b8 a0 53 41 c1 e8 80 ff f4 ff e8 1b b0 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.440920] EIP: [<c110a6e0>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.440920] CR2: 0000000000000000
[ 0.452539] ---[ end trace 225518712278e9ab ]---
[ 0.456251] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6c80 with usage -1

dmesg-yocto-inn-16:20131009082959:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.424763] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.432191] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.432798] IP: [<c110a6e0>] __fput+0x50/0x380
[ 0.433094] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.433094] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.433094] Modules linked in:
[ 0.433094] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.433094] Workqueue: events delayed_fput
[ 0.433094] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.433094] EIP: 0060:[<c110a6e0>] EFLAGS: 00010212 CPU: 0
[ 0.433094] EIP is at __fput+0x50/0x380
[ 0.433094] EAX: 00000000 EBX: cd0e3200 ECX: 00000000 EDX: 0000001d
[ 0.433094] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.433094] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.433094] CR0: 8005003b CR2: 00000000 CR3: 0d10a000 CR4: 000006b0
[ 0.433094] Stack:
[ 0.433094] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.433094] 00000000 c0124540 ce867ea4 c110aa39 c1495640 ce867efc c10492f9 00000000
[ 0.433094] 00000002 00000000 c10492c1 00000000 00000000 00000000 0019f047 c0083400
[ 0.433094] Call Trace:
[ 0.433094] [<c110aa39>] delayed_fput+0x29/0x30
[ 0.433094] [<c10492f9>] process_one_work+0x2f9/0x650
[ 0.433094] [<c10492c1>] ? process_one_work+0x2c1/0x650
[ 0.433094] [<c104ac2f>] worker_thread+0x28f/0x610
[ 0.433094] [<c104a9a0>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.433094] [<c1050c42>] kthread+0x92/0xa0
[ 0.433094] [<c130ee1b>] ret_from_kernel_thread+0x1b/0x30
[ 0.433094] [<c1050bb0>] ? kthread_create_on_node+0xd0/0xd0
[ 0.433094] Code: 00 b8 a0 53 41 c1 e8 80 ff f4 ff e8 1b b0 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.433094] EIP: [<c110a6e0>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.433094] CR2: 0000000000000000
[ 0.446916] ---[ end trace 34a537809b14cc4f ]---
[ 0.449762] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6c80 with usage -1

dmesg-yocto-inn-16:20131009083032:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.502675] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.511910] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.512629] IP: [<c110a6e0>] __fput+0x50/0x380
[ 0.513067] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.513647] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.513867] Modules linked in:
[ 0.513867] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.513867] Workqueue: events delayed_fput
[ 0.513867] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.513867] EIP: 0060:[<c110a6e0>] EFLAGS: 00010212 CPU: 0
[ 0.513867] EIP is at __fput+0x50/0x380
[ 0.513867] EAX: 00000000 EBX: cd0e3600 ECX: 00000000 EDX: 0000001d
[ 0.513867] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.513867] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.513867] CR0: 8005003b CR2: 00000000 CR3: 0d10a000 CR4: 000006b0
[ 0.513867] Stack:
[ 0.513867] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.513867] 00000000 c0124540 ce867ea4 c110aa39 c1495640 ce867efc c10492f9 00000000
[ 0.513867] 00000002 00000000 c10492c1 00000000 00000000 00000000 0019f047 c0083400
[ 0.513867] Call Trace:
[ 0.513867] [<c110aa39>] delayed_fput+0x29/0x30
[ 0.513867] [<c10492f9>] process_one_work+0x2f9/0x650
[ 0.513867] [<c10492c1>] ? process_one_work+0x2c1/0x650
[ 0.513867] [<c104ac2f>] worker_thread+0x28f/0x610
[ 0.513867] [<c104a9a0>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.513867] [<c1050c42>] kthread+0x92/0xa0
[ 0.513867] [<c130ee1b>] ret_from_kernel_thread+0x1b/0x30
[ 0.513867] [<c1050bb0>] ? kthread_create_on_node+0xd0/0xd0
[ 0.513867] Code: 00 b8 a0 53 41 c1 e8 80 ff f4 ff e8 1b b0 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.513867] EIP: [<c110a6e0>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.513867] CR2: 0000000000000000
[ 0.529167] ---[ end trace a83aad245ec4094c ]---
[ 0.533890] kernel tried to execute NX-protected page - exploit attempt? (uid: 0)

dmesg-yocto-inn-17:20131009083026:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.434086] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.441392] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.442025] IP: [<c110a6e0>] __fput+0x50/0x380
[ 0.442025] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.442025] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.442025] Modules linked in:
[ 0.442025] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.442025] Workqueue: events delayed_fput
[ 0.442025] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.442025] EIP: 0060:[<c110a6e0>] EFLAGS: 00010212 CPU: 0
[ 0.442025] EIP is at __fput+0x50/0x380
[ 0.442025] EAX: 00000000 EBX: cd0e3200 ECX: 00000000 EDX: 0000001d
[ 0.442025] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.442025] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.442025] CR0: 8005003b CR2: 00000000 CR3: 0d10a000 CR4: 000006b0
[ 0.442025] Stack:
[ 0.442025] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.442025] 00000000 c0124540 ce867ea4 c110aa39 c1495640 ce867efc c10492f9 00000000
[ 0.442025] 00000002 00000000 c10492c1 00000000 00000000 00000000 0019f047 c0083400
[ 0.442025] Call Trace:
[ 0.442025] [<c110aa39>] delayed_fput+0x29/0x30
[ 0.442025] [<c10492f9>] process_one_work+0x2f9/0x650
[ 0.442025] [<c10492c1>] ? process_one_work+0x2c1/0x650
[ 0.442025] [<c104ac2f>] worker_thread+0x28f/0x610
[ 0.442025] [<c104a9a0>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.442025] [<c1050c42>] kthread+0x92/0xa0
[ 0.442025] [<c130ee1b>] ret_from_kernel_thread+0x1b/0x30
[ 0.442025] [<c1050bb0>] ? kthread_create_on_node+0xd0/0xd0
[ 0.442025] Code: 00 b8 a0 53 41 c1 e8 80 ff f4 ff e8 1b b0 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.442025] EIP: [<c110a6e0>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.442025] CR2: 0000000000000000
[ 0.456868] ---[ end trace f890ee58c5fab7df ]---
[ 0.460395] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6c80 with usage -1

dmesg-yocto-inn-19:20131009083017:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.410913] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.417939] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.418185] IP: [<c110a6e0>] __fput+0x50/0x380
[ 0.418185] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.418185] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.418185] Modules linked in:
[ 0.418185] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.418185] Workqueue: events delayed_fput
[ 0.418185] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.418185] EIP: 0060:[<c110a6e0>] EFLAGS: 00010212 CPU: 0
[ 0.418185] EIP is at __fput+0x50/0x380
[ 0.418185] EAX: 00000000 EBX: cd0e3200 ECX: 00000000 EDX: 0000001d
[ 0.418185] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.418185] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.418185] CR0: 8005003b CR2: 00000000 CR3: 0d10a000 CR4: 000006b0
[ 0.418185] Stack:
[ 0.418185] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.418185] 00000000 c0124540 ce867ea4 c110aa39 c1495640 ce867efc c10492f9 00000000
[ 0.418185] 00000002 00000000 c10492c1 00000000 00000000 00000000 0019f047 c0083400
[ 0.418185] Call Trace:
[ 0.418185] [<c110aa39>] delayed_fput+0x29/0x30
[ 0.418185] [<c10492f9>] process_one_work+0x2f9/0x650
[ 0.418185] [<c10492c1>] ? process_one_work+0x2c1/0x650
[ 0.418185] [<c104ac2f>] worker_thread+0x28f/0x610
[ 0.418185] [<c104a9a0>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.418185] [<c1050c42>] kthread+0x92/0xa0
[ 0.418185] [<c130ee1b>] ret_from_kernel_thread+0x1b/0x30
[ 0.418185] [<c1050bb0>] ? kthread_create_on_node+0xd0/0xd0
[ 0.418185] Code: 00 b8 a0 53 41 c1 e8 80 ff f4 ff e8 1b b0 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.418185] EIP: [<c110a6e0>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.418185] CR2: 0000000000000000
[ 0.432292] ---[ end trace 581eb8f1e6fe4c76 ]---
[ 0.434863] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6c80 with usage -1

dmesg-yocto-inn-34:20131009083040:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.426450] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.433565] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.434171] IP: [<c110a6e0>] __fput+0x50/0x380
[ 0.434545] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.435027] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.435385] Modules linked in:
[ 0.435656] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.435656] Workqueue: events delayed_fput
[ 0.435656] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.435656] EIP: 0060:[<c110a6e0>] EFLAGS: 00010212 CPU: 0
[ 0.435656] EIP is at __fput+0x50/0x380
[ 0.435656] EAX: 00000000 EBX: cd0e3200 ECX: 00000000 EDX: 0000001d
[ 0.435656] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.435656] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.435656] CR0: 8005003b CR2: 00000000 CR3: 0d10a000 CR4: 000006b0
[ 0.435656] Stack:
[ 0.435656] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.435656] 00000000 c0124540 ce867ea4 c110aa39 c1495640 ce867efc c10492f9 00000000
[ 0.435656] 00000002 00000000 c10492c1 00000000 00000000 00000000 0019f047 c0083400
[ 0.435656] Call Trace:
[ 0.435656] [<c110aa39>] delayed_fput+0x29/0x30
[ 0.435656] [<c10492f9>] process_one_work+0x2f9/0x650
[ 0.435656] [<c10492c1>] ? process_one_work+0x2c1/0x650
[ 0.435656] [<c104ac2f>] worker_thread+0x28f/0x610
[ 0.435656] [<c104a9a0>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.435656] [<c1050c42>] kthread+0x92/0xa0
[ 0.435656] [<c130ee1b>] ret_from_kernel_thread+0x1b/0x30
[ 0.435656] [<c1050bb0>] ? kthread_create_on_node+0xd0/0xd0
[ 0.435656] Code: 00 b8 a0 53 41 c1 e8 80 ff f4 ff e8 1b b0 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.435656] EIP: [<c110a6e0>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.435656] CR2: 0000000000000000
[ 0.448224] ---[ end trace 6a3e5cea92ca5442 ]---
[ 0.451867] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6c80 with usage -1

dmesg-yocto-inn-42:20131009082955:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.408103] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.414988] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.415578] IP: [<c110a6e0>] __fput+0x50/0x380
[ 0.415938] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.416400] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.416747] Modules linked in:
[ 0.416996] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.417584] Workqueue: events delayed_fput
[ 0.417693] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.417693] EIP: 0060:[<c110a6e0>] EFLAGS: 00010212 CPU: 0
[ 0.417693] EIP is at __fput+0x50/0x380
[ 0.417693] EAX: 00000000 EBX: cd0e3e00 ECX: 00000000 EDX: 0000001d
[ 0.417693] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.417693] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.417693] CR0: 8005003b CR2: 00000000 CR3: 0d10a000 CR4: 000006b0
[ 0.417693] Stack:
[ 0.417693] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.417693] 00000000 c0124540 ce867ea4 c110aa39 c1495640 ce867efc c10492f9 00000000
[ 0.417693] 00000002 00000000 c10492c1 00000000 00000000 00000000 0019f047 c0083400
[ 0.417693] Call Trace:
[ 0.417693] [<c110aa39>] delayed_fput+0x29/0x30
[ 0.417693] [<c10492f9>] process_one_work+0x2f9/0x650
[ 0.417693] [<c10492c1>] ? process_one_work+0x2c1/0x650
[ 0.417693] [<c104ac2f>] worker_thread+0x28f/0x610
[ 0.417693] [<c104a9a0>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.417693] [<c1050c42>] kthread+0x92/0xa0
[ 0.417693] [<c130ee1b>] ret_from_kernel_thread+0x1b/0x30
[ 0.417693] [<c1050bb0>] ? kthread_create_on_node+0xd0/0xd0
[ 0.417693] Code: 00 b8 a0 53 41 c1 e8 80 ff f4 ff e8 1b b0 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.417693] EIP: [<c110a6e0>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.417693] CR2: 0000000000000000
[ 0.428950] ---[ end trace 2261da89eba9a6f9 ]---
[ 0.432229] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6c80 with usage -1

dmesg-yocto-inn-46:20131009083045:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.496471] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.503853] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.504469] IP: [<c110a6e0>] __fput+0x50/0x380
[ 0.504851] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.505348] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.505721] Modules linked in:
[ 0.506019] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.506160] Workqueue: events delayed_fput
[ 0.506160] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.506160] EIP: 0060:[<c110a6e0>] EFLAGS: 00010212 CPU: 0
[ 0.506160] EIP is at __fput+0x50/0x380
[ 0.506160] EAX: 00000000 EBX: cd0e3600 ECX: 00000000 EDX: 0000001d
[ 0.506160] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.506160] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.506160] CR0: 8005003b CR2: 00000000 CR3: 0d10a000 CR4: 000006b0
[ 0.506160] Stack:
[ 0.506160] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.506160] 00000000 c0124540 ce867ea4 c110aa39 c1495640 ce867efc c10492f9 00000000
[ 0.506160] 00000002 00000000 c10492c1 00000000 00000000 00000000 0019f047 c0083400
[ 0.506160] Call Trace:
[ 0.506160] [<c110aa39>] delayed_fput+0x29/0x30
[ 0.506160] [<c10492f9>] process_one_work+0x2f9/0x650
[ 0.506160] [<c10492c1>] ? process_one_work+0x2c1/0x650
[ 0.506160] [<c104ac2f>] worker_thread+0x28f/0x610
[ 0.506160] [<c104a9a0>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.506160] [<c1050c42>] kthread+0x92/0xa0
[ 0.506160] [<c130ee1b>] ret_from_kernel_thread+0x1b/0x30
[ 0.506160] [<c1050bb0>] ? kthread_create_on_node+0xd0/0xd0
[ 0.506160] Code: 00 b8 a0 53 41 c1 e8 80 ff f4 ff e8 1b b0 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.506160] EIP: [<c110a6e0>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.506160] CR2: 0000000000000000
[ 0.518909] ---[ end trace 28d48498ca9ee6eb ]---
[ 0.522478] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6a80 with usage -2

dmesg-yocto-inn-9:20131009083033:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.441803] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.449101] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.449725] IP: [<c110a6e0>] __fput+0x50/0x380
[ 0.450120] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.450628] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.451010] Modules linked in:
[ 0.451287] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.451940] Workqueue: events delayed_fput
[ 0.452298] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.452416] EIP: 0060:[<c110a6e0>] EFLAGS: 00010212 CPU: 0
[ 0.452416] EIP is at __fput+0x50/0x380
[ 0.452416] EAX: 00000000 EBX: cd0e3200 ECX: 00000000 EDX: 0000001d
[ 0.452416] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.452416] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.452416] CR0: 8005003b CR2: 00000000 CR3: 0d10a000 CR4: 000006b0
[ 0.452416] Stack:
[ 0.452416] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.452416] 00000000 c0124540 ce867ea4 c110aa39 c1495640 ce867efc c10492f9 00000000
[ 0.452416] 00000002 00000000 c10492c1 00000000 00000000 00000000 0019f047 c0083400
[ 0.452416] Call Trace:
[ 0.452416] [<c110aa39>] delayed_fput+0x29/0x30
[ 0.452416] [<c10492f9>] process_one_work+0x2f9/0x650
[ 0.452416] [<c10492c1>] ? process_one_work+0x2c1/0x650
[ 0.452416] [<c104ac2f>] worker_thread+0x28f/0x610
[ 0.452416] [<c104a9a0>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.452416] [<c1050c42>] kthread+0x92/0xa0
[ 0.452416] [<c130ee1b>] ret_from_kernel_thread+0x1b/0x30
[ 0.452416] [<c1050bb0>] ? kthread_create_on_node+0xd0/0xd0
[ 0.452416] Code: 00 b8 a0 53 41 c1 e8 80 ff f4 ff e8 1b b0 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.452416] EIP: [<c110a6e0>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.452416] CR2: 0000000000000000
[ 0.464393] ---[ end trace ebfc7022f114ec65 ]---
[ 0.468186] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6c80 with usage -1

dmesg-yocto-jaketown-12:20131009083043:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 1.551342] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 1.586132] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 1.586642] IP: [< (null)>] (null)
[ 1.586642] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 1.586642] Oops: 0010 [#1] DEBUG_PAGEALLOC
[ 1.586642] Modules linked in:
[ 1.586642] CPU: 0 PID: 46 Comm: mount Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.586642] task: cd7c3cd0 ti: cd10a000 task.ti: cd10a000
[ 1.586642] EIP: 0060:[<00000000>] EFLAGS: 00010246 CPU: 0
[ 1.586642] EIP is at 0x0
[ 1.586642] EAX: cd0dc500 EBX: cd0dce00 ECX: 00000000 EDX: cd0dc500
[ 1.586642] ESI: cd7c3f68 EDI: cd7c3cd0 EBP: cd10bf44 ESP: cd10bf34
[ 1.586642] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.586642] CR0: 8005003b CR2: 00000000 CR3: 0d102000 CR4: 000006b0
[ 1.586642] Stack:
[ 1.586642] c104d7d9 cd7c3f80 cd0d6a00 cd7c3cd0 cd10bf8c c10311d2 00000000 00000000
[ 1.586642] cee9d000 00000035 00000001 cd10bf88 c11095c1 00000001 00000000 cd0d6a50
[ 1.586642] cd7c3cd0 080d3208 cd10bf9c 0000ff00 cd0ea600 cd7c3cd0 cd10bfa4 c10327ca
[ 1.586642] Call Trace:
[ 1.586642] [<c104d7d9>] ? task_work_run+0x79/0xa0
[ 1.586642] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.586642] [<c11095c1>] ? vfs_write+0x161/0x1a0
[ 1.586642] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.586642] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.586642] [<c1307ad5>] syscall_call+0x7/0xb
[ 1.586642] Code: Bad EIP value.
[ 1.586642] EIP: [<00000000>] 0x0 SS:ESP 0068:cd10bf34
[ 1.586642] CR2: 0000000000000000
[ 1.648930] ---[ end trace 7f02bd0664dace14 ]---
[ 1.650964] Fixing recursive fault but reboot is needed!

dmesg-yocto-jaketown-15:20131009083013:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 1.530444] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 1.566314] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 1.568802] IP: [< (null)>] (null)
[ 1.568802] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 1.568802] Oops: 0010 [#1] DEBUG_PAGEALLOC
[ 1.568802] Modules linked in:
[ 1.568802] CPU: 0 PID: 46 Comm: mount Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.568802] task: cd7c3cd0 ti: cd10a000 task.ti: cd10a000
[ 1.568802] EIP: 0060:[<00000000>] EFLAGS: 00010246 CPU: 0
[ 1.568802] EIP is at 0x0
[ 1.568802] EAX: cd0dc500 EBX: cd0dce00 ECX: 00000000 EDX: cd0dc500
[ 1.568802] ESI: cd7c3f68 EDI: cd7c3cd0 EBP: cd10bf44 ESP: cd10bf34
[ 1.568802] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.568802] CR0: 8005003b CR2: 00000000 CR3: 0d102000 CR4: 000006b0
[ 1.568802] Stack:
[ 1.568802] c104d7d9 cd7c3f80 cd0d6a00 cd7c3cd0 cd10bf8c c10311d2 00000000 00000000
[ 1.568802] cee9d000 00000035 00000001 cd10bf88 c11095c1 00000001 00000000 cd0d6a50
[ 1.568802] cd7c3cd0 080d3208 cd10bf9c 0000ff00 cd0ea600 cd7c3cd0 cd10bfa4 c10327ca
[ 1.568802] Call Trace:
[ 1.568802] [<c104d7d9>] ? task_work_run+0x79/0xa0
[ 1.568802] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.568802] [<c11095c1>] ? vfs_write+0x161/0x1a0
[ 1.568802] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.568802] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.568802] [<c1307ad5>] syscall_call+0x7/0xb
[ 1.568802] Code: Bad EIP value.
[ 1.568802] EIP: [<00000000>] 0x0 SS:ESP 0068:cd10bf34
[ 1.568802] CR2: 0000000000000000
[ 1.627698] ---[ end trace 6b2b793cd84617c3 ]---
[ 1.629800] Fixing recursive fault but reboot is needed!

dmesg-yocto-jaketown-29:20131009083045:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 1.496690] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 1.531112] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 1.534201] IP: [< (null)>] (null)
[ 1.534264] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 1.534264] Oops: 0010 [#1] DEBUG_PAGEALLOC
[ 1.534264] Modules linked in:
[ 1.534264] CPU: 0 PID: 46 Comm: mount Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.534264] task: cd7c3cd0 ti: cd10a000 task.ti: cd10a000
[ 1.534264] EIP: 0060:[<00000000>] EFLAGS: 00010246 CPU: 0
[ 1.534264] EIP is at 0x0
[ 1.534264] EAX: cd0dc500 EBX: cd0dc400 ECX: 00000000 EDX: cd0dc500
[ 1.534264] ESI: cd7c3f68 EDI: cd7c3cd0 EBP: cd10bf44 ESP: cd10bf34
[ 1.534264] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.534264] CR0: 8005003b CR2: 00000000 CR3: 0d102000 CR4: 000006b0
[ 1.534264] Stack:
[ 1.534264] c104d7d9 cd7c3f80 cd0d6a00 cd7c3cd0 cd10bf8c c10311d2 00000000 00000000
[ 1.534264] cee9d000 00000035 00000001 cd10bf88 c11095c1 00000001 00000000 cd0d6a50
[ 1.534264] cd7c3cd0 080d3208 cd10bf9c 0000ff00 cd0ea600 cd7c3cd0 cd10bfa4 c10327ca
[ 1.534264] Call Trace:
[ 1.534264] [<c104d7d9>] ? task_work_run+0x79/0xa0
[ 1.534264] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.534264] [<c11095c1>] ? vfs_write+0x161/0x1a0
[ 1.534264] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.534264] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.534264] [<c1307ad5>] syscall_call+0x7/0xb
[ 1.534264] Code: Bad EIP value.
[ 1.534264] EIP: [<00000000>] 0x0 SS:ESP 0068:cd10bf34
[ 1.534264] CR2: 0000000000000000
[ 1.589395] ---[ end trace d950a506c3655153 ]---
[ 1.591408] Fixing recursive fault but reboot is needed!

dmesg-yocto-jaketown-32:20131009082958:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 1.546502] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 1.580575] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 1.581657] IP: [< (null)>] (null)
[ 1.581657] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 1.581657] Oops: 0010 [#1] DEBUG_PAGEALLOC
[ 1.581657] Modules linked in:
[ 1.581657] CPU: 0 PID: 46 Comm: mount Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.581657] task: cd7c3cd0 ti: cd10a000 task.ti: cd10a000
[ 1.581657] EIP: 0060:[<00000000>] EFLAGS: 00010246 CPU: 0
[ 1.581657] EIP is at 0x0
[ 1.581657] EAX: cd0dc500 EBX: cd0dce00 ECX: 00000000 EDX: cd0dc500
[ 1.581657] ESI: cd7c3f68 EDI: cd7c3cd0 EBP: cd10bf44 ESP: cd10bf34
[ 1.581657] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.581657] CR0: 8005003b CR2: 00000000 CR3: 0d102000 CR4: 000006b0
[ 1.581657] Stack:
[ 1.581657] c104d7d9 cd7c3f80 cd0d6a00 cd7c3cd0 cd10bf8c c10311d2 00000000 00000000
[ 1.581657] cee9d000 00000035 00000001 cd10bf88 c11095c1 00000001 00000000 cd0d6a50
[ 1.581657] cd7c3cd0 080d3208 cd10bf9c 0000ff00 cd0ea600 cd7c3cd0 cd10bfa4 c10327ca
[ 1.581657] Call Trace:
[ 1.581657] [<c104d7d9>] ? task_work_run+0x79/0xa0
[ 1.581657] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.581657] [<c11095c1>] ? vfs_write+0x161/0x1a0
[ 1.581657] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.581657] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.581657] [<c1307ad5>] syscall_call+0x7/0xb
[ 1.581657] Code: Bad EIP value.
[ 1.581657] EIP: [<00000000>] 0x0 SS:ESP 0068:cd10bf34
[ 1.581657] CR2: 0000000000000000
[ 1.643072] ---[ end trace b28c2b43abeb7e04 ]---
[ 1.645210] Fixing recursive fault but reboot is needed!

dmesg-yocto-jaketown-40:20131009082921:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 1.018438] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 1.038912] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 1.040921] IP: [< (null)>] (null)
[ 1.041670] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 1.041670] Oops: 0010 [#1] DEBUG_PAGEALLOC
[ 1.041670] Modules linked in:
[ 1.041670] CPU: 0 PID: 46 Comm: mount Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.041670] task: cd7c3cd0 ti: cd10a000 task.ti: cd10a000
[ 1.041670] EIP: 0060:[<00000000>] EFLAGS: 00010246 CPU: 0
[ 1.041670] EIP is at 0x0
[ 1.041670] EAX: cd0dc500 EBX: cd0dce00 ECX: 00000000 EDX: cd0dc500
[ 1.041670] ESI: cd7c3f68 EDI: cd7c3cd0 EBP: cd10bf44 ESP: cd10bf34
[ 1.041670] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.041670] CR0: 8005003b CR2: 00000000 CR3: 0d102000 CR4: 000006b0
[ 1.041670] Stack:
[ 1.041670] c104d7d9 cd7c3f80 cd0d6a00 cd7c3cd0 cd10bf8c c10311d2 00000000 00000000
[ 1.041670] cee9d000 00000035 00000001 cd10bf88 c11095c1 00000001 00000000 cd0d6a50
[ 1.041670] cd7c3cd0 080d3208 cd10bf9c 0000ff00 cd0ea600 cd7c3cd0 cd10bfa4 c10327ca
[ 1.041670] Call Trace:
[ 1.041670] [<c104d7d9>] ? task_work_run+0x79/0xa0
[ 1.041670] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.041670] [<c11095c1>] ? vfs_write+0x161/0x1a0
[ 1.041670] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.041670] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.041670] [<c1307ad5>] syscall_call+0x7/0xb
[ 1.041670] Code: Bad EIP value.
[ 1.041670] EIP: [<00000000>] 0x0 SS:ESP 0068:cd10bf34
[ 1.041670] CR2: 0000000000000000
[ 1.076421] ---[ end trace 4b5bedf680260623 ]---
[ 1.077673] Fixing recursive fault but reboot is needed!

dmesg-yocto-jaketown-41:20131009083036:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 1.535975] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 1.570337] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 1.571212] IP: [< (null)>] (null)
[ 1.571212] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 1.571212] Oops: 0010 [#1] DEBUG_PAGEALLOC
[ 1.571212] Modules linked in:
[ 1.571212] CPU: 0 PID: 46 Comm: mount Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.571212] task: cd7c3cd0 ti: cd10a000 task.ti: cd10a000
[ 1.571212] EIP: 0060:[<00000000>] EFLAGS: 00010246 CPU: 0
[ 1.571212] EIP is at 0x0
[ 1.571212] EAX: cd0dc500 EBX: cd0dce00 ECX: 00000000 EDX: cd0dc500
[ 1.571212] ESI: cd7c3f68 EDI: cd7c3cd0 EBP: cd10bf44 ESP: cd10bf34
[ 1.571212] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.571212] CR0: 8005003b CR2: 00000000 CR3: 0d102000 CR4: 000006b0
[ 1.571212] Stack:
[ 1.571212] c104d7d9 cd7c3f80 cd0d6a00 cd7c3cd0 cd10bf8c c10311d2 00000000 00000000
[ 1.571212] cee9d000 00000035 00000001 cd10bf88 c11095c1 00000001 00000000 cd0d6a50
[ 1.571212] cd7c3cd0 080d3208 cd10bf9c 0000ff00 cd0ea600 cd7c3cd0 cd10bfa4 c10327ca
[ 1.571212] Call Trace:
[ 1.571212] [<c104d7d9>] ? task_work_run+0x79/0xa0
[ 1.571212] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.571212] [<c11095c1>] ? vfs_write+0x161/0x1a0
[ 1.571212] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.571212] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.571212] [<c1307ad5>] syscall_call+0x7/0xb
[ 1.571212] Code: Bad EIP value.
[ 1.571212] EIP: [<00000000>] 0x0 SS:ESP 0068:cd10bf34
[ 1.571212] CR2: 0000000000000000
[ 1.630732] ---[ end trace 72dc9de4dfb9e8df ]---
[ 1.632860] Fixing recursive fault but reboot is needed!

dmesg-yocto-jaketown-46:20131009083002:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 1.567564] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 1.602275] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 1.604681] IP: [< (null)>] (null)
[ 1.604681] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 1.604681] Oops: 0010 [#1] DEBUG_PAGEALLOC
[ 1.604681] Modules linked in:
[ 1.604681] CPU: 0 PID: 46 Comm: mount Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.604681] task: cd7c3cd0 ti: cd10a000 task.ti: cd10a000
[ 1.604681] EIP: 0060:[<00000000>] EFLAGS: 00010246 CPU: 0
[ 1.604681] EIP is at 0x0
[ 1.604681] EAX: cd0dc500 EBX: cd0dce00 ECX: 00000000 EDX: cd0dc500
[ 1.604681] ESI: cd7c3f68 EDI: cd7c3cd0 EBP: cd10bf44 ESP: cd10bf34
[ 1.604681] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.604681] CR0: 8005003b CR2: 00000000 CR3: 0d102000 CR4: 000006b0
[ 1.604681] Stack:
[ 1.604681] c104d7d9 cd7c3f80 cd0d6a00 cd7c3cd0 cd10bf8c c10311d2 00000000 00000000
[ 1.604681] cee9d000 00000035 00000001 cd10bf88 c11095c1 00000001 00000000 cd0d6a50
[ 1.604681] cd7c3cd0 080d3208 cd10bf9c 0000ff00 cd0ea600 cd7c3cd0 cd10bfa4 c10327ca
[ 1.604681] Call Trace:
[ 1.604681] [<c104d7d9>] ? task_work_run+0x79/0xa0
[ 1.604681] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.604681] [<c11095c1>] ? vfs_write+0x161/0x1a0
[ 1.604681] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.604681] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.604681] [<c1307ad5>] syscall_call+0x7/0xb
[ 1.604681] Code: Bad EIP value.
[ 1.604681] EIP: [<00000000>] 0x0 SS:ESP 0068:cd10bf34
[ 1.604681] CR2: 0000000000000000
[ 1.663708] ---[ end trace d7d60fed41220e4a ]---
[ 1.665897] Fixing recursive fault but reboot is needed!

dmesg-yocto-jaketown-47:20131009083012:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 1.570224] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 1.605401] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 1.608167] IP: [< (null)>] (null)
[ 1.608167] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 1.608167] Oops: 0010 [#1] DEBUG_PAGEALLOC
[ 1.608167] Modules linked in:
[ 1.608167] CPU: 0 PID: 46 Comm: mount Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.608167] task: cd7c3cd0 ti: cd10a000 task.ti: cd10a000
[ 1.608167] EIP: 0060:[<00000000>] EFLAGS: 00010246 CPU: 0
[ 1.608167] EIP is at 0x0
[ 1.608167] EAX: cd0dc500 EBX: cd0dce00 ECX: 00000000 EDX: cd0dc500
[ 1.608167] ESI: cd7c3f68 EDI: cd7c3cd0 EBP: cd10bf44 ESP: cd10bf34
[ 1.608167] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.608167] CR0: 8005003b CR2: 00000000 CR3: 0d102000 CR4: 000006b0
[ 1.608167] Stack:
[ 1.608167] c104d7d9 cd7c3f80 cd0d6a00 cd7c3cd0 cd10bf8c c10311d2 00000000 00000000
[ 1.608167] cee9d000 00000035 00000001 cd10bf88 c11095c1 00000001 00000000 cd0d6a50
[ 1.608167] cd7c3cd0 080d3208 cd10bf9c 0000ff00 cd0ea600 cd7c3cd0 cd10bfa4 c10327ca
[ 1.608167] Call Trace:
[ 1.608167] [<c104d7d9>] ? task_work_run+0x79/0xa0
[ 1.608167] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.608167] [<c11095c1>] ? vfs_write+0x161/0x1a0
[ 1.608167] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.608167] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.608167] [<c1307ad5>] syscall_call+0x7/0xb
[ 1.608167] Code: Bad EIP value.
[ 1.608167] EIP: [<00000000>] 0x0 SS:ESP 0068:cd10bf34
[ 1.608167] CR2: 0000000000000000
[ 1.666045] ---[ end trace db7ead92435cc1aa ]---
[ 1.668186] Fixing recursive fault but reboot is needed!

dmesg-yocto-jaketown-4:20131009082939:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 1.020838] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 1.042223] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 1.044259] IP: [< (null)>] (null)
[ 1.044958] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 1.044958] Oops: 0010 [#1] DEBUG_PAGEALLOC
[ 1.044958] Modules linked in:
[ 1.044958] CPU: 0 PID: 46 Comm: mount Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 1.044958] task: cd7c3cd0 ti: cd10a000 task.ti: cd10a000
[ 1.044958] EIP: 0060:[<00000000>] EFLAGS: 00010246 CPU: 0
[ 1.044958] EIP is at 0x0
[ 1.044958] EAX: cd0dc500 EBX: cd0dce00 ECX: 00000000 EDX: cd0dc500
[ 1.044958] ESI: cd7c3f68 EDI: cd7c3cd0 EBP: cd10bf44 ESP: cd10bf34
[ 1.044958] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 1.044958] CR0: 8005003b CR2: 00000000 CR3: 0d102000 CR4: 000006b0
[ 1.044958] Stack:
[ 1.044958] c104d7d9 cd7c3f80 cd0d6a00 cd7c3cd0 cd10bf8c c10311d2 00000000 00000000
[ 1.044958] cee9d000 00000035 00000001 cd10bf88 c11095c1 00000001 00000000 cd0d6a50
[ 1.044958] cd7c3cd0 080d3208 cd10bf9c 0000ff00 cd0ea600 cd7c3cd0 cd10bfa4 c10327ca
[ 1.044958] Call Trace:
[ 1.044958] [<c104d7d9>] ? task_work_run+0x79/0xa0
[ 1.044958] [<c10311d2>] do_exit+0x2f2/0x960
[ 1.044958] [<c11095c1>] ? vfs_write+0x161/0x1a0
[ 1.044958] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 1.044958] [<c1032838>] SyS_exit_group+0x18/0x20
[ 1.044958] [<c1307ad5>] syscall_call+0x7/0xb
[ 1.044958] Code: Bad EIP value.
[ 1.044958] EIP: [<00000000>] 0x0 SS:ESP 0068:cd10bf34
[ 1.044958] CR2: 0000000000000000
[ 1.079981] ---[ end trace c2310af05059d583 ]---
[ 1.081346] Fixing recursive fault but reboot is needed!

dmesg-yocto-lkp-st01-2:20131009083038:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.888984] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.914539] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.915693] IP: [< (null)>] (null)
[ 0.916157] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.916157] Oops: 0010 [#1] DEBUG_PAGEALLOC
[ 0.916157] Modules linked in:
[ 0.916157] CPU: 0 PID: 46 Comm: mount Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.916157] task: cd7cbcd0 ti: cd10e000 task.ti: cd10e000
[ 0.916157] EIP: 0060:[<00000000>] EFLAGS: 00010246 CPU: 0
[ 0.916157] EIP is at 0x0
[ 0.916157] EAX: cd0e3500 EBX: cd0e3e00 ECX: 00000000 EDX: cd0e3500
[ 0.916157] ESI: cd7cbf68 EDI: cd7cbcd0 EBP: cd10ff44 ESP: cd10ff34
[ 0.916157] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.916157] CR0: 8005003b CR2: 00000000 CR3: 0d10a000 CR4: 000006b0
[ 0.916157] Stack:
[ 0.916157] c104d7d9 cd7cbf80 cd0daa00 cd7cbcd0 cd10ff8c c10311d2 00000000 00000000
[ 0.916157] cee9d000 00000035 00000001 cd10ff88 c11095c1 00000001 00000000 cd0daa50
[ 0.916157] cd7cbcd0 080d3208 cd10ff9c 0000ff00 cd0ee600 cd7cbcd0 cd10ffa4 c10327ca
[ 0.916157] Call Trace:
[ 0.916157] [<c104d7d9>] ? task_work_run+0x79/0xa0
[ 0.916157] [<c10311d2>] do_exit+0x2f2/0x960
[ 0.916157] [<c11095c1>] ? vfs_write+0x161/0x1a0
[ 0.916157] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 0.916157] [<c1032838>] SyS_exit_group+0x18/0x20
[ 0.916157] [<c1307ad5>] syscall_call+0x7/0xb
[ 0.916157] Code: Bad EIP value.
[ 0.916157] EIP: [<00000000>] 0x0 SS:ESP 0068:cd10ff34
[ 0.916157] CR2: 0000000000000000
[ 0.936493] ---[ end trace f10ae585fb74f7e1 ]---
[ 0.937227] Fixing recursive fault but reboot is needed!

dmesg-yocto-lkp-st01-8:20131009083013:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.889728] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.915375] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.916273] IP: [< (null)>] (null)
[ 0.916273] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.916273] Oops: 0010 [#1] DEBUG_PAGEALLOC
[ 0.916273] Modules linked in:
[ 0.916273] CPU: 0 PID: 46 Comm: mount Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.916273] task: cd7cbcd0 ti: cd10e000 task.ti: cd10e000
[ 0.916273] EIP: 0060:[<00000000>] EFLAGS: 00010246 CPU: 0
[ 0.916273] EIP is at 0x0
[ 0.916273] EAX: cd0e3200 EBX: cd0e3e00 ECX: 00000000 EDX: cd0e3200
[ 0.916273] ESI: cd7cbf68 EDI: cd7cbcd0 EBP: cd10ff44 ESP: cd10ff34
[ 0.916273] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.916273] CR0: 8005003b CR2: 00000000 CR3: 0d10a000 CR4: 000006b0
[ 0.916273] Stack:
[ 0.916273] c104d7d9 cd7cbf80 cd0daa00 cd7cbcd0 cd10ff8c c10311d2 00000000 00000000
[ 0.916273] cee9d000 00000035 00000001 cd10ff88 c11095c1 00000001 00000000 cd0daa50
[ 0.916273] cd7cbcd0 080d3208 cd10ff9c 0000ff00 cd0ee600 cd7cbcd0 cd10ffa4 c10327ca
[ 0.916273] Call Trace:
[ 0.916273] [<c104d7d9>] ? task_work_run+0x79/0xa0
[ 0.916273] [<c10311d2>] do_exit+0x2f2/0x960
[ 0.916273] [<c11095c1>] ? vfs_write+0x161/0x1a0
[ 0.916273] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 0.916273] [<c1032838>] SyS_exit_group+0x18/0x20
[ 0.916273] [<c1307ad5>] syscall_call+0x7/0xb
[ 0.916273] Code: Bad EIP value.
[ 0.916273] EIP: [<00000000>] 0x0 SS:ESP 0068:cd10ff34
[ 0.916273] CR2: 0000000000000000
[ 0.937421] ---[ end trace 76773643dbf59fe6 ]---
[ 0.938147] Fixing recursive fault but reboot is needed!

dmesg-yocto-lkp-tt02-19:20131008230131:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1


mount: mounting proc on /proc failed: No such device
[ 0.988873] kernel tried to execute NX-protected page - exploit attempt? (uid: 0)
[ 0.990372] BUG: unable to handle kernel paging request at cd0dcc08
[ 0.991192] IP: [<cd0dcc08>] 0xcd0dcc07
[ 0.991192] *pdpt = 0000000001525001 *pde = 000000000fbfc067 *pte = 800000000d0dc163
[ 0.991192] Oops: 0011 [#1] DEBUG_PAGEALLOC
[ 0.991192] Modules linked in:
[ 0.991192] CPU: 0 PID: 46 Comm: mount Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.991192] task: cd7c3cd0 ti: cd10a000 task.ti: cd10a000
[ 0.991192] EIP: 0060:[<cd0dcc08>] EFLAGS: 00010246 CPU: 0
[ 0.991192] EIP is at 0xcd0dcc08
[ 0.991192] EAX: cd0dcc00 EBX: cd0dc600 ECX: 00000000 EDX: cd0dcc00
[ 0.991192] ESI: cd7c3f68 EDI: cd7c3cd0 EBP: cd10bf44 ESP: cd10bf34
[ 0.991192] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.991192] CR0: 8005003b CR2: cd0dcc08 CR3: 0d102000 CR4: 000006b0
[ 0.991192] Stack:
[ 0.991192] c104d7d9 cd7c3f80 cd0d6a00 cd7c3cd0 cd10bf8c c10311d2 00000000 00000000
[ 0.991192] cee9d000 00000035 00000001 cd10bf88 c11095c1 00000001 00000000 cd0d6a50
[ 0.991192] cd7c3cd0 080d3208 cd10bf9c 0000ff00 cd0ea600 cd7c3cd0 cd10bfa4 c10327ca
[ 0.991192] Call Trace:
[ 0.991192] [<c104d7d9>] ? task_work_run+0x79/0xa0
[ 0.991192] [<c10311d2>] do_exit+0x2f2/0x960
[ 0.991192] [<c11095c1>] ? vfs_write+0x161/0x1a0
[ 0.991192] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 0.991192] [<c1032838>] SyS_exit_group+0x18/0x20
[ 0.991192] [<c1307ad5>] syscall_call+0x7/0xb
[ 0.991192] Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 c6 0d cd 08 cc 0d cd <20> 00 00 00 4c cc 0d cd 44 cc 0d cd 48 cc 0d cd 01 00 00 00 ad
[ 0.991192] EIP: [<cd0dcc08>] 0xcd0dcc08 SS:ESP 0068:cd10bf34
[ 0.991192] CR2: 00000000cd0dcc08
[ 0.991192] ---[ end trace c19536785f94c587 ]---
[ 0.991192] Fixing recursive fault but reboot is needed!

dmesg-yocto-lkp-tt02-23:20131008230154:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1


mount: mounting proc on /proc failed: No such device
[ 0.987575] kernel tried to execute NX-protected page - exploit attempt? (uid: 0)
[ 0.988107] BUG: unable to handle kernel paging request at cd0dc408
[ 0.988107] IP: [<cd0dc408>] 0xcd0dc407
[ 0.988107] *pdpt = 0000000001525001 *pde = 000000000fbfc067 *pte = 800000000d0dc163
[ 0.988107] Oops: 0011 [#1] DEBUG_PAGEALLOC
[ 0.988107] Modules linked in:
[ 0.988107] CPU: 0 PID: 46 Comm: mount Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.988107] task: cd7c3cd0 ti: cd10a000 task.ti: cd10a000
[ 0.988107] EIP: 0060:[<cd0dc408>] EFLAGS: 00010246 CPU: 0
[ 0.988107] EIP is at 0xcd0dc408
[ 0.988107] EAX: cd0dc400 EBX: cd0dc600 ECX: 00000000 EDX: cd0dc400
[ 0.988107] ESI: cd7c3f68 EDI: cd7c3cd0 EBP: cd10bf44 ESP: cd10bf34
[ 0.988107] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.988107] CR0: 8005003b CR2: cd0dc408 CR3: 0d102000 CR4: 000006b0
[ 0.988107] Stack:
[ 0.988107] c104d7d9 cd7c3f80 cd0d6a00 cd7c3cd0 cd10bf8c c10311d2 00000000 00000000
[ 0.988107] cee9d000 00000035 00000001 cd10bf88 c11095c1 00000001 00000000 cd0d6a50
[ 0.988107] cd7c3cd0 080d3208 cd10bf9c 0000ff00 cd0ea600 cd7c3cd0 cd10bfa4 c10327ca
[ 0.988107] Call Trace:
[ 0.988107] [<c104d7d9>] ? task_work_run+0x79/0xa0
[ 0.988107] [<c10311d2>] do_exit+0x2f2/0x960
[ 0.988107] [<c11095c1>] ? vfs_write+0x161/0x1a0
[ 0.988107] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 0.988107] [<c1032838>] SyS_exit_group+0x18/0x20
[ 0.988107] [<c1307ad5>] syscall_call+0x7/0xb
[ 0.988107] Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 c6 0d cd 08 c4 0d cd <20> 00 00 00 4c c4 0d cd 44 c4 0d cd 48 c4 0d cd 01 00 00 00 ad
[ 0.988107] EIP: [<cd0dc408>] 0xcd0dc408 SS:ESP 0068:cd10bf34
[ 0.988107] CR2: 00000000cd0dc408
[ 0.988107] ---[ end trace 3ebf8bf531c016bd ]---
[ 0.988107] Fixing recursive fault but reboot is needed!

dmesg-yocto-nhm4-1:20131009003543:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.426035] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.433333] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.433951] IP: [<c110a6e0>] __fput+0x50/0x380
[ 0.434335] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.434839] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.434880] Modules linked in:
[ 0.434880] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.434880] Workqueue: events delayed_fput
[ 0.434880] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.434880] EIP: 0060:[<c110a6e0>] EFLAGS: 00010212 CPU: 0
[ 0.434880] EIP is at __fput+0x50/0x380
[ 0.434880] EAX: 00000000 EBX: cd0e3200 ECX: 00000000 EDX: 0000001d
[ 0.434880] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.434880] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.434880] CR0: 8005003b CR2: 00000000 CR3: 0d10b000 CR4: 000006b0
[ 0.434880] Stack:
[ 0.434880] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.434880] 00000000 c0124540 ce867ea4 c110aa39 c1495640 ce867efc c10492f9 00000000
[ 0.434880] 00000002 00000000 c10492c1 00000000 00000000 00000000 0019f047 c0083400
[ 0.434880] Call Trace:
[ 0.434880] [<c110aa39>] delayed_fput+0x29/0x30
[ 0.434880] [<c10492f9>] process_one_work+0x2f9/0x650
[ 0.434880] [<c10492c1>] ? process_one_work+0x2c1/0x650
[ 0.434880] [<c104ac2f>] worker_thread+0x28f/0x610
[ 0.434880] [<c104a9a0>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.434880] [<c1050c42>] kthread+0x92/0xa0
[ 0.434880] [<c130ee1b>] ret_from_kernel_thread+0x1b/0x30
[ 0.434880] [<c1050bb0>] ? kthread_create_on_node+0xd0/0xd0
[ 0.434880] Code: 00 b8 a0 53 41 c1 e8 80 ff f4 ff e8 1b b0 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.434880] EIP: [<c110a6e0>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.434880] CR2: 0000000000000000
[ 0.448662] ---[ end trace 08170cf8d35771e6 ]---
[ 0.451536] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6d00 with usage -1

dmesg-yocto-nhm4-2:20131009003443:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.428450] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.435717] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.436341] IP: [<c110a6e0>] __fput+0x50/0x380
[ 0.436733] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.437233] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.437609] Modules linked in:
[ 0.437879] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.438404] Workqueue: events delayed_fput
[ 0.438404] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.438404] EIP: 0060:[<c110a6e0>] EFLAGS: 00010212 CPU: 0
[ 0.438404] EIP is at __fput+0x50/0x380
[ 0.438404] EAX: 00000000 EBX: cd0e3200 ECX: 00000000 EDX: 0000001d
[ 0.438404] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.438404] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.438404] CR0: 8005003b CR2: 00000000 CR3: 0d10b000 CR4: 000006b0
[ 0.438404] Stack:
[ 0.438404] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.438404] 00000000 c0124540 ce867ea4 c110aa39 c1495640 ce867efc c10492f9 00000000
[ 0.438404] 00000002 00000000 c10492c1 00000000 00000000 00000000 0019f047 c0083400
[ 0.438404] Call Trace:
[ 0.438404] [<c110aa39>] delayed_fput+0x29/0x30
[ 0.438404] [<c10492f9>] process_one_work+0x2f9/0x650
[ 0.438404] [<c10492c1>] ? process_one_work+0x2c1/0x650
[ 0.438404] [<c104ac2f>] worker_thread+0x28f/0x610
[ 0.438404] [<c104a9a0>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.438404] [<c1050c42>] kthread+0x92/0xa0
[ 0.438404] [<c130ee1b>] ret_from_kernel_thread+0x1b/0x30
[ 0.438404] [<c1050bb0>] ? kthread_create_on_node+0xd0/0xd0
[ 0.438404] Code: 00 b8 a0 53 41 c1 e8 80 ff f4 ff e8 1b b0 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.438404] EIP: [<c110a6e0>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.438404] CR2: 0000000000000000
[ 0.450971] ---[ end trace dc6249fbb8b3aa6f ]---
[ 0.454483] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6d00 with usage -1

dmesg-yocto-roam-19:20131009082928:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.499036] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.507597] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.508319] IP: [<c110a6e0>] __fput+0x50/0x380
[ 0.508766] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.509356] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.509787] Modules linked in:
[ 0.510101] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.510745] Workqueue: events delayed_fput
[ 0.510745] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.510745] EIP: 0060:[<c110a6e0>] EFLAGS: 00010212 CPU: 0
[ 0.510745] EIP is at __fput+0x50/0x380
[ 0.510745] EAX: 00000000 EBX: cd0e3200 ECX: 00000000 EDX: 0000001d
[ 0.510745] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.510745] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.510745] CR0: 8005003b CR2: 00000000 CR3: 0d10c000 CR4: 000006b0
[ 0.510745] Stack:
[ 0.510745] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.510745] 00000000 c0124540 ce867ea4 c110aa39 c1495640 ce867efc c10492f9 00000000
[ 0.510745] 00000002 00000000 c10492c1 00000000 00000000 00000000 0019f047 c0083400
[ 0.510745] Call Trace:
[ 0.510745] [<c110aa39>] delayed_fput+0x29/0x30
[ 0.510745] [<c10492f9>] process_one_work+0x2f9/0x650
[ 0.510745] [<c10492c1>] ? process_one_work+0x2c1/0x650
[ 0.510745] [<c104ac2f>] worker_thread+0x28f/0x610
[ 0.510745] [<c104a9a0>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.510745] [<c1050c42>] kthread+0x92/0xa0
[ 0.510745] [<c130ee1b>] ret_from_kernel_thread+0x1b/0x30
[ 0.510745] [<c1050bb0>] ? kthread_create_on_node+0xd0/0xd0
[ 0.510745] Code: 00 b8 a0 53 41 c1 e8 80 ff f4 ff e8 1b b0 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.510745] EIP: [<c110a6e0>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.510745] CR2: 0000000000000000
[ 0.525145] ---[ end trace 646f8ad850537230 ]---
[ 0.529312] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6c80 with usage -1

dmesg-yocto-roam-19:20131009083028:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.499251] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.507900] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.508631] IP: [<c110a6e0>] __fput+0x50/0x380
[ 0.509091] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.509677] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.510118] Modules linked in:
[ 0.510153] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.510153] Workqueue: events delayed_fput
[ 0.510153] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.510153] EIP: 0060:[<c110a6e0>] EFLAGS: 00010212 CPU: 0
[ 0.510153] EIP is at __fput+0x50/0x380
[ 0.510153] EAX: 00000000 EBX: cd0e3200 ECX: 00000000 EDX: 0000001d
[ 0.510153] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.510153] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.510153] CR0: 8005003b CR2: 00000000 CR3: 0d10a000 CR4: 000006b0
[ 0.510153] Stack:
[ 0.510153] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.510153] 00000000 c0124540 ce867ea4 c110aa39 c1495640 ce867efc c10492f9 00000000
[ 0.510153] 00000002 00000000 c10492c1 00000000 00000000 00000000 0019f047 c0083400
[ 0.510153] Call Trace:
[ 0.510153] [<c110aa39>] delayed_fput+0x29/0x30
[ 0.510153] [<c10492f9>] process_one_work+0x2f9/0x650
[ 0.510153] [<c10492c1>] ? process_one_work+0x2c1/0x650
[ 0.510153] [<c104ac2f>] worker_thread+0x28f/0x610
[ 0.510153] [<c104a9a0>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.510153] [<c1050c42>] kthread+0x92/0xa0
[ 0.510153] [<c130ee1b>] ret_from_kernel_thread+0x1b/0x30
[ 0.510153] [<c1050bb0>] ? kthread_create_on_node+0xd0/0xd0
[ 0.510153] Code: 00 b8 a0 53 41 c1 e8 80 ff f4 ff e8 1b b0 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.510153] EIP: [<c110a6e0>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.510153] CR2: 0000000000000000
[ 0.525438] ---[ end trace 7b73824a90479b7b ]---
[ 0.529939] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6c80 with usage -1

dmesg-yocto-roam-31:20131009083002:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.495782] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.504013] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.504136] IP: [<c110a6e0>] __fput+0x50/0x380
[ 0.504136] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.504136] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.504136] Modules linked in:
[ 0.504136] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.504136] Workqueue: events delayed_fput
[ 0.504136] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.504136] EIP: 0060:[<c110a6e0>] EFLAGS: 00010212 CPU: 0
[ 0.504136] EIP is at __fput+0x50/0x380
[ 0.504136] EAX: 00000000 EBX: cd0e3200 ECX: 00000000 EDX: 0000001d
[ 0.504136] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.504136] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.504136] CR0: 8005003b CR2: 00000000 CR3: 0d10a000 CR4: 000006b0
[ 0.504136] Stack:
[ 0.504136] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.504136] 00000000 c0124540 ce867ea4 c110aa39 c1495640 ce867efc c10492f9 00000000
[ 0.504136] 00000002 00000000 c10492c1 00000000 00000000 00000000 0019f047 c0083400
[ 0.504136] Call Trace:
[ 0.504136] [<c110aa39>] delayed_fput+0x29/0x30
[ 0.504136] [<c10492f9>] process_one_work+0x2f9/0x650
[ 0.504136] [<c10492c1>] ? process_one_work+0x2c1/0x650
[ 0.504136] [<c104ac2f>] worker_thread+0x28f/0x610
[ 0.504136] [<c104a9a0>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.504136] [<c1050c42>] kthread+0x92/0xa0
[ 0.504136] [<c130ee1b>] ret_from_kernel_thread+0x1b/0x30
[ 0.504136] [<c1050bb0>] ? kthread_create_on_node+0xd0/0xd0
[ 0.504136] Code: 00 b8 a0 53 41 c1 e8 80 ff f4 ff e8 1b b0 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.504136] EIP: [<c110a6e0>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.504136] CR2: 0000000000000000
[ 0.521546] ---[ end trace 39b01e980fcb1dd0 ]---
[ 0.525685] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6c80 with usage -1

dmesg-yocto-roam-7:20131009083018:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.493942] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.502525] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.503224] IP: [<c110a6e0>] __fput+0x50/0x380
[ 0.503655] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.504223] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.504638] Modules linked in:
[ 0.504940] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.505167] Workqueue: events delayed_fput
[ 0.505167] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.505167] EIP: 0060:[<c110a6e0>] EFLAGS: 00010212 CPU: 0
[ 0.505167] EIP is at __fput+0x50/0x380
[ 0.505167] EAX: 00000000 EBX: cd0e3100 ECX: 00000000 EDX: 0000001d
[ 0.505167] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.505167] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.505167] CR0: 8005003b CR2: 00000000 CR3: 0d10a000 CR4: 000006b0
[ 0.505167] Stack:
[ 0.505167] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.505167] 00000000 c0124540 ce867ea4 c110aa39 c1495640 ce867efc c10492f9 00000000
[ 0.505167] 00000002 00000000 c10492c1 00000000 00000000 00000000 0019f047 c0083400
[ 0.505167] Call Trace:
[ 0.505167] [<c110aa39>] delayed_fput+0x29/0x30
[ 0.505167] [<c10492f9>] process_one_work+0x2f9/0x650
[ 0.505167] [<c10492c1>] ? process_one_work+0x2c1/0x650
[ 0.505167] [<c104ac2f>] worker_thread+0x28f/0x610
[ 0.505167] [<c104a9a0>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.505167] [<c1050c42>] kthread+0x92/0xa0
[ 0.505167] [<c130ee1b>] ret_from_kernel_thread+0x1b/0x30
[ 0.505167] [<c1050bb0>] ? kthread_create_on_node+0xd0/0xd0
[ 0.505167] Code: 00 b8 a0 53 41 c1 e8 80 ff f4 ff e8 1b b0 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.505167] EIP: [<c110a6e0>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.505167] CR2: 0000000000000000
[ 0.519574] ---[ end trace 4c42a6d58bfb847a ]---
[ 0.523721] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6c80 with usage -1

dmesg-yocto-snb-16:20131009083047:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.562054] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.571826] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.572634] IP: [<c110a6e0>] __fput+0x50/0x380
[ 0.573140] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.573797] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.574281] Modules linked in:
[ 0.574636] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.574925] Workqueue: events delayed_fput
[ 0.574925] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.574925] EIP: 0060:[<c110a6e0>] EFLAGS: 00010212 CPU: 0
[ 0.574925] EIP is at __fput+0x50/0x380
[ 0.574925] EAX: 00000000 EBX: cd0e3200 ECX: 00000000 EDX: 0000001d
[ 0.574925] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.574925] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.574925] CR0: 8005003b CR2: 00000000 CR3: 0d10a000 CR4: 000006b0
[ 0.574925] Stack:
[ 0.574925] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.574925] 00000000 c0124540 ce867ea4 c110aa39 c1495640 ce867efc c10492f9 00000000
[ 0.574925] 00000002 00000000 c10492c1 00000000 00000000 00000000 0019f047 c0083400
[ 0.574925] Call Trace:
[ 0.574925] [<c110aa39>] delayed_fput+0x29/0x30
[ 0.574925] [<c10492f9>] process_one_work+0x2f9/0x650
[ 0.574925] [<c10492c1>] ? process_one_work+0x2c1/0x650
[ 0.574925] [<c104ac2f>] worker_thread+0x28f/0x610
[ 0.574925] [<c104a9a0>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.574925] [<c1050c42>] kthread+0x92/0xa0
[ 0.574925] [<c130ee1b>] ret_from_kernel_thread+0x1b/0x30
[ 0.574925] [<c1050bb0>] ? kthread_create_on_node+0xd0/0xd0
[ 0.574925] Code: 00 b8 a0 53 41 c1 e8 80 ff f4 ff e8 1b b0 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.574925] EIP: [<c110a6e0>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.574925] CR2: 0000000000000000
[ 0.591274] ---[ end trace 86ab9df62a7af15b ]---
[ 0.594899] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6c80 with usage -1

dmesg-yocto-snb-34:20131009083004:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.561343] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.571257] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.572088] IP: [<c110a6e0>] __fput+0x50/0x380
[ 0.572619] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.573285] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.573723] Modules linked in:
[ 0.573723] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.573723] Workqueue: events delayed_fput
[ 0.573723] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.573723] EIP: 0060:[<c110a6e0>] EFLAGS: 00010212 CPU: 0
[ 0.573723] EIP is at __fput+0x50/0x380
[ 0.573723] EAX: 00000000 EBX: cd0e3200 ECX: 00000000 EDX: 0000001d
[ 0.573723] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.573723] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.573723] CR0: 8005003b CR2: 00000000 CR3: 0d10a000 CR4: 000006b0
[ 0.573723] Stack:
[ 0.573723] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.573723] 00000000 c0124540 ce867ea4 c110aa39 c1495640 ce867efc c10492f9 00000000
[ 0.573723] 00000002 00000000 c10492c1 00000000 00000000 00000000 0019f047 c0083400
[ 0.573723] Call Trace:
[ 0.573723] [<c110aa39>] delayed_fput+0x29/0x30
[ 0.573723] [<c10492f9>] process_one_work+0x2f9/0x650
[ 0.573723] [<c10492c1>] ? process_one_work+0x2c1/0x650
[ 0.573723] [<c104ac2f>] worker_thread+0x28f/0x610
[ 0.573723] [<c104a9a0>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.573723] [<c1050c42>] kthread+0x92/0xa0
[ 0.573723] [<c130ee1b>] ret_from_kernel_thread+0x1b/0x30
[ 0.573723] [<c1050bb0>] ? kthread_create_on_node+0xd0/0xd0
[ 0.573723] Code: 00 b8 a0 53 41 c1 e8 80 ff f4 ff e8 1b b0 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.573723] EIP: [<c110a6e0>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.573723] CR2: 0000000000000000
[ 0.591594] ---[ end trace ce2ea4d7239919b0 ]---
[ 0.596515] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6c80 with usage -1

dmesg-yocto-snb-38:20131009083044:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.557316] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.567160] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.567941] IP: [<c110a6e0>] __fput+0x50/0x380
[ 0.568436] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.569076] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.569544] Modules linked in:
[ 0.569887] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.570447] Workqueue: events delayed_fput
[ 0.570447] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.570447] EIP: 0060:[<c110a6e0>] EFLAGS: 00010212 CPU: 0
[ 0.570447] EIP is at __fput+0x50/0x380
[ 0.570447] EAX: 00000000 EBX: cd0e3200 ECX: 00000000 EDX: 0000001d
[ 0.570447] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.570447] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.570447] CR0: 8005003b CR2: 00000000 CR3: 0d10a000 CR4: 000006b0
[ 0.570447] Stack:
[ 0.570447] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.570447] 00000000 c0124540 ce867ea4 c110aa39 c1495640 ce867efc c10492f9 00000000
[ 0.570447] 00000002 00000000 c10492c1 00000000 00000000 00000000 0019f047 c0083400
[ 0.570447] Call Trace:
[ 0.570447] [<c110aa39>] delayed_fput+0x29/0x30
[ 0.570447] [<c10492f9>] process_one_work+0x2f9/0x650
[ 0.570447] [<c10492c1>] ? process_one_work+0x2c1/0x650
[ 0.570447] [<c104ac2f>] worker_thread+0x28f/0x610
[ 0.570447] [<c104a9a0>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.570447] [<c1050c42>] kthread+0x92/0xa0
[ 0.570447] [<c130ee1b>] ret_from_kernel_thread+0x1b/0x30
[ 0.570447] [<c1050bb0>] ? kthread_create_on_node+0xd0/0xd0
[ 0.570447] Code: 00 b8 a0 53 41 c1 e8 80 ff f4 ff e8 1b b0 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.570447] EIP: [<c110a6e0>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.570447] CR2: 0000000000000000
[ 0.586221] ---[ end trace e1d5a895fede2b91 ]---
[ 0.590456] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6c80 with usage -1

dmesg-yocto-snb-40:20131009083017:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.551710] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.561097] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.561887] IP: [<c110a6e0>] __fput+0x50/0x380
[ 0.562371] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.563004] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.563467] Modules linked in:
[ 0.563669] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.563669] Workqueue: events delayed_fput
[ 0.563669] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.563669] EIP: 0060:[<c110a6e0>] EFLAGS: 00010212 CPU: 0
[ 0.563669] EIP is at __fput+0x50/0x380
[ 0.563669] EAX: 00000000 EBX: cd0e3200 ECX: 00000000 EDX: 0000001d
[ 0.563669] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.563669] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.563669] CR0: 8005003b CR2: 00000000 CR3: 0d10a000 CR4: 000006b0
[ 0.563669] Stack:
[ 0.563669] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.563669] 00000000 c0124540 ce867ea4 c110aa39 c1495640 ce867efc c10492f9 00000000
[ 0.563669] 00000002 00000000 c10492c1 00000000 00000000 00000000 0019f047 c0083400
[ 0.563669] Call Trace:
[ 0.563669] [<c110aa39>] delayed_fput+0x29/0x30
[ 0.563669] [<c10492f9>] process_one_work+0x2f9/0x650
[ 0.563669] [<c10492c1>] ? process_one_work+0x2c1/0x650
[ 0.563669] [<c104ac2f>] worker_thread+0x28f/0x610
[ 0.563669] [<c104a9a0>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.563669] [<c1050c42>] kthread+0x92/0xa0
[ 0.563669] [<c130ee1b>] ret_from_kernel_thread+0x1b/0x30
[ 0.563669] [<c1050bb0>] ? kthread_create_on_node+0xd0/0xd0
[ 0.563669] Code: 00 b8 a0 53 41 c1 e8 80 ff f4 ff e8 1b b0 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.563669] EIP: [<c110a6e0>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.563669] CR2: 0000000000000000
[ 0.580028] ---[ end trace d9920da2f1432e39 ]---
[ 0.583684] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6c80 with usage -1

dmesg-yocto-snb-4:20131009083037:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.565218] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.574878] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.575734] IP: [<c110a6e0>] __fput+0x50/0x380
[ 0.576267] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.576964] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.577471] Modules linked in:
[ 0.577547] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.577547] Workqueue: events delayed_fput
[ 0.577547] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.577547] EIP: 0060:[<c110a6e0>] EFLAGS: 00010212 CPU: 0
[ 0.577547] EIP is at __fput+0x50/0x380
[ 0.577547] EAX: 00000000 EBX: cd0e3200 ECX: 00000000 EDX: 0000001d
[ 0.577547] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.577547] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.577547] CR0: 8005003b CR2: 00000000 CR3: 0d10a000 CR4: 000006b0
[ 0.577547] Stack:
[ 0.577547] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.577547] 00000000 c0124540 ce867ea4 c110aa39 c1495640 ce867efc c10492f9 00000000
[ 0.577547] 00000002 00000000 c10492c1 00000000 00000000 00000000 0019f047 c0083400
[ 0.577547] Call Trace:
[ 0.577547] [<c110aa39>] delayed_fput+0x29/0x30
[ 0.577547] [<c10492f9>] process_one_work+0x2f9/0x650
[ 0.577547] [<c10492c1>] ? process_one_work+0x2c1/0x650
[ 0.577547] [<c104ac2f>] worker_thread+0x28f/0x610
[ 0.577547] [<c104a9a0>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.577547] [<c1050c42>] kthread+0x92/0xa0
[ 0.577547] [<c130ee1b>] ret_from_kernel_thread+0x1b/0x30
[ 0.577547] [<c1050bb0>] ? kthread_create_on_node+0xd0/0xd0
[ 0.577547] Code: 00 b8 a0 53 41 c1 e8 80 ff f4 ff e8 1b b0 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.577547] EIP: [<c110a6e0>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.577547] CR2: 0000000000000000
[ 0.595690] ---[ end trace c3edee3d6a10ee16 ]---
[ 0.600571] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6c80 with usage -1

dmesg-yocto-stoakley-6:20131009083037:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.805269] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.828029] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.829058] IP: [< (null)>] (null)
[ 0.829589] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.829639] Oops: 0010 [#1] DEBUG_PAGEALLOC
[ 0.829639] Modules linked in:
[ 0.829639] CPU: 0 PID: 46 Comm: mount Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.829639] task: cd7cbcd0 ti: cd10e000 task.ti: cd10e000
[ 0.829639] EIP: 0060:[<00000000>] EFLAGS: 00010246 CPU: 0
[ 0.829639] EIP is at 0x0
[ 0.829639] EAX: cd0e3500 EBX: cd0e3e00 ECX: 00000000 EDX: cd0e3500
[ 0.829639] ESI: cd7cbf68 EDI: cd7cbcd0 EBP: cd10ff44 ESP: cd10ff34
[ 0.829639] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.829639] CR0: 8005003b CR2: 00000000 CR3: 0d10a000 CR4: 000006b0
[ 0.829639] Stack:
[ 0.829639] c104d7d9 cd7cbf80 cd0daa00 cd7cbcd0 cd10ff8c c10311d2 00000000 00000000
[ 0.829639] cee9d000 00000035 00000001 cd10ff88 c11095c1 00000001 00000000 cd0daa50
[ 0.829639] cd7cbcd0 080d3208 cd10ff9c 0000ff00 cd0ee600 cd7cbcd0 cd10ffa4 c10327ca
[ 0.829639] Call Trace:
[ 0.829639] [<c104d7d9>] ? task_work_run+0x79/0xa0
[ 0.829639] [<c10311d2>] do_exit+0x2f2/0x960
[ 0.829639] [<c11095c1>] ? vfs_write+0x161/0x1a0
[ 0.829639] [<c10327ca>] do_group_exit+0x4a/0xa0
[ 0.829639] [<c1032838>] SyS_exit_group+0x18/0x20
[ 0.829639] [<c1307ad5>] syscall_call+0x7/0xb
[ 0.829639] Code: Bad EIP value.
[ 0.829639] EIP: [<00000000>] 0x0 SS:ESP 0068:cd10ff34
[ 0.829639] CR2: 0000000000000000
[ 0.847288] ---[ end trace 98305221751e108d ]---
[ 0.847937] Fixing recursive fault but reboot is needed!

dmesg-yocto-waimea-12:20131009162634:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.431392] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.438770] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.439521] IP: [<c110a6e0>] __fput+0x50/0x380
[ 0.439980] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.440584] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.440780] Modules linked in:
[ 0.440780] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.440780] Workqueue: events delayed_fput
[ 0.440780] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.440780] EIP: 0060:[<c110a6e0>] EFLAGS: 00010212 CPU: 0
[ 0.440780] EIP is at __fput+0x50/0x380
[ 0.440780] EAX: 00000000 EBX: cd0e3200 ECX: 00000000 EDX: 0000001d
[ 0.440780] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.440780] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.440780] CR0: 8005003b CR2: 00000000 CR3: 0d10b000 CR4: 000006b0
[ 0.440780] Stack:
[ 0.440780] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.440780] 00000000 c0124540 ce867ea4 c110aa39 c1495640 ce867efc c10492f9 00000000
[ 0.440780] 00000002 00000000 c10492c1 00000000 00000000 00000000 0019f047 c0083400
[ 0.440780] Call Trace:
[ 0.440780] [<c110aa39>] delayed_fput+0x29/0x30
[ 0.440780] [<c10492f9>] process_one_work+0x2f9/0x650
[ 0.440780] [<c10492c1>] ? process_one_work+0x2c1/0x650
[ 0.440780] [<c104ac2f>] worker_thread+0x28f/0x610
[ 0.440780] [<c104a9a0>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.440780] [<c1050c42>] kthread+0x92/0xa0
[ 0.440780] [<c130ee1b>] ret_from_kernel_thread+0x1b/0x30
[ 0.440780] [<c1050bb0>] ? kthread_create_on_node+0xd0/0xd0
[ 0.440780] Code: 00 b8 a0 53 41 c1 e8 80 ff f4 ff e8 1b b0 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.440780] EIP: [<c110a6e0>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.440780] CR2: 0000000000000000
[ 0.457515] ---[ end trace 0e5a4f7de707cf42 ]---
[ 0.460786] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6d00 with usage -1

dmesg-yocto-waimea-13:20131009162615:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.435422] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.442521] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.443270] IP: [<c110a6e0>] __fput+0x50/0x380
[ 0.443728] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.444339] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.444788] Modules linked in:
[ 0.445120] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.445669] Workqueue: events delayed_fput
[ 0.445669] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.445669] EIP: 0060:[<c110a6e0>] EFLAGS: 00010212 CPU: 0
[ 0.445669] EIP is at __fput+0x50/0x380
[ 0.445669] EAX: 00000000 EBX: cd0e3200 ECX: 00000000 EDX: 0000001d
[ 0.445669] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.445669] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.445669] CR0: 8005003b CR2: 00000000 CR3: 0d10d000 CR4: 000006b0
[ 0.445669] Stack:
[ 0.445669] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.445669] 00000000 c0124540 ce867ea4 c110aa39 c1495640 ce867efc c10492f9 00000000
[ 0.445669] 00000002 00000000 c10492c1 00000000 00000000 00000000 0019f047 c0083400
[ 0.445669] Call Trace:
[ 0.445669] [<c110aa39>] delayed_fput+0x29/0x30
[ 0.445669] [<c10492f9>] process_one_work+0x2f9/0x650
[ 0.445669] [<c10492c1>] ? process_one_work+0x2c1/0x650
[ 0.445669] [<c104ac2f>] worker_thread+0x28f/0x610
[ 0.445669] [<c104a9a0>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.445669] [<c1050c42>] kthread+0x92/0xa0
[ 0.445669] [<c130ee1b>] ret_from_kernel_thread+0x1b/0x30
[ 0.445669] [<c1050bb0>] ? kthread_create_on_node+0xd0/0xd0
[ 0.445669] Code: 00 b8 a0 53 41 c1 e8 80 ff f4 ff e8 1b b0 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.445669] EIP: [<c110a6e0>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.445669] CR2: 0000000000000000
[ 0.461494] ---[ end trace b2929bac14a5c78d ]---
[ 0.464652] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6d00 with usage -1

dmesg-yocto-waimea-3:20131009162715:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.443848] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.450955] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.451729] IP: [<c110a6e0>] __fput+0x50/0x380
[ 0.452205] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.452834] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.453299] Modules linked in:
[ 0.453299] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.453299] Workqueue: events delayed_fput
[ 0.453299] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.453299] EIP: 0060:[<c110a6e0>] EFLAGS: 00010212 CPU: 0
[ 0.453299] EIP is at __fput+0x50/0x380
[ 0.453299] EAX: 00000000 EBX: cd0e3200 ECX: 00000000 EDX: 0000001d
[ 0.453299] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.453299] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.453299] CR0: 8005003b CR2: 00000000 CR3: 0d10b000 CR4: 000006b0
[ 0.453299] Stack:
[ 0.453299] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.453299] 00000000 c0124540 ce867ea4 c110aa39 c1495640 ce867efc c10492f9 00000000
[ 0.453299] 00000002 00000000 c10492c1 00000000 00000000 00000000 0019f047 c0083400
[ 0.453299] Call Trace:
[ 0.453299] [<c110aa39>] delayed_fput+0x29/0x30
[ 0.453299] [<c10492f9>] process_one_work+0x2f9/0x650
[ 0.453299] [<c10492c1>] ? process_one_work+0x2c1/0x650
[ 0.453299] [<c104ac2f>] worker_thread+0x28f/0x610
[ 0.453299] [<c104a9a0>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.453299] [<c1050c42>] kthread+0x92/0xa0
[ 0.453299] [<c130ee1b>] ret_from_kernel_thread+0x1b/0x30
[ 0.453299] [<c1050bb0>] ? kthread_create_on_node+0xd0/0xd0
[ 0.453299] Code: 00 b8 a0 53 41 c1 e8 80 ff f4 ff e8 1b b0 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.453299] EIP: [<c110a6e0>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.453299] CR2: 0000000000000000
[ 0.470056] ---[ end trace c86545004fb7c1f8 ]---
[ 0.473292] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6d00 with usage -1

dmesg-yocto-waimea-5:20131009162638:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.444934] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.452534] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.453092] IP: [<c110a6e0>] __fput+0x50/0x380
[ 0.453092] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.453092] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.453092] Modules linked in:
[ 0.453092] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.453092] Workqueue: events delayed_fput
[ 0.453092] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.453092] EIP: 0060:[<c110a6e0>] EFLAGS: 00010212 CPU: 0
[ 0.453092] EIP is at __fput+0x50/0x380
[ 0.453092] EAX: 00000000 EBX: cd0e3200 ECX: 00000000 EDX: 0000001d
[ 0.453092] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.453092] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.453092] CR0: 8005003b CR2: 00000000 CR3: 0d10b000 CR4: 000006b0
[ 0.453092] Stack:
[ 0.453092] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.453092] 00000000 c0124540 ce867ea4 c110aa39 c1495640 ce867efc c10492f9 00000000
[ 0.453092] 00000002 00000000 c10492c1 00000000 00000000 00000000 0019f047 c0083400
[ 0.453092] Call Trace:
[ 0.453092] [<c110aa39>] delayed_fput+0x29/0x30
[ 0.453092] [<c10492f9>] process_one_work+0x2f9/0x650
[ 0.453092] [<c10492c1>] ? process_one_work+0x2c1/0x650
[ 0.453092] [<c104ac2f>] worker_thread+0x28f/0x610
[ 0.453092] [<c104a9a0>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.453092] [<c1050c42>] kthread+0x92/0xa0
[ 0.453092] [<c130ee1b>] ret_from_kernel_thread+0x1b/0x30
[ 0.453092] [<c1050bb0>] ? kthread_create_on_node+0xd0/0xd0
[ 0.453092] Code: 00 b8 a0 53 41 c1 e8 80 ff f4 ff e8 1b b0 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.453092] EIP: [<c110a6e0>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.453092] CR2: 0000000000000000
[ 0.471754] ---[ end trace a80cb7a793b7b7f8 ]---
[ 0.475157] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6d00 with usage -1

dmesg-yocto-xian-13:20131009083020:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.502865] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.511394] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.512125] IP: [<c110a6e0>] __fput+0x50/0x380
[ 0.512337] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.512337] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.512337] Modules linked in:
[ 0.512337] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.512337] Workqueue: events delayed_fput
[ 0.512337] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.512337] EIP: 0060:[<c110a6e0>] EFLAGS: 00010212 CPU: 0
[ 0.512337] EIP is at __fput+0x50/0x380
[ 0.512337] EAX: 00000000 EBX: cd0e3200 ECX: 00000000 EDX: 0000001d
[ 0.512337] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.512337] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.512337] CR0: 8005003b CR2: 00000000 CR3: 0d10a000 CR4: 000006b0
[ 0.512337] Stack:
[ 0.512337] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.512337] 00000000 c0124540 ce867ea4 c110aa39 c1495640 ce867efc c10492f9 00000000
[ 0.512337] 00000002 00000000 c10492c1 00000000 00000000 00000000 0019f047 c0083400
[ 0.512337] Call Trace:
[ 0.512337] [<c110aa39>] delayed_fput+0x29/0x30
[ 0.512337] [<c10492f9>] process_one_work+0x2f9/0x650
[ 0.512337] [<c10492c1>] ? process_one_work+0x2c1/0x650
[ 0.512337] [<c104ac2f>] worker_thread+0x28f/0x610
[ 0.512337] [<c104a9a0>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.512337] [<c1050c42>] kthread+0x92/0xa0
[ 0.512337] [<c130ee1b>] ret_from_kernel_thread+0x1b/0x30
[ 0.512337] [<c1050bb0>] ? kthread_create_on_node+0xd0/0xd0
[ 0.512337] Code: 00 b8 a0 53 41 c1 e8 80 ff f4 ff e8 1b b0 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.512337] EIP: [<c110a6e0>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.512337] CR2: 0000000000000000
[ 0.529142] ---[ end trace 5a6c6b560abd06ef ]---
[ 0.532351] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6c80 with usage -1

dmesg-yocto-xian-30:20131009082927:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.592775] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.601919] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.602633] IP: [<c110a6e0>] __fput+0x50/0x380
[ 0.603067] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.603573] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.603573] Modules linked in:
[ 0.603573] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.603573] Workqueue: events delayed_fput
[ 0.603573] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.603573] EIP: 0060:[<c110a6e0>] EFLAGS: 00010212 CPU: 0
[ 0.603573] EIP is at __fput+0x50/0x380
[ 0.603573] EAX: 00000000 EBX: cd0e3200 ECX: 00000000 EDX: 0000001d
[ 0.603573] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.603573] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.603573] CR0: 8005003b CR2: 00000000 CR3: 0d10a000 CR4: 000006b0
[ 0.603573] Stack:
[ 0.603573] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.603573] 00000000 c0124540 ce867ea4 c110aa39 c1495640 ce867efc c10492f9 00000000
[ 0.603573] 00000002 00000000 c10492c1 00000000 00000000 00000000 0019f047 c0083400
[ 0.603573] Call Trace:
[ 0.603573] [<c110aa39>] delayed_fput+0x29/0x30
[ 0.603573] [<c10492f9>] process_one_work+0x2f9/0x650
[ 0.603573] [<c10492c1>] ? process_one_work+0x2c1/0x650
[ 0.603573] [<c104ac2f>] worker_thread+0x28f/0x610
[ 0.603573] [<c104a9a0>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.603573] [<c1050c42>] kthread+0x92/0xa0
[ 0.603573] [<c130ee1b>] ret_from_kernel_thread+0x1b/0x30
[ 0.603573] [<c1050bb0>] ? kthread_create_on_node+0xd0/0xd0
[ 0.603573] Code: 00 b8 a0 53 41 c1 e8 80 ff f4 ff e8 1b b0 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.603573] EIP: [<c110a6e0>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.603573] CR2: 0000000000000000
[ 0.619888] ---[ end trace 89172d650daf067d ]---
[ 0.623592] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6c80 with usage -1

dmesg-yocto-xps-7:20131009162609:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.458692] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.466465] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.467123] IP: [<c110a6e0>] __fput+0x50/0x380
[ 0.467487] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.467998] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.468382] Modules linked in:
[ 0.468434] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.468434] Workqueue: events delayed_fput
[ 0.468434] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.468434] EIP: 0060:[<c110a6e0>] EFLAGS: 00010212 CPU: 0
[ 0.468434] EIP is at __fput+0x50/0x380
[ 0.468434] EAX: 00000000 EBX: cd0e3200 ECX: 00000000 EDX: 0000001d
[ 0.468434] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.468434] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.468434] CR0: 8005003b CR2: 00000000 CR3: 0d10a000 CR4: 000006b0
[ 0.468434] Stack:
[ 0.468434] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.468434] 00000000 c0124540 ce867ea4 c110aa39 c1495640 ce867efc c10492f9 00000000
[ 0.468434] 00000002 00000000 c10492c1 00000000 00000000 00000000 0019f047 c0083400
[ 0.468434] Call Trace:
[ 0.468434] [<c110aa39>] delayed_fput+0x29/0x30
[ 0.468434] [<c10492f9>] process_one_work+0x2f9/0x650
[ 0.468434] [<c10492c1>] ? process_one_work+0x2c1/0x650
[ 0.468434] [<c104ac2f>] worker_thread+0x28f/0x610
[ 0.468434] [<c104a9a0>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.468434] [<c1050c42>] kthread+0x92/0xa0
[ 0.468434] [<c130ee1b>] ret_from_kernel_thread+0x1b/0x30
[ 0.468434] [<c1050bb0>] ? kthread_create_on_node+0xd0/0xd0
[ 0.468434] Code: 00 b8 a0 53 41 c1 e8 80 ff f4 ff e8 1b b0 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.468434] EIP: [<c110a6e0>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.468434] CR2: 0000000000000000
[ 0.482193] ---[ end trace ec2a3ff42e5d2c28 ]---
[ 0.485114] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6d00 with usage -1

dmesg-yocto-xps-7:20131009162631:i386-randconfig-r8-1005:3.12.0-rc1-00050-g0c44c2d:1

[ 0.441321] debug: unmapping init [mem 0xc14df000-0xc1524fff]

mount: mounting proc on /proc failed: No such device
[ 0.449600] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 0.450229] IP: [<c110a6e0>] __fput+0x50/0x380
[ 0.450626] *pdpt = 0000000000000000 *pde = f000ff53f000ff53
[ 0.450913] Oops: 0000 [#1] DEBUG_PAGEALLOC
[ 0.450913] Modules linked in:
[ 0.450913] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 3.12.0-rc1-00050-g0c44c2d #1
[ 0.450913] Workqueue: events delayed_fput
[ 0.450913] task: c0035f90 ti: ce866000 task.ti: ce866000
[ 0.450913] EIP: 0060:[<c110a6e0>] EFLAGS: 00010212 CPU: 0
[ 0.450913] EIP is at __fput+0x50/0x380
[ 0.450913] EAX: 00000000 EBX: cd0e3f00 ECX: 00000000 EDX: 0000001d
[ 0.450913] ESI: 00000010 EDI: 00000000 EBP: ce867e98 ESP: ce867e70
[ 0.450913] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068
[ 0.450913] CR0: 8005003b CR2: 00000000 CR3: 0d10a000 CR4: 000006b0
[ 0.450913] Stack:
[ 0.450913] 00000246 00000000 00000002 00000000 00000000 00000000 00000000 00000000
[ 0.450913] 00000000 c0124540 ce867ea4 c110aa39 c1495640 ce867efc c10492f9 00000000
[ 0.450913] 00000002 00000000 c10492c1 00000000 00000000 00000000 0019f047 c0083400
[ 0.450913] Call Trace:
[ 0.450913] [<c110aa39>] delayed_fput+0x29/0x30
[ 0.450913] [<c10492f9>] process_one_work+0x2f9/0x650
[ 0.450913] [<c10492c1>] ? process_one_work+0x2c1/0x650
[ 0.450913] [<c104ac2f>] worker_thread+0x28f/0x610
[ 0.450913] [<c104a9a0>] ? cancel_delayed_work_sync+0x20/0x20
[ 0.450913] [<c1050c42>] kthread+0x92/0xa0
[ 0.450913] [<c130ee1b>] ret_from_kernel_thread+0x1b/0x30
[ 0.450913] [<c1050bb0>] ? kthread_create_on_node+0xd0/0xd0
[ 0.450913] Code: 00 b8 a0 53 41 c1 e8 80 ff f4 ff e8 1b b0 1f 00 8b 43 10 89 c1 89 45 e8 8b 53 40 89 d0 83 e0 02 83 f8 01 19 f6 83 e6 08 83 c6 08 <8b> 01 25 00 f0 ff ff 66 3d 00 40 0f 84 2f 02 00 00 81 e2 00 00
[ 0.450913] EIP: [<c110a6e0>] __fput+0x50/0x380 SS:ESP 0068:ce867e70
[ 0.450913] CR2: 0000000000000000
[ 0.465551] ---[ end trace 060e117f1134b075 ]---
[ 0.469319] Kernel panic - not syncing: CRED: put_cred_rcu() sees cd0c6b00 with usage -2

2013-10-09 01:33:54

by Linus Torvalds

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel NULL pointer dereference at (null)

On Tue, Oct 8, 2013 at 6:09 PM, Fengguang Wu <[email protected]> wrote:
> [ 27.189229] BUG: unable to handle kernel NULL pointer dereference at 00000108
> [ 27.190165] IP: [<c1109200>] rw_verify_area+0xa0/0x1b0

This looks like file->f_inode is NULL, and it's trying to access inode->i_flock.

There's a number of other ones too (that last delayed __fput one, for
example) that might be due to a NULL inode.

And a lot of thre rest are file-handling too, with the BUG_ON() in
__put_cred() when there's something wrong with file->f_cred.

.. but I have no clue how that could happen and why the asm goto
should matter for this.

Linus

2013-10-09 01:44:41

by Mike Galbraith

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

On Tue, 2013-10-08 at 21:05 +0200, Jakub Jelinek wrote:
> On Tue, Oct 08, 2013 at 08:51:54PM +0200, Oleg Nesterov wrote:
> > On 10/08, Linus Torvalds wrote:
> > >
> > > (not yet merged), see:
> > >
> > > http://git.kernel.org/cgit/linux/kernel/git/tip/tip.git/commit/?id=0c44c2d0f459cd7e275242b72f500137c4fa834d
> >
> > I do not really understand inline assembly constraints, but I'll ask
> > anyway.
> >
> > +#define __GEN_RMWcc(fullop, var, cc, ...) \
> > +do { \
> > + asm volatile goto (fullop "; j" cc " %l[cc_label]" \
> > + : : "m" (var), ## __VA_ARGS__ \
> > ^^^^^^^^^
> >
> > don't we need
> >
> > "+m" (var)
> >
> > here?
>
> You actually can't have output operands with asm goto, only inputs
> and clobbers. But the "memory" clobber should be enough here.
>
> If you suspect a compiler bug, can somebody please narrow it down to
> a single object file (if I've skimmed the patch right, it is just an
> optimization, where object files compiled without and with the patch
> should actually coexist fine in the same kernel), ideally to a single
> routine if possible and post a preprocessed source + gcc command line
> + version of gcc?

gcc version 4.6.2 (SUSE Linux) won't produce output, but where it dies
might point in the general direction of newer gcc troubles?

CC [M] net/sunrpc/xprtsock.o
net/sunrpc/xprtsock.c: In function ‘xs_setup_tcp’:
net/sunrpc/xprtsock.c:2844:1: internal compiler error: in move_insn, at haifa-sched.c:2353

-Mike

2013-10-09 08:05:14

by Fengguang Wu

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

Hi Oleg,

Thanks for looking into this. Attached is the task_work.s for you.

> Fengguang, I do not think this will help, but just in case. Could you
> show the result of
>
> $ kernel/task_work.s
>
> ?

Sorry I lost some emails and found it back in LKML. Opened up too many
mutt clients..

Thanks,
Fengguang


Attachments:
(No filename) (318.00 B)
task_work.s (8.52 kB)
Download all attachments

2013-10-09 12:19:17

by Fengguang Wu

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

> > Fengguang, I do not think this will help, but just in case. Could you
> > show the result of
> >
> > $ kernel/task_work.s

Update: I recompiled the kernel with gcc 4.4.7 and find it booting fine!

Attached is the new kernel/task_work.s.

Thanks,
Fengguang


Attachments:
(No filename) (269.00 B)
task_work.s (7.93 kB)
Download all attachments

2013-10-09 12:21:55

by Fengguang Wu

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

On Wed, Oct 09, 2013 at 08:19:11PM +0800, Fengguang Wu wrote:
> > > Fengguang, I do not think this will help, but just in case. Could you
> > > show the result of
> > >
> > > $ kernel/task_work.s
>
> Update: I recompiled the kernel with gcc 4.4.7 and find it booting fine!
>
> Attached is the new kernel/task_work.s.

Here is the diff:

gcc 4.6.3 vs 4.4.7
==================
--- task_work.s 2013-10-09 20:19:48.312272579 +0800
+++ /tmp/task_work.s 2013-10-09 20:18:14.000000000 +0800
@@ -1,136 +1,150 @@
.file "task_work.c"
-# GNU C (Debian 4.6.3-1) version 4.6.3 (x86_64-linux-gnu)
-# compiled by GNU C version 4.6.3, GMP version 5.0.4, MPFR version 3.1.0-p3, MPC version 0.9
-# warning: GMP header version 5.0.4 differs from library version 5.0.2.
-# warning: MPFR header version 3.1.0-p3 differs from library version 3.1.1-p2.
+# GNU C (Debian 4.4.7-4) version 4.4.7 (x86_64-linux-gnu)
+# compiled by GNU C version 4.4.7, GMP version 5.1.1, MPFR version 3.1.1-p2.
+# warning: GMP header version 5.1.1 differs from library version 5.0.2.
# GGC heuristics: --param ggc-min-expand=100 --param ggc-min-heapsize=131072
-# options passed: -nostdinc -I /c/wfg/tip/arch/x86/include
-# -I arch/x86/include/generated -I /c/wfg/tip/include -I include
-# -I /c/wfg/tip/arch/x86/include/uapi -I arch/x86/include/generated/uapi
-# -I /c/wfg/tip/include/uapi -I include/generated/uapi -I /c/wfg/tip/kernel
-# -I kernel -imultilib 32 -imultiarch i386-linux-gnu -D __KERNEL__
-# -D CONFIG_AS_CFI=1 -D CONFIG_AS_CFI_SIGNAL_FRAME=1
-# -D CONFIG_AS_CFI_SECTIONS=1 -D CONFIG_AS_AVX=1 -D CONFIG_AS_AVX2=1
-# -D CC_HAVE_ASM_GOTO -D KBUILD_STR(s)=#s
-# -D KBUILD_BASENAME=KBUILD_STR(task_work)
-# -D KBUILD_MODNAME=KBUILD_STR(task_work)
-# -isystem /usr/lib/gcc/x86_64-linux-gnu/4.6/include
-# -include /c/wfg/tip/include/linux/kconfig.h -MD kernel/.task_work.s.d
+# options passed: -nostdinc -I/c/wfg/tip/arch/x86/include
+# -Iarch/x86/include/generated -I/c/wfg/tip/include -Iinclude
+# -I/c/wfg/tip/arch/x86/include/uapi -Iarch/x86/include/generated/uapi
+# -I/c/wfg/tip/include/uapi -Iinclude/generated/uapi -I/c/wfg/tip/kernel
+# -Ikernel -imultilib 32 -imultiarch i386-linux-gnu -D__KERNEL__
+# -DCONFIG_AS_CFI=1 -DCONFIG_AS_CFI_SIGNAL_FRAME=1
+# -DCONFIG_AS_CFI_SECTIONS=1 -DCONFIG_AS_AVX=1 -DCONFIG_AS_AVX2=1
+# -DKBUILD_STR(s)=#s -DKBUILD_BASENAME=KBUILD_STR(task_work)
+# -DKBUILD_MODNAME=KBUILD_STR(task_work) -isystem
+# /usr/lib/gcc/x86_64-linux-gnu/4.4.7/include -include
+# /c/wfg/tip/include/linux/kconfig.h -MD kernel/.task_work.s.d
# /c/wfg/tip/kernel/task_work.c -m32 -msoft-float -mregparm=3
# -mpreferred-stack-boundary=2 -march=winchip2 -maccumulate-outgoing-args
-# -mno-sse -mno-mmx -mno-sse2 -mno-3dnow -mno-avx
-# -auxbase-strip kernel/task_work.s -O2 -Wall -Wundef -Wstrict-prototypes
-# -Wno-trigraphs -Werror=implicit-function-declaration -Wno-format-security
-# -Wno-sign-compare -Wframe-larger-than=1024 -Wno-unused-but-set-variable
-# -Wdeclaration-after-statement -Wno-pointer-sign -p -fno-strict-aliasing
-# -fno-common -fno-delete-null-pointer-checks -freg-struct-return -fno-pic
+# -mno-sse -mno-mmx -mno-sse2 -mno-3dnow -mno-avx -auxbase-strip
+# kernel/task_work.s -O2 -Wall -Wundef -Wstrict-prototypes -Wno-trigraphs
+# -Werror-implicit-function-declaration -Wno-format-security
+# -Wno-sign-compare -Wframe-larger-than=1024 -Wdeclaration-after-statement
+# -Wno-pointer-sign -p -fno-strict-aliasing -fno-common
+# -fno-delete-null-pointer-checks -freg-struct-return -fno-pic
# -ffreestanding -fno-asynchronous-unwind-tables -fno-stack-protector
# -fno-omit-frame-pointer -fno-optimize-sibling-calls -fno-strict-overflow
# -fconserve-stack -fverbose-asm
-# options enabled: -fauto-inc-dec -fbranch-count-reg -fcaller-saves
-# -fcombine-stack-adjustments -fcompare-elim -fcprop-registers
-# -fcrossjumping -fcse-follow-jumps -fdefer-pop -fdevirtualize
-# -fdwarf2-cfi-asm -fearly-inlining -feliminate-unused-debug-types
-# -fexpensive-optimizations -fforward-propagate -ffunction-cse -fgcse
-# -fgcse-lm -fguess-branch-probability -fident -fif-conversion
-# -fif-conversion2 -findirect-inlining -finline
-# -finline-functions-called-once -finline-small-functions -fipa-cp
-# -fipa-profile -fipa-pure-const -fipa-reference -fipa-sra
+# options enabled: -falign-loops -fargument-alias -fauto-inc-dec
+# -fbranch-count-reg -fcaller-saves -fcprop-registers -fcrossjumping
+# -fcse-follow-jumps -fdefer-pop -fdwarf2-cfi-asm -fearly-inlining
+# -feliminate-unused-debug-types -fexpensive-optimizations
+# -fforward-propagate -ffunction-cse -fgcse -fgcse-lm
+# -fguess-branch-probability -fident -fif-conversion -fif-conversion2
+# -findirect-inlining -finline -finline-functions-called-once
+# -finline-small-functions -fipa-cp -fipa-pure-const -fipa-reference
# -fira-share-save-slots -fira-share-spill-slots -fivopts
# -fkeep-static-consts -fleading-underscore -fmath-errno -fmerge-constants
# -fmerge-debug-strings -fmove-loop-invariants -foptimize-register-move
-# -fpartial-inlining -fpeephole -fpeephole2 -fprefetch-loop-arrays
-# -fprofile -freg-struct-return -fregmove -freorder-blocks
-# -freorder-functions -frerun-cse-after-loop
-# -fsched-critical-path-heuristic -fsched-dep-count-heuristic
-# -fsched-group-heuristic -fsched-interblock -fsched-last-insn-heuristic
-# -fsched-rank-heuristic -fsched-spec -fsched-spec-insn-heuristic
-# -fsched-stalled-insns-dep -fshow-column -fsigned-zeros
-# -fsplit-ivs-in-unroller -fsplit-wide-types -fstrict-volatile-bitfields
-# -fthread-jumps -ftoplevel-reorder -ftrapping-math -ftree-bit-ccp
-# -ftree-builtin-call-dce -ftree-ccp -ftree-ch -ftree-copy-prop
-# -ftree-copyrename -ftree-cselim -ftree-dce -ftree-dominator-opts
-# -ftree-dse -ftree-forwprop -ftree-fre -ftree-loop-if-convert
-# -ftree-loop-im -ftree-loop-ivcanon -ftree-loop-optimize
-# -ftree-parallelize-loops= -ftree-phiprop -ftree-pre -ftree-pta
-# -ftree-reassoc -ftree-scev-cprop -ftree-sink -ftree-slp-vectorize
-# -ftree-sra -ftree-switch-conversion -ftree-ter -ftree-vect-loop-version
-# -ftree-vrp -funit-at-a-time -fvect-cost-model -fverbose-asm
+# -fpeephole -fpeephole2 -fprofile -freg-struct-return -fregmove
+# -freorder-blocks -freorder-functions -frerun-cse-after-loop
+# -fsched-interblock -fsched-spec -fsched-stalled-insns-dep -fsigned-zeros
+# -fsplit-ivs-in-unroller -fsplit-wide-types -fthread-jumps
+# -ftoplevel-reorder -ftrapping-math -ftree-builtin-call-dce -ftree-ccp
+# -ftree-ch -ftree-copy-prop -ftree-copyrename -ftree-cselim -ftree-dce
+# -ftree-dominator-opts -ftree-dse -ftree-fre -ftree-loop-im
+# -ftree-loop-ivcanon -ftree-loop-optimize -ftree-parallelize-loops=
+# -ftree-pre -ftree-reassoc -ftree-scev-cprop -ftree-sink -ftree-sra
+# -ftree-switch-conversion -ftree-ter -ftree-vect-loop-version -ftree-vrp
+# -funit-at-a-time -fvect-cost-model -fverbose-asm
# -fzero-initialized-in-bss -m32 -m96bit-long-double
-# -maccumulate-outgoing-args -malign-stringops -mglibc -mieee-fp
-# -mno-fancy-math-387 -mno-red-zone -mno-sse4 -mpush-args -msahf
+# -maccumulate-outgoing-args -malign-stringops -mfused-madd -mglibc
+# -mieee-fp -mno-fancy-math-387 -mno-red-zone -mno-sse4 -mpush-args -msahf
# -mtls-direct-seg-refs

-# Compiler executable checksum: aa5cb4c8e9c62c6cc9349213df314c34
+# Compiler executable checksum: f7c11247ad5a53a602823d9bd673a474

+ .section .rodata.str1.1,"aMS",@progbits,1
+.LC0:
+ .string "/c/wfg/tip/kernel/task_work.c"
.text
.p2align 4,,15
- .globl task_work_add
- .type task_work_add, @function
-task_work_add:
+.globl task_work_run
+ .type task_work_run, @function
+task_work_run:
pushl %ebp #
movl %esp, %ebp #,
pushl %edi #
pushl %esi #
pushl %ebx #
- subl $12, %esp #,
call mcount
- movl %eax, %edi # task, task
- movl %edx, -16(%ebp) # work, %sfp
- movb %cl, -21(%ebp) # notify, %sfp
+#APP
+# 14 "/c/wfg/tip/arch/x86/include/asm/current.h" 1
+ movl current_task,%edi #, task
+# 0 "" 2
+#NO_APP
+ leal 904(%edi), %ebx #, D.18648
.p2align 4,,15
+.L15:
+ movl (%ebx), %edx #* D.18648, work
+ testl %edx, %edx # work
+ je .L17 #,
+.L2:
+ xorl %ecx, %ecx # head.458
.L3:
- movl 904(%edi), %esi # task_3(D)->task_works, head
- cmpl $work_exited, %esi #, head
- sete %bl #, D.14145
- andl $255, %ebx #, D.14145
- xorl %ecx, %ecx #
- movl %ebx, %edx # D.14145,
- movl $______f.14042, %eax #,
- call ftrace_likely_update #
- testl %ebx, %ebx # D.14145
- jne .L4 #,
- movl -16(%ebp), %edx # %sfp,
- movl %esi, (%edx) # head, work_13(D)->next
- movl %esi, %eax # head, __ret
+ movl %edx, %eax # work, __ret
#APP
-# 34 "/c/wfg/tip/kernel/task_work.c" 1
- cmpxchgl %edx,904(%edi) #, *__ptr_16
+# 99 "/c/wfg/tip/kernel/task_work.c" 1
+ cmpxchgl %ecx,(%ebx) # head.458,* D.18648
# 0 "" 2
#NO_APP
- cmpl %eax, %esi # __ret, head
- jne .L3 #,
- cmpb $0, -21(%ebp) #, %sfp
- je .L5 #,
- movl 4(%edi), %eax # task_3(D)->stack, task_3(D)->stack
+ cmpl %eax, %edx # __ret, work
+ jne .L15 #,
+ testl %edx, %edx # work
+ je .L10 #,
+ .p2align 4,,15
+.L12:
#APP
-# 208 "/c/wfg/tip/arch/x86/include/asm/bitops.h" 1
- bts $1, 8(%eax); jc .L2 #, MEM[(volatile long unsigned int *)D.14203_29],
+# 656 "/c/wfg/tip/arch/x86/include/asm/processor.h" 1
+ rep; nop
# 0 "" 2
#NO_APP
-.L5:
- movl $0, -20(%ebp) #, %sfp
-.L2:
- movl -20(%ebp), %eax # %sfp,
- addl $12, %esp #,
- popl %ebx #
- popl %esi #
- popl %edi #
- popl %ebp #
- ret
+ movl 960(%edi), %eax # <variable>.pi_lock.raw_lock.slock, D.18658
+ testl %eax, %eax # D.18658
+ je .L12 #,
+ xorl %esi, %esi # head
+ jmp .L8 #
.p2align 4,,15
-.L4:
- movl $-3, -20(%ebp) #, %sfp
- movl -20(%ebp), %eax # %sfp,
- addl $12, %esp #,
+.L18:
+ movl %edx, %esi # work, head
+ movl %eax, %edx # next, work
+.L8:
+ movl (%edx), %eax # <variable>.next, next
+ movl %esi, (%edx) # head, <variable>.next
+ testl %eax, %eax # next
+ jne .L18 #,
+ jmp .L9 #
+ .p2align 4,,15
+.L17:
+ testb $4, 12(%edi) #, <variable>.flags
+ je .L2 #,
+ movl $work_exited, %ecx #, head.458
+ jmp .L3 #
+ .p2align 4,,15
+.L19:
+ movl %esi, %edx # work.461, work
+ movl (%esi), %esi # <variable>.next, work.461
+.L9:
+ movl %edx, %eax # work,
+ call *4(%edx) # <variable>.func
+ xorl %ecx, %ecx #
+ movl $125, %edx #,
+ movl $.LC0, %eax #,
+ call __might_sleep #
+ call _cond_resched #
+ testl %esi, %esi # work.461
+ jne .L19 #,
+ jmp .L15 #
+ .p2align 4,,15
+.L10:
popl %ebx #
popl %esi #
popl %edi #
popl %ebp #
ret
- .size task_work_add, .-task_work_add
+ .size task_work_run, .-task_work_run
.p2align 4,,15
- .globl task_work_cancel
+.globl task_work_cancel
.type task_work_cancel, @function
task_work_cancel:
pushl %ebp #
@@ -138,36 +152,35 @@
pushl %edi #
pushl %esi #
pushl %ebx #
- pushl %ecx #
+ subl $4, %esp #,
call mcount
movl %edx, %edi # func, func
leal 904(%eax), %esi #, pprev
addl $960, %eax #,
movl %eax, -16(%ebp) #, %sfp
call _raw_spin_lock_irqsave #
- movl %eax, %ecx #, flags
- jmp .L14 #
+ movl %eax, %edx #, flags
+ jmp .L28 #
.p2align 4,,15
-.L15:
+.L29:
movl %ebx, %esi # work, pprev
-.L14:
- movl (%esi), %ebx # MEM[(struct callback_head * volatile *)pprev_1], work
+.L28:
+ movl (%esi), %ebx #* pprev, work
testl %ebx, %ebx # work
- je .L12 #,
- cmpl %edi, 4(%ebx) # func, work_7->func
- jne .L15 #,
- movl (%ebx), %edx # work_7->next, __new
+ je .L23 #,
+ cmpl %edi, 4(%ebx) # func, <variable>.func
+ jne .L29 #,
+ movl (%ebx), %ecx # <variable>.next, __new
movl %ebx, %eax # work, __ret
#APP
# 69 "/c/wfg/tip/kernel/task_work.c" 1
- cmpxchgl %edx,(%esi) # __new, MEM[(volatile u32 *)pprev_1]
+ cmpxchgl %ecx,(%esi) # __new,* pprev
# 0 "" 2
#NO_APP
cmpl %eax, %ebx # __ret, work
- jne .L14 #,
+ jne .L28 #,
.p2align 4,,15
-.L12:
- movl %ecx, %edx # flags,
+.L23:
movl -16(%ebp), %eax # %sfp,
call _raw_spin_unlock_irqrestore #
movl %ebx, %eax # work,
@@ -178,113 +191,91 @@
popl %ebp #
ret
.size task_work_cancel, .-task_work_cancel
- .section .rodata.str1.1,"aMS",@progbits,1
-.LC0:
- .string "/c/wfg/tip/kernel/task_work.c"
- .text
.p2align 4,,15
- .globl task_work_run
- .type task_work_run, @function
-task_work_run:
+.globl task_work_add
+ .type task_work_add, @function
+task_work_add:
pushl %ebp #
movl %esp, %ebp #,
pushl %edi #
pushl %esi #
pushl %ebx #
+ subl $12, %esp #,
call mcount
-#APP
-# 14 "/c/wfg/tip/arch/x86/include/asm/current.h" 1
- movl current_task,%esi #, task
-# 0 "" 2
-#NO_APP
- leal 904(%esi), %edi #, __ptr
+ movl %eax, -20(%ebp) # task, %sfp
+ movl %edx, -16(%ebp) # work, %sfp
+ movb %cl, -21(%ebp) # notify, %sfp
+ movl %eax, %edi # task, D.18562
+ addl $904, %edi #, D.18562
.p2align 4,,15
-.L31:
- movl 904(%esi), %edx # task_39->task_works, work
- testl %edx, %edx # work
- je .L32 #,
-.L24:
- xorl %ecx, %ecx # head
-.L17:
- movl %edx, %eax # work, __ret
+.L33:
+ movl (%edi), %esi #* D.18562, head
+ cmpl $work_exited, %esi #, head
+ sete %al #, tmp72
+ xorl %ebx, %ebx # D.18565
+ movb %al, %bl # tmp72, D.18565
+ xorl %ecx, %ecx #
+ movl %ebx, %edx # D.18565,
+ movl $______f.18543, %eax #,
+ call ftrace_likely_update #
+ testl %ebx, %ebx # D.18565
+ jne .L38 #,
+ movl -16(%ebp), %eax # %sfp,
+ movl %esi, (%eax) # head, <variable>.next
+ movl %esi, %eax # head, __ret
+ movl -16(%ebp), %edx # %sfp,
#APP
-# 99 "/c/wfg/tip/kernel/task_work.c" 1
- cmpxchgl %ecx,(%edi) # head, *__ptr_14
+# 34 "/c/wfg/tip/kernel/task_work.c" 1
+ cmpxchgl %edx,(%edi) #,* D.18562
# 0 "" 2
#NO_APP
- cmpl %eax, %edx # __ret, work
- jne .L31 #,
- testl %edx, %edx # work
- je .L16 #,
- .p2align 4,,15
-.L28:
+ cmpl %eax, %esi # __ret, head
+ jne .L33 #,
+ cmpb $0, -21(%ebp) # %sfp
+ je .L37 #,
+ movl -20(%ebp), %edx # %sfp,
+ movl 4(%edx), %eax # <variable>.stack, <variable>.stack
#APP
-# 656 "/c/wfg/tip/arch/x86/include/asm/processor.h" 1
- rep; nop
+# 208 "/c/wfg/tip/arch/x86/include/asm/bitops.h" 1
+ bts $1, 8(%eax); setc %dl #,, c
# 0 "" 2
#NO_APP
- movl 960(%esi), %eax # task_39->pi_lock.raw_lock.slock, D.14132
- testl %eax, %eax # D.14132
- je .L28 #,
- xorl %ebx, %ebx # head
- jmp .L21 #
- .p2align 4,,15
-.L26:
- movl %edx, %ebx # work, head
- movl %eax, %edx # next, work
-.L21:
- movl (%edx), %eax # work_1->next, next
- movl %ebx, (%edx) # head, work_1->next
- testl %eax, %eax # next
- jne .L26 #,
- jmp .L23 #
- .p2align 4,,15
-.L32:
- testb $4, 12(%esi) #, task_39->flags
- je .L24 #,
- movl $work_exited, %ecx #, head
- jmp .L17 #
- .p2align 4,,15
-.L33:
- movl %ebx, %edx # work, work
- movl (%ebx), %ebx # work_5->next, work
-.L23:
- movl %edx, %eax # work,
- call *4(%edx) # work_2->func
- xorl %ecx, %ecx #
- movl $125, %edx #,
- movl $.LC0, %eax #,
- call __might_sleep #
- call _cond_resched #
- testl %ebx, %ebx # work
- jne .L33 #,
- jmp .L31 #
+.L37:
+ xorl %eax, %eax # D.18573
+ addl $12, %esp #,
+ popl %ebx #
+ popl %esi #
+ popl %edi #
+ popl %ebp #
+ ret
.p2align 4,,15
-.L16:
+.L38:
+ movl $-3, %eax #, D.18573
+ addl $12, %esp #,
popl %ebx #
popl %esi #
popl %edi #
popl %ebp #
ret
- .size task_work_run, .-task_work_run
- .local work_exited
- .comm work_exited,8,4
+ .size task_work_add, .-task_work_add
.section _ftrace_annotated_branch,"aw",@progbits
.align 4
- .type ______f.14042, @object
- .size ______f.14042, 20
-______f.14042:
+ .type ______f.18543, @object
+ .size ______f.18543, 20
+______f.18543:
# func:
- .long __func__.14043
+ .long __func__.18544
# file:
.long .LC0
# line:
.long 31
.zero 8
+ .local work_exited
+ .comm work_exited,8,4
.section .rodata
- .type __func__.14043, @object
- .size __func__.14043, 14
-__func__.14043:
+ .type __func__.18544, @object
+ .size __func__.18544, 14
+__func__.18544:
.string "task_work_add"
- .ident "GCC: (Debian 4.6.3-1) 4.6.3"
+ .ident "GCC: (Debian 4.4.7-4) 4.4.7"
.section .note.GNU-stack,"",@progbits
w

2013-10-09 12:27:19

by Peter Zijlstra

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

On Wed, Oct 09, 2013 at 08:19:11PM +0800, Fengguang Wu wrote:
> > > Fengguang, I do not think this will help, but just in case. Could you
> > > show the result of
> > >
> > > $ kernel/task_work.s
>
> Update: I recompiled the kernel with gcc 4.4.7 and find it booting fine!

> # 208 "/c/wfg/tip/arch/x86/include/asm/bitops.h" 1
> bts $1, 8(%eax); setc %dl #,, c

That compiler doesn't appear to have asm goto support, so we fall back
to the code we already knew worked :-)

2013-10-09 12:50:17

by Oleg Nesterov

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

Hi Fengguang,

On 10/09, Fengguang Wu wrote:
>
> Thanks for looking into this. Attached is the task_work.s for you.

Thanks a lot!

I'm afraid I am wrong, my asm skills are close to zero... but this
code looks wrong to me, and this can explain the oopses.

> task_work_add:
> pushl %ebp #
> movl %esp, %ebp #,
> pushl %edi #
> pushl %esi #
> pushl %ebx #
> subl $12, %esp #,
> call mcount
> movl %eax, %edi # task, task
> movl %edx, -16(%ebp) # work, %sfp
> movb %cl, -21(%ebp) # notify, %sfp
> .p2align 4,,15
> .L3:
> movl 904(%edi), %esi # task_3(D)->task_works, head
> cmpl $work_exited, %esi #, head
> sete %bl #, D.14145
> andl $255, %ebx #, D.14145
> xorl %ecx, %ecx #
> movl %ebx, %edx # D.14145,
> movl $______f.14042, %eax #,
> call ftrace_likely_update #
> testl %ebx, %ebx # D.14145
> jne .L4 #,
> movl -16(%ebp), %edx # %sfp,
> movl %esi, (%edx) # head, work_13(D)->next
> movl %esi, %eax # head, __ret
> #APP
> # 34 "/c/wfg/tip/kernel/task_work.c" 1
> cmpxchgl %edx,904(%edi) #, *__ptr_16
> # 0 "" 2
> #NO_APP
> cmpl %eax, %esi # __ret, head
> jne .L3 #,

OK, we added the new work successfully, we should return 0. If we return
non-zero, fput() (the likely caller) assumes that it should use the workqueues
to close/free this file. Then later task_work_run() will do __fput() again.

> cmpb $0, -21(%ebp) #, %sfp
> je .L5 #,
> movl 4(%edi), %eax # task_3(D)->stack, task_3(D)->stack
> #APP
> # 208 "/c/wfg/tip/arch/x86/include/asm/bitops.h" 1
> bts $1, 8(%eax); jc .L2 #, MEM[(volatile long unsigned int *)D.14203_29],

This is set_notify_resume(). Probably !CONFIG_SMP (I do not see kick_process).

> # 0 "" 2
> #NO_APP
> .L5:
> movl $0, -20(%ebp) #, %sfp
> .L2:
> movl -20(%ebp), %eax # %sfp,

This is what we are going to return. But note that -20(%ebp) was not
initialized if TIF_NOTIFY_RESUME was already set, "jc .L2" skips .L5
above. IOW, in this case we seem to return a random value from stack.

Oleg.

2013-10-09 12:52:32

by Ingo Molnar

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060


* Peter Zijlstra <[email protected]> wrote:

> On Wed, Oct 09, 2013 at 08:19:11PM +0800, Fengguang Wu wrote:
> > > > Fengguang, I do not think this will help, but just in case. Could you
> > > > show the result of
> > > >
> > > > $ kernel/task_work.s
> >
> > Update: I recompiled the kernel with gcc 4.4.7 and find it booting fine!
>
> > # 208 "/c/wfg/tip/arch/x86/include/asm/bitops.h" 1
> > bts $1, 8(%eax); setc %dl #,, c
>
> That compiler doesn't appear to have asm goto support, so we fall back
> to the code we already knew worked :-)

I'm using 4.7.2 with randconfig testing, which has asm goto support, and I
haven't seen this crash yet.

Unless my testing is off it might be a bug in GCC 4.8, or a pre-existing
bug gets exposed by GCC 4.8.

Thanks,

Ingo

2013-10-09 12:56:20

by Fengguang Wu

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

On Wed, Oct 09, 2013 at 02:27:05PM +0200, Peter Zijlstra wrote:
> On Wed, Oct 09, 2013 at 08:19:11PM +0800, Fengguang Wu wrote:
> > > > Fengguang, I do not think this will help, but just in case. Could you
> > > > show the result of
> > > >
> > > > $ kernel/task_work.s
> >
> > Update: I recompiled the kernel with gcc 4.4.7 and find it booting fine!
>
> > # 208 "/c/wfg/tip/arch/x86/include/asm/bitops.h" 1
> > bts $1, 8(%eax); setc %dl #,, c
>
> That compiler doesn't appear to have asm goto support, so we fall back
> to the code we already knew worked :-)

Ah OK..

btw, here is a simple script I used to reproduce the problem. I'll
attach the 3MB yocto initrd in another email. However I suspect
whatever initrd would be OK.

Thanks,
Fengguang


Attachments:
(No filename) (762.00 B)
kvm-0day.sh (722.00 B)
Download all attachments

2013-10-09 14:07:54

by Peter Zijlstra

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

On Wed, Oct 09, 2013 at 02:43:10PM +0200, Oleg Nesterov wrote:
> I'm afraid I am wrong, my asm skills are close to zero... but this
> code looks wrong to me, and this can explain the oopses.
>
> > task_work_add:
> > pushl %ebp #
> > movl %esp, %ebp #,
> > pushl %edi #
> > pushl %esi #
> > pushl %ebx #
> > subl $12, %esp #,
> > call mcount
> > movl %eax, %edi # task, task
> > movl %edx, -16(%ebp) # work, %sfp
> > movb %cl, -21(%ebp) # notify, %sfp
> > .p2align 4,,15
> > .L3:
> > movl 904(%edi), %esi # task_3(D)->task_works, head
> > cmpl $work_exited, %esi #, head
> > sete %bl #, D.14145
> > andl $255, %ebx #, D.14145
> > xorl %ecx, %ecx #
> > movl %ebx, %edx # D.14145,
> > movl $______f.14042, %eax #,
> > call ftrace_likely_update #
> > testl %ebx, %ebx # D.14145
> > jne .L4 #,
> > movl -16(%ebp), %edx # %sfp,
> > movl %esi, (%edx) # head, work_13(D)->next
> > movl %esi, %eax # head, __ret
> > #APP
> > # 34 "/c/wfg/tip/kernel/task_work.c" 1
> > cmpxchgl %edx,904(%edi) #, *__ptr_16
> > # 0 "" 2
> > #NO_APP
> > cmpl %eax, %esi # __ret, head
> > jne .L3 #,
>
> OK, we added the new work successfully, we should return 0. If we return
> non-zero, fput() (the likely caller) assumes that it should use the workqueues
> to close/free this file. Then later task_work_run() will do __fput() again.
>
> > cmpb $0, -21(%ebp) #, %sfp
> > je .L5 #,
> > movl 4(%edi), %eax # task_3(D)->stack, task_3(D)->stack
> > #APP
> > # 208 "/c/wfg/tip/arch/x86/include/asm/bitops.h" 1
> > bts $1, 8(%eax); jc .L2 #, MEM[(volatile long unsigned int *)D.14203_29],
>
> This is set_notify_resume(). Probably !CONFIG_SMP (I do not see kick_process).
>
> > # 0 "" 2
> > #NO_APP
> > .L5:
> > movl $0, -20(%ebp) #, %sfp
> > .L2:
> > movl -20(%ebp), %eax # %sfp,
>
> This is what we are going to return. But note that -20(%ebp) was not
> initialized if TIF_NOTIFY_RESUME was already set, "jc .L2" skips .L5
> above. IOW, in this case we seem to return a random value from stack.

I think you're quite right, and I can confirm I can reproduce this with
gcc-4.8.1 and Wu's .config:

.p2align 4,,15
.globl task_work_add
.type task_work_add, @function
task_work_add:
pushl %ebp #
movl %esp, %ebp #,
pushl %edi #
pushl %esi #
pushl %ebx #
subl $12, %esp #,
call mcount
movl %eax, %esi # task, task
movl %edx, %edi # work, work
movl %ecx, -24(%ebp) # notify, %sfp
jmp .L4 #
.p2align 4,,15
.L9:
movl %ebx, (%edi) # __old, work_15(D)->next
movl %ebx, %eax # __old, __ret
#APP
# 34 "/usr/src/linux-2.6/kernel/task_work.c" 1
cmpxchgl %edi,904(%esi) # work, *__ptr_17
# 0 "" 2
#NO_APP
cmpl %eax, %ebx # __ret, __old
je .L8 #,
.L4:
movl 904(%esi), %ebx # task_7(D)->task_works, __old
cmpl $work_exited, %ebx #, __old
sete -13(%ebp) #, %sfp
xorl %edx, %edx # ______r
movb -13(%ebp), %dl # %sfp, ______r
xorl %ecx, %ecx #
movl $______f.14204, %eax #,
call ftrace_likely_update #
cmpb $0, -13(%ebp) #, %sfp
je .L9 #,
movl $-3, -20(%ebp) #, %sfp
.L2:
movl -20(%ebp), %eax # %sfp,
addl $12, %esp #,
popl %ebx #
popl %esi #
popl %edi #
popl %ebp #
ret
.p2align 4,,15
.L8:
cmpb $0, -24(%ebp) #, %sfp
je .L6 #,
movl 4(%esi), %eax # task_7(D)->stack, task_7(D)->stack
#APP
# 208 "/usr/src/linux-2.6/arch/x86/include/asm/bitops.h" 1
bts $1, 8(%eax); jc .L2 #, MEM[(volatile long unsigned int *)_23],
# 0 "" 2
#NO_APP
.L6:
movl $0, -20(%ebp) #, %sfp
movl -20(%ebp), %eax # %sfp,
addl $12, %esp #,
popl %ebx #
popl %esi #
popl %edi #
popl %ebp #
ret
.size task_work_add, .-task_work_add

Once I force a x86_64 build using the 'same' config it goes away and
generates 'sensible' code again (although I don't see why L9 isn't
merged with L2):

.p2align 4,,15
.globl task_work_add
.type task_work_add, @function
task_work_add:
call __fentry__
pushq %rbp #
movq %rsp, %rbp #,
pushq %r15 #
pushq %r14 #
movl %edx, %r14d # notify, notify
pushq %r13 #
movq %rsi, %r13 # work, work
pushq %r12 #
movq %rdi, %r12 # task, task
pushq %rbx #
jmp .L4 #
.p2align 4,,10
.p2align 3
.L11:
movq %rbx, 0(%r13) # __old, work_17(D)->next
movq %rbx, %rax # __old, __ret
#APP
# 34 "/usr/src/linux-2.6/kernel/task_work.c" 1
cmpxchgq %r13,1312(%r12) # work, *__ptr_19
# 0 "" 2
#NO_APP
cmpq %rax, %rbx # __ret, __old
je .L10 #,
.L4:
movq 1312(%r12), %rbx # task_7(D)->task_works, __old
movq $______f.14855, %rdi #,
cmpq $work_exited, %rbx #, __old
sete %r15b #, tmp72
xorl %edx, %edx #
movzbl %r15b, %esi # tmp72, ______r
call ftrace_likely_update #
testb %r15b, %r15b # tmp72
je .L11 #,
movl $-3, %eax #, D.15034
.L2:
popq %rbx #
popq %r12 #
popq %r13 #
popq %r14 #
popq %r15 #
popq %rbp #
ret
.p2align 4,,10
.p2align 3
.L10:
xorl %eax, %eax # D.15034
testb %r14b, %r14b # notify
je .L2 #,
movq 8(%r12), %rdx # task_7(D)->stack, task_7(D)->stack
#APP
# 208 "/usr/src/linux-2.6/arch/x86/include/asm/bitops.h" 1
bts $1, 16(%rdx); jc .L9 #, MEM[(volatile long unsigned int *)_25],
# 0 "" 2
#NO_APP
.L9:
popq %rbx #
popq %r12 #
popq %r13 #
popq %r14 #
popq %r15 #
popq %rbp #
ret
.size task_work_add, .-task_work_add

2013-10-09 14:24:46

by Oleg Nesterov

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

OK, thanks...

I didn't notice Richard and Jakub were not cc'ed... Add them, perhaps
they can take a look.

On 10/09, Peter Zijlstra wrote:
>
> On Wed, Oct 09, 2013 at 02:43:10PM +0200, Oleg Nesterov wrote:
> > I'm afraid I am wrong, my asm skills are close to zero... but this
> > code looks wrong to me, and this can explain the oopses.
> >
> > > task_work_add:
> > > pushl %ebp #
> > > movl %esp, %ebp #,
> > > pushl %edi #
> > > pushl %esi #
> > > pushl %ebx #
> > > subl $12, %esp #,
> > > call mcount
> > > movl %eax, %edi # task, task
> > > movl %edx, -16(%ebp) # work, %sfp
> > > movb %cl, -21(%ebp) # notify, %sfp
> > > .p2align 4,,15
> > > .L3:
> > > movl 904(%edi), %esi # task_3(D)->task_works, head
> > > cmpl $work_exited, %esi #, head
> > > sete %bl #, D.14145
> > > andl $255, %ebx #, D.14145
> > > xorl %ecx, %ecx #
> > > movl %ebx, %edx # D.14145,
> > > movl $______f.14042, %eax #,
> > > call ftrace_likely_update #
> > > testl %ebx, %ebx # D.14145
> > > jne .L4 #,
> > > movl -16(%ebp), %edx # %sfp,
> > > movl %esi, (%edx) # head, work_13(D)->next
> > > movl %esi, %eax # head, __ret
> > > #APP
> > > # 34 "/c/wfg/tip/kernel/task_work.c" 1
> > > cmpxchgl %edx,904(%edi) #, *__ptr_16
> > > # 0 "" 2
> > > #NO_APP
> > > cmpl %eax, %esi # __ret, head
> > > jne .L3 #,
> >
> > OK, we added the new work successfully, we should return 0. If we return
> > non-zero, fput() (the likely caller) assumes that it should use the workqueues
> > to close/free this file. Then later task_work_run() will do __fput() again.
> >
> > > cmpb $0, -21(%ebp) #, %sfp
> > > je .L5 #,
> > > movl 4(%edi), %eax # task_3(D)->stack, task_3(D)->stack
> > > #APP
> > > # 208 "/c/wfg/tip/arch/x86/include/asm/bitops.h" 1
> > > bts $1, 8(%eax); jc .L2 #, MEM[(volatile long unsigned int *)D.14203_29],
> >
> > This is set_notify_resume(). Probably !CONFIG_SMP (I do not see kick_process).
> >
> > > # 0 "" 2
> > > #NO_APP
> > > .L5:
> > > movl $0, -20(%ebp) #, %sfp
> > > .L2:
> > > movl -20(%ebp), %eax # %sfp,
> >
> > This is what we are going to return. But note that -20(%ebp) was not
> > initialized if TIF_NOTIFY_RESUME was already set, "jc .L2" skips .L5
> > above. IOW, in this case we seem to return a random value from stack.
>
> I think you're quite right, and I can confirm I can reproduce this with
> gcc-4.8.1 and Wu's .config:
>
> .p2align 4,,15
> .globl task_work_add
> .type task_work_add, @function
> task_work_add:
> pushl %ebp #
> movl %esp, %ebp #,
> pushl %edi #
> pushl %esi #
> pushl %ebx #
> subl $12, %esp #,
> call mcount
> movl %eax, %esi # task, task
> movl %edx, %edi # work, work
> movl %ecx, -24(%ebp) # notify, %sfp
> jmp .L4 #
> .p2align 4,,15
> .L9:
> movl %ebx, (%edi) # __old, work_15(D)->next
> movl %ebx, %eax # __old, __ret
> #APP
> # 34 "/usr/src/linux-2.6/kernel/task_work.c" 1
> cmpxchgl %edi,904(%esi) # work, *__ptr_17
> # 0 "" 2
> #NO_APP
> cmpl %eax, %ebx # __ret, __old
> je .L8 #,
> .L4:
> movl 904(%esi), %ebx # task_7(D)->task_works, __old
> cmpl $work_exited, %ebx #, __old
> sete -13(%ebp) #, %sfp
> xorl %edx, %edx # ______r
> movb -13(%ebp), %dl # %sfp, ______r
> xorl %ecx, %ecx #
> movl $______f.14204, %eax #,
> call ftrace_likely_update #
> cmpb $0, -13(%ebp) #, %sfp
> je .L9 #,
> movl $-3, -20(%ebp) #, %sfp
> .L2:
> movl -20(%ebp), %eax # %sfp,
> addl $12, %esp #,
> popl %ebx #
> popl %esi #
> popl %edi #
> popl %ebp #
> ret
> .p2align 4,,15
> .L8:
> cmpb $0, -24(%ebp) #, %sfp
> je .L6 #,
> movl 4(%esi), %eax # task_7(D)->stack, task_7(D)->stack
> #APP
> # 208 "/usr/src/linux-2.6/arch/x86/include/asm/bitops.h" 1
> bts $1, 8(%eax); jc .L2 #, MEM[(volatile long unsigned int *)_23],
> # 0 "" 2
> #NO_APP
> .L6:
> movl $0, -20(%ebp) #, %sfp
> movl -20(%ebp), %eax # %sfp,
> addl $12, %esp #,
> popl %ebx #
> popl %esi #
> popl %edi #
> popl %ebp #
> ret
> .size task_work_add, .-task_work_add
>
> Once I force a x86_64 build using the 'same' config it goes away and
> generates 'sensible' code again (although I don't see why L9 isn't
> merged with L2):
>
> .p2align 4,,15
> .globl task_work_add
> .type task_work_add, @function
> task_work_add:
> call __fentry__
> pushq %rbp #
> movq %rsp, %rbp #,
> pushq %r15 #
> pushq %r14 #
> movl %edx, %r14d # notify, notify
> pushq %r13 #
> movq %rsi, %r13 # work, work
> pushq %r12 #
> movq %rdi, %r12 # task, task
> pushq %rbx #
> jmp .L4 #
> .p2align 4,,10
> .p2align 3
> .L11:
> movq %rbx, 0(%r13) # __old, work_17(D)->next
> movq %rbx, %rax # __old, __ret
> #APP
> # 34 "/usr/src/linux-2.6/kernel/task_work.c" 1
> cmpxchgq %r13,1312(%r12) # work, *__ptr_19
> # 0 "" 2
> #NO_APP
> cmpq %rax, %rbx # __ret, __old
> je .L10 #,
> .L4:
> movq 1312(%r12), %rbx # task_7(D)->task_works, __old
> movq $______f.14855, %rdi #,
> cmpq $work_exited, %rbx #, __old
> sete %r15b #, tmp72
> xorl %edx, %edx #
> movzbl %r15b, %esi # tmp72, ______r
> call ftrace_likely_update #
> testb %r15b, %r15b # tmp72
> je .L11 #,
> movl $-3, %eax #, D.15034
> .L2:
> popq %rbx #
> popq %r12 #
> popq %r13 #
> popq %r14 #
> popq %r15 #
> popq %rbp #
> ret
> .p2align 4,,10
> .p2align 3
> .L10:
> xorl %eax, %eax # D.15034
> testb %r14b, %r14b # notify
> je .L2 #,
> movq 8(%r12), %rdx # task_7(D)->stack, task_7(D)->stack
> #APP
> # 208 "/usr/src/linux-2.6/arch/x86/include/asm/bitops.h" 1
> bts $1, 16(%rdx); jc .L9 #, MEM[(volatile long unsigned int *)_25],
> # 0 "" 2
> #NO_APP
> .L9:
> popq %rbx #
> popq %r12 #
> popq %r13 #
> popq %r14 #
> popq %r15 #
> popq %rbp #
> ret
> .size task_work_add, .-task_work_add
>
>

2013-10-09 14:32:32

by Ingo Molnar

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060


* Peter Zijlstra <[email protected]> wrote:

> > This is what we are going to return. But note that -20(%ebp) was not
> > initialized if TIF_NOTIFY_RESUME was already set, "jc .L2" skips .L5
> > above. IOW, in this case we seem to return a random value from stack.
>
> I think you're quite right, and I can confirm I can reproduce this with
> gcc-4.8.1 and Wu's .config:
>
> [...]
>
> Once I force a x86_64 build using the 'same' config it goes away and
> generates 'sensible' code again [...]

So this at least opens up the possibility that we can create a not too
painful quirk and only use the 'asm goto' optimization tricks on 64-bit
kernels?

Thanks,

Ingo

2013-10-09 14:34:14

by Peter Zijlstra

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

On Wed, Oct 09, 2013 at 04:07:34PM +0200, Peter Zijlstra wrote:
> Once I force a x86_64 build using the 'same' config it goes away and
> generates 'sensible' code again (although I don't see why L9 isn't
> merged with L2):

i386-SMP also generates correct code afaict; a tad stupid but not wrong.

If I remove ftrace from the .config its still broken..
If I also remove the likely/unlikely tracer its still broken and lots
smaller:

.p2align 4,,15
.globl task_work_add
.type task_work_add, @function
task_work_add:
pushl %ebp #
movl %esp, %ebp #,
pushl %edi #
pushl %esi #
pushl %ebx #
movl %eax, %esi # task, task
.p2align 4,,15
.L4:
movl 904(%esi), %ebx # task_5(D)->task_works, __old
cmpl $work_exited, %ebx #, __old
je .L5 #,
movl %ebx, (%edx) # __old, work_10(D)->next
movl %ebx, %eax # __old, __ret
#APP
# 34 "/usr/src/linux-2.6/kernel/task_work.c" 1
cmpxchgl %edx,904(%esi) # work, *__ptr_12
# 0 "" 2
#NO_APP
cmpl %eax, %ebx # __ret, __old
jne .L4 #,
testb %cl, %cl # notify
je .L6 #,
movl 4(%esi), %eax # task_5(D)->stack, task_5(D)->stack
#APP
# 208 "/usr/src/linux-2.6/arch/x86/include/asm/bitops.h" 1
bts $1, 8(%eax); jc .L2 #, MEM[(volatile long unsigned int *)_18],
# 0 "" 2
#NO_APP
.L6:
xorl %edi, %edi # D.14172
.L2:
movl %edi, %eax # D.14172,
popl %ebx #
popl %esi #
popl %edi #
popl %ebp #
ret
.L5:
movl $-3, %edi #, D.14172
jmp .L2 #
.size task_work_add, .-task_work_add

That "jc .L2" needs to be .L6 ! It looks like it fails to deal with the
empty branch.

Why this thing needs to use EDI is anybodies guess I suppose. Would've
made much more sense to have:

.L6:
xorl %eax, %eax
.L2:
popl %ebx
popl %esi
popl %ebp
ret
.L5:
movl, $-3, %eax
jmp .L2

At least its not duplicating the popl+ret bits 3 times anymore.

2013-10-09 14:47:26

by Peter Zijlstra

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

On Wed, Oct 09, 2013 at 04:33:59PM +0200, Peter Zijlstra wrote:
> On Wed, Oct 09, 2013 at 04:07:34PM +0200, Peter Zijlstra wrote:
> > Once I force a x86_64 build using the 'same' config it goes away and
> > generates 'sensible' code again (although I don't see why L9 isn't
> > merged with L2):
>
> i386-SMP also generates correct code afaict; a tad stupid but not wrong.
>
> If I remove ftrace from the .config its still broken..
> If I also remove the likely/unlikely tracer its still broken and lots
> smaller:

OK, its -march=winchip2 that's buggered.

Find attached task_work.i and try:

gcc -nostdinc -I /usr/src/linux-2.6/arch/x86/include -I arch/x86/include/generated -I /usr/src/linux-2.6/include -I include -I /usr/src/linux-2.6/arch/x86/include/uapi -I arch/x86/include/generated/uapi -I /usr/src/linux-2.6/include/uapi -I include/generated/uapi -I /usr/src/linux-2.6/kernel -I kernel -D __KERNEL__ -D CONFIG_AS_CFI=1 -D CONFIG_AS_CFI_SIGNAL_FRAME=1 -D CONFIG_AS_CFI_SECTIONS=1 -D CONFIG_AS_AVX=1 -D CONFIG_AS_AVX2=1 -D CC_HAVE_ASM_GOTO -D "KBUILD_STR(s)=#s" -D "KBUILD_BASENAME=KBUILD_STR(task_work)" -D KBUILD_MODNAME="KBUILD_STR(task_work)" -isystem /usr/lib/gcc/x86_64-linux-gnu/4.8/include -include /usr/src/linux-2.6/include/linux/kconfig.h -m32 -msoft-float -mregparm=3 -mpreferred-stack-boundary=2 -march=i686 -mtune=generic -mno-sse -mno-mmx -mno-sse2 -mno-3dnow -mno-avx -O2 -Wall -Wundef -Wstrict-prototypes -Wno-trigraphs -Werror=implicit-function-declaration -Wno-format-security -Wno-sign-compare -Wframe-larger-than=2048 -Wno-unused-but-set-variable -Wdeclaration-after-statement -Wno-pointer-sign -fno-strict-aliasing -fno-common -fno-delete-null-pointer-checks -freg-struct-return -fno-pic -ffreestanding -fno-asynchronous-unwind-tables -fno-stack-protector -fno-omit-frame-pointer -fno-optimize-sibling-calls -fno-strict-overflow -fconserve-stack -fverbose-asm -S -o - task_work.i

and

gcc -nostdinc -I /usr/src/linux-2.6/arch/x86/include -I arch/x86/include/generated -I /usr/src/linux-2.6/include -I include -I /usr/src/linux-2.6/arch/x86/include/uapi -I arch/x86/include/generated/uapi -I /usr/src/linux-2.6/include/uapi -I include/generated/uapi -I /usr/src/linux-2.6/kernel -I kernel -D __KERNEL__ -D CONFIG_AS_CFI=1 -D CONFIG_AS_CFI_SIGNAL_FRAME=1 -D CONFIG_AS_CFI_SECTIONS=1 -D CONFIG_AS_AVX=1 -D CONFIG_AS_AVX2=1 -D CC_HAVE_ASM_GOTO -D "KBUILD_STR(s)=#s" -D "KBUILD_BASENAME=KBUILD_STR(task_work)" -D KBUILD_MODNAME="KBUILD_STR(task_work)" -isystem /usr/lib/gcc/x86_64-linux-gnu/4.8/include -include /usr/src/linux-2.6/include/linux/kconfig.h -m32 -msoft-float -mregparm=3 -mpreferred-stack-boundary=2 -march=winchip2 -mno-sse -mno-mmx -mno-sse2 -mno-3dnow -mno-avx -O2 -Wall -Wundef -Wstrict-prototypes -Wno-trigraphs -Werror=implicit-function-declaration -Wno-format-security -Wno-sign-compare -Wframe-larger-than=2048 -Wno-unused-but-set-variable -Wdeclaration-after-statement -Wno-pointer-sign -fno-strict-aliasing -fno-common -fno-delete-null-pointer-checks -freg-struct-return -fno-pic -ffreestanding -fno-asynchronous-unwind-tables -fno-stack-protector -fno-omit-frame-pointer -fno-optimize-sibling-calls -fno-strict-overflow -fconserve-stack -fverbose-asm -S -o - task_work.i | less




Attachments:
(No filename) (3.16 kB)
task_work.i (501.96 kB)
Download all attachments

2013-10-09 17:18:18

by Ingo Molnar

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060


* Ingo Molnar <[email protected]> wrote:

>
> * Peter Zijlstra <[email protected]> wrote:
>
> > On Wed, Oct 09, 2013 at 08:19:11PM +0800, Fengguang Wu wrote:
> > > > > Fengguang, I do not think this will help, but just in case. Could you
> > > > > show the result of
> > > > >
> > > > > $ kernel/task_work.s
> > >
> > > Update: I recompiled the kernel with gcc 4.4.7 and find it booting fine!
> >
> > > # 208 "/c/wfg/tip/arch/x86/include/asm/bitops.h" 1
> > > bts $1, 8(%eax); setc %dl #,, c
> >
> > That compiler doesn't appear to have asm goto support, so we fall back
> > to the code we already knew worked :-)
>
> I'm using 4.7.2 with randconfig testing, which has asm goto support, and
> I haven't seen this crash yet.
>
> Unless my testing is off it might be a bug in GCC 4.8, or a pre-existing
> bug gets exposed by GCC 4.8.

And as it happens, just a few hours later I hit a very similar crash, this
time compiled with both 4.7.3 and 4.7.2! (config attached)

This has a weird-x86-arch tuning knob as well:

CONFIG_MGEODE_LX=y

So I think we might need to turn off asm goto for all things 32-bit x86.

Thanks,

Ingo


Attachments:
(No filename) (1.12 kB)
config (109.29 kB)
Download all attachments

2013-10-09 18:17:16

by Jakub Jelinek

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

On Wed, Oct 09, 2013 at 04:46:56PM +0200, Peter Zijlstra wrote:
> On Wed, Oct 09, 2013 at 04:33:59PM +0200, Peter Zijlstra wrote:
> > On Wed, Oct 09, 2013 at 04:07:34PM +0200, Peter Zijlstra wrote:
> > > Once I force a x86_64 build using the 'same' config it goes away and
> > > generates 'sensible' code again (although I don't see why L9 isn't
> > > merged with L2):
> >
> > i386-SMP also generates correct code afaict; a tad stupid but not wrong.
> >
> > If I remove ftrace from the .config its still broken..
> > If I also remove the likely/unlikely tracer its still broken and lots
> > smaller:
>
> OK, its -march=winchip2 that's buggered.

Confirmed as gcc bug, filed http://gcc.gnu.org/PR58670
Seems all of 4.[6-9] miscompile it. Will have a look tomorrow
unless somebody beats me to it. But historically, the case where
asm goto labels jump to fallthru basic block had numerous problems in the
past.

Jakub

2013-10-09 18:54:07

by Linus Torvalds

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

On Wed, Oct 9, 2013 at 11:16 AM, Jakub Jelinek <[email protected]> wrote:
>
> Confirmed as gcc bug, filed http://gcc.gnu.org/PR58670
> Seems all of 4.[6-9] miscompile it. Will have a look tomorrow
> unless somebody beats me to it. But historically, the case where
> asm goto labels jump to fallthru basic block had numerous problems in the
> past.

Ok, so it isn't even specific for x86-32, because your test-case shows
the bug for me on 64-bit too. Apparently we just have a harder time
hitting it in practice in the kernel on x86-64./

Too bad. It makes me nervous about all our _traditional_ uses of asm
goto too, never mind the new ones..

Linus

2013-10-09 19:02:44

by Peter Zijlstra

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

On Wed, Oct 09, 2013 at 08:16:13PM +0200, Jakub Jelinek wrote:
> Confirmed as gcc bug, filed http://gcc.gnu.org/PR58670
> Seems all of 4.[6-9] miscompile it. Will have a look tomorrow
> unless somebody beats me to it. But historically, the case where
> asm goto labels jump to fallthru basic block had numerous problems in the
> past.

That bug lists the component as middle end; this suggests x86_64 would
be vulnerable too, can you confirm? So far we've only observed the wrong
code on i386 targets, x86_64 targets appeared correct.

2013-10-09 19:09:35

by Jakub Jelinek

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

On Wed, Oct 09, 2013 at 09:02:31PM +0200, Peter Zijlstra wrote:
> On Wed, Oct 09, 2013 at 08:16:13PM +0200, Jakub Jelinek wrote:
> > Confirmed as gcc bug, filed http://gcc.gnu.org/PR58670
> > Seems all of 4.[6-9] miscompile it. Will have a look tomorrow
> > unless somebody beats me to it. But historically, the case where
> > asm goto labels jump to fallthru basic block had numerous problems in the
> > past.
>
> That bug lists the component as middle end; this suggests x86_64 would
> be vulnerable too, can you confirm? So far we've only observed the wrong
> code on i386 targets, x86_64 targets appeared correct.

Any target, the testcase in the bugzilla aborts on x86_64 with -O2, and
even say on ppc64 (sure, one would have to rewrite the asm to have it fail
at runtime).

Jakub

2013-10-10 02:16:47

by Mike Galbraith

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

On Wed, 2013-10-09 at 19:18 +0200, Ingo Molnar wrote:
> * Ingo Molnar <[email protected]> wrote:
>
> >
> > * Peter Zijlstra <[email protected]> wrote:
> >
> > > On Wed, Oct 09, 2013 at 08:19:11PM +0800, Fengguang Wu wrote:
> > > > > > Fengguang, I do not think this will help, but just in case. Could you
> > > > > > show the result of
> > > > > >
> > > > > > $ kernel/task_work.s
> > > >
> > > > Update: I recompiled the kernel with gcc 4.4.7 and find it booting fine!
> > >
> > > > # 208 "/c/wfg/tip/arch/x86/include/asm/bitops.h" 1
> > > > bts $1, 8(%eax); setc %dl #,, c
> > >
> > > That compiler doesn't appear to have asm goto support, so we fall back
> > > to the code we already knew worked :-)
> >
> > I'm using 4.7.2 with randconfig testing, which has asm goto support, and
> > I haven't seen this crash yet.
> >
> > Unless my testing is off it might be a bug in GCC 4.8, or a pre-existing
> > bug gets exposed by GCC 4.8.
>
> And as it happens, just a few hours later I hit a very similar crash, this
> time compiled with both 4.7.3 and 4.7.2! (config attached)
>
> This has a weird-x86-arch tuning knob as well:
>
> CONFIG_MGEODE_LX=y
>
> So I think we might need to turn off asm goto for all things 32-bit x86.

Hm, 32 bit x86...

I built 4.8.1 yesterday, so can now build x86_64 tip, but I suspect I'll
not be the only one with a compiler that goes belly up.

net/sunrpc/xprtsock.c: In function ‘xs_setup_tcp’:
net/sunrpc/xprtsock.c:2844:1: internal compiler error: in move_insn, at haifa-sched.c:2353

gcc-4.6.2 (opensuse 12.1) has happily chewed up humongous piles of
source, but finds this asm goto stuff to be toxic.

-Mike

2013-10-10 06:22:44

by Ingo Molnar

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060


* Jakub Jelinek <[email protected]> wrote:

> On Wed, Oct 09, 2013 at 09:02:31PM +0200, Peter Zijlstra wrote:
> > On Wed, Oct 09, 2013 at 08:16:13PM +0200, Jakub Jelinek wrote:
> >
> > > Confirmed as gcc bug, filed http://gcc.gnu.org/PR58670 Seems all of
> > > 4.[6-9] miscompile it. Will have a look tomorrow unless somebody
> > > beats me to it. But historically, the case where asm goto labels
> > > jump to fallthru basic block had numerous problems in the past.
> >
> > That bug lists the component as middle end; this suggests x86_64 would
> > be vulnerable too, can you confirm? So far we've only observed the
> > wrong code on i386 targets, x86_64 targets appeared correct.
>
> Any target, the testcase in the bugzilla aborts on x86_64 with -O2, and
> even say on ppc64 (sure, one would have to rewrite the asm to have it
> fail at runtime).

Please let us know once you know enough about the bug to suggest
workarounds. Because it's a nice optimization even extra instruction(s)
would be acceptable I suspect: we could perhaps put a NOP into a slowpath,
with an (unused) goto to it, or something like that?

Thanks,

Ingo

2013-10-10 06:51:40

by Jakub Jelinek

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

On Thu, Oct 10, 2013 at 08:22:38AM +0200, Ingo Molnar wrote:
> > On Wed, Oct 09, 2013 at 09:02:31PM +0200, Peter Zijlstra wrote:
> > > On Wed, Oct 09, 2013 at 08:16:13PM +0200, Jakub Jelinek wrote:
> > >
> > > > Confirmed as gcc bug, filed http://gcc.gnu.org/PR58670 Seems all of
> > > > 4.[6-9] miscompile it. Will have a look tomorrow unless somebody
> > > > beats me to it. But historically, the case where asm goto labels
> > > > jump to fallthru basic block had numerous problems in the past.
> > >
> > > That bug lists the component as middle end; this suggests x86_64 would
> > > be vulnerable too, can you confirm? So far we've only observed the
> > > wrong code on i386 targets, x86_64 targets appeared correct.
> >
> > Any target, the testcase in the bugzilla aborts on x86_64 with -O2, and
> > even say on ppc64 (sure, one would have to rewrite the asm to have it
> > fail at runtime).
>
> Please let us know once you know enough about the bug to suggest
> workarounds. Because it's a nice optimization even extra instruction(s)
> would be acceptable I suspect: we could perhaps put a NOP into a slowpath,
> with an (unused) goto to it, or something like that?

IMHO you don't need to put there a nop, I guess asm (""); would be enough,
that will still make sure the label is never in the fallthru basic block
and the whole class of issues with asm goto with labels in the fallthru
bb can't hit. The disadvantage is that it will generate worse code.

@@ -8,6 +8,7 @@ foo (int a, int b)
asm volatile goto ("bts $1, %0; jc %l[lab]" : : "m" (b) : "memory" : lab);
return 0;
lab:
+ asm ("");
return 0;
}

on the testcase from the PR results in something like:
#APP
# 8 "pr58670-1.c" 1
bts $1, -4(%rsp); jc .L3
# 0 "" 2
#NO_APP
.L5:
xorl %eax, %eax
ret
.p2align 4,,10
.p2align 3
.L3:
xorl %eax, %eax
ret
.p2align 4,,10
.p2align 3
.L4:
movl $-3, %eax
ret
while code without the extra asm (""); and with a fixed compiler:
#APP
# 6 "pr58670.c" 1
bts $1, -4(%rsp); jc .L3
# 0 "" 2
#NO_APP
.L3:
xorl %eax, %eax
ret
.p2align 4,,10
.p2align 3
.L4:
.L2:
movl $-3, %eax
ret

FYI, list of past compiler issues with asm goto include:
PR54127, PR46226, PR44071, PR52650, PR54455, PR51767.

I hope we get this fixed for 4.8.2, so you could then avoid
these hacks for GCC 4.8.2 and later.

Jakub

2013-10-10 08:05:46

by Jakub Jelinek

[permalink] [raw]
Subject: Re: [x86] BUG: unable to handle kernel paging request at 00740060

On Thu, Oct 10, 2013 at 08:51:04AM +0200, Jakub Jelinek wrote:
> @@ -8,6 +8,7 @@ foo (int a, int b)
> asm volatile goto ("bts $1, %0; jc %l[lab]" : : "m" (b) : "memory" : lab);
> return 0;
> lab:
> + asm ("");
> return 0;
> }

Or alternatively put the asm (""); right after asm goto,
asm volatile goto ("bts $1, %0; jc %l[lab]" : : "m" (b) : "memory" : lab);
asm ("");
return ...;
lab;
return ...;
What generates better code remains to be tested. In any case, please
conditionalize the hacks on non-fixed compilers once the fix is released.

Jakub

2013-10-10 08:24:43

by Ingo Molnar

[permalink] [raw]
Subject: [PATCH] gcc4: Add 'asm goto' miscompilation quirk


* Jakub Jelinek <[email protected]> wrote:

> On Thu, Oct 10, 2013 at 08:51:04AM +0200, Jakub Jelinek wrote:
> > @@ -8,6 +8,7 @@ foo (int a, int b)
> > asm volatile goto ("bts $1, %0; jc %l[lab]" : : "m" (b) : "memory" : lab);
> > return 0;
> > lab:
> > + asm ("");
> > return 0;
> > }
>
> Or alternatively put the asm (""); right after asm goto,
> asm volatile goto ("bts $1, %0; jc %l[lab]" : : "m" (b) : "memory" : lab);
> asm ("");
> return ...;
> lab;
> return ...;
> What generates better code remains to be tested. In any case, please
> conditionalize the hacks on non-fixed compilers once the fix is released.

Something like the patch below? (Totally untested and all that.)

Notes:

- If the bug is fixed in 4.8.3 then the version check can be sharpened
from 99999 to 40803.

- I'd really prefer this quirk versus having to add the extra barrier to
the label, as it makes the actual usage sites a lot less painful.

Thanks,

Ingo

=======================>
>From 76372b417b900f8c13f42af6dae67751add339dd Mon Sep 17 00:00:00 2001
From: Ingo Molnar <[email protected]>
Date: Thu, 10 Oct 2013 10:16:30 +0200
Subject: [PATCH] gcc4: Add 'asm goto' miscompilation quirk

Fengguang Wu, Oleg Nesterov and Peter Zijlstra tracked down
a kernel crash to a GCC bug: GCC miscompiles certain 'asm goto'
constructs, as outlined here:

http://gcc.gnu.org/bugzilla/show_bug.cgi?id=58670

Implement a workaround suggested by Jakub Jelinek.

Reported-by: Fengguang Wu <[email protected]>
Reported-by: Oleg Nesterov <[email protected]>
Reported-by: Peter Zijlstra <[email protected]>
Suggested-by: Jakub Jelinek <[email protected]>
Cc: Linus Torvalds <[email protected]>
Cc: Andrew Morton <[email protected]>
Cc: Thomas Gleixner <[email protected]>
Signed-off-by: Ingo Molnar <[email protected]>
---
arch/arm/include/asm/jump_label.h | 2 +-
arch/mips/include/asm/jump_label.h | 2 +-
arch/powerpc/include/asm/jump_label.h | 2 +-
arch/s390/include/asm/jump_label.h | 2 +-
arch/sparc/include/asm/jump_label.h | 2 +-
arch/x86/include/asm/cpufeature.h | 6 +++---
arch/x86/include/asm/jump_label.h | 2 +-
include/linux/compiler-gcc4.h | 13 +++++++++++++
8 files changed, 22 insertions(+), 9 deletions(-)

diff --git a/arch/arm/include/asm/jump_label.h b/arch/arm/include/asm/jump_label.h
index bfc198c..1ab0cf6 100644
--- a/arch/arm/include/asm/jump_label.h
+++ b/arch/arm/include/asm/jump_label.h
@@ -16,7 +16,7 @@

static __always_inline bool arch_static_branch(struct static_key *key)
{
- asm goto("1:\n\t"
+ asm_goto("1:\n\t"
JUMP_LABEL_NOP "\n\t"
".pushsection __jump_table, \"aw\"\n\t"
".word 1b, %l[l_yes], %c0\n\t"
diff --git a/arch/mips/include/asm/jump_label.h b/arch/mips/include/asm/jump_label.h
index 4d6d77e..c0f8f5d 100644
--- a/arch/mips/include/asm/jump_label.h
+++ b/arch/mips/include/asm/jump_label.h
@@ -22,7 +22,7 @@

static __always_inline bool arch_static_branch(struct static_key *key)
{
- asm goto("1:\tnop\n\t"
+ asm_goto("1:\tnop\n\t"
"nop\n\t"
".pushsection __jump_table, \"aw\"\n\t"
WORD_INSN " 1b, %l[l_yes], %0\n\t"
diff --git a/arch/powerpc/include/asm/jump_label.h b/arch/powerpc/include/asm/jump_label.h
index ae098c4..2b843a2 100644
--- a/arch/powerpc/include/asm/jump_label.h
+++ b/arch/powerpc/include/asm/jump_label.h
@@ -19,7 +19,7 @@

static __always_inline bool arch_static_branch(struct static_key *key)
{
- asm goto("1:\n\t"
+ asm_goto("1:\n\t"
"nop\n\t"
".pushsection __jump_table, \"aw\"\n\t"
JUMP_ENTRY_TYPE "1b, %l[l_yes], %c0\n\t"
diff --git a/arch/s390/include/asm/jump_label.h b/arch/s390/include/asm/jump_label.h
index 6c32190..323422e 100644
--- a/arch/s390/include/asm/jump_label.h
+++ b/arch/s390/include/asm/jump_label.h
@@ -15,7 +15,7 @@

static __always_inline bool arch_static_branch(struct static_key *key)
{
- asm goto("0: brcl 0,0\n"
+ asm_goto("0: brcl 0,0\n"
".pushsection __jump_table, \"aw\"\n"
ASM_ALIGN "\n"
ASM_PTR " 0b, %l[label], %0\n"
diff --git a/arch/sparc/include/asm/jump_label.h b/arch/sparc/include/asm/jump_label.h
index 5080d16..e466c37 100644
--- a/arch/sparc/include/asm/jump_label.h
+++ b/arch/sparc/include/asm/jump_label.h
@@ -9,7 +9,7 @@

static __always_inline bool arch_static_branch(struct static_key *key)
{
- asm goto("1:\n\t"
+ asm_goto("1:\n\t"
"nop\n\t"
"nop\n\t"
".pushsection __jump_table, \"aw\"\n\t"
diff --git a/arch/x86/include/asm/cpufeature.h b/arch/x86/include/asm/cpufeature.h
index d3f5c63..acba4ad 100644
--- a/arch/x86/include/asm/cpufeature.h
+++ b/arch/x86/include/asm/cpufeature.h
@@ -374,7 +374,7 @@ static __always_inline __pure bool __static_cpu_has(u16 bit)
* Catch too early usage of this before alternatives
* have run.
*/
- asm goto("1: jmp %l[t_warn]\n"
+ asm_goto("1: jmp %l[t_warn]\n"
"2:\n"
".section .altinstructions,\"a\"\n"
" .long 1b - .\n"
@@ -388,7 +388,7 @@ static __always_inline __pure bool __static_cpu_has(u16 bit)

#endif

- asm goto("1: jmp %l[t_no]\n"
+ asm_goto("1: jmp %l[t_no]\n"
"2:\n"
".section .altinstructions,\"a\"\n"
" .long 1b - .\n"
@@ -453,7 +453,7 @@ static __always_inline __pure bool _static_cpu_has_safe(u16 bit)
* have. Thus, we force the jump to the widest, 4-byte, signed relative
* offset even though the last would often fit in less bytes.
*/
- asm goto("1: .byte 0xe9\n .long %l[t_dynamic] - 2f\n"
+ asm_goto("1: .byte 0xe9\n .long %l[t_dynamic] - 2f\n"
"2:\n"
".section .altinstructions,\"a\"\n"
" .long 1b - .\n" /* src offset */
diff --git a/arch/x86/include/asm/jump_label.h b/arch/x86/include/asm/jump_label.h
index 64507f3..65e951e 100644
--- a/arch/x86/include/asm/jump_label.h
+++ b/arch/x86/include/asm/jump_label.h
@@ -18,7 +18,7 @@

static __always_inline bool arch_static_branch(struct static_key *key)
{
- asm goto("1:"
+ asm_goto("1:"
".byte " __stringify(STATIC_KEY_INIT_NOP) "\n\t"
".pushsection __jump_table, \"aw\" \n\t"
_ASM_ALIGN "\n\t"
diff --git a/include/linux/compiler-gcc4.h b/include/linux/compiler-gcc4.h
index 842de22..b2ae613 100644
--- a/include/linux/compiler-gcc4.h
+++ b/include/linux/compiler-gcc4.h
@@ -65,6 +65,19 @@
#define __visible __attribute__((externally_visible))
#endif

+/*
+ * GCC 'asm goto' miscompiles certain code sequences:
+ *
+ * http://gcc.gnu.org/bugzilla/show_bug.cgi?id=58670
+ *
+ * Work it around via quirk suggested by Jakub Jelinek.
+ * Not yet fixed, so use the quirk on all compiler versions:
+ */
+#if GCC_VERSION <= 99999
+# define asm_goto(x...) do { asm goto(x); asm (""); } while (0)
+#else
+# define asm_goto(x...) do { asm goto(x); } while (0)
+#endif

#ifdef CONFIG_ARCH_USE_BUILTIN_BSWAP
#if GCC_VERSION >= 40400

2013-10-10 08:31:49

by Jakub Jelinek

[permalink] [raw]
Subject: Re: [PATCH] gcc4: Add 'asm goto' miscompilation quirk

On Thu, Oct 10, 2013 at 10:24:30AM +0200, Ingo Molnar wrote:
> Something like the patch below? (Totally untested and all that.)
>
> Notes:
>
> - If the bug is fixed in 4.8.3 then the version check can be sharpened
> from 99999 to 40803.

The bug is likely going to be fixed already for 4.8.2 (to be released
next week or so).

> - I'd really prefer this quirk versus having to add the extra barrier to
> the label, as it makes the actual usage sites a lot less painful.

Please check how much it bloats the generated code.
Also, for the bitops patch, you probably want an asm_volatile_goto variant.

> --- a/include/linux/compiler-gcc4.h
> +++ b/include/linux/compiler-gcc4.h
> @@ -65,6 +65,19 @@
> #define __visible __attribute__((externally_visible))
> #endif
>
> +/*
> + * GCC 'asm goto' miscompiles certain code sequences:
> + *
> + * http://gcc.gnu.org/bugzilla/show_bug.cgi?id=58670
> + *
> + * Work it around via quirk suggested by Jakub Jelinek.
> + * Not yet fixed, so use the quirk on all compiler versions:
> + */
> +#if GCC_VERSION <= 99999
> +# define asm_goto(x...) do { asm goto(x); asm (""); } while (0)
> +#else
> +# define asm_goto(x...) do { asm goto(x); } while (0)
> +#endif
>
> #ifdef CONFIG_ARCH_USE_BUILTIN_BSWAP
> #if GCC_VERSION >= 40400

Jakub

2013-10-10 08:34:51

by Ingo Molnar

[permalink] [raw]
Subject: Re: [PATCH] gcc4: Add 'asm goto' miscompilation quirk


* Ingo Molnar <[email protected]> wrote:

> Something like the patch below? (Totally untested and all that.)

It's up to 'lightly tested' state on x86: the .config that produced a
crash before now boots fine, so the workaround appears to work!

Thanks,

Ingo

2013-10-10 08:45:41

by Ingo Molnar

[permalink] [raw]
Subject: Re: [PATCH] gcc4: Add 'asm goto' miscompilation quirk


* Jakub Jelinek <[email protected]> wrote:

> On Thu, Oct 10, 2013 at 10:24:30AM +0200, Ingo Molnar wrote:
> > Something like the patch below? (Totally untested and all that.)
> >
> > Notes:
> >
> > - If the bug is fixed in 4.8.3 then the version check can be sharpened
> > from 99999 to 40803.
>
> The bug is likely going to be fixed already for 4.8.2 (to be released
> next week or so).
>
> > - I'd really prefer this quirk versus having to add the extra barrier to
> > the label, as it makes the actual usage sites a lot less painful.
>
> Please check how much it bloats the generated code.

on Linus's latest tree plain 'asm goto' is only rarely used, so the size
impact of the patch, on x86-64 defconfig, is zero:

vmlinux:
text data bss dec hex filename
11166823 1448024 1187840 13802687 d29cbf vmlinux.before
11166823 1448024 1187840 13802687 d29cbf vmlinux.after
1f7c3c1fd71b4b1327965bcfbc7a77fb vmlinux.before
3b246add801bc170e47096b712942395 vmlinux.after

Using GCC 4.8.1.

> Also, for the bitops patch, you probably want an asm_volatile_goto variant.

Also, for mutex_64.h - good point, will fix that.

Thanks,

Ingo

2013-10-10 08:55:16

by Ingo Molnar

[permalink] [raw]
Subject: [PATCH, -v2] compiler/gcc4: Add quirk for 'asm goto' miscompilation bug


* Ingo Molnar <[email protected]> wrote:

> * Jakub Jelinek <[email protected]> wrote:
>
> > On Thu, Oct 10, 2013 at 10:24:30AM +0200, Ingo Molnar wrote:
> > > Something like the patch below? (Totally untested and all that.)
> > >
> > > Notes:
> > >
> > > - If the bug is fixed in 4.8.3 then the version check can be sharpened
> > > from 99999 to 40803.
> >
> > The bug is likely going to be fixed already for 4.8.2 (to be released
> > next week or so).
> >
> > > - I'd really prefer this quirk versus having to add the extra barrier to
> > > the label, as it makes the actual usage sites a lot less painful.
> >
> > Please check how much it bloats the generated code.
>
> on Linus's latest tree plain 'asm goto' is only rarely used, so the size
> impact of the patch, on x86-64 defconfig, is zero:
>
> vmlinux:
> text data bss dec hex filename
> 11166823 1448024 1187840 13802687 d29cbf vmlinux.before
> 11166823 1448024 1187840 13802687 d29cbf vmlinux.after
> 1f7c3c1fd71b4b1327965bcfbc7a77fb vmlinux.before
> 3b246add801bc170e47096b712942395 vmlinux.after
>
> Using GCC 4.8.1.
>
> > Also, for the bitops patch, you probably want an asm_volatile_goto variant.
>
> Also, for mutex_64.h - good point, will fix that.

See the updated patch below. I've added a 4.8.2 version cutoff.

Thanks,

Ingo

===================>
Subject: compiler/gcc4: Add quirk for 'asm goto' miscompilation bug
From: Ingo Molnar <[email protected]>
Date: Thu, 10 Oct 2013 10:16:30 +0200

Fengguang Wu, Oleg Nesterov and Peter Zijlstra tracked down
a kernel crash to a GCC bug: GCC miscompiles certain 'asm goto'
constructs, as outlined here:

http://gcc.gnu.org/bugzilla/show_bug.cgi?id=58670

Implement a workaround suggested by Jakub Jelinek.

Reported-by: Fengguang Wu <[email protected]>
Reported-by: Oleg Nesterov <[email protected]>
Reported-by: Peter Zijlstra <[email protected]>
Suggested-by: Jakub Jelinek <[email protected]>
Cc: Linus Torvalds <[email protected]>
Cc: Andrew Morton <[email protected]>
Signed-off-by: Ingo Molnar <[email protected]>
---
arch/arm/include/asm/jump_label.h | 2 +-
arch/mips/include/asm/jump_label.h | 2 +-
arch/powerpc/include/asm/jump_label.h | 2 +-
arch/s390/include/asm/jump_label.h | 2 +-
arch/sparc/include/asm/jump_label.h | 2 +-
arch/x86/include/asm/cpufeature.h | 6 +++---
arch/x86/include/asm/jump_label.h | 2 +-
arch/x86/include/asm/mutex_64.h | 4 ++--
include/linux/compiler-gcc4.h | 16 ++++++++++++++++
9 files changed, 27 insertions(+), 11 deletions(-)

Index: tip/arch/arm/include/asm/jump_label.h
===================================================================
--- tip.orig/arch/arm/include/asm/jump_label.h
+++ tip/arch/arm/include/asm/jump_label.h
@@ -16,7 +16,7 @@

static __always_inline bool arch_static_branch(struct static_key *key)
{
- asm goto("1:\n\t"
+ asm_goto("1:\n\t"
JUMP_LABEL_NOP "\n\t"
".pushsection __jump_table, \"aw\"\n\t"
".word 1b, %l[l_yes], %c0\n\t"
Index: tip/arch/mips/include/asm/jump_label.h
===================================================================
--- tip.orig/arch/mips/include/asm/jump_label.h
+++ tip/arch/mips/include/asm/jump_label.h
@@ -22,7 +22,7 @@

static __always_inline bool arch_static_branch(struct static_key *key)
{
- asm goto("1:\tnop\n\t"
+ asm_goto("1:\tnop\n\t"
"nop\n\t"
".pushsection __jump_table, \"aw\"\n\t"
WORD_INSN " 1b, %l[l_yes], %0\n\t"
Index: tip/arch/powerpc/include/asm/jump_label.h
===================================================================
--- tip.orig/arch/powerpc/include/asm/jump_label.h
+++ tip/arch/powerpc/include/asm/jump_label.h
@@ -19,7 +19,7 @@

static __always_inline bool arch_static_branch(struct static_key *key)
{
- asm goto("1:\n\t"
+ asm_goto("1:\n\t"
"nop\n\t"
".pushsection __jump_table, \"aw\"\n\t"
JUMP_ENTRY_TYPE "1b, %l[l_yes], %c0\n\t"
Index: tip/arch/s390/include/asm/jump_label.h
===================================================================
--- tip.orig/arch/s390/include/asm/jump_label.h
+++ tip/arch/s390/include/asm/jump_label.h
@@ -15,7 +15,7 @@

static __always_inline bool arch_static_branch(struct static_key *key)
{
- asm goto("0: brcl 0,0\n"
+ asm_goto("0: brcl 0,0\n"
".pushsection __jump_table, \"aw\"\n"
ASM_ALIGN "\n"
ASM_PTR " 0b, %l[label], %0\n"
Index: tip/arch/sparc/include/asm/jump_label.h
===================================================================
--- tip.orig/arch/sparc/include/asm/jump_label.h
+++ tip/arch/sparc/include/asm/jump_label.h
@@ -9,7 +9,7 @@

static __always_inline bool arch_static_branch(struct static_key *key)
{
- asm goto("1:\n\t"
+ asm_goto("1:\n\t"
"nop\n\t"
"nop\n\t"
".pushsection __jump_table, \"aw\"\n\t"
Index: tip/arch/x86/include/asm/cpufeature.h
===================================================================
--- tip.orig/arch/x86/include/asm/cpufeature.h
+++ tip/arch/x86/include/asm/cpufeature.h
@@ -374,7 +374,7 @@ static __always_inline __pure bool __sta
* Catch too early usage of this before alternatives
* have run.
*/
- asm goto("1: jmp %l[t_warn]\n"
+ asm_goto("1: jmp %l[t_warn]\n"
"2:\n"
".section .altinstructions,\"a\"\n"
" .long 1b - .\n"
@@ -388,7 +388,7 @@ static __always_inline __pure bool __sta

#endif

- asm goto("1: jmp %l[t_no]\n"
+ asm_goto("1: jmp %l[t_no]\n"
"2:\n"
".section .altinstructions,\"a\"\n"
" .long 1b - .\n"
@@ -453,7 +453,7 @@ static __always_inline __pure bool _stat
* have. Thus, we force the jump to the widest, 4-byte, signed relative
* offset even though the last would often fit in less bytes.
*/
- asm goto("1: .byte 0xe9\n .long %l[t_dynamic] - 2f\n"
+ asm_goto("1: .byte 0xe9\n .long %l[t_dynamic] - 2f\n"
"2:\n"
".section .altinstructions,\"a\"\n"
" .long 1b - .\n" /* src offset */
Index: tip/arch/x86/include/asm/jump_label.h
===================================================================
--- tip.orig/arch/x86/include/asm/jump_label.h
+++ tip/arch/x86/include/asm/jump_label.h
@@ -18,7 +18,7 @@

static __always_inline bool arch_static_branch(struct static_key *key)
{
- asm goto("1:"
+ asm_goto("1:"
".byte " __stringify(STATIC_KEY_INIT_NOP) "\n\t"
".pushsection __jump_table, \"aw\" \n\t"
_ASM_ALIGN "\n\t"
Index: tip/arch/x86/include/asm/mutex_64.h
===================================================================
--- tip.orig/arch/x86/include/asm/mutex_64.h
+++ tip/arch/x86/include/asm/mutex_64.h
@@ -20,7 +20,7 @@
static inline void __mutex_fastpath_lock(atomic_t *v,
void (*fail_fn)(atomic_t *))
{
- asm volatile goto(LOCK_PREFIX " decl %0\n"
+ asm_volatile_goto(LOCK_PREFIX " decl %0\n"
" jns %l[exit]\n"
: : "m" (v->counter)
: "memory", "cc"
@@ -75,7 +75,7 @@ static inline int __mutex_fastpath_lock_
static inline void __mutex_fastpath_unlock(atomic_t *v,
void (*fail_fn)(atomic_t *))
{
- asm volatile goto(LOCK_PREFIX " incl %0\n"
+ asm_volatile_goto(LOCK_PREFIX " incl %0\n"
" jg %l[exit]\n"
: : "m" (v->counter)
: "memory", "cc"
Index: tip/include/linux/compiler-gcc4.h
===================================================================
--- tip.orig/include/linux/compiler-gcc4.h
+++ tip/include/linux/compiler-gcc4.h
@@ -65,6 +65,22 @@
#define __visible __attribute__((externally_visible))
#endif

+/*
+ * GCC 'asm goto' miscompiles certain code sequences:
+ *
+ * http://gcc.gnu.org/bugzilla/show_bug.cgi?id=58670
+ *
+ * Work it around via quirk suggested by Jakub Jelinek.
+ * Fixed in GCC 4.8.2 and later versions.
+ */
+#if GCC_VERSION <= 40801
+# define __asm_goto(vol, x...) do { asm vol goto(x); asm (""); } while (0)
+#else
+# define __asm_goto(vol, x...) do { asm vol goto(x); } while (0)
+#endif
+
+#define asm_goto(x...) __asm_goto(,x)
+#define asm_volatile_goto(x...) __asm_goto(volatile, x)

#ifdef CONFIG_ARCH_USE_BUILTIN_BSWAP
#if GCC_VERSION >= 40400

2013-10-10 11:56:42

by Peter Zijlstra

[permalink] [raw]
Subject: Re: [PATCH, -v2] compiler/gcc4: Add quirk for 'asm goto' miscompilation bug

On Thu, Oct 10, 2013 at 10:55:06AM +0200, Ingo Molnar wrote:
> +/*
> + * GCC 'asm goto' miscompiles certain code sequences:
> + *
> + * http://gcc.gnu.org/bugzilla/show_bug.cgi?id=58670
> + *
> + * Work it around via quirk suggested by Jakub Jelinek.
> + * Fixed in GCC 4.8.2 and later versions.
> + */
> +#if GCC_VERSION <= 40801

We didn't do version checks for CC_HAVE_ASM_GOTO because of vendor
backports; can't we detect this in the same way?

> +# define __asm_goto(vol, x...) do { asm vol goto(x); asm (""); } while (0)
> +#else
> +# define __asm_goto(vol, x...) do { asm vol goto(x); } while (0)
> +#endif

This places the asm("") in the fallthrough case; but Jakub wrote:

> @@ -8,6 +8,7 @@ foo (int a, int b)
> asm volatile goto ("bts $1, %0; jc %l[lab]" : : "m" (b) : "memory" : lab);
> return 0;
> lab:
> + asm ("");
> return 0;
> }

Which places the asm ("") after the label, these two are not the same.

2013-10-10 12:33:14

by Jakub Jelinek

[permalink] [raw]
Subject: Re: [PATCH, -v2] compiler/gcc4: Add quirk for 'asm goto' miscompilation bug

On Thu, Oct 10, 2013 at 01:56:17PM +0200, Peter Zijlstra wrote:
> On Thu, Oct 10, 2013 at 10:55:06AM +0200, Ingo Molnar wrote:
> > +/*
> > + * GCC 'asm goto' miscompiles certain code sequences:
> > + *
> > + * http://gcc.gnu.org/bugzilla/show_bug.cgi?id=58670
> > + *
> > + * Work it around via quirk suggested by Jakub Jelinek.
> > + * Fixed in GCC 4.8.2 and later versions.
> > + */
> > +#if GCC_VERSION <= 40801
>
> We didn't do version checks for CC_HAVE_ASM_GOTO because of vendor
> backports; can't we detect this in the same way?

The problem is that it will be harder to check for this as compile time only
check, and for runtime check you'd need to have the assembly string for
every architecture and you couldn't do it for cross-compiling anyway.
For compile time only check, it wouldn't be 100% reliable, you could e.g.
check for that using -S -O2 -xc - -o - on:
int
foo (int a, int b)
{
if (a)
return -3;
asm volatile goto ("asm volatile goto to %l[lab]" : : "m" (b) : "memory" : lab);
return 0;
lab:
return 0;
}
and use awk on the resulting assembly to find out if the
asm volatile goto to (.*)$
string, then skip lines starting in column 0 with an
assembly comment character(s) (#, %, //, not sure if those 3 are all you can
see) and check that the first non-skipped line starts with the string matching
(.*) earlier followed by : (or perhaps skip other labels too?).
That said, the check could fail even in fixed gccs, so perhaps you want to
combine that with both version check and test, if version is >= 4.8.3
(note, while I hope it will be fixed in 4.8.2 release, people using
prerelease compilers would still have __GNUC_PATCHLEVEL__ == 2, at least
in upstream gcc (e.g. in Fedora/RHEL we patch down the patchlevel version,
so that __GNUC_PATCHLEVEL__ is 2 only for GCC release x.y.2 and following
snapshots, while upstream bumps patchlevel immediately after a release is
made), even with gcc containing that bug. So for >= 4.8.3 just assume no
workaround is needed, otherwise scan assembly.

>
> > +# define __asm_goto(vol, x...) do { asm vol goto(x); asm (""); } while (0)
> > +#else
> > +# define __asm_goto(vol, x...) do { asm vol goto(x); } while (0)
> > +#endif
>
> This places the asm("") in the fallthrough case; but Jakub wrote:
>
> > @@ -8,6 +8,7 @@ foo (int a, int b)
> > asm volatile goto ("bts $1, %0; jc %l[lab]" : : "m" (b) : "memory" : lab);
> > return 0;
> > lab:
> > + asm ("");
> > return 0;
> > }
>
> Which places the asm ("") after the label, these two are not the same.

See the follow-up mails, I think placing it immediately after asm goto might
be better.

Jakub

2013-10-10 13:10:53

by Peter Zijlstra

[permalink] [raw]
Subject: Re: [PATCH, -v2] compiler/gcc4: Add quirk for 'asm goto' miscompilation bug

On Thu, Oct 10, 2013 at 02:32:36PM +0200, Jakub Jelinek wrote:
> On Thu, Oct 10, 2013 at 01:56:17PM +0200, Peter Zijlstra wrote:
> > We didn't do version checks for CC_HAVE_ASM_GOTO because of vendor
> > backports; can't we detect this in the same way?
>
> The problem is that it will be harder to check for this as compile time only
> check, and for runtime check you'd need to have the assembly string for
> every architecture and you couldn't do it for cross-compiling anyway.

> So for >= 4.8.3 just assume no
> workaround is needed, otherwise scan assembly.

Right, tedious and error prone it is.. :-)

Would it make sense to create something whereby GCC can tell us about
these things? Maybe something like:

__builtin_bug_fixed(58670)

Which would default return 0, and only return 1 when its a known number.

But yes, I also see why you'd not want to do that. I suppose all I'm
saying is it would be nice to be able to detect some arbitrary issue
being fixed.

> See the follow-up mails, I think placing it immediately after asm goto might
> be better.

Duh indeed, must've missed that when I scanned through the thread :/

2013-10-10 14:04:27

by Richard Henderson

[permalink] [raw]
Subject: Re: [PATCH] gcc4: Add 'asm goto' miscompilation quirk

On 10/10/2013 01:31 AM, Jakub Jelinek wrote:
> Also, for the bitops patch, you probably want an asm_volatile_goto variant.

Why? Asm without output (which asm goto must be) are automatically volatile.


r!

2013-10-10 14:27:39

by Jakub Jelinek

[permalink] [raw]
Subject: Re: [PATCH] gcc4: Add 'asm goto' miscompilation quirk

On Thu, Oct 10, 2013 at 07:04:18AM -0700, Richard Henderson wrote:
> On 10/10/2013 01:31 AM, Jakub Jelinek wrote:
> > Also, for the bitops patch, you probably want an asm_volatile_goto variant.
>
> Why? Asm without output (which asm goto must be) are automatically volatile.

You're right.

Jakub

2013-10-10 15:04:20

by Ingo Molnar

[permalink] [raw]
Subject: Re: [PATCH, -v2] compiler/gcc4: Add quirk for 'asm goto' miscompilation bug


* Peter Zijlstra <[email protected]> wrote:

> > So for >= 4.8.3 just assume no workaround is needed, otherwise scan
> > assembly.
>
> Right, tedious and error prone it is.. :-)
>
> Would it make sense to create something whereby GCC can tell us about
> these things? Maybe something like:
>
> __builtin_bug_fixed(58670)
>
> Which would default return 0, and only return 1 when its a known number.
>
> But yes, I also see why you'd not want to do that. I suppose all I'm
> saying is it would be nice to be able to detect some arbitrary issue
> being fixed.

Basically not a monolithic 1-dimensional feature value but a more
finegrained multi-dimensional feature vector would be nice.

It could be used not just for bugs but for all regular features as well,
as they are added.

Something like:

__builtin_feature(asm_goto)

would return 1 for a basic asm goto implementation and 0 for unknown
feature strings. Any individual bug, if applications are affected by it,
would then would be discoverable:

__builtin_feature(asm_goto_bug_58670_fixed)

(or a fully symbolic name would suffice as well.) On old GCC this would
return 1, on anything 4.8.2 and higher it would return 1.

Thanks,

Ingo

2013-10-10 15:12:25

by Ingo Molnar

[permalink] [raw]
Subject: [PATCH, -v3] compiler/gcc4: Add quirk for 'asm goto' miscompilation bug


* Jakub Jelinek <[email protected]> wrote:

> On Thu, Oct 10, 2013 at 07:04:18AM -0700, Richard Henderson wrote:
> > On 10/10/2013 01:31 AM, Jakub Jelinek wrote:
> > > Also, for the bitops patch, you probably want an asm_volatile_goto variant.
> >
> > Why? Asm without output (which asm goto must be) are automatically volatile.
>
> You're right.

Indeed. Something like the updated version below?

[ I kept the asm_volatile_goto() naming to make sure the implicit volatile
is visible. ]

Thanks,

Ingo

--------------------->
>From 1ab592e8d55576880b90c131529111f51c188284 Mon Sep 17 00:00:00 2001
From: Ingo Molnar <[email protected]>
Date: Thu, 10 Oct 2013 10:16:30 +0200
Subject: [PATCH] compiler/gcc4: Add quirk for 'asm goto' miscompilation bug

Fengguang Wu, Oleg Nesterov and Peter Zijlstra tracked down
a kernel crash to a GCC bug: GCC miscompiles certain 'asm goto'
constructs, as outlined here:

http://gcc.gnu.org/bugzilla/show_bug.cgi?id=58670

Implement a workaround suggested by Jakub Jelinek.

Reported-by: Fengguang Wu <[email protected]>
Reported-by: Oleg Nesterov <[email protected]>
Reported-by: Peter Zijlstra <[email protected]>
Suggested-by: Jakub Jelinek <[email protected]>
Cc: Linus Torvalds <[email protected]>
Cc: Andrew Morton <[email protected]>
Signed-off-by: Ingo Molnar <[email protected]>
---
arch/arm/include/asm/jump_label.h | 2 +-
arch/mips/include/asm/jump_label.h | 2 +-
arch/powerpc/include/asm/jump_label.h | 2 +-
arch/s390/include/asm/jump_label.h | 2 +-
arch/sparc/include/asm/jump_label.h | 2 +-
arch/x86/include/asm/cpufeature.h | 6 +++---
arch/x86/include/asm/jump_label.h | 2 +-
arch/x86/include/asm/mutex_64.h | 4 ++--
arch/x86/include/asm/rmwcc.h | 2 +-
include/linux/compiler-gcc4.h | 15 +++++++++++++++
10 files changed, 27 insertions(+), 12 deletions(-)

diff --git a/arch/arm/include/asm/jump_label.h b/arch/arm/include/asm/jump_label.h
index bfc198c..863c892 100644
--- a/arch/arm/include/asm/jump_label.h
+++ b/arch/arm/include/asm/jump_label.h
@@ -16,7 +16,7 @@

static __always_inline bool arch_static_branch(struct static_key *key)
{
- asm goto("1:\n\t"
+ asm_volatile_goto("1:\n\t"
JUMP_LABEL_NOP "\n\t"
".pushsection __jump_table, \"aw\"\n\t"
".word 1b, %l[l_yes], %c0\n\t"
diff --git a/arch/mips/include/asm/jump_label.h b/arch/mips/include/asm/jump_label.h
index 4d6d77e..e194f95 100644
--- a/arch/mips/include/asm/jump_label.h
+++ b/arch/mips/include/asm/jump_label.h
@@ -22,7 +22,7 @@

static __always_inline bool arch_static_branch(struct static_key *key)
{
- asm goto("1:\tnop\n\t"
+ asm_volatile_goto("1:\tnop\n\t"
"nop\n\t"
".pushsection __jump_table, \"aw\"\n\t"
WORD_INSN " 1b, %l[l_yes], %0\n\t"
diff --git a/arch/powerpc/include/asm/jump_label.h b/arch/powerpc/include/asm/jump_label.h
index ae098c4..f016bb6 100644
--- a/arch/powerpc/include/asm/jump_label.h
+++ b/arch/powerpc/include/asm/jump_label.h
@@ -19,7 +19,7 @@

static __always_inline bool arch_static_branch(struct static_key *key)
{
- asm goto("1:\n\t"
+ asm_volatile_goto("1:\n\t"
"nop\n\t"
".pushsection __jump_table, \"aw\"\n\t"
JUMP_ENTRY_TYPE "1b, %l[l_yes], %c0\n\t"
diff --git a/arch/s390/include/asm/jump_label.h b/arch/s390/include/asm/jump_label.h
index 6c32190..346b1c8 100644
--- a/arch/s390/include/asm/jump_label.h
+++ b/arch/s390/include/asm/jump_label.h
@@ -15,7 +15,7 @@

static __always_inline bool arch_static_branch(struct static_key *key)
{
- asm goto("0: brcl 0,0\n"
+ asm_volatile_goto("0: brcl 0,0\n"
".pushsection __jump_table, \"aw\"\n"
ASM_ALIGN "\n"
ASM_PTR " 0b, %l[label], %0\n"
diff --git a/arch/sparc/include/asm/jump_label.h b/arch/sparc/include/asm/jump_label.h
index 5080d16..ec2e2e2 100644
--- a/arch/sparc/include/asm/jump_label.h
+++ b/arch/sparc/include/asm/jump_label.h
@@ -9,7 +9,7 @@

static __always_inline bool arch_static_branch(struct static_key *key)
{
- asm goto("1:\n\t"
+ asm_volatile_goto("1:\n\t"
"nop\n\t"
"nop\n\t"
".pushsection __jump_table, \"aw\"\n\t"
diff --git a/arch/x86/include/asm/cpufeature.h b/arch/x86/include/asm/cpufeature.h
index d3f5c63..89270b4 100644
--- a/arch/x86/include/asm/cpufeature.h
+++ b/arch/x86/include/asm/cpufeature.h
@@ -374,7 +374,7 @@ static __always_inline __pure bool __static_cpu_has(u16 bit)
* Catch too early usage of this before alternatives
* have run.
*/
- asm goto("1: jmp %l[t_warn]\n"
+ asm_volatile_goto("1: jmp %l[t_warn]\n"
"2:\n"
".section .altinstructions,\"a\"\n"
" .long 1b - .\n"
@@ -388,7 +388,7 @@ static __always_inline __pure bool __static_cpu_has(u16 bit)

#endif

- asm goto("1: jmp %l[t_no]\n"
+ asm_volatile_goto("1: jmp %l[t_no]\n"
"2:\n"
".section .altinstructions,\"a\"\n"
" .long 1b - .\n"
@@ -453,7 +453,7 @@ static __always_inline __pure bool _static_cpu_has_safe(u16 bit)
* have. Thus, we force the jump to the widest, 4-byte, signed relative
* offset even though the last would often fit in less bytes.
*/
- asm goto("1: .byte 0xe9\n .long %l[t_dynamic] - 2f\n"
+ asm_volatile_goto("1: .byte 0xe9\n .long %l[t_dynamic] - 2f\n"
"2:\n"
".section .altinstructions,\"a\"\n"
" .long 1b - .\n" /* src offset */
diff --git a/arch/x86/include/asm/jump_label.h b/arch/x86/include/asm/jump_label.h
index 64507f3..6a2cefb 100644
--- a/arch/x86/include/asm/jump_label.h
+++ b/arch/x86/include/asm/jump_label.h
@@ -18,7 +18,7 @@

static __always_inline bool arch_static_branch(struct static_key *key)
{
- asm goto("1:"
+ asm_volatile_goto("1:"
".byte " __stringify(STATIC_KEY_INIT_NOP) "\n\t"
".pushsection __jump_table, \"aw\" \n\t"
_ASM_ALIGN "\n\t"
diff --git a/arch/x86/include/asm/mutex_64.h b/arch/x86/include/asm/mutex_64.h
index e7e6751..07537a4 100644
--- a/arch/x86/include/asm/mutex_64.h
+++ b/arch/x86/include/asm/mutex_64.h
@@ -20,7 +20,7 @@
static inline void __mutex_fastpath_lock(atomic_t *v,
void (*fail_fn)(atomic_t *))
{
- asm volatile goto(LOCK_PREFIX " decl %0\n"
+ asm_volatile_goto(LOCK_PREFIX " decl %0\n"
" jns %l[exit]\n"
: : "m" (v->counter)
: "memory", "cc"
@@ -75,7 +75,7 @@ static inline int __mutex_fastpath_lock_retval(atomic_t *count)
static inline void __mutex_fastpath_unlock(atomic_t *v,
void (*fail_fn)(atomic_t *))
{
- asm volatile goto(LOCK_PREFIX " incl %0\n"
+ asm_volatile_goto(LOCK_PREFIX " incl %0\n"
" jg %l[exit]\n"
: : "m" (v->counter)
: "memory", "cc"
diff --git a/arch/x86/include/asm/rmwcc.h b/arch/x86/include/asm/rmwcc.h
index 735f184..1ff990f 100644
--- a/arch/x86/include/asm/rmwcc.h
+++ b/arch/x86/include/asm/rmwcc.h
@@ -5,7 +5,7 @@

#define __GEN_RMWcc(fullop, var, cc, ...) \
do { \
- asm volatile goto (fullop "; j" cc " %l[cc_label]" \
+ asm_volatile_goto (fullop "; j" cc " %l[cc_label]" \
: : "m" (var), ## __VA_ARGS__ \
: "memory" : cc_label); \
return 0; \
diff --git a/include/linux/compiler-gcc4.h b/include/linux/compiler-gcc4.h
index 842de22..ded4299 100644
--- a/include/linux/compiler-gcc4.h
+++ b/include/linux/compiler-gcc4.h
@@ -65,6 +65,21 @@
#define __visible __attribute__((externally_visible))
#endif

+/*
+ * GCC 'asm goto' miscompiles certain code sequences:
+ *
+ * http://gcc.gnu.org/bugzilla/show_bug.cgi?id=58670
+ *
+ * Work it around via a compiler barrier quirk suggested by Jakub Jelinek.
+ * Fixed in GCC 4.8.2 and later versions.
+ *
+ * (asm goto is automatically volatile - the naming reflects this.)
+ */
+#if GCC_VERSION <= 40801
+# define asm_volatile_goto(x...) do { asm goto(x); asm (""); } while (0)
+#else
+# define asm_volatile_goto(x...) do { asm goto(x); } while (0)
+#endif

#ifdef CONFIG_ARCH_USE_BUILTIN_BSWAP
#if GCC_VERSION >= 40400

2013-10-10 16:15:37

by Richard Henderson

[permalink] [raw]
Subject: Re: [PATCH, -v3] compiler/gcc4: Add quirk for 'asm goto' miscompilation bug

On 10/10/2013 08:12 AM, Ingo Molnar wrote:
> Indeed. Something like the updated version below?
>
> [ I kept the asm_volatile_goto() naming to make sure the implicit volatile
> is visible. ]
>
> Thanks,
>
> Ingo

Looks good.

Reviewed-by: Richard Henderson <[email protected]>


r~

2013-10-10 16:49:28

by Ingo Molnar

[permalink] [raw]
Subject: Re: [PATCH, -v3] compiler/gcc4: Add quirk for 'asm goto' miscompilation bug


* Richard Henderson <[email protected]> wrote:

> On 10/10/2013 08:12 AM, Ingo Molnar wrote:
> > Indeed. Something like the updated version below?
> >
> > [ I kept the asm_volatile_goto() naming to make sure the implicit volatile
> > is visible. ]
> >
> > Thanks,
> >
> > Ingo
>
> Looks good.
>
> Reviewed-by: Richard Henderson <[email protected]>

The question then would be, does it solve Fengguang's crashes as well? He
was able to reproduce them faster than I.

Thanks,

Ingo

2013-10-11 04:36:00

by Fengguang Wu

[permalink] [raw]
Subject: Re: [PATCH, -v3] compiler/gcc4: Add quirk for 'asm goto' miscompilation bug

On Thu, Oct 10, 2013 at 05:12:19PM +0200, Ingo Molnar wrote:
>
> * Jakub Jelinek <[email protected]> wrote:
>
> > On Thu, Oct 10, 2013 at 07:04:18AM -0700, Richard Henderson wrote:
> > > On 10/10/2013 01:31 AM, Jakub Jelinek wrote:
> > > > Also, for the bitops patch, you probably want an asm_volatile_goto variant.
> > >
> > > Why? Asm without output (which asm goto must be) are automatically volatile.
> >
> > You're right.
>
> Indeed. Something like the updated version below?
>
> [ I kept the asm_volatile_goto() naming to make sure the implicit volatile
> is visible. ]

Ingo, I applied this patch (as commit c015a7f0b746) on top of
tip/sched/core

3354781a2184 "sched/numa: Reflow task_numa_group() to avoid a compiler warning"

The below results show that it does fixed the many oops:

/kernel/i386-randconfig-i005-1008/c015a7f0b746d0a7e18b82876bd2b693722479d2

+--------------------------------------------------------------+--------------+--------------+
| | 3354781a2184 | c015a7f0b746 |
+--------------------------------------------------------------+--------------+--------------+
| WARNING:CPU:PID:at_fs/sysfs/dir.c:sysfs_add_one() | 9 | |
| WARNING:CPU:PID:at_lib/kobject.c:kobject_add_internal() | 9 | |
| WARNING:CPU:PID:at_drivers/base/driver.c:driver_unregister() | 9 | |
| WARNING:CPU:PID:at_lib/list_debug.c:__list_add() | 9 | |
| kernel_BUG_at_kernel/timer.c | 9 | |
| invalid_opcode:PREEMPT_SMP | 9 | |
| Kernel_panic-not_syncing:Fatal_exception_in_interrupt | 9 | |
| good_boots | 0 | 9 |
+--------------------------------------------------------------+--------------+--------------+

/kernel/i386-randconfig-r4-1009/c015a7f0b746d0a7e18b82876bd2b693722479d2

+--------------------------------------------------------------+--------------+--------------+
| | 3354781a2184 | c015a7f0b746 |
+--------------------------------------------------------------+--------------+--------------+
| BUG:kernel_early_hang_without_any_printk_output | 2 | 3 |
| WARNING:CPU:PID:at_fs/sysfs/dir.c:sysfs_add_one() | 7 | |
| WARNING:CPU:PID:at_lib/kobject.c:kobject_add_internal() | 7 | |
| WARNING:CPU:PID:at_drivers/base/driver.c:driver_unregister() | 7 | |
| WARNING:CPU:PID:at_lib/debugobjects.c:debug_print_object() | 7 | |
| INFO:trying_to_register_non-static_key | 7 | |
| kernel_BUG_at_kernel/timer.c | 7 | |
| invalid_opcode:SMP | 7 | |
| Kernel_panic-not_syncing:Fatal_exception_in_interrupt | 7 | |
| good_boots | 0 | 6 |
+--------------------------------------------------------------+--------------+--------------+

/kernel/i386-randconfig-r8-1005/c015a7f0b746d0a7e18b82876bd2b693722479d2

+---------------------------------------------------------------+--------------+--------------+
| | 3354781a2184 | c015a7f0b746 |
+---------------------------------------------------------------+--------------+--------------+
| BUG:unable_to_handle_kernel_NULL_pointer_dereference_at | 1 | |
| Oops:DEBUG_PAGEALLOC | 9 | |
| kernel_BUG_at_kernel/cred.c | 1 | |
| invalid_opcode:DEBUG_PAGEALLOC | 1 | |
| Kernel_panic-not_syncing:CRED:put_cred_rcu()sees_with_usage | 4 | |
| BUG:unable_to_handle_kernel_paging_request_at | 3 | |
| BUG:unable_to_handle_kernel_NULL_pointer_dereference_at(null) | 5 | |
| good_boots | 0 | 9 |
+---------------------------------------------------------------+--------------+--------------+

However it seems that it leads to or increases the chances of early
boot hang:

/kernel/x86_64-randconfig-a1-1009/c015a7f0b746d0a7e18b82876bd2b693722479d2

+-------------------------------------------------+--------------+--------------+
| | 3354781a2184 | c015a7f0b746 |
+-------------------------------------------------+--------------+--------------+
| good_boots | 9 | 8 |
| BUG:kernel_early_hang_without_any_printk_output | 0 | 1 |
+-------------------------------------------------+--------------+--------------+

/kernel/x86_64-randconfig-a5-1009/c015a7f0b746d0a7e18b82876bd2b693722479d2

+-------------------------------------------------+--------------+--------------+
| | 3354781a2184 | c015a7f0b746 |
+-------------------------------------------------+--------------+--------------+
| good_boots | 9 | 8 |
| BUG:kernel_early_hang_without_any_printk_output | 0 | 1 |
+-------------------------------------------------+--------------+--------------+

/kernel/i386-randconfig-r1-1009/c015a7f0b746d0a7e18b82876bd2b693722479d2

+-------------------------------------------------+--------------+--------------+
| | 3354781a2184 | c015a7f0b746 |
+-------------------------------------------------+--------------+--------------+
| BUG:kernel_early_hang_without_any_printk_output | 9 | 9 |
+-------------------------------------------------+--------------+--------------+

/kernel/i386-randconfig-r7-1009/c015a7f0b746d0a7e18b82876bd2b693722479d2

+--------------------------------------------------+--------------+--------------+
| | 3354781a2184 | c015a7f0b746 |
+--------------------------------------------------+--------------+--------------+
| BUG:soft_lockup-CPU_stuck_for_s | 1 | |
| INFO:task_blocked_for_more_than_seconds | 8 | 8 |
| Kernel_panic-not_syncing:hung_task:blocked_tasks | 8 | 8 |
| BUG:kernel_early_hang_without_any_printk_output | 0 | 1 |
+--------------------------------------------------+--------------+--------------+

/kernel/i386-randconfig-r5-1009/c015a7f0b746d0a7e18b82876bd2b693722479d2

+-------------------------------------------------+--------------+--------------+
| | 3354781a2184 | c015a7f0b746 |
+-------------------------------------------------+--------------+--------------+
| BUG:kernel_early_hang_without_any_printk_output | 9 | 9 |
+-------------------------------------------------+--------------+--------------+

/kernel/i386-randconfig-i008-1008/c015a7f0b746d0a7e18b82876bd2b693722479d2

+-------------------------------------------------+--------------+--------------+
| | 3354781a2184 | c015a7f0b746 |
+-------------------------------------------------+--------------+--------------+
| BUG:kernel_early_hang_without_any_printk_output | 9 | 9 |
+-------------------------------------------------+--------------+--------------+

/kernel/i386-randconfig-i006-1008/c015a7f0b746d0a7e18b82876bd2b693722479d2

+-------------------------------------------------+--------------+--------------+
| | 3354781a2184 | c015a7f0b746 |
+-------------------------------------------------+--------------+--------------+
| good_boots | 9 | 7 |
| BUG:kernel_early_hang_without_any_printk_output | 0 | 2 |
+-------------------------------------------------+--------------+--------------+

Thanks,
Fengguang

2013-10-11 05:47:02

by Ingo Molnar

[permalink] [raw]
Subject: Re: [PATCH, -v3] compiler/gcc4: Add quirk for 'asm goto' miscompilation bug


* Fengguang Wu <[email protected]> wrote:

> > Indeed. Something like the updated version below?
> >
> > [ I kept the asm_volatile_goto() naming to make sure the implicit volatile
> > is visible. ]
>
> Ingo, I applied this patch (as commit c015a7f0b746) on top of
> tip/sched/core
>
> 3354781a2184 "sched/numa: Reflow task_numa_group() to avoid a compiler warning"
>
> The below results show that it does fixed the many oops:

Thanks Fengguang!

I've added your Tested-by tag as well and have split the patch in two
parts: the upstream part with a -stable tag and the rmwcc.h part that goes
into the scheduler tree.

If there are no objections I will send a pull request for the upstream
part to Linus later today.

Thanks,

Ingo

2013-10-11 06:51:56

by Fengguang Wu

[permalink] [raw]
Subject: Re: [PATCH, -v3] compiler/gcc4: Add quirk for 'asm goto' miscompilation bug

On Fri, Oct 11, 2013 at 07:46:55AM +0200, Ingo Molnar wrote:
>
> * Fengguang Wu <[email protected]> wrote:
>
> > > Indeed. Something like the updated version below?
> > >
> > > [ I kept the asm_volatile_goto() naming to make sure the implicit volatile
> > > is visible. ]
> >
> > Ingo, I applied this patch (as commit c015a7f0b746) on top of
> > tip/sched/core
> >
> > 3354781a2184 "sched/numa: Reflow task_numa_group() to avoid a compiler warning"
> >
> > The below results show that it does fixed the many oops:
>
> Thanks Fengguang!
>
> I've added your Tested-by tag as well and have split the patch in two
> parts: the upstream part with a -stable tag and the rmwcc.h part that goes
> into the scheduler tree.
>
> If there are no objections I will send a pull request for the upstream
> part to Linus later today.

Ingo, sorry I'm still waiting for more results to arrive so as to confirm
whether the below "kernel_early_hang_without_any_printk_output" is a noise or
reliably caused by the gcc patch:

+-------------------------------------------------+--------------+--------------+
| | 3354781a2184 | c015a7f0b746 |
+-------------------------------------------------+--------------+--------------+
| good_boots | 9 | 8 |
| BUG:kernel_early_hang_without_any_printk_output | 0 | 1 |
+-------------------------------------------------+--------------+--------------+

Thanks,
Fengguang

2013-10-11 09:30:55

by Fengguang Wu

[permalink] [raw]
Subject: Re: [PATCH, -v3] compiler/gcc4: Add quirk for 'asm goto' miscompilation bug

Ingo,

After adding more test runs to these kernels, we can see that the boot hangs
happen both before/after patch. So the patch is fine.

Tested-by: Fengguang Wu <[email protected]>


/kernel/x86_64-randconfig-a1-1009/c015a7f0b746d0a7e18b82876bd2b693722479d2

+-------------------------------------------------+--------------+--------------+
| | 3354781a2184 | c015a7f0b746 |
+-------------------------------------------------+--------------+--------------+
| good_boots | 1012 | 1067 |
| has_kernel_error_warning | 27 | 40 |
| BUG:kernel_early_hang_without_any_printk_output | 14 | 13 |
| BUG:kernel_boot_hang | 13 | 27 |
+-------------------------------------------------+--------------+--------------+

/kernel/x86_64-randconfig-a5-1009/c015a7f0b746d0a7e18b82876bd2b693722479d2

+-------------------------------------------------+--------------+--------------+
| | 3354781a2184 | c015a7f0b746 |
+-------------------------------------------------+--------------+--------------+
| good_boots | 1078 | 1058 |
| has_kernel_error_warning | 35 | 13 |
| BUG:kernel_early_hang_without_any_printk_output | 35 | 13 |
+-------------------------------------------------+--------------+--------------+

btw, the boot hangs all happen in one of the test boxes, which is
probably misconfigured or not reliable.

Thanks,
Fengguang

2013-10-12 17:03:45

by Ingo Molnar

[permalink] [raw]
Subject: Re: [PATCH, -v3] compiler/gcc4: Add quirk for 'asm goto' miscompilation bug


* Fengguang Wu <[email protected]> wrote:

> Ingo,
>
> After adding more test runs to these kernels, we can see that the boot hangs
> happen both before/after patch. So the patch is fine.
>
> Tested-by: Fengguang Wu <[email protected]>

Cool, thanks for all the testing - I'll send the fix to Linus.

> btw, the boot hangs all happen in one of the test boxes, which is
> probably misconfigured or not reliable.

... or somehow has hardware layout/properties that triggers a particularly
nasty kernel bug.

Thanks,

Ingo