2011-03-05 08:25:06

by Justin P. Mattock

[permalink] [raw]
Subject: <IRQ> [<ffffffff810c9204>] ? __alloc_pages_nodemask+0x622/0x696

not sure what this is or where I should post this:

basically turned the machine on, loaded gnome-mplayer(music starts)
then thunderbird, gwibber,llirc then started watching a movie on
hulu..in the process I was adding
audit rules to my SELinux policy(/usr/sbin/semodule -i somename) then
all hell broke loose:

/semodule" subj=justin:staff_r:staff_sudo_t:s0 key=(null)
[ 339.786270] plugin-containe: page allocation failure. order:2, mode:0x4020
[ 339.786275] Pid: 2572, comm: plugin-containe Not tainted
2.6.38-rc7-00143-gd1b152c #7
[ 339.786278] Call Trace:
[ 339.786280] <IRQ> [<ffffffff810c9204>] ? __alloc_pages_nodemask+0x622/0x696
[ 339.786302] [<ffffffffa015a077>] ? ath_rxbuf_alloc+0x29/0x9a [ath]
[ 339.786306] [<ffffffff810f67cf>] ? new_slab+0x7b/0x1c6
[ 339.786310] [<ffffffffa015a077>] ? ath_rxbuf_alloc+0x29/0x9a [ath]
[ 339.786314] [<ffffffff810f6dd6>] ? T.925+0x163/0x29c
[ 339.786318] [<ffffffffa015a077>] ? ath_rxbuf_alloc+0x29/0x9a [ath]
[ 339.786322] [<ffffffff810f895a>] ? __kmalloc_track_caller+0xfe/0x190
[ 339.786327] [<ffffffff81380600>] ? __alloc_skb+0x6c/0x126
[ 339.786331] [<ffffffffa015a077>] ? ath_rxbuf_alloc+0x29/0x9a [ath]
[ 339.786338] [<ffffffffa01c553e>] ? ath_rx_tasklet+0x8bc/0x163b [ath9k]
[ 339.786345] [<ffffffffa01c4335>] ? ath9k_tasklet+0xa3/0x143 [ath9k]
[ 339.786350] [<ffffffff81066081>] ? tasklet_action+0x7b/0xfb
[ 339.786353] [<ffffffff81067253>] ? __do_softirq+0xc7/0x1a4
[ 339.786358] [<ffffffff8102e15c>] ? call_softirq+0x1c/0x28
[ 339.786361] [<ffffffff8102f635>] ? do_softirq+0x41/0x7e
[ 339.786364] [<ffffffff810670ea>] ? irq_exit+0x36/0x78
[ 339.786368] [<ffffffff8102ed0e>] ? do_IRQ+0x98/0xaf
[ 339.786372] [<ffffffff814473d3>] ? ret_from_intr+0x0/0x15
[ 339.786374] <EOI> [<ffffffff8102d384>] ? sysret_audit+0x16/0x20
[ 339.786379] Mem-Info:
[ 339.786381] DMA per-cpu:
[ 339.786383] CPU 0: hi: 0, btch: 1 usd: 0
[ 339.786386] CPU 1: hi: 0, btch: 1 usd: 0
[ 339.786388] DMA32 per-cpu:
[ 339.786390] CPU 0: hi: 186, btch: 31 usd: 0
[ 339.786392] CPU 1: hi: 186, btch: 31 usd: 30
[ 339.786398] active_anon:88538 inactive_anon:88629 isolated_anon:96
[ 339.786399] active_file:19394 inactive_file:18955 isolated_file:0
[ 339.786401] unevictable:10 dirty:3018 writeback:1035 unstable:0
[ 339.786402] free:2022 slab_reclaimable:4588 slab_unreclaimable:22662
[ 339.786404] mapped:21900 shmem:1676 pagetables:3959 bounce:0
[ 339.786411] DMA free:3948kB min:60kB low:72kB high:88kB
active_anon:5016kB inactive_anon:5176kB active_file:56kB
inactive_file:1020kB unevictable:0kB isolated(anon):0kB
isolated(file):0kB present:15684kB mlocked:0kB dirty:0kB writeback:0kB
mapped:240kB shmem:0kB slab_reclaimable:40kB slab_unreclaimable:196kB
kernel_stack:0kB pagetables:456kB unstable:0kB bounce:0kB
writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 339.786419] lowmem_reserve[]: 0 978 978 978
[ 339.786428] DMA32 free:4140kB min:3972kB low:4964kB high:5956kB
active_anon:349136kB inactive_anon:349340kB active_file:77520kB
inactive_file:74800kB unevictable:40kB isolated(anon):384kB
isolated(file):0kB present:1002436kB mlocked:40kB dirty:12072kB
writeback:4140kB mapped:87360kB shmem:6704kB slab_reclaimable:18312kB
slab_unreclaimable:90452kB kernel_stack:2256kB pagetables:15380kB
unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0
all_unreclaimable? no
[ 339.786436] lowmem_reserve[]: 0 0 0 0
[ 339.786440] DMA: 5*4kB 1*8kB 1*16kB 0*32kB 1*64kB 2*128kB 2*256kB
2*512kB 0*1024kB 1*2048kB 0*4096kB = 3948kB
[ 339.786451] DMA32: 871*4kB 16*8kB 13*16kB 4*32kB 3*64kB 0*128kB
0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4140kB
[ 339.786461] 40904 total pagecache pages
[ 339.786463] 876 pages in swap cache
[ 339.786465] Swap cache stats: add 2272, delete 1396, find 37/43
[ 339.786467] Free swap = 381732kB
[ 339.786469] Total swap = 390620kB
[ 339.787008] 258163 pages RAM
[ 339.787008] 6166 pages reserved
[ 339.787008] 137254 pages shared
[ 339.787008] 207478 pages non-shared
[ 339.787008] SLUB: Unable to allocate memory on node -1 (gfp=0x20)
[ 339.787008] cache: kmalloc-8192, object size: 8192, buffer size:
8264, default order: 3, min order: 2
[ 339.787008] kmalloc-8192 debugging increased min order, use
slub_debug=O to disable.
[ 339.787008] node 0: slabs: 181, objs: 543, free: 0
[ 339.790575] skbuff alloc of size 3904 failed
[ 339.823775] swapper: page allocation failure. order:2, mode:0x4020
[ 339.823781] Pid: 0, comm: swapper Not tainted 2.6.38-rc7-00143-gd1b152c #7
[ 339.823783] Call Trace:
[ 339.823786] <IRQ> [<ffffffff810c9204>] ? __alloc_pages_nodemask+0x622/0x696
[ 339.823811] [<ffffffffa015a077>] ? ath_rxbuf_alloc+0x29/0x9a [ath]
[ 339.823815] [<ffffffff810f67cf>] ? new_slab+0x7b/0x1c6
[ 339.823819] [<ffffffffa015a077>] ? ath_rxbuf_alloc+0x29/0x9a [ath]
[ 339.823823] [<ffffffff810f6dd6>] ? T.925+0x163/0x29c
[ 339.823827] [<ffffffff810c4ecc>] ? mempool_destroy+0xf/0x17
[ 339.823832] [<ffffffffa015a077>] ? ath_rxbuf_alloc+0x29/0x9a [ath]
[ 339.823836] [<ffffffff810f895a>] ? __kmalloc_track_caller+0xfe/0x190


full dmesg is here:
http://fpaste.org/wkjq/

let me know if I need to supply any info

--
Justin P. Mattock


2011-03-06 02:50:19

by David Rientjes

[permalink] [raw]
Subject: Re: <IRQ> [<ffffffff810c9204>] ? __alloc_pages_nodemask+0x622/0x696

On Sat, 5 Mar 2011, Justin Mattock wrote:

> [ 339.787008] SLUB: Unable to allocate memory on node -1 (gfp=0x20)
> [ 339.787008] cache: kmalloc-8192, object size: 8192, buffer size:
> 8264, default order: 3, min order: 2
> [ 339.787008] kmalloc-8192 debugging increased min order, use
> slub_debug=O to disable.
> [ 339.787008] node 0: slabs: 181, objs: 543, free: 0
> [ 339.790575] skbuff alloc of size 3904 failed
> [ 339.823775] swapper: page allocation failure. order:2, mode:0x4020
> [ 339.823781] Pid: 0, comm: swapper Not tainted 2.6.38-rc7-00143-gd1b152c #7
> [ 339.823783] Call Trace:
> [ 339.823786] <IRQ> [<ffffffff810c9204>] ? __alloc_pages_nodemask+0x622/0x696
> [ 339.823811] [<ffffffffa015a077>] ? ath_rxbuf_alloc+0x29/0x9a [ath]
> [ 339.823815] [<ffffffff810f67cf>] ? new_slab+0x7b/0x1c6
> [ 339.823819] [<ffffffffa015a077>] ? ath_rxbuf_alloc+0x29/0x9a [ath]
> [ 339.823823] [<ffffffff810f6dd6>] ? T.925+0x163/0x29c
> [ 339.823827] [<ffffffff810c4ecc>] ? mempool_destroy+0xf/0x17
> [ 339.823832] [<ffffffffa015a077>] ? ath_rxbuf_alloc+0x29/0x9a [ath]
> [ 339.823836] [<ffffffff810f895a>] ? __kmalloc_track_caller+0xfe/0x190
>

Order-2 atomic allocations are always going to be difficult since we can't
do synchronous compaction or reclaim, but I'd try the suggestion shown
above: boot with slub_debug=O or disable slub debugging so that
kmalloc-8192 is actually order-1 like it should be.

2011-03-06 03:21:08

by Justin P. Mattock

[permalink] [raw]
Subject: Re: <IRQ> [<ffffffff810c9204>] ? __alloc_pages_nodemask+0x622/0x696

On 03/05/2011 06:50 PM, David Rientjes wrote:
> On Sat, 5 Mar 2011, Justin Mattock wrote:
>
>> [ 339.787008] SLUB: Unable to allocate memory on node -1 (gfp=0x20)
>> [ 339.787008] cache: kmalloc-8192, object size: 8192, buffer size:
>> 8264, default order: 3, min order: 2
>> [ 339.787008] kmalloc-8192 debugging increased min order, use
>> slub_debug=O to disable.
>> [ 339.787008] node 0: slabs: 181, objs: 543, free: 0
>> [ 339.790575] skbuff alloc of size 3904 failed
>> [ 339.823775] swapper: page allocation failure. order:2, mode:0x4020
>> [ 339.823781] Pid: 0, comm: swapper Not tainted 2.6.38-rc7-00143-gd1b152c #7
>> [ 339.823783] Call Trace:
>> [ 339.823786]<IRQ> [<ffffffff810c9204>] ? __alloc_pages_nodemask+0x622/0x696
>> [ 339.823811] [<ffffffffa015a077>] ? ath_rxbuf_alloc+0x29/0x9a [ath]
>> [ 339.823815] [<ffffffff810f67cf>] ? new_slab+0x7b/0x1c6
>> [ 339.823819] [<ffffffffa015a077>] ? ath_rxbuf_alloc+0x29/0x9a [ath]
>> [ 339.823823] [<ffffffff810f6dd6>] ? T.925+0x163/0x29c
>> [ 339.823827] [<ffffffff810c4ecc>] ? mempool_destroy+0xf/0x17
>> [ 339.823832] [<ffffffffa015a077>] ? ath_rxbuf_alloc+0x29/0x9a [ath]
>> [ 339.823836] [<ffffffff810f895a>] ? __kmalloc_track_caller+0xfe/0x190
>>
>
> Order-2 atomic allocations are always going to be difficult since we can't
> do synchronous compaction or reclaim, but I'd try the suggestion shown
> above: boot with slub_debug=O or disable slub debugging so that
> kmalloc-8192 is actually order-1 like it should be.
>

alright! I will leave that setting on in the boot options to see if this
happens again.

Justin P. Mattock

2011-03-09 04:34:31

by Justin P. Mattock

[permalink] [raw]
Subject: Re: <IRQ> [<ffffffff810c9204>] ? __alloc_pages_nodemask+0x622/0x696

On 03/05/2011 06:50 PM, David Rientjes wrote:
> On Sat, 5 Mar 2011, Justin Mattock wrote:
>
>> [ 339.787008] SLUB: Unable to allocate memory on node -1 (gfp=0x20)
>> [ 339.787008] cache: kmalloc-8192, object size: 8192, buffer size:
>> 8264, default order: 3, min order: 2
>> [ 339.787008] kmalloc-8192 debugging increased min order, use
>> slub_debug=O to disable.
>> [ 339.787008] node 0: slabs: 181, objs: 543, free: 0
>> [ 339.790575] skbuff alloc of size 3904 failed
>> [ 339.823775] swapper: page allocation failure. order:2, mode:0x4020
>> [ 339.823781] Pid: 0, comm: swapper Not tainted 2.6.38-rc7-00143-gd1b152c #7
>> [ 339.823783] Call Trace:
>> [ 339.823786]<IRQ> [<ffffffff810c9204>] ? __alloc_pages_nodemask+0x622/0x696
>> [ 339.823811] [<ffffffffa015a077>] ? ath_rxbuf_alloc+0x29/0x9a [ath]
>> [ 339.823815] [<ffffffff810f67cf>] ? new_slab+0x7b/0x1c6
>> [ 339.823819] [<ffffffffa015a077>] ? ath_rxbuf_alloc+0x29/0x9a [ath]
>> [ 339.823823] [<ffffffff810f6dd6>] ? T.925+0x163/0x29c
>> [ 339.823827] [<ffffffff810c4ecc>] ? mempool_destroy+0xf/0x17
>> [ 339.823832] [<ffffffffa015a077>] ? ath_rxbuf_alloc+0x29/0x9a [ath]
>> [ 339.823836] [<ffffffff810f895a>] ? __kmalloc_track_caller+0xfe/0x190
>>
>
> Order-2 atomic allocations are always going to be difficult since we can't
> do synchronous compaction or reclaim, but I'd try the suggestion shown
> above: boot with slub_debug=O or disable slub debugging so that
> kmalloc-8192 is actually order-1 like it should be.
>

man O man.. didnt have a chance to use the boot options yet due to other
things I have been doing, anyways this popped up may/maynot be related:

[ 7603.339047]
=============================================================================
[ 7603.339053] BUG radix_tree_node: Padding overwritten.
0xffff88000008fe00-0xffff88000008fe32
[ 7603.339055]
-----------------------------------------------------------------------------
[ 7603.339056]
[ 7603.339059] INFO: Slab 0xffffea0000001ea0 objects=25 used=25 fp=0x
(null) flags=0x4081
[ 7603.339063] Pid: 0, comm: swapper Not tainted
2.6.38-rc7-00164-gcdf1389 #8
[ 7603.339066] Call Trace:
[ 7603.339068] <IRQ> [<ffffffff810f4df9>] ? slab_err+0x8a/0x98
[ 7603.339083] [<ffffffff81446ea2>] ? _raw_spin_unlock+0x9/0xb
[ 7603.339088] [<ffffffff810c7904>] ? free_one_page+0x2d4/0x2e3
[ 7603.339091] [<ffffffff810f52df>] ? slab_pad_check+0xc4/0x102
[ 7603.339096] [<ffffffff811f6382>] ? radix_tree_node_rcu_free+0x3b/0x3d
[ 7603.339099] [<ffffffff810f53a7>] ? check_slab+0x8a/0x91
[ 7603.339102] [<ffffffff810f5d9e>] ? free_debug_processing+0x22/0x208
[ 7603.339105] [<ffffffff810f60b4>] ? __slab_free+0x130/0x145
[ 7603.339108] [<ffffffff810f6a93>] ? kmem_cache_free+0x8e/0xd4
[ 7603.339112] [<ffffffff811f6382>] ? radix_tree_node_rcu_free+0x3b/0x3d
[ 7603.339118] [<ffffffff810a75c5>] ? __rcu_process_callbacks+0x186/0x28b
[ 7603.339121] [<ffffffff810a76ed>] ? rcu_process_callbacks+0x23/0x44
[ 7603.339126] [<ffffffff81067253>] ? __do_softirq+0xc7/0x1a4
[ 7603.339132] [<ffffffff8102fd79>] ? timer_interrupt+0x19/0x20
[ 7603.339135] [<ffffffff8102e15c>] ? call_softirq+0x1c/0x28
[ 7603.339139] [<ffffffff8102f635>] ? do_softirq+0x41/0x7e
[ 7603.339142] [<ffffffff810670ea>] ? irq_exit+0x36/0x78
[ 7603.339145] [<ffffffff8102ed0e>] ? do_IRQ+0x98/0xaf
[ 7603.339148] [<ffffffff81447253>] ? ret_from_intr+0x0/0x15
[ 7603.339150] <EOI> [<ffffffff810337d5>] ? native_sched_clock+0x2d/0x60
[ 7603.339183] [<ffffffffa001a661>] ? acpi_idle_enter_bm+0x2b9/0x2f1
[processor]
[ 7603.339189] [<ffffffffa001a65a>] ? acpi_idle_enter_bm+0x2b2/0x2f1
[processor]
[ 7603.339195] [<ffffffff81336a52>] ? menu_select+0x175/0x2a8
[ 7603.339198] [<ffffffff81335c3a>] ? cpuidle_idle_call+0x118/0x1be
[ 7603.339202] [<ffffffff8102c691>] ? cpu_idle+0x60/0x97
[ 7603.339206] [<ffffffff814308b4>] ? rest_init+0x68/0x6a
[ 7603.339211] [<ffffffff81705c3c>] ? start_kernel+0x2fc/0x307
[ 7603.339215] [<ffffffff8170527b>] ? x86_64_start_reservations+0x82/0x86
[ 7603.339218] [<ffffffff81705385>] ? x86_64_start_kernel+0x106/0x115
[ 7603.339221] Padding 0xffff88000008fbeb: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339234] Padding 0xffff88000008fbfb: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339247] Padding 0xffff88000008fc0b: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339260] Padding 0xffff88000008fc1b: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339273] Padding 0xffff88000008fc2b: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339285] Padding 0xffff88000008fc3b: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339298] Padding 0xffff88000008fc4b: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339311] Padding 0xffff88000008fc5b: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339324] Padding 0xffff88000008fc6b: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339337] Padding 0xffff88000008fc7b: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339349] Padding 0xffff88000008fc8b: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339362] Padding 0xffff88000008fc9b: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339375] Padding 0xffff88000008fcab: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339387] Padding 0xffff88000008fcbb: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339400] Padding 0xffff88000008fccb: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339413] Padding 0xffff88000008fcdb: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339426] Padding 0xffff88000008fceb: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339439] Padding 0xffff88000008fcfb: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339451] Padding 0xffff88000008fd0b: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339464] Padding 0xffff88000008fd1b: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339477] Padding 0xffff88000008fd2b: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339490] Padding 0xffff88000008fd3b: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339503] Padding 0xffff88000008fd4b: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339516] Padding 0xffff88000008fd5b: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339529] Padding 0xffff88000008fd6b: 00 00 00 00 00 cc cc cc cc
cc cc cc cc 00 00 00 .....????????...
[ 7603.339542] Padding 0xffff88000008fd7b: 00 00 00 00 00 29 6e 1f 81
ff ff ff ff 00 00 00 .....)n..????...
[ 7603.339555] Padding 0xffff88000008fd8b: 00 c2 0a 00 00 44 ec 0a 00
01 00 00 00 00 00 00 .?...D?.........
[ 7603.339568] Padding 0xffff88000008fd9b: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339581] Padding 0xffff88000008fdab: 00 00 00 00 00 5a 5a 5a 5a
5a 5a 5a 5a 5a 5a 5a .....ZZZZZZZZZZZ
[ 7603.339593] Padding 0xffff88000008fdbb: 5a 5a 5a 5a 5a 5a 5a 5a 5a
5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
[ 7603.339606] Padding 0xffff88000008fdcb: 5a 5a 5a 5a 5a 5a 5a 5a 5a
5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
[ 7603.339619] Padding 0xffff88000008fddb: 5a 5a 5a 5a 5a 5a 5a 5a 5a
5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
[ 7603.339632] Padding 0xffff88000008fdeb: 5a 5a 5a 5a 5a 5a 5a 5a 5a
5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
[ 7603.339645] Padding 0xffff88000008fdfb: 5a 5a 5a 5a 5a 00 5a 5a 5a
10 b0 08 3f 00 80 00 ZZZZZ.ZZZ.?.?...
[ 7603.339658] Padding 0xffff88000008fe0b: 00 c7 60 ed 3f 3f 00 10 df
ed 3f ff 07 10 c0 ed .?`???..????..??
[ 7603.339671] Padding 0xffff88000008fe1b: 3f fa 33 c9 33 d2 b8 3c fe
08 00 0f 01 c8 b8 31 ??3?3Ҹ<?....ȸ1
[ 7603.339684] Padding 0xffff88000008fe2b: 00 00 00 0f 01 c9 eb e9
.....???
[ 7603.339698] FIX radix_tree_node: Restoring
0xffff88000008fbeb-0xffff88000008fe32=0x5a
[ 7603.339699]
[ 7603.339791]
=============================================================================
[ 7603.339793] BUG radix_tree_node: Redzone overwritten
[ 7603.339795]
-----------------------------------------------------------------------------
[ 7603.339796]
[ 7603.339799] INFO: 0xffff88000008fd70-0xffff88000008fd77. First byte
0x5a instead of 0xcc
[ 7603.339805] INFO: Allocated in 0x5a5a5a5a5a5a5a5a
age=11936128522584921681 cpu=1515870810 pid=1515870810
[ 7603.339809] INFO: Freed in 0x5a5a5a5a5a5a5a5a
age=11936128522584921681 cpu=1515870810 pid=1515870810
[ 7603.339812] INFO: Slab 0xffffea0000001ea0 objects=25 used=1
fp=0xffff88000008f8c8 flags=0x4081
[ 7603.339815] INFO: Object 0xffff88000008fb40 @offset=15168
fp=0x5a5a5a5a5a5a5a5a
[ 7603.339816]
[ 7603.339818] Bytes b4 0xffff88000008fb30: ab 70 6f 00 01 00 00 00 5a
5a 5a 5a 5a 5a 5a 5a ?po.....ZZZZZZZZ
[ 7603.339832] Object 0xffff88000008fb40: 01 00 00 00 00 00 00 00 08
80 10 00 00 88 ff ff ..............??
[ 7603.339845] Object 0xffff88000008fb50: 47 63 1f 81 ff ff ff ff 00
00 00 00 00 00 00 00 Gc..????........
[ 7603.339857] Object 0xffff88000008fb60: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339870] Object 0xffff88000008fb70: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339883] Object 0xffff88000008fb80: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339896] Object 0xffff88000008fb90: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339908] Object 0xffff88000008fba0: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339921] Object 0xffff88000008fbb0: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339934] Object 0xffff88000008fbc0: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339946] Object 0xffff88000008fbd0: 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 ................
[ 7603.339959] Object 0xffff88000008fbe0: 00 00 00 00 00 00 00 00 00
00 00 5a 5a 5a 5a 5a ...........ZZZZZ
[ 7603.339972] Object 0xffff88000008fbf0: 5a 5a 5a 5a 5a 5a 5a 5a 5a
5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
[ 7603.339985] Object 0xffff88000008fc00: 5a 5a 5a 5a 5a 5a 5a 5a 5a
5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
[ 7603.339998] Object 0xffff88000008fc10: 5a 5a 5a 5a 5a 5a 5a 5a 5a
5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
[ 7603.340010] Object 0xffff88000008fc20: 5a 5a 5a 5a 5a 5a 5a 5a 5a
5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
[ 7603.340018] Object 0xffff88000008fc30: 5a 5a 5a 5a 5a 5a 5a 5a 5a
5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
[ 7603.340018] Object 0xffff88000008fc40: 5a 5a 5a 5a 5a 5a 5a 5a 5a
5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
[ 7603.340018] Object 0xffff88000008fc50: 5a 5a 5a 5a 5a 5a 5a 5a 5a
5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
[ 7603.340018] Object 0xffff88000008fc60: 5a 5a 5a 5a 5a 5a 5a 5a 5a
5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
[ 7603.340018] Object 0xffff88000008fc70: 5a 5a 5a 5a 5a 5a 5a 5a 5a
5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
[ 7603.340018] Object 0xffff88000008fc80: 5a 5a 5a 5a 5a 5a 5a 5a 5a
5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
[ 7603.340018] Object 0xffff88000008fc90: 5a 5a 5a 5a 5a 5a 5a 5a 5a
5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
[ 7603.340018] Object 0xffff88000008fca0: 5a 5a 5a 5a 5a 5a 5a 5a 5a
5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
[ 7603.340018] Object 0xffff88000008fcb0: 5a 5a 5a 5a 5a 5a 5a 5a 5a
5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
[ 7603.340018] Object 0xffff88000008fcc0: 5a 5a 5a 5a 5a 5a 5a 5a 5a
5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
[ 7603.340018] Object 0xffff88000008fcd0: 5a 5a 5a 5a 5a 5a 5a 5a 5a
5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
[ 7603.340018] Object 0xffff88000008fce0: 5a 5a 5a 5a 5a 5a 5a 5a 5a
5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
[ 7603.340018] Object 0xffff88000008fcf0: 5a 5a 5a 5a 5a 5a 5a 5a 5a
5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
[ 7603.340018] Object 0xffff88000008fd00: 5a 5a 5a 5a 5a 5a 5a 5a 5a
5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
[ 7603.340018] Object 0xffff88000008fd10: 5a 5a 5a 5a 5a 5a 5a 5a 5a
5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
[ 7603.340018] Object 0xffff88000008fd20: 5a 5a 5a 5a 5a 5a 5a 5a 5a
5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
[ 7603.340018] Object 0xffff88000008fd30: 5a 5a 5a 5a 5a 5a 5a 5a 5a
5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
[ 7603.340018] Object 0xffff88000008fd40: 5a 5a 5a 5a 5a 5a 5a 5a 5a
5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
[ 7603.340018] Object 0xffff88000008fd50: 5a 5a 5a 5a 5a 5a 5a 5a 5a
5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
[ 7603.340018] Object 0xffff88000008fd60: 5a 5a 5a 5a 5a 5a 5a 5a 5a
5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
[ 7603.340018] Redzone 0xffff88000008fd70: 5a 5a 5a 5a 5a 5a 5a 5a
ZZZZZZZZ
[ 7603.340018] Padding 0xffff88000008fdb0: 5a 5a 5a 5a 5a 5a 5a 5a
ZZZZZZZZ
[ 7603.340018] Pid: 0, comm: swapper Not tainted
2.6.38-rc7-00164-gcdf1389 #8
[ 7603.340018] Call Trace:
[ 7603.340018] <IRQ> [<ffffffff810f4f35>] ? print_trailer+0x12e/0x137
[ 7603.340018] [<ffffffff811f63cc>] ? __lookup_tag+0x39/0xf0
[ 7603.340018] [<ffffffff810f5463>] ? check_bytes_and_report+0xb5/0xe6
[ 7603.340018] [<ffffffff811f63cc>] ? __lookup_tag+0x39/0xf0
[ 7603.340018] [<ffffffff810f54dd>] ? check_object+0x49/0x1eb
[ 7603.340018] [<ffffffff811f6382>] ? radix_tree_node_rcu_free+0x3b/0x3d
[ 7603.340018] [<ffffffff810f5e4a>] ? free_debug_processing+0xce/0x208
[ 7603.340018] [<ffffffff810f60b4>] ? __slab_free+0x130/0x145
[ 7603.340018] [<ffffffff810f6a93>] ? kmem_cache_free+0x8e/0xd4
[ 7603.340018] [<ffffffff811f6382>] ? radix_tree_node_rcu_free+0x3b/0x3d
[ 7603.340018] [<ffffffff810a75c5>] ? __rcu_process_callbacks+0x186/0x28b
[ 7603.340018] [<ffffffff810a76ed>] ? rcu_process_callbacks+0x23/0x44
[ 7603.340018] [<ffffffff81067253>] ? __do_softirq+0xc7/0x1a4
[ 7603.340018] [<ffffffff8102fd79>] ? timer_interrupt+0x19/0x20
[ 7603.340018] [<ffffffff8102e15c>] ? call_softirq+0x1c/0x28
[ 7603.340018] [<ffffffff8102f635>] ? do_softirq+0x41/0x7e
[ 7603.340018] [<ffffffff810670ea>] ? irq_exit+0x36/0x78
[ 7603.340018] [<ffffffff8102ed0e>] ? do_IRQ+0x98/0xaf
[ 7603.340018] [<ffffffff81447253>] ? ret_from_intr+0x0/0x15
[ 7603.340018] <EOI> [<ffffffff810337d5>] ? native_sched_clock+0x2d/0x60
[ 7603.340018] [<ffffffffa001a661>] ? acpi_idle_enter_bm+0x2b9/0x2f1
[processor]
[ 7603.340018] [<ffffffffa001a65a>] ? acpi_idle_enter_bm+0x2b2/0x2f1
[processor]
[ 7603.340018] [<ffffffff81336a52>] ? menu_select+0x175/0x2a8
[ 7603.340018] [<ffffffff81335c3a>] ? cpuidle_idle_call+0x118/0x1be
[ 7603.340018] [<ffffffff8102c691>] ? cpu_idle+0x60/0x97
[ 7603.340018] [<ffffffff814308b4>] ? rest_init+0x68/0x6a
[ 7603.340018] [<ffffffff81705c3c>] ? start_kernel+0x2fc/0x307
[ 7603.340018] [<ffffffff8170527b>] ? x86_64_start_reservations+0x82/0x86
[ 7603.340018] [<ffffffff81705385>] ? x86_64_start_kernel+0x106/0x115
[ 7603.340018] FIX radix_tree_node: Restoring
0xffff88000008fd70-0xffff88000008fd77=0xcc
[ 7603.340018]
[ 7747.730540] cfg80211: Calling CRDA to update world regulatory domain
[ 7750.272336] wlan0: authenticate with 00:21:55:b4:20:20 (try 1)
[ 7750.275393] wlan0: authenticated


full dmesg here:
http://fpaste.org/aVFd/

Justin P. Mattock

2011-03-09 20:57:22

by David Rientjes

[permalink] [raw]
Subject: Re: <IRQ> [<ffffffff810c9204>] ? __alloc_pages_nodemask+0x622/0x696

On Tue, 8 Mar 2011, Justin P. Mattock wrote:

> man O man.. didnt have a chance to use the boot options yet due to other
> things I have been doing, anyways this popped up may/maynot be related:
>

Adding some people who have been working in this area recently to the cc.

> [ 7603.339047]
> =============================================================================
> [ 7603.339053] BUG radix_tree_node: Padding overwritten.
> 0xffff88000008fe00-0xffff88000008fe32
> [ 7603.339055]
> -----------------------------------------------------------------------------
> [ 7603.339056]
> [ 7603.339059] INFO: Slab 0xffffea0000001ea0 objects=25 used=25 fp=0x
> (null) flags=0x4081
> [ 7603.339063] Pid: 0, comm: swapper Not tainted 2.6.38-rc7-00164-gcdf1389 #8
> [ 7603.339066] Call Trace:
> [ 7603.339068] <IRQ> [<ffffffff810f4df9>] ? slab_err+0x8a/0x98
> [ 7603.339083] [<ffffffff81446ea2>] ? _raw_spin_unlock+0x9/0xb
> [ 7603.339088] [<ffffffff810c7904>] ? free_one_page+0x2d4/0x2e3
> [ 7603.339091] [<ffffffff810f52df>] ? slab_pad_check+0xc4/0x102
> [ 7603.339096] [<ffffffff811f6382>] ? radix_tree_node_rcu_free+0x3b/0x3d
> [ 7603.339099] [<ffffffff810f53a7>] ? check_slab+0x8a/0x91
> [ 7603.339102] [<ffffffff810f5d9e>] ? free_debug_processing+0x22/0x208
> [ 7603.339105] [<ffffffff810f60b4>] ? __slab_free+0x130/0x145
> [ 7603.339108] [<ffffffff810f6a93>] ? kmem_cache_free+0x8e/0xd4
> [ 7603.339112] [<ffffffff811f6382>] ? radix_tree_node_rcu_free+0x3b/0x3d
> [ 7603.339118] [<ffffffff810a75c5>] ? __rcu_process_callbacks+0x186/0x28b
> [ 7603.339121] [<ffffffff810a76ed>] ? rcu_process_callbacks+0x23/0x44
> [ 7603.339126] [<ffffffff81067253>] ? __do_softirq+0xc7/0x1a4
> [ 7603.339132] [<ffffffff8102fd79>] ? timer_interrupt+0x19/0x20
> [ 7603.339135] [<ffffffff8102e15c>] ? call_softirq+0x1c/0x28
> [ 7603.339139] [<ffffffff8102f635>] ? do_softirq+0x41/0x7e
> [ 7603.339142] [<ffffffff810670ea>] ? irq_exit+0x36/0x78
> [ 7603.339145] [<ffffffff8102ed0e>] ? do_IRQ+0x98/0xaf
> [ 7603.339148] [<ffffffff81447253>] ? ret_from_intr+0x0/0x15
> [ 7603.339150] <EOI> [<ffffffff810337d5>] ? native_sched_clock+0x2d/0x60
> [ 7603.339183] [<ffffffffa001a661>] ? acpi_idle_enter_bm+0x2b9/0x2f1
> [processor]
> [ 7603.339189] [<ffffffffa001a65a>] ? acpi_idle_enter_bm+0x2b2/0x2f1
> [processor]
> [ 7603.339195] [<ffffffff81336a52>] ? menu_select+0x175/0x2a8
> [ 7603.339198] [<ffffffff81335c3a>] ? cpuidle_idle_call+0x118/0x1be
> [ 7603.339202] [<ffffffff8102c691>] ? cpu_idle+0x60/0x97
> [ 7603.339206] [<ffffffff814308b4>] ? rest_init+0x68/0x6a
> [ 7603.339211] [<ffffffff81705c3c>] ? start_kernel+0x2fc/0x307
> [ 7603.339215] [<ffffffff8170527b>] ? x86_64_start_reservations+0x82/0x86
> [ 7603.339218] [<ffffffff81705385>] ? x86_64_start_kernel+0x106/0x115
> [ 7603.339221] Padding 0xffff88000008fbeb: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339234] Padding 0xffff88000008fbfb: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339247] Padding 0xffff88000008fc0b: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339260] Padding 0xffff88000008fc1b: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339273] Padding 0xffff88000008fc2b: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339285] Padding 0xffff88000008fc3b: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339298] Padding 0xffff88000008fc4b: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339311] Padding 0xffff88000008fc5b: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339324] Padding 0xffff88000008fc6b: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339337] Padding 0xffff88000008fc7b: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339349] Padding 0xffff88000008fc8b: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339362] Padding 0xffff88000008fc9b: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339375] Padding 0xffff88000008fcab: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339387] Padding 0xffff88000008fcbb: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339400] Padding 0xffff88000008fccb: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339413] Padding 0xffff88000008fcdb: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339426] Padding 0xffff88000008fceb: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339439] Padding 0xffff88000008fcfb: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339451] Padding 0xffff88000008fd0b: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339464] Padding 0xffff88000008fd1b: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339477] Padding 0xffff88000008fd2b: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339490] Padding 0xffff88000008fd3b: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339503] Padding 0xffff88000008fd4b: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339516] Padding 0xffff88000008fd5b: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339529] Padding 0xffff88000008fd6b: 00 00 00 00 00 cc cc cc cc cc cc
> cc cc 00 00 00 .....????????...
> [ 7603.339542] Padding 0xffff88000008fd7b: 00 00 00 00 00 29 6e 1f 81 ff ff
> ff ff 00 00 00 .....)n..????...
> [ 7603.339555] Padding 0xffff88000008fd8b: 00 c2 0a 00 00 44 ec 0a 00 01 00
> 00 00 00 00 00 .?...D?.........
> [ 7603.339568] Padding 0xffff88000008fd9b: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339581] Padding 0xffff88000008fdab: 00 00 00 00 00 5a 5a 5a 5a 5a 5a
> 5a 5a 5a 5a 5a .....ZZZZZZZZZZZ
> [ 7603.339593] Padding 0xffff88000008fdbb: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
> [ 7603.339606] Padding 0xffff88000008fdcb: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
> [ 7603.339619] Padding 0xffff88000008fddb: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
> [ 7603.339632] Padding 0xffff88000008fdeb: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
> [ 7603.339645] Padding 0xffff88000008fdfb: 5a 5a 5a 5a 5a 00 5a 5a 5a 10 b0
> 08 3f 00 80 00 ZZZZZ.ZZZ.?.?...
> [ 7603.339658] Padding 0xffff88000008fe0b: 00 c7 60 ed 3f 3f 00 10 df ed 3f
> ff 07 10 c0 ed .?`???..????..??
> [ 7603.339671] Padding 0xffff88000008fe1b: 3f fa 33 c9 33 d2 b8 3c fe 08 00
> 0f 01 c8 b8 31 ??3?3Ҹ<?....ȸ1
> [ 7603.339684] Padding 0xffff88000008fe2b: 00 00 00 0f 01 c9 eb e9
> .....???
> [ 7603.339698] FIX radix_tree_node: Restoring
> 0xffff88000008fbeb-0xffff88000008fe32=0x5a
> [ 7603.339699]
> [ 7603.339791]
> =============================================================================
> [ 7603.339793] BUG radix_tree_node: Redzone overwritten
> [ 7603.339795]
> -----------------------------------------------------------------------------
> [ 7603.339796]
> [ 7603.339799] INFO: 0xffff88000008fd70-0xffff88000008fd77. First byte 0x5a
> instead of 0xcc
> [ 7603.339805] INFO: Allocated in 0x5a5a5a5a5a5a5a5a age=11936128522584921681
> cpu=1515870810 pid=1515870810
> [ 7603.339809] INFO: Freed in 0x5a5a5a5a5a5a5a5a age=11936128522584921681
> cpu=1515870810 pid=1515870810
> [ 7603.339812] INFO: Slab 0xffffea0000001ea0 objects=25 used=1
> fp=0xffff88000008f8c8 flags=0x4081
> [ 7603.339815] INFO: Object 0xffff88000008fb40 @offset=15168
> fp=0x5a5a5a5a5a5a5a5a
> [ 7603.339816]
> [ 7603.339818] Bytes b4 0xffff88000008fb30: ab 70 6f 00 01 00 00 00 5a 5a 5a
> 5a 5a 5a 5a 5a ?po.....ZZZZZZZZ
> [ 7603.339832] Object 0xffff88000008fb40: 01 00 00 00 00 00 00 00 08 80 10
> 00 00 88 ff ff ..............??
> [ 7603.339845] Object 0xffff88000008fb50: 47 63 1f 81 ff ff ff ff 00 00 00
> 00 00 00 00 00 Gc..????........
> [ 7603.339857] Object 0xffff88000008fb60: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339870] Object 0xffff88000008fb70: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339883] Object 0xffff88000008fb80: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339896] Object 0xffff88000008fb90: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339908] Object 0xffff88000008fba0: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339921] Object 0xffff88000008fbb0: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339934] Object 0xffff88000008fbc0: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339946] Object 0xffff88000008fbd0: 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 ................
> [ 7603.339959] Object 0xffff88000008fbe0: 00 00 00 00 00 00 00 00 00 00 00
> 5a 5a 5a 5a 5a ...........ZZZZZ
> [ 7603.339972] Object 0xffff88000008fbf0: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
> [ 7603.339985] Object 0xffff88000008fc00: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
> [ 7603.339998] Object 0xffff88000008fc10: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
> [ 7603.340010] Object 0xffff88000008fc20: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
> [ 7603.340018] Object 0xffff88000008fc30: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
> [ 7603.340018] Object 0xffff88000008fc40: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
> [ 7603.340018] Object 0xffff88000008fc50: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
> [ 7603.340018] Object 0xffff88000008fc60: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
> [ 7603.340018] Object 0xffff88000008fc70: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
> [ 7603.340018] Object 0xffff88000008fc80: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
> [ 7603.340018] Object 0xffff88000008fc90: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
> [ 7603.340018] Object 0xffff88000008fca0: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
> [ 7603.340018] Object 0xffff88000008fcb0: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
> [ 7603.340018] Object 0xffff88000008fcc0: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
> [ 7603.340018] Object 0xffff88000008fcd0: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
> [ 7603.340018] Object 0xffff88000008fce0: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
> [ 7603.340018] Object 0xffff88000008fcf0: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
> [ 7603.340018] Object 0xffff88000008fd00: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
> [ 7603.340018] Object 0xffff88000008fd10: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
> [ 7603.340018] Object 0xffff88000008fd20: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
> [ 7603.340018] Object 0xffff88000008fd30: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
> [ 7603.340018] Object 0xffff88000008fd40: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
> [ 7603.340018] Object 0xffff88000008fd50: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
> [ 7603.340018] Object 0xffff88000008fd60: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
> [ 7603.340018] Redzone 0xffff88000008fd70: 5a 5a 5a 5a 5a 5a 5a 5a
> ZZZZZZZZ
> [ 7603.340018] Padding 0xffff88000008fdb0: 5a 5a 5a 5a 5a 5a 5a 5a
> ZZZZZZZZ
> [ 7603.340018] Pid: 0, comm: swapper Not tainted 2.6.38-rc7-00164-gcdf1389 #8
> [ 7603.340018] Call Trace:
> [ 7603.340018] <IRQ> [<ffffffff810f4f35>] ? print_trailer+0x12e/0x137
> [ 7603.340018] [<ffffffff811f63cc>] ? __lookup_tag+0x39/0xf0
> [ 7603.340018] [<ffffffff810f5463>] ? check_bytes_and_report+0xb5/0xe6
> [ 7603.340018] [<ffffffff811f63cc>] ? __lookup_tag+0x39/0xf0
> [ 7603.340018] [<ffffffff810f54dd>] ? check_object+0x49/0x1eb
> [ 7603.340018] [<ffffffff811f6382>] ? radix_tree_node_rcu_free+0x3b/0x3d
> [ 7603.340018] [<ffffffff810f5e4a>] ? free_debug_processing+0xce/0x208
> [ 7603.340018] [<ffffffff810f60b4>] ? __slab_free+0x130/0x145
> [ 7603.340018] [<ffffffff810f6a93>] ? kmem_cache_free+0x8e/0xd4
> [ 7603.340018] [<ffffffff811f6382>] ? radix_tree_node_rcu_free+0x3b/0x3d
> [ 7603.340018] [<ffffffff810a75c5>] ? __rcu_process_callbacks+0x186/0x28b
> [ 7603.340018] [<ffffffff810a76ed>] ? rcu_process_callbacks+0x23/0x44
> [ 7603.340018] [<ffffffff81067253>] ? __do_softirq+0xc7/0x1a4
> [ 7603.340018] [<ffffffff8102fd79>] ? timer_interrupt+0x19/0x20
> [ 7603.340018] [<ffffffff8102e15c>] ? call_softirq+0x1c/0x28
> [ 7603.340018] [<ffffffff8102f635>] ? do_softirq+0x41/0x7e
> [ 7603.340018] [<ffffffff810670ea>] ? irq_exit+0x36/0x78
> [ 7603.340018] [<ffffffff8102ed0e>] ? do_IRQ+0x98/0xaf
> [ 7603.340018] [<ffffffff81447253>] ? ret_from_intr+0x0/0x15
> [ 7603.340018] <EOI> [<ffffffff810337d5>] ? native_sched_clock+0x2d/0x60
> [ 7603.340018] [<ffffffffa001a661>] ? acpi_idle_enter_bm+0x2b9/0x2f1
> [processor]
> [ 7603.340018] [<ffffffffa001a65a>] ? acpi_idle_enter_bm+0x2b2/0x2f1
> [processor]
> [ 7603.340018] [<ffffffff81336a52>] ? menu_select+0x175/0x2a8
> [ 7603.340018] [<ffffffff81335c3a>] ? cpuidle_idle_call+0x118/0x1be
> [ 7603.340018] [<ffffffff8102c691>] ? cpu_idle+0x60/0x97
> [ 7603.340018] [<ffffffff814308b4>] ? rest_init+0x68/0x6a
> [ 7603.340018] [<ffffffff81705c3c>] ? start_kernel+0x2fc/0x307
> [ 7603.340018] [<ffffffff8170527b>] ? x86_64_start_reservations+0x82/0x86
> [ 7603.340018] [<ffffffff81705385>] ? x86_64_start_kernel+0x106/0x115
> [ 7603.340018] FIX radix_tree_node: Restoring
> 0xffff88000008fd70-0xffff88000008fd77=0xcc
> [ 7603.340018]
> [ 7747.730540] cfg80211: Calling CRDA to update world regulatory domain
> [ 7750.272336] wlan0: authenticate with 00:21:55:b4:20:20 (try 1)
> [ 7750.275393] wlan0: authenticated

2011-03-09 21:18:55

by Justin P. Mattock

[permalink] [raw]
Subject: Re: <IRQ> [<ffffffff810c9204>] ? __alloc_pages_nodemask+0x622/0x696

On 03/09/2011 12:57 PM, David Rientjes wrote:
> On Tue, 8 Mar 2011, Justin P. Mattock wrote:
>
>> man O man.. didnt have a chance to use the boot options yet due to other
>> things I have been doing, anyways this popped up may/maynot be related:
>>
>
> Adding some people who have been working in this area recently to the cc.

cool thanks!! I will keep my eye out for this, as well as the other.

>
>> [ 7603.339047]
>> =============================================================================
>> [ 7603.339053] BUG radix_tree_node: Padding overwritten.
>> 0xffff88000008fe00-0xffff88000008fe32
>> [ 7603.339055]
>> -----------------------------------------------------------------------------
>> [ 7603.339056]
>> [ 7603.339059] INFO: Slab 0xffffea0000001ea0 objects=25 used=25 fp=0x
>> (null) flags=0x4081
>> [ 7603.339063] Pid: 0, comm: swapper Not tainted 2.6.38-rc7-00164-gcdf1389 #8
>> [ 7603.339066] Call Trace:
>> [ 7603.339068]<IRQ> [<ffffffff810f4df9>] ? slab_err+0x8a/0x98
>> [ 7603.339083] [<ffffffff81446ea2>] ? _raw_spin_unlock+0x9/0xb
>> [ 7603.339088] [<ffffffff810c7904>] ? free_one_page+0x2d4/0x2e3
>> [ 7603.339091] [<ffffffff810f52df>] ? slab_pad_check+0xc4/0x102
>> [ 7603.339096] [<ffffffff811f6382>] ? radix_tree_node_rcu_free+0x3b/0x3d
>> [ 7603.339099] [<ffffffff810f53a7>] ? check_slab+0x8a/0x91
>> [ 7603.339102] [<ffffffff810f5d9e>] ? free_debug_processing+0x22/0x208
>> [ 7603.339105] [<ffffffff810f60b4>] ? __slab_free+0x130/0x145
>> [ 7603.339108] [<ffffffff810f6a93>] ? kmem_cache_free+0x8e/0xd4
>> [ 7603.339112] [<ffffffff811f6382>] ? radix_tree_node_rcu_free+0x3b/0x3d
>> [ 7603.339118] [<ffffffff810a75c5>] ? __rcu_process_callbacks+0x186/0x28b
>> [ 7603.339121] [<ffffffff810a76ed>] ? rcu_process_callbacks+0x23/0x44
>> [ 7603.339126] [<ffffffff81067253>] ? __do_softirq+0xc7/0x1a4
>> [ 7603.339132] [<ffffffff8102fd79>] ? timer_interrupt+0x19/0x20
>> [ 7603.339135] [<ffffffff8102e15c>] ? call_softirq+0x1c/0x28
>> [ 7603.339139] [<ffffffff8102f635>] ? do_softirq+0x41/0x7e
>> [ 7603.339142] [<ffffffff810670ea>] ? irq_exit+0x36/0x78
>> [ 7603.339145] [<ffffffff8102ed0e>] ? do_IRQ+0x98/0xaf
>> [ 7603.339148] [<ffffffff81447253>] ? ret_from_intr+0x0/0x15
>> [ 7603.339150]<EOI> [<ffffffff810337d5>] ? native_sched_clock+0x2d/0x60
>> [ 7603.339183] [<ffffffffa001a661>] ? acpi_idle_enter_bm+0x2b9/0x2f1
>> [processor]
>> [ 7603.339189] [<ffffffffa001a65a>] ? acpi_idle_enter_bm+0x2b2/0x2f1
>> [processor]
>> [ 7603.339195] [<ffffffff81336a52>] ? menu_select+0x175/0x2a8
>> [ 7603.339198] [<ffffffff81335c3a>] ? cpuidle_idle_call+0x118/0x1be
>> [ 7603.339202] [<ffffffff8102c691>] ? cpu_idle+0x60/0x97
>> [ 7603.339206] [<ffffffff814308b4>] ? rest_init+0x68/0x6a
>> [ 7603.339211] [<ffffffff81705c3c>] ? start_kernel+0x2fc/0x307
>> [ 7603.339215] [<ffffffff8170527b>] ? x86_64_start_reservations+0x82/0x86
>> [ 7603.339218] [<ffffffff81705385>] ? x86_64_start_kernel+0x106/0x115
>> [ 7603.339221] Padding 0xffff88000008fbeb: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339234] Padding 0xffff88000008fbfb: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339247] Padding 0xffff88000008fc0b: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339260] Padding 0xffff88000008fc1b: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339273] Padding 0xffff88000008fc2b: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339285] Padding 0xffff88000008fc3b: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339298] Padding 0xffff88000008fc4b: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339311] Padding 0xffff88000008fc5b: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339324] Padding 0xffff88000008fc6b: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339337] Padding 0xffff88000008fc7b: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339349] Padding 0xffff88000008fc8b: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339362] Padding 0xffff88000008fc9b: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339375] Padding 0xffff88000008fcab: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339387] Padding 0xffff88000008fcbb: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339400] Padding 0xffff88000008fccb: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339413] Padding 0xffff88000008fcdb: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339426] Padding 0xffff88000008fceb: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339439] Padding 0xffff88000008fcfb: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339451] Padding 0xffff88000008fd0b: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339464] Padding 0xffff88000008fd1b: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339477] Padding 0xffff88000008fd2b: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339490] Padding 0xffff88000008fd3b: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339503] Padding 0xffff88000008fd4b: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339516] Padding 0xffff88000008fd5b: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339529] Padding 0xffff88000008fd6b: 00 00 00 00 00 cc cc cc cc cc cc
>> cc cc 00 00 00 .....????????...
>> [ 7603.339542] Padding 0xffff88000008fd7b: 00 00 00 00 00 29 6e 1f 81 ff ff
>> ff ff 00 00 00 .....)n..????...
>> [ 7603.339555] Padding 0xffff88000008fd8b: 00 c2 0a 00 00 44 ec 0a 00 01 00
>> 00 00 00 00 00 .?...D?.........
>> [ 7603.339568] Padding 0xffff88000008fd9b: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339581] Padding 0xffff88000008fdab: 00 00 00 00 00 5a 5a 5a 5a 5a 5a
>> 5a 5a 5a 5a 5a .....ZZZZZZZZZZZ
>> [ 7603.339593] Padding 0xffff88000008fdbb: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
>> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
>> [ 7603.339606] Padding 0xffff88000008fdcb: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
>> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
>> [ 7603.339619] Padding 0xffff88000008fddb: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
>> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
>> [ 7603.339632] Padding 0xffff88000008fdeb: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
>> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
>> [ 7603.339645] Padding 0xffff88000008fdfb: 5a 5a 5a 5a 5a 00 5a 5a 5a 10 b0
>> 08 3f 00 80 00 ZZZZZ.ZZZ.?.?...
>> [ 7603.339658] Padding 0xffff88000008fe0b: 00 c7 60 ed 3f 3f 00 10 df ed 3f
>> ff 07 10 c0 ed .?`???..????..??
>> [ 7603.339671] Padding 0xffff88000008fe1b: 3f fa 33 c9 33 d2 b8 3c fe 08 00
>> 0f 01 c8 b8 31 ??3?3Ҹ<?....ȸ1
>> [ 7603.339684] Padding 0xffff88000008fe2b: 00 00 00 0f 01 c9 eb e9
>> .....???
>> [ 7603.339698] FIX radix_tree_node: Restoring
>> 0xffff88000008fbeb-0xffff88000008fe32=0x5a
>> [ 7603.339699]
>> [ 7603.339791]
>> =============================================================================
>> [ 7603.339793] BUG radix_tree_node: Redzone overwritten
>> [ 7603.339795]
>> -----------------------------------------------------------------------------
>> [ 7603.339796]
>> [ 7603.339799] INFO: 0xffff88000008fd70-0xffff88000008fd77. First byte 0x5a
>> instead of 0xcc
>> [ 7603.339805] INFO: Allocated in 0x5a5a5a5a5a5a5a5a age=11936128522584921681
>> cpu=1515870810 pid=1515870810
>> [ 7603.339809] INFO: Freed in 0x5a5a5a5a5a5a5a5a age=11936128522584921681
>> cpu=1515870810 pid=1515870810
>> [ 7603.339812] INFO: Slab 0xffffea0000001ea0 objects=25 used=1
>> fp=0xffff88000008f8c8 flags=0x4081
>> [ 7603.339815] INFO: Object 0xffff88000008fb40 @offset=15168
>> fp=0x5a5a5a5a5a5a5a5a
>> [ 7603.339816]
>> [ 7603.339818] Bytes b4 0xffff88000008fb30: ab 70 6f 00 01 00 00 00 5a 5a 5a
>> 5a 5a 5a 5a 5a ?po.....ZZZZZZZZ
>> [ 7603.339832] Object 0xffff88000008fb40: 01 00 00 00 00 00 00 00 08 80 10
>> 00 00 88 ff ff ..............??
>> [ 7603.339845] Object 0xffff88000008fb50: 47 63 1f 81 ff ff ff ff 00 00 00
>> 00 00 00 00 00 Gc..????........
>> [ 7603.339857] Object 0xffff88000008fb60: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339870] Object 0xffff88000008fb70: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339883] Object 0xffff88000008fb80: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339896] Object 0xffff88000008fb90: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339908] Object 0xffff88000008fba0: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339921] Object 0xffff88000008fbb0: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339934] Object 0xffff88000008fbc0: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339946] Object 0xffff88000008fbd0: 00 00 00 00 00 00 00 00 00 00 00
>> 00 00 00 00 00 ................
>> [ 7603.339959] Object 0xffff88000008fbe0: 00 00 00 00 00 00 00 00 00 00 00
>> 5a 5a 5a 5a 5a ...........ZZZZZ
>> [ 7603.339972] Object 0xffff88000008fbf0: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
>> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
>> [ 7603.339985] Object 0xffff88000008fc00: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
>> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
>> [ 7603.339998] Object 0xffff88000008fc10: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
>> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
>> [ 7603.340010] Object 0xffff88000008fc20: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
>> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
>> [ 7603.340018] Object 0xffff88000008fc30: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
>> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
>> [ 7603.340018] Object 0xffff88000008fc40: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
>> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
>> [ 7603.340018] Object 0xffff88000008fc50: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
>> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
>> [ 7603.340018] Object 0xffff88000008fc60: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
>> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
>> [ 7603.340018] Object 0xffff88000008fc70: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
>> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
>> [ 7603.340018] Object 0xffff88000008fc80: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
>> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
>> [ 7603.340018] Object 0xffff88000008fc90: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
>> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
>> [ 7603.340018] Object 0xffff88000008fca0: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
>> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
>> [ 7603.340018] Object 0xffff88000008fcb0: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
>> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
>> [ 7603.340018] Object 0xffff88000008fcc0: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
>> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
>> [ 7603.340018] Object 0xffff88000008fcd0: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
>> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
>> [ 7603.340018] Object 0xffff88000008fce0: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
>> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
>> [ 7603.340018] Object 0xffff88000008fcf0: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
>> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
>> [ 7603.340018] Object 0xffff88000008fd00: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
>> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
>> [ 7603.340018] Object 0xffff88000008fd10: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
>> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
>> [ 7603.340018] Object 0xffff88000008fd20: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
>> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
>> [ 7603.340018] Object 0xffff88000008fd30: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
>> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
>> [ 7603.340018] Object 0xffff88000008fd40: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
>> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
>> [ 7603.340018] Object 0xffff88000008fd50: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
>> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
>> [ 7603.340018] Object 0xffff88000008fd60: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a
>> 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
>> [ 7603.340018] Redzone 0xffff88000008fd70: 5a 5a 5a 5a 5a 5a 5a 5a
>> ZZZZZZZZ
>> [ 7603.340018] Padding 0xffff88000008fdb0: 5a 5a 5a 5a 5a 5a 5a 5a
>> ZZZZZZZZ
>> [ 7603.340018] Pid: 0, comm: swapper Not tainted 2.6.38-rc7-00164-gcdf1389 #8
>> [ 7603.340018] Call Trace:
>> [ 7603.340018]<IRQ> [<ffffffff810f4f35>] ? print_trailer+0x12e/0x137
>> [ 7603.340018] [<ffffffff811f63cc>] ? __lookup_tag+0x39/0xf0
>> [ 7603.340018] [<ffffffff810f5463>] ? check_bytes_and_report+0xb5/0xe6
>> [ 7603.340018] [<ffffffff811f63cc>] ? __lookup_tag+0x39/0xf0
>> [ 7603.340018] [<ffffffff810f54dd>] ? check_object+0x49/0x1eb
>> [ 7603.340018] [<ffffffff811f6382>] ? radix_tree_node_rcu_free+0x3b/0x3d
>> [ 7603.340018] [<ffffffff810f5e4a>] ? free_debug_processing+0xce/0x208
>> [ 7603.340018] [<ffffffff810f60b4>] ? __slab_free+0x130/0x145
>> [ 7603.340018] [<ffffffff810f6a93>] ? kmem_cache_free+0x8e/0xd4
>> [ 7603.340018] [<ffffffff811f6382>] ? radix_tree_node_rcu_free+0x3b/0x3d
>> [ 7603.340018] [<ffffffff810a75c5>] ? __rcu_process_callbacks+0x186/0x28b
>> [ 7603.340018] [<ffffffff810a76ed>] ? rcu_process_callbacks+0x23/0x44
>> [ 7603.340018] [<ffffffff81067253>] ? __do_softirq+0xc7/0x1a4
>> [ 7603.340018] [<ffffffff8102fd79>] ? timer_interrupt+0x19/0x20
>> [ 7603.340018] [<ffffffff8102e15c>] ? call_softirq+0x1c/0x28
>> [ 7603.340018] [<ffffffff8102f635>] ? do_softirq+0x41/0x7e
>> [ 7603.340018] [<ffffffff810670ea>] ? irq_exit+0x36/0x78
>> [ 7603.340018] [<ffffffff8102ed0e>] ? do_IRQ+0x98/0xaf
>> [ 7603.340018] [<ffffffff81447253>] ? ret_from_intr+0x0/0x15
>> [ 7603.340018]<EOI> [<ffffffff810337d5>] ? native_sched_clock+0x2d/0x60
>> [ 7603.340018] [<ffffffffa001a661>] ? acpi_idle_enter_bm+0x2b9/0x2f1
>> [processor]
>> [ 7603.340018] [<ffffffffa001a65a>] ? acpi_idle_enter_bm+0x2b2/0x2f1
>> [processor]
>> [ 7603.340018] [<ffffffff81336a52>] ? menu_select+0x175/0x2a8
>> [ 7603.340018] [<ffffffff81335c3a>] ? cpuidle_idle_call+0x118/0x1be
>> [ 7603.340018] [<ffffffff8102c691>] ? cpu_idle+0x60/0x97
>> [ 7603.340018] [<ffffffff814308b4>] ? rest_init+0x68/0x6a
>> [ 7603.340018] [<ffffffff81705c3c>] ? start_kernel+0x2fc/0x307
>> [ 7603.340018] [<ffffffff8170527b>] ? x86_64_start_reservations+0x82/0x86
>> [ 7603.340018] [<ffffffff81705385>] ? x86_64_start_kernel+0x106/0x115
>> [ 7603.340018] FIX radix_tree_node: Restoring
>> 0xffff88000008fd70-0xffff88000008fd77=0xcc
>> [ 7603.340018]
>> [ 7747.730540] cfg80211: Calling CRDA to update world regulatory domain
>> [ 7750.272336] wlan0: authenticate with 00:21:55:b4:20:20 (try 1)
>> [ 7750.275393] wlan0: authenticated

Subject: Re: <IRQ> [<ffffffff810c9204>] ? __alloc_pages_nodemask+0x622/0x696

Some more things from the syslog that may be of relevance. System went
through multiple suspend and resume cycles.

Before the failure we have a wlan authentication and the ATH driver throws a fit.

[ 7339.673270] ll header: ff:ff:ff:ff:ff:ff:00:90:fb:1c:4f:5c:08:00
[ 7340.076865] FIREWALL:INPUT IN=wlan0 OUT= MAC=00:19:e3:06:2c:16:00:90:fb:1c:4f:5c:08:00 SRC=192.168.5.1
DST=192.168.5.11 LEN=48 TOS=0x00 PREC=0x00 TTL=64 ID=0 DF PROTO=ICMP TYPE=8 CODE=0 ID=251 SEQ=0
[ 7416.743752] cfg80211: Calling CRDA to update world regulatory domain
[ 7419.292521] wlan0: authenticate with 00:21:55:b4:20:20 (try 1)
[ 7419.312690] wlan0: authenticated
[ 7419.318325] wlan0: associate with 00:21:55:b4:20:20 (try 1)
[ 7419.322764] wlan0: RX AssocResp from 00:21:55:b4:20:20 (capab=0x401 status=0 aid=218)
[ 7419.322770] wlan0: associated
[ 7427.161366] ath: Failed to stop TX DMA in 100 msec after killing last frame
[ 7427.161432] ath: Failed to stop TX DMA!
[ 7434.492398] ath: Failed to stop TX DMA in 100 msec after killing last frame
[ 7434.492462] ath: Failed to stop TX DMA!
[ 7603.339047]
=============================================================================
[ 7603.339053] BUG radix_tree_node: Padding overwritten. 0xffff88000008fe00-0xffff88000008fe32
[ 7603.339055]
-----------------------------------------------------------------------------
[ 7603.339056]


Could the ath driver corrupt memory if the TX DMA cannot be stopped?

Maybe fix the driver first?

2011-03-10 00:05:52

by Bob Copeland

[permalink] [raw]
Subject: Re: <IRQ> [<ffffffff810c9204>] ? __alloc_pages_nodemask+0x622/0x696

On Wed, Mar 09, 2011 at 03:54:24PM -0600, Christoph Lameter wrote:
> [ 7419.322770] wlan0: associated
> [ 7427.161366] ath: Failed to stop TX DMA in 100 msec after killing last frame
> [ 7427.161432] ath: Failed to stop TX DMA!
> [ 7434.492398] ath: Failed to stop TX DMA in 100 msec after killing last frame
> [ 7434.492462] ath: Failed to stop TX DMA!
> [ 7603.339047]
> =============================================================================
> [ 7603.339053] BUG radix_tree_node: Padding overwritten. 0xffff88000008fe00-0xffff88000008fe32

> Could the ath driver corrupt memory if the TX DMA cannot be stopped?

Looks like ath_draintxq() can do something bad (e.g. DMA engine uses
an old address from ath_tx_return_buffer()) if DMA is still active
in ath_drain_all_txq().

But this is ath9k which I'm not so familiar with, maybe Luis can say.

--
Bob Copeland %% http://www.bobcopeland.com

2011-03-15 20:59:50

by Luis R. Rodriguez

[permalink] [raw]
Subject: Re: <IRQ> [<ffffffff810c9204>] ? __alloc_pages_nodemask+0x622/0x696

On Wed, Mar 09, 2011 at 04:05:02PM -0800, Bob Copeland wrote:
> On Wed, Mar 09, 2011 at 03:54:24PM -0600, Christoph Lameter wrote:
> > [ 7419.322770] wlan0: associated
> > [ 7427.161366] ath: Failed to stop TX DMA in 100 msec after killing last frame
> > [ 7427.161432] ath: Failed to stop TX DMA!
> > [ 7434.492398] ath: Failed to stop TX DMA in 100 msec after killing last frame
> > [ 7434.492462] ath: Failed to stop TX DMA!
> > [ 7603.339047]
> > =============================================================================
> > [ 7603.339053] BUG radix_tree_node: Padding overwritten. 0xffff88000008fe00-0xffff88000008fe32
>
> > Could the ath driver corrupt memory if the TX DMA cannot be stopped?

Yes, this is why we have had a series of patches to address this upstream,
the latest one was for RX DMA failing to stop but Felix found a fix for that.
Apart from that I am not aware of more issues. Can you please try with
wireless-testing.git ?

Luis

2011-03-15 21:29:03

by Justin P. Mattock

[permalink] [raw]
Subject: Re: <IRQ> [<ffffffff810c9204>] ? __alloc_pages_nodemask+0x622/0x696

On 03/15/2011 01:59 PM, Luis R. Rodriguez wrote:
> On Wed, Mar 09, 2011 at 04:05:02PM -0800, Bob Copeland wrote:
>> On Wed, Mar 09, 2011 at 03:54:24PM -0600, Christoph Lameter wrote:
>>> [ 7419.322770] wlan0: associated
>>> [ 7427.161366] ath: Failed to stop TX DMA in 100 msec after killing last frame
>>> [ 7427.161432] ath: Failed to stop TX DMA!
>>> [ 7434.492398] ath: Failed to stop TX DMA in 100 msec after killing last frame
>>> [ 7434.492462] ath: Failed to stop TX DMA!
>>> [ 7603.339047]
>>> =============================================================================
>>> [ 7603.339053] BUG radix_tree_node: Padding overwritten. 0xffff88000008fe00-0xffff88000008fe32
>>
>>> Could the ath driver corrupt memory if the TX DMA cannot be stopped?
>
> Yes, this is why we have had a series of patches to address this upstream,
> the latest one was for RX DMA failing to stop but Felix found a fix for that.
> Apart from that I am not aware of more issues. Can you please try with
> wireless-testing.git ?
>
> Luis
> --
> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> the body of a message to [email protected]
> More majordomo info at http://vger.kernel.org/majordomo-info.html
> Please read the FAQ at http://www.tux.org/lkml/
>
sure..

as for seeing this issue. nothing really now on the current. only
message I see is:

[ 69.551295] ath: Failed to stop TX DMA in 100 msec after killing last
frame
[ 69.551336] ath: Failed to stop TX DMA!

which I saw earlier today.. keep in mind I am at the book store so the
internet is constantly connecting/disconnecting

Justin P. Mattock

2011-03-15 22:13:19

by Luis R. Rodriguez

[permalink] [raw]
Subject: Re: <IRQ> [<ffffffff810c9204>] ? __alloc_pages_nodemask+0x622/0x696

On Tue, Mar 15, 2011 at 02:28:52PM -0700, Justin P. Mattock wrote:
> On 03/15/2011 01:59 PM, Luis R. Rodriguez wrote:
> > On Wed, Mar 09, 2011 at 04:05:02PM -0800, Bob Copeland wrote:
> >> On Wed, Mar 09, 2011 at 03:54:24PM -0600, Christoph Lameter wrote:
> >>> [ 7419.322770] wlan0: associated
> >>> [ 7427.161366] ath: Failed to stop TX DMA in 100 msec after killing last frame
> >>> [ 7427.161432] ath: Failed to stop TX DMA!
> >>> [ 7434.492398] ath: Failed to stop TX DMA in 100 msec after killing last frame
> >>> [ 7434.492462] ath: Failed to stop TX DMA!
> >>> [ 7603.339047]
> >>> =============================================================================
> >>> [ 7603.339053] BUG radix_tree_node: Padding overwritten. 0xffff88000008fe00-0xffff88000008fe32
> >>
> >>> Could the ath driver corrupt memory if the TX DMA cannot be stopped?
> >
> > Yes, this is why we have had a series of patches to address this upstream,
> > the latest one was for RX DMA failing to stop but Felix found a fix for that.
> > Apart from that I am not aware of more issues. Can you please try with
> > wireless-testing.git ?
> >
> > Luis
> > --
> > To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> > the body of a message to [email protected]
> > More majordomo info at http://vger.kernel.org/majordomo-info.html
> > Please read the FAQ at http://www.tux.org/lkml/
> >
> sure..
>
> as for seeing this issue. nothing really now on the current. only
> message I see is:
>
> [ 69.551295] ath: Failed to stop TX DMA in 100 msec after killing last
> frame
> [ 69.551336] ath: Failed to stop TX DMA!

Can you easily reproduce?

Luis

2011-03-15 23:56:57

by Justin P. Mattock

[permalink] [raw]
Subject: Re: <IRQ> [<ffffffff810c9204>] ? __alloc_pages_nodemask+0x622/0x696

On 03/15/2011 03:13 PM, Luis R. Rodriguez wrote:
> On Tue, Mar 15, 2011 at 02:28:52PM -0700, Justin P. Mattock wrote:
>> On 03/15/2011 01:59 PM, Luis R. Rodriguez wrote:
>>> On Wed, Mar 09, 2011 at 04:05:02PM -0800, Bob Copeland wrote:
>>>> On Wed, Mar 09, 2011 at 03:54:24PM -0600, Christoph Lameter wrote:
>>>>> [ 7419.322770] wlan0: associated
>>>>> [ 7427.161366] ath: Failed to stop TX DMA in 100 msec after killing last frame
>>>>> [ 7427.161432] ath: Failed to stop TX DMA!
>>>>> [ 7434.492398] ath: Failed to stop TX DMA in 100 msec after killing last frame
>>>>> [ 7434.492462] ath: Failed to stop TX DMA!
>>>>> [ 7603.339047]
>>>>> =============================================================================
>>>>> [ 7603.339053] BUG radix_tree_node: Padding overwritten. 0xffff88000008fe00-0xffff88000008fe32
>>>>
>>>>> Could the ath driver corrupt memory if the TX DMA cannot be stopped?
>>>
>>> Yes, this is why we have had a series of patches to address this upstream,
>>> the latest one was for RX DMA failing to stop but Felix found a fix for that.
>>> Apart from that I am not aware of more issues. Can you please try with
>>> wireless-testing.git ?
>>>
>>> Luis
>>> --
>>> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
>>> the body of a message to [email protected]
>>> More majordomo info at http://vger.kernel.org/majordomo-info.html
>>> Please read the FAQ at http://www.tux.org/lkml/
>>>
>> sure..
>>
>> as for seeing this issue. nothing really now on the current. only
>> message I see is:
>>
>> [ 69.551295] ath: Failed to stop TX DMA in 100 msec after killing last
>> frame
>> [ 69.551336] ath: Failed to stop TX DMA!
>
> Can you easily reproduce?
>
> Luis
>

at this point I have seen this a few times now. but as for reproducing I
can try and see.(cloning the wireless tree and loading it up)

Justin P. Mattock