Return-Path: <linux-kernel-owner+w=401wt.eu-S1756563AbZLXG76@vger.kernel.org>
Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand
	id S1756563AbZLXG76 (ORCPT <rfc822;w@1wt.eu>);
	Thu, 24 Dec 2009 01:59:58 -0500
Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1754717AbZLXG75
	(ORCPT <rfc822;linux-kernel-outgoing>);
	Thu, 24 Dec 2009 01:59:57 -0500
Received: from smtp1.linux-foundation.org ([140.211.169.13]:46599 "EHLO
	smtp1.linux-foundation.org" rhost-flags-OK-OK-OK-OK)
	by vger.kernel.org with ESMTP id S1754207AbZLXG74 (ORCPT
	<rfc822;linux-kernel@vger.kernel.org>);
	Thu, 24 Dec 2009 01:59:56 -0500
Date: Wed, 23 Dec 2009 22:58:55 -0800
From: Andrew Morton <akpm@linux-foundation.org>
To: "Berck E. Nash" <flyboy@gmail.com>
Cc: "linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
       netdev@vger.kernel.org, Stephen Hemminger <shemminger@vyatta.com>,
       Michael Breuer <mbreuer@majjas.com>
Subject: Re: sky2 panic in 2.6.32.1 under load
Message-Id: <20091223225855.4a7d00af.akpm@linux-foundation.org>
In-Reply-To: <4B300A2A.8040305@gmail.com>
References: <4B300A2A.8040305@gmail.com>
X-Mailer: Sylpheed 2.4.8 (GTK+ 2.12.5; x86_64-redhat-linux-gnu)
Mime-Version: 1.0
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: 7bit
Sender: linux-kernel-owner@vger.kernel.org
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org
Content-Length: 6651
Lines: 134

On Mon, 21 Dec 2009 16:52:10 -0700 "Berck E. Nash" <flyboy@gmail.com> wrote:

> Since 2.6.32, I've been getting kernel panics under heavy network load
> (bittorrent usage).

Let's cc the right list and developer.

This is a 2.6.31->2.6.32 regression?

> [ 8673.345873] sky2 eth0: receiver hang detected
> [ 8673.350368] sky2 eth0: disabling interface
> [ 8673.354749] BUG: unable to handle kernel NULL pointer dereference at
> 0000000000000010

Please fix the wordwrapping for next time.

> [ 8673.359748] IP: [<ffffffffa00373d3>] sky2_xmit_frame+0x321/0x5d8 [sky2]
> [ 8673.364675] PGD a09a6067 PUD a09a5067 PMD 0
> [ 8673.373838] Oops: 0002 [#1] SMP
> [ 8673.373838] last sysfs file: /sys/devices/platform/coretemp.1/temp1_label
> [ 8673.383900] CPU 0
> [ 8673.383900] Modules linked in: nfsd exportfs nfs lockd nfs_acl
> auth_rpcgss sunrpc nls_cp437 msdos fat kvm_intel kvm fuse snd_rtctimer
> hwmon_vid nvidia(P) usbhid tuner_simple tuner_types wm8775 tda9887
> snd_hda_codec_realtek tda8290 snd_hda_intel tuner snd_hda_codec
> snd_pcm_oss snd_mixer_oss snd_pcm cx25840 snd_seq_dummy snd_seq_oss
> snd_seq_midi_event ivtv snd_seq i2c_algo_bit cx2341x v4l2_common
> snd_timer videodev uhci_hcd snd_seq_device v4l1_compat ehci_hcd snd
> v4l2_compat_ioctl32 i2c_i801 soundcore snd_page_alloc floppy sky2
> usbcore tveeprom
> [ 8673.435268] Pid: 4, comm: ksoftirqd/0 Tainted: P           2.6.32.1
> #3 P5W DH Deluxe
> [ 8673.438943] RIP: 0010:[<ffffffffa00373d3>]  [<ffffffffa00373d3>]
> sky2_xmit_frame+0x321/0x5d8 [sky2]
> [ 8673.448539] RSP: 0018:ffff880001603df8  EFLAGS: 00010246
> [ 8673.458678] RAX: 0000000000000000 RBX: ffff8800bd201d40 RCX:
> 0000000000000000
> [ 8673.465016] RDX: 0000000000000000 RSI: 000000000000008c RDI:
> 0000000000000000
> [ 8673.472396] RBP: ffff880001603e48 R08: 0000000000000001 R09:
> 0000000000000000
> [ 8673.474083] R10: 000000000000001e R11: 0000000000000ef8 R12:
> ffff88009bf3ab48
> [ 8673.484317] R13: ffff8800bef4d000 R14: 0000000000000000 R15:
> 00000000955fa87e
> [ 8673.492381] FS:  0000000000000000(0000) GS:ffff880001600000(0000)
> knlGS:0000000000000000
> [ 8673.501448] CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
> [ 8673.509707] CR2: 0000000000000010 CR3: 00000000a09bf000 CR4:
> 00000000000026f0
> [ 8673.514146] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
> 0000000000000000
> [ 8673.520661] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
> 0000000000000400
> [ 8673.528842] Process ksoftirqd/0 (pid: 4, threadinfo ffff8800bf8b4000,
> task ffff8800bf8a8650)
> [ 8673.539212] Stack:
> [ 8673.539212]  ffff8800992f5980 ffff8800955fa87e ffff8800bd201800
> 000000428122a659
> [ 8673.548658] <0> ffff880001603e48 ffff88009bf3ab48 ffff8800992f5980
> ffffffff813eaf30
> [ 8673.556929] <0> ffff8800bd201800 ffff8800bef03940 ffff880001603e98
> ffffffff81231de8
> [ 8673.565432] Call Trace:
> [ 8673.565432]  <IRQ>
> [ 8673.565432]  [<ffffffff81231de8>] dev_hard_start_xmit+0x21c/0x2b7
> [ 8673.574516]  [<ffffffff81041746>] ? run_timer_softirq+0x4f/0x1c9
> [ 8673.579515]  [<ffffffff81240252>] sch_direct_xmit+0x5e/0x154
> [ 8673.584559]  [<ffffffff81240404>] __qdisc_run+0xbc/0xd5
> [ 8673.592673]  [<ffffffff8122fb19>] net_tx_action+0xbb/0x10e
> [ 8673.598719]  [<ffffffff8103dc16>] __do_softirq+0x91/0x11b
> [ 8673.601787]  [<ffffffff8100be9c>] call_softirq+0x1c/0x28
> [ 8673.609833]  <EOI>
> [ 8673.610994]  [<ffffffff8100d907>] do_softirq+0x33/0x6b
> [ 8673.614419]  [<ffffffff8103d71e>] ksoftirqd+0x60/0xd7
> [ 8673.620082]  [<ffffffff8103d6be>] ? ksoftirqd+0x0/0xd7
> [ 8673.620082]  [<ffffffff8104aee7>] kthread+0x7a/0x82
> [ 8673.629310]  [<ffffffff8100bd9a>] child_rip+0xa/0x20
> [ 8673.634137]  [<ffffffff8104ae6d>] ? kthread+0x0/0x82
> [ 8673.639492]  [<ffffffff8100bd90>] ? child_rip+0x0/0x20
> [ 8673.647639] Code: 06 00 00 00 00 89 08 66 c7 40 04 00 00 c6 40 06 01
> c6 40 07 9f 41 0f b7 c6 48 89 c7 48 c1 e0 03 48 c1 e7 05 48 89 f9 48 03
> 4b 20 <4c> 89 79 10 48 c7 41 08 01 00 00 00 8b 75 cc 89 71 18 48 03 7b
> [ 8673.667726] RIP  [<ffffffffa00373d3>] sky2_xmit_frame+0x321/0x5d8 [sky2]
> [ 8673.674902]  RSP <ffff880001603df8>
> [ 8673.674902] CR2: 0000000000000010
> [ 8673.682956] hda-intel: IRQ timing workaround is activated for card
> #0. Suggest a bigger bdl_pos_adj.
> [ 8673.683015] ---[ end trace 2c387977cf1c7c9a ]---
> [ 8673.683017] Kernel panic - not syncing: Fatal exception in interrupt
> [ 8673.683020] Pid: 4, comm: ksoftirqd/0 Tainted: P      D    2.6.32.1 #3
> [ 8673.683021] Call Trace:
> [ 8673.683023]  <IRQ>  [<ffffffff8129839d>] panic+0x75/0x11c
> [ 8673.683030]  [<ffffffff8100e9a7>] oops_end+0x81/0x8e
> [ 8673.683033]  [<ffffffff81026e5f>] no_context+0x1ee/0x1fd
> [ 8673.683036]  [<ffffffff81032a6d>] ? find_busiest_group+0x387/0x8d8
> [ 8673.683039]  [<ffffffff81026fe0>] __bad_area_nosemaphore+0x172/0x195
> [ 8673.683041]  [<ffffffff81027011>] bad_area_nosemaphore+0xe/0x10
> [ 8673.683044]  [<ffffffff8102724b>] do_page_fault+0x114/0x252
> [ 8673.683047]  [<ffffffff8129a97f>] page_fault+0x1f/0x30
> [ 8673.683054]  [<ffffffffa00373d3>] ? sky2_xmit_frame+0x321/0x5d8 [sky2]
> [ 8673.683058]  [<ffffffffa00371b8>] ? sky2_xmit_frame+0x106/0x5d8 [sky2]
> [ 8673.683061]  [<ffffffff81231de8>] dev_hard_start_xmit+0x21c/0x2b7
> [ 8673.683065]  [<ffffffff81041746>] ? run_timer_softirq+0x4f/0x1c9
> [ 8673.683067]  [<ffffffff81240252>] sch_direct_xmit+0x5e/0x154
> [ 8673.683070]  [<ffffffff81240404>] __qdisc_run+0xbc/0xd5
> [ 8673.683072]  [<ffffffff8122fb19>] net_tx_action+0xbb/0x10e
> [ 8673.683075]  [<ffffffff8103dc16>] __do_softirq+0x91/0x11b
> [ 8673.683078]  [<ffffffff8100be9c>] call_softirq+0x1c/0x28
> [ 8673.683079]  <EOI>  [<ffffffff8100d907>] do_softirq+0x33/0x6b
> [ 8673.683083]  [<ffffffff8103d71e>] ksoftirqd+0x60/0xd7
> [ 8673.683085]  [<ffffffff8103d6be>] ? ksoftirqd+0x0/0xd7
> [ 8673.683088]  [<ffffffff8104aee7>] kthread+0x7a/0x82
> [ 8673.683090]  [<ffffffff8100bd9a>] child_rip+0xa/0x20
> [ 8673.683093]  [<ffffffff8104ae6d>] ? kthread+0x0/0x82
> [ 8673.683095]  [<ffffffff8100bd90>] ? child_rip+0x0/0x20
> 
> Note that sometimes I get the receiver hang and things continue without
> the crash:
> 
> [ 1219.346571] sky2 eth0: receiver hang detected
> [ 1219.351145] sky2 eth0: disabling interface
> [ 1219.357389] sky2 eth0: enabling interface
> [ 1222.572980] sky2 eth0: Link is up at 1000 Mbps, full duplex, flow
> control both
> 
> Please CC as I'm not subscribed.
> 

--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/