Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S264014AbUDTXLG (ORCPT ); Tue, 20 Apr 2004 19:11:06 -0400 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S264271AbUDTXKA (ORCPT ); Tue, 20 Apr 2004 19:10:00 -0400 Received: from potato.cts.ucla.edu ([149.142.36.49]:56740 "EHLO potato.cts.ucla.edu") by vger.kernel.org with ESMTP id S264500AbUDTXBf (ORCPT ); Tue, 20 Apr 2004 19:01:35 -0400 Date: Tue, 20 Apr 2004 16:01:32 -0700 (PDT) From: Chris Stromsoe To: linux-kernel@vger.kernel.org cc: Marcelo Tosatti Subject: two lockups with 2.4.25 Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: linux-kernel-owner@vger.kernel.org X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 54109 Lines: 1478 I had two different machines lock up within hours of each other this morning. They have the exact same hardware and had very similar uptimes (within hours of each other). Both machines have a single SCSI disk on an onboard adaptec controller. All partitions are ext3. There are 3 other disks arranged in a RAID5 partition that are formatted JFS. The machines run as virus quarantine servers, writing about 50k messages to disk per day. The files are written out into directories as year/month/day/hour/filename. There are usually around 2k to 3k files per directory. Both machines locked up hard. I was able to get sysrq+t output from one machine, but nothing from the other (it has no serial console). I ran the output through ksymoops. It's listed below. -Chris ksymoops 2.4.5 on i686 2.4.25. Options used -V (default) -k /proc/ksyms (specified) -l /proc/modules (specified) -o /lib/modules/2.4.25/ (specified) -m /boot/System.map-2.4.25 (specified) Pid: 26885, comm: sophie EIP: 0010:[] CPU: 1 EFLAGS: 00000202 Not tainted Using defaults from ksymoops -t elf32-i386 -a i386 EAX: 00000001 EBX: 00000001 ECX: 00000202 EDX: 01000000 ESI: f4762cc0 EDI: 081a1d28 EBP: e806fe94 DS: 0018 ES: 0018 Warning (Oops_set_regs): garbage 'DS: 0018 ES: 0018' at end of register line ignored CR0: 8005003b CR2: 081a1d28 CR3: 14c2c000 CR4: 00000690 Call Trace: [] [] [] [] [] [] [] [] Warning (Oops_read): Code line not seen, dumping what data is available >>EIP; c0110ed7 <===== >>EDX; 01000000 Before first symbol >>ESI; f4762cc0 <_end+343c85cc/3896e90c> >>EDI; 081a1d28 Before first symbol >>EBP; e806fe94 <_end+27cd57a0/3896e90c> Trace; c011100f Trace; c01259b7 Trace; c01260de Trace; c01132f9 Trace; c0113158 Trace; c0224ce1 <__kfree_skb+129/134> Trace; c01145e3 Trace; c0106fc4 init R C3FFBF28 0 1 0 18517 (NOTLB) Call Trace: [] [] [] [] [] [] keventd S C3FEC000 0 2 1 3 (L-TLB) Call Trace: [] [] ksoftirqd_CPU R C3FEA000 0 3 1 4 2 (L-TLB) Call Trace: [] [] ksoftirqd_CPU R C3FE8000 0 4 1 5 3 (L-TLB) Call Trace: [] [] kswapd S C3FD8000 0 5 1 6 4 (L-TLB) Call Trace: [] [] bdflush R 00000286 0 6 1 7 5 (L-TLB) Call Trace: [] [] [] kupdated R C3FB5F30 0 7 1 8 6 (L-TLB) Call Trace: [] [] [] [] [] [] [] [] [] [] jfsIO S C3FA2000 0 8 1 9 7 (L-TLB) Call Trace: [] [] jfsCommit D F70C0CC0 0 9 1 10 8 (L-TLB) Call Trace: [] [] [] jfsSync S C0366180 376 10 1 11 9 (L-TLB) Call Trace: [] [] ahc_dv_0 S F7AD3F2C 5944 11 1 12 10 (L-TLB) Call Trace: [] [] [] [] ahc_dv_1 S C3FE2D0C 6172 12 1 13 11 (L-TLB) Call Trace: [] [] [] [] scsi_eh_0 S F7ABDFD8 36 13 1 14 12 (L-TLB) Call Trace: [] [] [] [] scsi_eh_1 S F7AB7FD8 36 14 1 15 13 (L-TLB) Call Trace: [] [] [] [] mdrecoveryd S F7A0E000 0 15 1 16 14 (L-TLB) Call Trace: [] [] raid5d S F7A02000 0 16 1 190 15 (L-TLB) Call Trace: [] [] syslogd R 7FFFFFFF 0 190 1 194 16 (NOTLB) Call Trace: [] [] [] [] klogd R F6FDA000 0 194 1 199 190 (NOTLB) Call Trace: [] [] [] [] inetd R F6FD3FAC 1376 199 1 317 194 (NOTLB) Call Trace: [] [] sendmail R F6F7BF28 68 317 1 323 199 (NOTLB) Call Trace: [] [] [] [] [] [] sendmail R 00000000 0 323 1 324 335 317 (NOTLB) Call Trace: [] [] sendmail R F6F5E000 132 324 323 (NOTLB) Call Trace: [] [] sendmail R 00000000 0 335 1 336 338 323 (NOTLB) Call Trace: [] [] sendmail R F6F46000 4 336 335 (NOTLB) Call Trace: [] [] sshd R 7FFFFFFF 0 338 1 29552 343 335 (NOTLB) Call Trace: [] [] [] [] ntpd R 7FFFFFFF 8 343 1 350 338 (NOTLB) Call Trace: [] [] [] [] mdadm R F6F25F88 0 350 1 354 343 (NOTLB) Call Trace: [] [] [] [] cron R F6E5FF88 0 354 1 363 350 (NOTLB) Call Trace: [] [] [] [] apache R F6B7FF28 32 363 1 13135 417 354 (NOTLB) Call Trace: [] [] [] [] [] getty R 7FFFFFFF 2400 417 1 418 363 (NOTLB) Call Trace: [] [] [] [] [] getty R 7FFFFFFF 1376 418 1 419 417 (NOTLB) Call Trace: [] [] [] [] [] getty R 7FFFFFFF 0 419 1 12367 418 (NOTLB) Call Trace: [] [] [] [] [] [] logger R F6A5E000 8 425 363 426 (NOTLB) Call Trace: [] [] [] [] logger R F6A32000 0 426 363 18988 425 (NOTLB) Call Trace: [] [] [] [] sophie R C7DF3F88 2400 12367 1 26885 12393 419 (NOTLB) Call Trace: [] [] [] [] mimedefang-mu R D065DF28 0 12393 1 26392 12404 12367 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R D84B3FAC 0 12404 1 12405 18514 12393 (NOTLB) Call Trace: [] [] mimedefang R D0EC0000 160 12405 12404 26890 (NOTLB) Call Trace: [] mimedefang R E3B3DFAC 0 12406 12405 14117 (NOTLB) Call Trace: [] [] sophie R C9857F28 84 8398 12367 26884 (NOTLB) Call Trace: [] [] [] [] [] [] sshd R 7FFFFFFF 0 29552 338 29556 (NOTLB) Call Trace: [] [] [] [] [] [] [] sshd R 7FFFFFFF 0 29556 29552 29557 (NOTLB) Call Trace: [] [] [] [] tcsh R 7FFFFFFF 48 29557 29556 (NOTLB) Call Trace: [] [] [] [] [] apache R 00000001 80 18988 363 15030 426 (NOTLB) Call Trace: [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] apache R 00000001 0 15030 363 16181 18988 (NOTLB) Call Trace: [] [] [] [] [] [] [] [] [] [] [] [] [] apache R 7FFFFFFF 144 16181 363 31860 15030 (NOTLB) Call Trace: [] [] [] [] apache R 00000001 0 31860 363 6914 16181 (NOTLB) Call Trace: [] [] [] [] [] [] [] [] [] [] [] [] [] [] apache R 00000001 28 6914 363 31487 31860 (NOTLB) Call Trace: [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] apache R 00000001 12 31487 363 13089 6914 (NOTLB) Call Trace: [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] hostmon-clien R C4425F88 0 18514 1 18517 12404 (NOTLB) Call Trace: [] [] [] [] hostmon-clien R 7FFFFFFF 144 18517 1 18514 (NOTLB) Call Trace: [] [] [] [] [] [] [] [] [] [] apache R 00000001 68 13089 363 13135 31487 (NOTLB) Call Trace: [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] apache R 00000001 8 13135 363 13089 (NOTLB) Call Trace: [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] mimedefang R E127DF28 0 14117 12405 15166 12406 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R C9433F28 80 15166 12405 15168 14117 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R DB6F3F28 0 15168 12405 15611 15166 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R CCF53F28 40 15611 12405 16920 15168 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R C6FEFF28 0 16920 12405 16921 15611 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R C8305F28 0 16921 12405 561 16920 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R D9D99F28 80 561 12405 628 16921 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R CC561F28 0 628 12405 13814 561 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R E4281F28 64 13814 12405 18268 628 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R E71C3F28 132 18268 12405 19336 13814 (NOTLB) Call Trace: [] [] [] [] [] mimedefang.pl R CCE82000 0 19234 12393 19235 (NOTLB) Call Trace: [] mimedefang.pl R 7FFFFFFF 0 19235 12393 19242 19234 (NOTLB) Call Trace: [] [] [] [] [] [] [] mimedefang.pl R F04B0000 0 19242 12393 21612 19235 (NOTLB) Call Trace: [] [] [] [] mimedefang R E34E7F28 4 19336 12405 19849 18268 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R F6CE3F28 0 19849 12405 19870 19336 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R F135BF28 0 19870 12405 19872 19849 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R EADB7F28 0 19872 12405 20723 19870 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R C9C29F28 12 20723 12405 20993 19872 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R ED4C5F28 4 20993 12405 22071 20723 (NOTLB) Call Trace: [] [] [] [] [] mimedefang.pl R E5C96000 80 21612 12393 22136 19242 (NOTLB) Call Trace: [] [] [] [] mimedefang R C4B55F28 0 22071 12405 22383 20993 (NOTLB) Call Trace: [] [] [] [] [] mimedefang.pl R EE658000 4 22136 12393 22137 21612 (NOTLB) Call Trace: [] [] [] [] mimedefang.pl R EBF06000 0 22137 12393 22140 22136 (NOTLB) Call Trace: [] [] [] [] mimedefang.pl R E74FC000 0 22140 12393 22142 22137 (NOTLB) Call Trace: [] [] [] [] mimedefang.pl R E4BBE000 2400 22142 12393 22146 22140 (NOTLB) Call Trace: [] [] [] [] mimedefang.pl R EE172000 96 22146 12393 22159 22142 (NOTLB) Call Trace: [] [] [] [] mimedefang.pl R E853E000 1376 22159 12393 24159 22146 (NOTLB) Call Trace: [] [] [] [] mimedefang R E03F9F28 100 22383 12405 22521 22071 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R ED0D3F28 0 22521 12405 22522 22383 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R F4933F28 80 22522 12405 22775 22521 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R DBE89F28 32 22775 12405 24871 22522 (NOTLB) Call Trace: [] [] [] [] [] mimedefang.pl R D9166000 104 24159 12393 24160 22159 (NOTLB) Call Trace: [] [] [] [] mimedefang.pl R E0390000 304 24160 12393 26390 24159 (NOTLB) Call Trace: [] [] [] [] mimedefang R CDF47F28 80 24871 12405 25252 22775 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R F4E75F28 100 25252 12405 25477 24871 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R DE085F28 0 25477 12405 26006 25252 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R EEB7FF28 0 26006 12405 26016 25477 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R DB0A1F28 104 26016 12405 26029 26006 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R EDF07F28 0 26029 12405 26281 26016 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R D3E27F28 4 26281 12405 26507 26029 (NOTLB) Call Trace: [] [] [] [] [] mimedefang.pl R E3A48000 0 26390 12393 26392 24160 (NOTLB) Call Trace: [] [] [] [] mimedefang.pl R C67D0000 16 26392 12393 26390 (NOTLB) Call Trace: [] [] [] [] mimedefang R C5E21F28 272 26507 12405 26540 26281 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R C418FF28 68 26540 12405 26541 26507 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R D2C1FF28 68 26541 12405 26637 26540 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R E914BF28 0 26637 12405 26756 26541 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R DC941F28 0 26756 12405 26761 26637 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R E5ACDF28 0 26761 12405 26772 26756 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R DB6C3F28 400 26772 12405 26793 26761 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R D022FF28 80 26793 12405 26795 26772 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R DE591F28 68 26795 12405 26801 26793 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R E0923F28 16 26801 12405 26812 26795 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R F318BF28 64 26812 12405 26818 26801 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R 7FFFFFFF 0 26818 12405 26824 26812 (NOTLB) Call Trace: [] [] [] [] [] [] [] mimedefang R F3E77F28 80 26824 12405 26826 26818 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R E03F7F28 80 26826 12405 26830 26824 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R DD0ABF28 0 26830 12405 26844 26826 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R E4E85F28 0 26844 12405 26846 26830 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R C8E6FF28 40 26846 12405 26848 26844 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R CF007F28 4 26848 12405 26851 26846 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R CE075F28 68 26851 12405 26859 26848 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R 7FFFFFFF 0 26859 12405 26871 26851 (NOTLB) Call Trace: [] [] [] [] [] [] [] mimedefang R F51CBF28 80 26871 12405 26872 26859 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R CDD91F28 0 26872 12405 26876 26871 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R DD759F28 2400 26876 12405 26879 26872 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R E8A9DF28 0 26879 12405 26886 26876 (NOTLB) Call Trace: [] [] [] [] [] sophie Z C3F74200 80 26884 12367 26885 8398 (L-TLB) Call Trace: [] [] [] sophie R current 0 26885 12367 26884 (NOTLB) Call Trace: [] mimedefang R DA151F28 4 26886 12405 26887 26879 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R EF435F28 2408 26887 12405 26888 26886 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R CC989F28 0 26888 12405 26889 26887 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R E5A83F28 0 26889 12405 26890 26888 (NOTLB) Call Trace: [] [] [] [] [] mimedefang R F67E5F28 0 26890 12405 26889 (NOTLB) Call Trace: [] [] [] [] [] Warning (Oops_read): Code line not seen, dumping what data is available Proc; init >>EIP; c3ffbf28 <_end+3c61834/3896e90c> <===== Trace; c0130fc1 <_alloc_pages+19/20> Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; keventd >>EIP; c3fec000 <_end+3c5190c/3896e90c> <===== Trace; c012418c Trace; c0105680 Proc; ksoftirqd_CPU >>EIP; c3fea000 <_end+3c4f90c/3896e90c> <===== Trace; c011c47e Trace; c0105680 Proc; ksoftirqd_CPU >>EIP; c3fe8000 <_end+3c4d90c/3896e90c> <===== Trace; c011c47e Trace; c0105680 Proc; kswapd >>EIP; c3fd8000 <_end+3c3d90c/3896e90c> <===== Trace; c01307fb Trace; c0105680 Proc; bdflush >>EIP; 00000286 Before first symbol <===== Trace; c0114a3e Trace; c013cb93 Trace; c0105680 Proc; kupdated >>EIP; c3fb5f30 <_end+3c1b83c/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c013cc74 Trace; c01705ff Trace; c01708b1 Trace; c0172345 Trace; c01723d9 Trace; c0106e86 Trace; c013cb98 Trace; c0105680 Proc; jfsIO >>EIP; c3fa2000 <_end+3c0790c/3896e90c> <===== Trace; c0194c68 Trace; c0105680 Proc; jfsCommit >>EIP; f70c0cc0 <_end+36d265cc/3896e90c> <===== Trace; c019776b Trace; c0197960 Trace; c0105680 Proc; jfsSync >>EIP; c0366180 <===== Trace; c0197ed3 Trace; c0105680 Proc; ahc_dv_0 >>EIP; f7ad3f2c <_end+37739838/3896e90c> <===== Trace; c0105c2c <__down_interruptible+6c/ec> Trace; c0105d22 <__down_failed_interruptible+a/10> Trace; c01e9fba <.text.lock.aic7xxx_osm+115/29b> Trace; c0105680 Proc; ahc_dv_1 >>EIP; c3fe2d0c <_end+3c48618/3896e90c> <===== Trace; c0105c2c <__down_interruptible+6c/ec> Trace; c0105d22 <__down_failed_interruptible+a/10> Trace; c01e9fba <.text.lock.aic7xxx_osm+115/29b> Trace; c0105680 Proc; scsi_eh_0 >>EIP; f7abdfd8 <_end+377238e4/3896e90c> <===== Trace; c0105c2c <__down_interruptible+6c/ec> Trace; c0105d22 <__down_failed_interruptible+a/10> Trace; c01def72 <.text.lock.scsi_error+e5/103> Trace; c0105680 Proc; scsi_eh_1 >>EIP; f7ab7fd8 <_end+3771d8e4/3896e90c> <===== Trace; c0105c2c <__down_interruptible+6c/ec> Trace; c0105d22 <__down_failed_interruptible+a/10> Trace; c01def72 <.text.lock.scsi_error+e5/103> Trace; c0105680 Proc; mdrecoveryd >>EIP; f7a0e000 <_end+3767390c/3896e90c> <===== Trace; c021fd31 Trace; c0105680 Proc; raid5d >>EIP; f7a02000 <_end+3766790c/3896e90c> <===== Trace; c021fd31 Trace; c0105680 Proc; syslogd >>EIP; 7fffffff Before first symbol <===== Trace; c0114077 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; klogd >>EIP; f6fda000 <_end+36c3f90c/3896e90c> <===== Trace; c011740f Trace; c015b3fa Trace; c013836d Trace; c0106ed3 Proc; inetd >>EIP; f6fd3fac <_end+36c398b8/3896e90c> <===== Trace; c0106017 Trace; c0106ed3 Proc; sendmail >>EIP; f6f7bf28 <_end+36be1834/3896e90c> <===== Trace; c0147930 <__pollwait+88/90> Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; sendmail >>EIP; 00000000 Before first symbol Trace; c011af34 Trace; c0106ed3 Proc; sendmail >>EIP; f6f5e000 <_end+36bc390c/3896e90c> <===== Trace; c010c9ed Trace; c0106ed3 Proc; sendmail >>EIP; 00000000 Before first symbol Trace; c011af34 Trace; c0106ed3 Proc; sendmail >>EIP; f6f46000 <_end+36bab90c/3896e90c> <===== Trace; c010c9ed Trace; c0106ed3 Proc; sshd >>EIP; 7fffffff Before first symbol <===== Trace; c0114077 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; ntpd >>EIP; 7fffffff Before first symbol <===== Trace; c0114077 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mdadm >>EIP; f6f25f88 <_end+36b8b894/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c011fb08 Trace; c0106ed3 Proc; cron >>EIP; f6e5ff88 <_end+36ac5894/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c011fb08 Trace; c0106ed3 Proc; apache >>EIP; f6b7ff28 <_end+367e5834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; getty >>EIP; 7fffffff Before first symbol <===== Trace; c0114077 Trace; c01a4553 Trace; c01a0008 Trace; c013836d Trace; c0106ed3 Proc; getty >>EIP; 7fffffff Before first symbol <===== Trace; c0114077 Trace; c01a4553 Trace; c01a0008 Trace; c013836d Trace; c0106ed3 Proc; getty >>EIP; 7fffffff Before first symbol <===== Trace; c0114077 Trace; c01a4553 Trace; c01b1c65 Trace; c01a0008 Trace; c013836d Trace; c0106ed3 Proc; logger >>EIP; f6a5e000 <_end+366c390c/3896e90c> <===== Trace; c014171a Trace; c0141807 Trace; c013836d Trace; c0106ed3 Proc; logger >>EIP; f6a32000 <_end+3669790c/3896e90c> <===== Trace; c014171a Trace; c0141807 Trace; c013836d Trace; c0106ed3 Proc; sophie >>EIP; c7df3f88 <_end+7a59894/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c011fb08 Trace; c0106ed3 Proc; mimedefang-mu >>EIP; d065df28 <_end+102c3834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; d84b3fac <_end+181198b8/3896e90c> <===== Trace; c0106017 Trace; c0106ed3 Proc; mimedefang >>EIP; d0ec0000 <_end+10b2590c/3896e90c> <===== Trace; c0106f81 Proc; mimedefang >>EIP; e3b3dfac <_end+237a38b8/3896e90c> <===== Trace; c0106017 Trace; c0106ed3 Proc; sophie >>EIP; c9857f28 <_end+94bd834/3896e90c> <===== Trace; c0141c47 Trace; c01140da Trace; c0114000 Trace; c01481a0 Trace; c01483bd Trace; c0106ed3 Proc; sshd >>EIP; 7fffffff Before first symbol <===== Trace; c0114077 Trace; c0271ac6 Trace; c0271ca1 Trace; c0221713 Trace; c022180f Trace; c013836d Trace; c0106ed3 Proc; sshd >>EIP; 7fffffff Before first symbol <===== Trace; c0114077 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; tcsh >>EIP; 7fffffff Before first symbol <===== Trace; c0114077 Trace; c01a4553 Trace; c01a0008 Trace; c013836d Trace; c0106ed3 Proc; apache >>EIP; 00000001 Before first symbol <===== Trace; c019cd05 Trace; c0221000 Trace; c0248577 Trace; c0224b3f Trace; c0224b56 Trace; c0224ce1 <__kfree_skb+129/134> Trace; c024c369 Trace; c0131497 <__free_pages+1f/24> Trace; c02539fe Trace; c0223a93 Trace; c0244711 Trace; c014c8ec Trace; c014b37b Trace; c01218f6 Trace; c010c605 Trace; c0106ed3 Proc; apache >>EIP; 00000001 Before first symbol <===== Trace; c019cd05 Trace; c0231403 Trace; c024c89c Trace; c024c944 Trace; c024d429 Trace; c024e16a Trace; c02441c5 Trace; c0224b56 Trace; c0224ce1 <__kfree_skb+129/134> Trace; c0228cab Trace; c011bf3d Trace; c010c605 Trace; c0106ed3 Proc; apache >>EIP; 7fffffff Before first symbol <===== Trace; c0114077 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; apache >>EIP; 00000001 Before first symbol <===== Trace; c0228795 Trace; c019cd05 Trace; c0231403 Trace; c024c89c Trace; c024c944 Trace; c0224b3f Trace; c024d429 Trace; c024e16a Trace; c02441c5 Trace; c014c8ec Trace; c014b37b Trace; c01218f6 Trace; c010c605 Trace; c0106ed3 Proc; apache >>EIP; 00000001 Before first symbol <===== Trace; c019cd05 Trace; c02395fc Trace; c0231000 Trace; c02395b5 Trace; c0239730 Trace; c0228edb Trace; c0228f8a Trace; c02290c3 Trace; c011bf3d Trace; c010890e Trace; c0140018 Trace; c012ebf3 Trace; c014b37b Trace; c01218f6 Trace; c010c605 Trace; c0106ed3 Proc; apache >>EIP; 00000001 Before first symbol <===== Trace; c019cd05 Trace; c0231403 Trace; c024c89c Trace; c024c944 Trace; c0224b3f Trace; c024d429 Trace; c024e16a Trace; c0224b56 Trace; c0224ce1 <__kfree_skb+129/134> Trace; c0228cab Trace; c011bf3d Trace; c010890e Trace; c019c7b5 Trace; c010c605 Trace; c0106ed3 Proc; hostmon-clien >>EIP; c4425f88 <_end+408b894/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c011fb08 Trace; c0106ed3 Proc; hostmon-clien >>EIP; 7fffffff Before first symbol <===== Trace; c0114077 Trace; c0244bc1 Trace; c0244d4a Trace; c025eb4a Trace; c0222271 Trace; c0224b56 Trace; c0224ce1 <__kfree_skb+129/134> Trace; c0228cab Trace; c0222d1b Trace; c0106ed3 Proc; apache >>EIP; 00000001 Before first symbol <===== Trace; c019cd05 Trace; c0221000 Trace; c0248577 Trace; c0224b3f Trace; c0224b56 Trace; c0224ce1 <__kfree_skb+129/134> Trace; c024c369 Trace; c0131497 <__free_pages+1f/24> Trace; c02539fe Trace; c0223a93 Trace; c0244711 Trace; c014c8ec Trace; c014b37b Trace; c01218f6 Trace; c010c605 Trace; c0106ed3 Proc; apache >>EIP; 00000001 Before first symbol <===== Trace; c019cd05 Trace; f8d0c83d <[eepro100]speedo_start_xmit+16d/1f4> Trace; c0231403 Trace; c022648d Trace; c0224b3f Trace; c0224b56 Trace; c0224ce1 <__kfree_skb+129/134> Trace; c0253926 Trace; c0223a93 Trace; c0244711 Trace; c014c8ec Trace; c014b37b Trace; c01218f6 Trace; c010c605 Trace; c0106ed3 Proc; mimedefang >>EIP; e127df28 <_end+20ee3834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; c9433f28 <_end+9099834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; db6f3f28 <_end+1b359834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; ccf53f28 <_end+cbb9834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; c6feff28 <_end+6c55834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; c8305f28 <_end+7f6b834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; d9d99f28 <_end+199ff834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; cc561f28 <_end+c1c7834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; e4281f28 <_end+23ee7834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; e71c3f28 <_end+26e29834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang.pl >>EIP; cce82000 <_end+cae790c/3896e90c> <===== Trace; c0106f81 Proc; mimedefang.pl >>EIP; 7fffffff Before first symbol <===== Trace; c0114077 Trace; c0271ac6 Trace; c0271ca1 Trace; c0221713 Trace; c022180f Trace; c013836d Trace; c0106ed3 Proc; mimedefang.pl >>EIP; f04b0000 <_end+3011590c/3896e90c> <===== Trace; c014171a Trace; c0141807 Trace; c013836d Trace; c0106ed3 Proc; mimedefang >>EIP; e34e7f28 <_end+2314d834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; f6ce3f28 <_end+36949834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; f135bf28 <_end+30fc1834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; eadb7f28 <_end+2aa1d834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; c9c29f28 <_end+988f834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; ed4c5f28 <_end+2d12b834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang.pl >>EIP; e5c96000 <_end+258fb90c/3896e90c> <===== Trace; c014171a Trace; c0141807 Trace; c013836d Trace; c0106ed3 Proc; mimedefang >>EIP; c4b55f28 <_end+47bb834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang.pl >>EIP; ee658000 <_end+2e2bd90c/3896e90c> <===== Trace; c014171a Trace; c0141807 Trace; c013836d Trace; c0106ed3 Proc; mimedefang.pl >>EIP; ebf06000 <_end+2bb6b90c/3896e90c> <===== Trace; c014171a Trace; c0141807 Trace; c013836d Trace; c0106ed3 Proc; mimedefang.pl >>EIP; e74fc000 <_end+2716190c/3896e90c> <===== Trace; c014171a Trace; c0141807 Trace; c013836d Trace; c0106ed3 Proc; mimedefang.pl >>EIP; e4bbe000 <_end+2482390c/3896e90c> <===== Trace; c014171a Trace; c0141807 Trace; c013836d Trace; c0106ed3 Proc; mimedefang.pl >>EIP; ee172000 <_end+2ddd790c/3896e90c> <===== Trace; c014171a Trace; c0141807 Trace; c013836d Trace; c0106ed3 Proc; mimedefang.pl >>EIP; e853e000 <_end+281a390c/3896e90c> <===== Trace; c014171a Trace; c0141807 Trace; c013836d Trace; c0106ed3 Proc; mimedefang >>EIP; e03f9f28 <_end+2005f834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; ed0d3f28 <_end+2cd39834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; f4933f28 <_end+34599834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; dbe89f28 <_end+1baef834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang.pl >>EIP; d9166000 <_end+18dcb90c/3896e90c> <===== Trace; c014171a Trace; c0141807 Trace; c013836d Trace; c0106ed3 Proc; mimedefang.pl >>EIP; e0390000 <_end+1fff590c/3896e90c> <===== Trace; c014171a Trace; c0141807 Trace; c013836d Trace; c0106ed3 Proc; mimedefang >>EIP; cdf47f28 <_end+dbad834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; f4e75f28 <_end+34adb834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; de085f28 <_end+1dceb834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; eeb7ff28 <_end+2e7e5834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; db0a1f28 <_end+1ad07834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; edf07f28 <_end+2db6d834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; d3e27f28 <_end+13a8d834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang.pl >>EIP; e3a48000 <_end+236ad90c/3896e90c> <===== Trace; c014171a Trace; c0141807 Trace; c013836d Trace; c0106ed3 Proc; mimedefang.pl >>EIP; c67d0000 <_end+643590c/3896e90c> <===== Trace; c014171a Trace; c0141807 Trace; c013836d Trace; c0106ed3 Proc; mimedefang >>EIP; c5e21f28 <_end+5a87834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; c418ff28 <_end+3df5834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; d2c1ff28 <_end+12885834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; e914bf28 <_end+28db1834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; dc941f28 <_end+1c5a7834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; e5acdf28 <_end+25733834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; db6c3f28 <_end+1b329834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; d022ff28 <_end+fe95834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; de591f28 <_end+1e1f7834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; e0923f28 <_end+20589834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; f318bf28 <_end+32df1834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; 7fffffff Before first symbol <===== Trace; c0114077 Trace; c0271ac6 Trace; c0271ca1 Trace; c0221713 Trace; c022180f Trace; c013836d Trace; c0106ed3 Proc; mimedefang >>EIP; f3e77f28 <_end+33add834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; e03f7f28 <_end+2005d834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; dd0abf28 <_end+1cd11834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; e4e85f28 <_end+24aeb834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; c8e6ff28 <_end+8ad5834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; cf007f28 <_end+ec6d834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; ce075f28 <_end+dcdb834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; 7fffffff Before first symbol <===== Trace; c0114077 Trace; c0271ac6 Trace; c0271ca1 Trace; c0221713 Trace; c022180f Trace; c013836d Trace; c0106ed3 Proc; mimedefang >>EIP; f51cbf28 <_end+34e31834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; cdd91f28 <_end+d9f7834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; dd759f28 <_end+1d3bf834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; e8a9df28 <_end+28703834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; sophie >>EIP; c3f74200 <_end+3bd9b0c/3896e90c> <===== Trace; c011ab7c Trace; c011abb4 Trace; c0106ed3 Proc; sophie >>EIP; 0000000c Before first symbol <===== Trace; c0106fc4 Proc; mimedefang >>EIP; da151f28 <_end+19db7834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; ef435f28 <_end+2f09b834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; cc989f28 <_end+c5ef834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; e5a83f28 <_end+256e9834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 Proc; mimedefang >>EIP; f67e5f28 <_end+3644b834/3896e90c> <===== Trace; c01140da Trace; c0114000 Trace; c0147bac Trace; c0147f38 Trace; c0106ed3 3 warnings issued. Results may not be reliable. - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/