-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Dear all,
I'm experiencing serious problems with Kernel 2.4.20 on a IBM xSeries 350
machine, having 4 700 MHz processors and 4 GB RAM (same on another machine
with the same configuration, but only 3 GB RAM). The machine just com-
pletely freezes after some time, ranging from 20 minutes to 3 hours. It
is running IBM DB/2 with quite some load, the base system is RedHat 7.2
with all the updates applied. There is no oops or other fault, just a
plain freeze.
I first thought, this might be related to the ips-driver, as the firmware
wasn't up-to-date on the first run, but updating this didn't help at all.
2.4.20 is the first 2.4-kernel I ran, thinking that earlier ones might
not be ready for real production systems yet. The machine has been rock-
stable on several 2.2-kernels for months.
The only change I did to the source was some small patch to sem.h which
set SEMMNI and SEMMSL to 1024, and SEMOPM to 512.
I had a small loop on a network-shell that simply wrote the date to a
file as well as stdout. This seems to work 5 to 10 seconds longer on
the network than on the disc.
If anybody has any idea what else I could try I'd be more than happy -
we're experiencing a bit of a problem with "only" 2GB RAM... I'm willing
to try anything, but as this is a production machine it could take some
time to find a timeframe.
Attached there's a dmesg as well as the kernel-config if that helps any-
thing.
Greets
Peter H. Ruegg
Systems-/Networkadministrator RHCE eEnterprises Technology
-
--8<------------------------------------------------------------------------
-
main(){char*s="O_>>^PQAHBbPQAHBbPOOH^^PAAHBJPAAHBbPA_H>BB";int
i,j,k=1,l,m,n;
for(j=0;j<7;j++)for(l=0;m=l-6+j,i=m/6,n=j*6+i,k=1<<m%6,l<41-j;l++)
putchar(l<6-j?' ':l==40-j?'\n':k&&s[n]&k?'*':' ');}
Dec 10 21:42:33 db03 syslogd 1.4.1: restart.
Dec 10 21:42:33 db03 syslog: syslogd startup succeeded
Dec 10 21:42:33 db03 kernel: klogd 1.4.1, log source = /proc/kmsg started.
Dec 10 21:42:33 db03 kernel: Inspecting /boot/System.map-2.4.20-0.2.smp
Dec 10 21:42:33 db03 syslog: klogd startup succeeded
Dec 10 21:42:33 db03 keytable: Loading keymap: succeeded
Dec 10 21:42:33 db03 kernel: Loaded 18185 symbols from
/boot/System.map-2.4.20-0.2.smp.
Dec 10 21:42:33 db03 kernel: Symbols match kernel version 2.4.20.
Dec 10 21:42:33 db03 kernel: Loaded 11 symbols from 2 modules.
Dec 10 21:42:33 db03 kernel: Linux version 2.4.20-0.2.smp
([email protected]) (gcc version 2.96 20000731 (Red Hat Linux 7.2
2.96-112.7.2)) #1 SMP Tue Dec 10 21:01:29 CET 2002
Dec 10 21:42:33 db03 kernel: BIOS-provided physical RAM map:
Dec 10 21:42:33 db03 kernel: BIOS-e820: 0000000000000000 - 000000000009c800
(usable)
Dec 10 21:42:33 db03 kernel: BIOS-e820: 000000000009c800 - 00000000000a0000
(reserved)
Dec 10 21:42:33 db03 kernel: BIOS-e820: 00000000000e0000 - 0000000000100000
(reserved)
Dec 10 21:42:33 db03 kernel: BIOS-e820: 0000000000100000 - 00000000eb7f9380
(usable)
Dec 10 21:42:33 db03 kernel: BIOS-e820: 00000000eb7f9380 - 00000000eb800000
(ACPI data)
Dec 10 21:42:33 db03 kernel: BIOS-e820: 00000000fec00000 - 00000000fec01000
(reserved)
Dec 10 21:42:33 db03 kernel: BIOS-e820: 00000000fee00000 - 00000000fee01000
(reserved)
Dec 10 21:42:33 db03 kernel: BIOS-e820: 00000000fff80000 - 0000000100000000
(reserved)
Dec 10 21:42:33 db03 kernel: 2871MB HIGHMEM available.
Dec 10 21:42:33 db03 keytable: Loading system font: succeeded
Dec 10 21:42:33 db03 kernel: 896MB LOWMEM available.
Dec 10 21:42:33 db03 kernel: found SMP MP-table at 0009c9d0
Dec 10 21:42:33 db03 kernel: hm, page 0009c000 reserved twice.
Dec 10 21:42:33 db03 kernel: hm, page 0009d000 reserved twice.
Dec 10 21:42:33 db03 kernel: hm, page 0009c000 reserved twice.
Dec 10 21:42:33 db03 kernel: hm, page 0009d000 reserved twice.
Dec 10 21:42:33 db03 random: Initializing random number generator:
succeeded
Dec 10 21:42:33 db03 kernel: WARNING: MP table in the EBDA can be UNSAFE,
contact [email protected] if you experience SMP problems!
Dec 10 21:42:33 db03 kernel: On node 0 totalpages: 964601
Dec 10 21:42:33 db03 kernel: zone(0): 4096 pages.
Dec 10 21:42:33 db03 kernel: zone(1): 225280 pages.
Dec 10 21:42:33 db03 kernel: zone(2): 735225 pages.
Dec 10 21:42:33 db03 kernel: Intel MultiProcessor Specification v1.4
Dec 10 21:42:34 db03 kernel: Virtual Wire compatibility mode.
Dec 10 21:42:34 db03 ntpd[610]: ntpd 4.1.0 Wed Sep 5 06:54:30 EDT 2001 (1)
Dec 10 21:42:34 db03 ntpd: ntpd startup succeeded
Dec 10 21:42:34 db03 kernel: OEM ID: IBM ENSW Product ID: NF 6000R SMP APIC
at: 0xFEE00000
Dec 10 21:42:34 db03 kernel: Processor #3 Pentium(tm) Pro APIC version 17
Dec 10 21:42:34 db03 kernel: Processor #0 Pentium(tm) Pro APIC version 17
Dec 10 21:42:34 db03 kernel: Processor #1 Pentium(tm) Pro APIC version 17
Dec 10 21:42:34 db03 kernel: Processor #2 Pentium(tm) Pro APIC version 17
Dec 10 21:42:34 db03 kernel: I/O APIC #14 Version 17 at 0xFEC00000.
Dec 10 21:42:34 db03 ntpd[610]: precision = 8 usec
Dec 10 21:42:34 db03 kernel: I/O APIC #13 Version 17 at 0xFEC01000.
Dec 10 21:42:34 db03 ntpd[610]: kernel time discipline status 0040
Dec 10 21:42:34 db03 kernel: Processors: 4
Dec 10 21:42:34 db03 kernel: IBM machine detected. Enabling interrupts
during APM calls.
Dec 10 21:42:34 db03 ntpd[610]: frequency initialized 229.359 from
/etc/ntp/drift
Dec 10 21:42:34 db03 kernel: Kernel command line: ro root=/dev/sda2
vga=extended
Dec 10 21:42:34 db03 kernel: Initializing CPU#0
Dec 10 21:42:34 db03 kernel: Detected 699.475 MHz processor.
Dec 10 21:42:34 db03 kernel: Console: colour VGA+ 80x50
Dec 10 21:42:34 db03 kernel: Calibrating delay loop... 1395.91 BogoMIPS
Dec 10 21:42:34 db03 kernel: Memory: 3809868k/3858404k available (1563k
kernel code, 48136k reserved, 573k data, 108k init, 2940900k highmem)
Dec 10 21:42:34 db03 kernel: Dentry cache hash table entries: 262144 (order:
9, 2097152 bytes)
Dec 10 21:42:34 db03 kernel: Inode cache hash table entries: 262144 (order:
9, 2097152 bytes)
Dec 10 21:42:34 db03 kernel: Mount-cache hash table entries: 65536 (order:
7, 524288 bytes)
Dec 10 21:42:34 db03 kernel: Buffer-cache hash table entries: 262144 (order:
8, 1048576 bytes)
Dec 10 21:42:34 db03 kernel: Page-cache hash table entries: 524288 (order:
9, 2097152 bytes)
Dec 10 21:42:34 db03 kernel: CPU: L1 I cache: 16K, L1 D cache: 16K
Dec 10 21:42:34 db03 kernel: CPU: L2 cache: 1024K
Dec 10 21:42:34 db03 kernel: Intel machine check architecture supported.
Dec 10 21:42:35 db03 kernel: Intel machine check reporting enabled on CPU#0.
Dec 10 21:42:35 db03 kernel: Enabling fast FPU save and restore... done.
Dec 10 21:42:35 db03 kernel: Enabling unmasked SIMD FPU exception support...
done.
Dec 10 21:42:35 db03 kernel: Checking 'hlt' instruction... OK.
Dec 10 21:42:35 db03 kernel: POSIX conformance testing by UNIFIX
Dec 10 21:42:35 db03 kernel: mtrr: v1.40 (20010327) Richard Gooch
([email protected])
Dec 10 21:42:35 db03 snmpd: snmpd startup succeeded
Dec 10 21:42:35 db03 kernel: mtrr: detected mtrr type: Intel
Dec 10 21:42:35 db03 kernel: CPU: L1 I cache: 16K, L1 D cache: 16K
Dec 10 21:42:30 db03 sysctl: fs.file-max = 32768
Dec 10 21:42:35 db03 kernel: CPU: L2 cache: 1024K
Dec 10 21:42:35 db03 sshd: Starting sshd:
Dec 10 21:42:35 db03 kernel: Intel machine check reporting enabled on CPU#0.
Dec 10 21:42:30 db03 sysctl: kernel.msgmni = 1024
Dec 10 21:42:30 db03 network: Setting network parameters: succeeded
Dec 10 21:42:30 db03 network: Bringing up interface lo: succeeded
Dec 10 21:42:35 db03 kernel: CPU0: Intel Pentium III (Cascades) stepping 01
Dec 10 21:42:35 db03 kernel: per-CPU timeslice cutoff: 2927.35 usecs.
Dec 10 21:42:35 db03 kernel: enabled ExtINT on CPU#0
Dec 10 21:42:35 db03 kernel: ESR value before enabling vector: 00000000
Dec 10 21:42:35 db03 sshd[647]: Server listening on 0.0.0.0 port 22.
Dec 10 21:42:35 db03 sshd: sshd startup succeeded
Dec 10 21:42:35 db03 kernel: ESR value after enabling vector: 00000000
Dec 10 21:42:35 db03 sshd: ^[[60G
Dec 10 21:42:35 db03 kernel: Booting processor 1/0 eip 2000
Dec 10 21:42:35 db03 kernel: Initializing CPU#1
Dec 10 21:42:36 db03 kernel: masked ExtINT on CPU#1
Dec 10 21:42:36 db03 sshd:
Dec 10 21:42:36 db03 kernel: ESR value before enabling vector: 00000000
Dec 10 21:42:36 db03 rc: Starting sshd: succeeded
Dec 10 21:42:36 db03 kernel: ESR value after enabling vector: 00000000
Dec 10 21:42:36 db03 kernel: Calibrating delay loop... 1395.91 BogoMIPS
Dec 10 21:42:36 db03 kernel: CPU: L1 I cache: 16K, L1 D cache: 16K
Dec 10 21:42:36 db03 kernel: CPU: L2 cache: 1024K
Dec 10 21:42:36 db03 kernel: Intel machine check reporting enabled on CPU#1.
Dec 10 21:42:36 db03 ucd-snmp[629]: UCD-SNMP version 4.2.5
Dec 10 21:42:36 db03 kernel: CPU1: Intel Pentium III (Cascades) stepping 01
Dec 10 21:42:36 db03 kernel: Booting processor 2/1 eip 2000
Dec 10 21:42:36 db03 kernel: Initializing CPU#2
Dec 10 21:42:36 db03 kernel: masked ExtINT on CPU#2
Dec 10 21:42:36 db03 kernel: ESR value before enabling vector: 00000000
Dec 10 21:42:36 db03 kernel: ESR value after enabling vector: 00000000
Dec 10 21:42:36 db03 kernel: Calibrating delay loop... 1395.91 BogoMIPS
Dec 10 21:42:36 db03 kernel: CPU: L1 I cache: 16K, L1 D cache: 16K
Dec 10 21:42:36 db03 kernel: CPU: L2 cache: 1024K
Dec 10 21:42:36 db03 kernel: Intel machine check reporting enabled on CPU#2.
Dec 10 21:42:36 db03 kernel: CPU2: Intel Pentium III (Cascades) stepping 01
Dec 10 21:42:36 db03 kernel: Booting processor 3/2 eip 2000
Dec 10 21:42:36 db03 kernel: Initializing CPU#3
Dec 10 21:42:36 db03 kernel: masked ExtINT on CPU#3
Dec 10 21:42:36 db03 kernel: ESR value before enabling vector: 00000000
Dec 10 21:42:36 db03 kernel: ESR value after enabling vector: 00000000
Dec 10 21:42:36 db03 kernel: Calibrating delay loop... 1395.91 BogoMIPS
Dec 10 21:42:36 db03 kernel: CPU: L1 I cache: 16K, L1 D cache: 16K
Dec 10 21:42:36 db03 kernel: CPU: L2 cache: 1024K
Dec 10 21:42:36 db03 kernel: Intel machine check reporting enabled on CPU#3.
Dec 10 21:42:36 db03 kernel: CPU3: Intel Pentium III (Cascades) stepping 01
Dec 10 21:42:36 db03 kernel: Total of 4 processors activated (5583.66
BogoMIPS).
Dec 10 21:42:36 db03 kernel: ENABLING IO-APIC IRQs
Dec 10 21:42:36 db03 xinetd[680]: xinetd Version 2.3.7 started with libwrap
options compiled in.
Dec 10 21:42:36 db03 kernel: Setting 14 in the phys_id_present_map
Dec 10 21:42:36 db03 xinetd[680]: Started working: 0 available services
Dec 10 21:42:36 db03 kernel: ...changing IO-APIC physical APIC ID to 14 ...
ok.
Dec 10 21:42:36 db03 kernel: Setting 13 in the phys_id_present_map
Dec 10 21:42:36 db03 kernel: ...changing IO-APIC physical APIC ID to 13 ...
ok.
Dec 10 21:42:36 db03 kernel: ..TIMER: vector=0x31 pin1=2 pin2=-1
Dec 10 21:42:36 db03 kernel: ..MP-BIOS bug: 8254 timer not connected to
IO-APIC
Dec 10 21:42:36 db03 kernel: ...trying to set up timer (IRQ0) through the
8259A ... failed.
Dec 10 21:42:36 db03 kernel: ...trying to set up timer as Virtual Wire
IRQ... works.
Dec 10 21:42:37 db03 kernel: testing the IO APIC.......................
Dec 10 21:42:37 db03 kernel:
Dec 10 21:42:37 db03 kernel:
Dec 10 21:42:37 db03 kernel: .................................... done.
Dec 10 21:42:37 db03 kernel: Using local APIC timer interrupts.
Dec 10 21:42:37 db03 kernel: calibrating APIC timer ...
Dec 10 21:42:37 db03 kernel: ..... CPU clock speed is 699.3801 MHz.
Dec 10 21:42:37 db03 kernel: ..... host bus clock speed is 99.9113 MHz.
Dec 10 21:42:37 db03 kernel: cpu: 0, clocks: 999113, slice: 199822
Dec 10 21:42:37 db03 kernel: CPU0<T0:999104,T1:799280,D:2,S:199822,C:999113>
Dec 10 21:42:37 db03 kernel: cpu: 1, clocks: 999113, slice: 199822
Dec 10 21:42:37 db03 kernel: cpu: 2, clocks: 999113, slice: 199822
Dec 10 21:42:37 db03 kernel: cpu: 3, clocks: 999113, slice: 199822
Dec 10 21:42:37 db03 kernel: CPU2<T0:999104,T1:399632,D:6,S:199822,C:999113>
Dec 10 21:42:37 db03 kernel: CPU3<T0:999104,T1:199808,D:8,S:199822,C:999113>
Dec 10 21:42:37 db03 kernel: CPU1<T0:999104,T1:599456,D:4,S:199822,C:999113>
Dec 10 21:42:37 db03 kernel: checking TSC synchronization across CPUs:
passed.
Dec 10 21:42:37 db03 kernel: Waiting on wait_init_idle (map = 0xe)
Dec 10 21:42:37 db03 kernel: All processors have done init_idle
Dec 10 21:42:37 db03 kernel: PCI: PCI BIOS revision 2.10 entry at 0xfd32c,
last bus=8
Dec 10 21:42:37 db03 kernel: PCI: Using configuration type 1
Dec 10 21:42:37 db03 kernel: PCI: Probing PCI hardware
Dec 10 21:42:37 db03 kernel: PCI: Discovered peer bus 02
Dec 10 21:42:37 db03 kernel: PCI->APIC IRQ transform: (B0,I5,P0) -> 16
Dec 10 21:42:37 db03 kernel: PCI->APIC IRQ transform: (B0,I15,P0) -> 19
Dec 10 21:42:37 db03 kernel: PCI->APIC IRQ transform: (B2,I1,P0) -> 17
Dec 10 21:42:37 db03 kernel: PCI->APIC IRQ transform: (B2,I1,P1) -> 18
Dec 10 21:42:37 db03 kernel: PCI->APIC IRQ transform: (B2,I6,P0) -> 25
Dec 10 21:42:37 db03 kernel: Linux NET4.0 for Linux 2.4
Dec 10 21:42:37 db03 kernel: Based upon Swansea University Computer Society
NET3.039
Dec 10 21:42:37 db03 kernel: Initializing RT netlink socket
Dec 10 21:42:37 db03 kernel: Starting kswapd
Dec 10 21:42:37 db03 kernel: allocated 32 pages and 32 bhs reserved for the
highmem bounces
Dec 10 21:42:37 db03 kernel: VFS: Diskquotas version dquot_6.4.0 initialized
Dec 10 21:42:37 db03 kernel: Journalled Block Device driver loaded
Dec 10 21:42:37 db03 kernel: Installing knfsd (copyright (C) 1996
[email protected]).
Dec 10 21:42:37 db03 kernel: pty: 256 Unix98 ptys configured
Dec 10 21:42:37 db03 kernel: Serial driver version 5.05c (2001-07-08) with
MANY_PORTS SHARE_IRQ SERIAL_PCI enabled
Dec 10 21:42:37 db03 kernel: ttyS00 at 0x03f8 (irq = 4) is a 16550A
Dec 10 21:42:37 db03 kernel: ttyS01 at 0x02f8 (irq = 3) is a 16550A
Dec 10 21:42:37 db03 kernel: Uniform Multi-Platform E-IDE driver Revision:
6.31
Dec 10 21:42:37 db03 kernel: ide: Assuming 33MHz system bus speed for PIO
modes; override with idebus=xx
Dec 10 21:42:37 db03 kernel: ServerWorks OSB4: IDE controller on PCI bus 00
dev 79
Dec 10 21:42:37 db03 kernel: ServerWorks OSB4: detected chipset, but driver
not compiled in!
Dec 10 21:42:37 db03 kernel: ServerWorks OSB4: chipset revision 0
Dec 10 21:42:37 db03 kernel: ServerWorks OSB4: not 100%% native mode: will
probe irqs later
Dec 10 21:42:37 db03 kernel: ide0: BM-DMA at 0x0700-0x0707, BIOS
settings: hda:DMA, hdb:DMA
Dec 10 21:42:37 db03 kernel: ide1: BM-DMA at 0x0708-0x070f, BIOS
settings: hdc:pio, hdd:pio
Dec 10 21:42:37 db03 kernel: hda: LG CD-ROM CRD-8484B, ATAPI CD/DVD-ROM
drive
Dec 10 21:42:37 db03 kernel: ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
Dec 10 21:42:37 db03 kernel: Floppy drive(s): fd0 is 1.44M
Dec 10 21:42:37 db03 kernel: FDC 0 is a National Semiconductor PC87306
Dec 10 21:42:37 db03 kernel: SCSI subsystem driver Revision: 1.00
Dec 10 21:42:37 db03 kernel: Red Hat/Adaptec aacraid driver, Dec 10 2002
Dec 10 21:42:37 db03 kernel: scsi0 : Adaptec AIC7XXX EISA/VLB/PCI SCSI HBA
DRIVER, Rev 6.2.8
Dec 10 21:42:37 db03 kernel: <Adaptec aic7899 Ultra160 SCSI adapter>
Dec 10 21:42:37 db03 kernel: aic7899: Ultra160 Wide Channel A, SCSI
Id=7, 32/253 SCBs
Dec 10 21:42:37 db03 kernel:
Dec 10 21:42:37 db03 kernel: scsi1 : Adaptec AIC7XXX EISA/VLB/PCI SCSI HBA
DRIVER, Rev 6.2.8
Dec 10 21:42:37 db03 kernel: <Adaptec aic7899 Ultra160 SCSI adapter>
Dec 10 21:42:37 db03 kernel: aic7899: Ultra160 Wide Channel B, SCSI
Id=7, 32/253 SCBs
Dec 10 21:42:37 db03 kernel:
Dec 10 21:42:37 db03 kernel: blk: queue f7963c18, I/O limit 4095Mb (mask
0xffffffff)
Dec 10 21:42:37 db03 kernel: scsi2 : IBM PCI ServeRAID 5.10.21 <ServeRAID
4H>
Dec 10 21:42:37 db03 kernel: Vendor: IBM Model: SERVERAID
Rev: 1.00
Dec 10 21:42:37 db03 kernel: Type: Direct-Access
ANSI SCSI revision: 02
Dec 10 21:42:37 db03 kernel: Vendor: IBM Model: SERVERAID
Rev: 1.00
Dec 10 21:42:37 db03 kernel: Type: Direct-Access
ANSI SCSI revision: 02
Dec 10 21:42:37 db03 kernel: Vendor: IBM Model: SERVERAID
Rev: 1.00
Dec 10 21:42:37 db03 kernel: Type: Processor
ANSI SCSI revision: 02
Dec 10 21:42:37 db03 kernel: Vendor: IBM Model: YGLv3 S2
Rev: 0
Dec 10 21:42:37 db03 kernel: Type: Processor
ANSI SCSI revision: 02
Dec 10 21:42:37 db03 kernel: Vendor: IBM Model: EXP300 S160
Rev: D014
Dec 10 21:42:37 db03 kernel: Type: Processor
ANSI SCSI revision: 03
Dec 10 21:42:37 db03 kernel: Vendor: IBM Model: EXP300 S160
Rev: D014
Dec 10 21:42:37 db03 kernel: Type: Processor
ANSI SCSI revision: 03
Dec 10 21:42:37 db03 kernel: megaraid: v1.18 (Release Date: Thu Oct 11
15:02:53 EDT 2001)
Dec 10 21:42:37 db03 kernel: megaraid: no BIOS enabled.
Dec 10 21:42:37 db03 kernel: Attached scsi disk sda at scsi2, channel 0, id
0, lun 0
Dec 10 21:42:37 db03 kernel: Attached scsi disk sdb at scsi2, channel 0, id
1, lun 0
Dec 10 21:42:37 db03 kernel: SCSI device sda: 35547136 512-byte hdwr sectors
(18200 MB)
Dec 10 21:42:37 db03 kernel: Partition check:
Dec 10 21:42:37 db03 kernel: sda: sda1 sda2 sda3 sda4 < sda5 sda6 sda7 sda8
>
Dec 10 21:42:37 db03 kernel: SCSI device sdb: 177735680 512-byte hdwr
sectors (91001 MB)
Dec 10 21:42:37 db03 kernel: sdb: sdb1
Dec 10 21:42:37 db03 kernel: md: raid1 personality registered as nr 3
Dec 10 21:42:37 db03 kernel: md: raid5 personality registered as nr 4
Dec 10 21:42:37 db03 kernel: raid5: measuring checksumming speed
Dec 10 21:42:37 db03 kernel: 8regs : 1291.200 MB/sec
Dec 10 21:42:37 db03 kernel: 32regs : 606.800 MB/sec
Dec 10 21:42:37 db03 kernel: pIII_sse : 1406.000 MB/sec
Dec 10 21:42:37 db03 kernel: pII_mmx : 1599.600 MB/sec
Dec 10 21:42:37 db03 kernel: p5_mmx : 1668.400 MB/sec
Dec 10 21:42:38 db03 kernel: raid5: using function: pIII_sse (1406.000
MB/sec)
Dec 10 21:42:38 db03 kernel: md: md driver 0.90.0 MAX_MD_DEVS=256,
MD_SB_DISKS=27
Dec 10 21:42:38 db03 kernel: md: Autodetecting RAID arrays.
Dec 10 21:42:38 db03 kernel: md: autorun ...
Dec 10 21:42:38 db03 kernel: md: ... autorun DONE.
Dec 10 21:42:38 db03 kernel: NET4: Linux TCP/IP 1.0 for NET4.0
Dec 10 21:42:38 db03 kernel: IP Protocols: ICMP, UDP, TCP
Dec 10 21:42:38 db03 kernel: IP: routing cache hash table of 32768 buckets,
256Kbytes
Dec 10 21:42:38 db03 kernel: TCP: Hash tables configured (established 262144
bind 65536)
Dec 10 21:42:38 db03 kernel: NET4: Unix domain sockets 1.0/SMP for Linux
NET4.0.
Dec 10 21:42:38 db03 kernel: VFS: Mounted root (ext2 filesystem) readonly.
Dec 10 21:42:38 db03 kernel: Freeing unused kernel memory: 108k freed
Dec 10 21:42:38 db03 kernel: Real Time Clock Driver v1.10e
Dec 10 21:42:38 db03 kernel: Adding Swap: 2097136k swap-space (priority -1)
Dec 10 21:42:38 db03 kernel: pcnet32.c:v1.27b 01.10.2002
[email protected]
Dec 10 21:42:38 db03 kernel: pcnet32: PCnet/FAST III 79C975 at 0x2200, 00 02
55 fc 32 5c assigned IRQ 16.
Dec 10 21:42:38 db03 kernel: eth0: registered as PCnet/FAST III 79C975
Dec 10 21:42:38 db03 kernel: pcnet32: 1 cards_found.
Dec 10 21:42:38 db03 kernel: eth0: link up, 100Mbps, full-duplex, lpa 0x41E1
Dec 10 21:42:39 db03 xinetd: xinetd startup succeeded
Dec 10 21:42:40 db03 sendmail: sendmail startup succeeded
Dec 10 21:42:40 db03 crond: crond startup succeeded
Dec 10 21:42:40 db03 atd: atd startup succeeded
Dec 10 21:42:41 db03 su(pam_unix)[789]: session opened for user db2admin by
(uid=0)
Dec 10 21:42:44 db03 su(pam_unix)[789]: session closed for user db2admin
Dec 10 21:42:44 db03 su(pam_unix)[875]: session opened for user db2iholy by
(uid=0)
Dec 10 21:42:46 db03 su(pam_unix)[875]: session closed for user db2iholy
Dec 10 21:42:46 db03 su(pam_unix)[940]: session opened for user db2ijava by
(uid=0)
Dec 10 21:42:47 db03 su(pam_unix)[940]: session closed for user db2ijava
Dec 10 21:42:47 db03 su(pam_unix)[1005]: session opened for user db2ietsb by
(uid=0)
Dec 10 21:42:49 db03 su(pam_unix)[1005]: session closed for user db2ietsb
CONFIG_X86=y
CONFIG_UID16=y
CONFIG_EXPERIMENTAL=y
CONFIG_MODULES=y
CONFIG_KMOD=y
CONFIG_MPENTIUMIII=y
CONFIG_X86_WP_WORKS_OK=y
CONFIG_X86_INVLPG=y
CONFIG_X86_CMPXCHG=y
CONFIG_X86_XADD=y
CONFIG_X86_BSWAP=y
CONFIG_X86_POPAD_OK=y
CONFIG_RWSEM_XCHGADD_ALGORITHM=y
CONFIG_X86_L1_CACHE_SHIFT=5
CONFIG_X86_HAS_TSC=y
CONFIG_X86_GOOD_APIC=y
CONFIG_X86_PGE=y
CONFIG_X86_USE_PPRO_CHECKSUM=y
CONFIG_X86_F00F_WORKS_OK=y
CONFIG_X86_MCE=y
CONFIG_MICROCODE=m
CONFIG_HIGHMEM4G=y
CONFIG_HIGHMEM=y
CONFIG_HIGHIO=y
CONFIG_MTRR=y
CONFIG_SMP=y
CONFIG_X86_TSC=y
CONFIG_HAVE_DEC_LOCK=y
CONFIG_NET=y
CONFIG_X86_IO_APIC=y
CONFIG_X86_LOCAL_APIC=y
CONFIG_PCI=y
CONFIG_PCI_GOANY=y
CONFIG_PCI_BIOS=y
CONFIG_PCI_DIRECT=y
CONFIG_PCI_NAMES=y
CONFIG_HOTPLUG=y
CONFIG_HOTPLUG_PCI=m
CONFIG_HOTPLUG_PCI_IBM=m
CONFIG_SYSVIPC=y
CONFIG_BSD_PROCESS_ACCT=y
CONFIG_SYSCTL=y
CONFIG_KCORE_ELF=y
CONFIG_BINFMT_AOUT=y
CONFIG_BINFMT_ELF=y
CONFIG_BINFMT_MISC=y
CONFIG_PARPORT=m
CONFIG_PARPORT_PC=m
CONFIG_PARPORT_PC_CML1=m
CONFIG_PARPORT_PC_FIFO=y
CONFIG_PARPORT_1284=y
CONFIG_BLK_DEV_FD=y
CONFIG_BLK_DEV_LOOP=m
CONFIG_BLK_DEV_NBD=m
CONFIG_BLK_DEV_RAM=m
CONFIG_BLK_DEV_RAM_SIZE=4096
CONFIG_BLK_STATS=y
CONFIG_MD=y
CONFIG_BLK_DEV_MD=y
CONFIG_MD_RAID1=y
CONFIG_MD_RAID5=y
CONFIG_MD_MULTIPATH=m
CONFIG_BLK_DEV_LVM=m
CONFIG_PACKET=y
CONFIG_NETFILTER=y
CONFIG_FILTER=y
CONFIG_UNIX=y
CONFIG_INET=y
CONFIG_IP_ADVANCED_ROUTER=y
CONFIG_IP_ROUTE_MULTIPATH=y
CONFIG_NET_IPIP=m
CONFIG_NET_IPGRE=m
CONFIG_INET_ECN=y
CONFIG_SYN_COOKIES=y
CONFIG_IP_NF_IPTABLES=m
CONFIG_IP_NF_MATCH_LIMIT=m
CONFIG_IP_NF_MATCH_MAC=m
CONFIG_IP_NF_MATCH_PKTTYPE=m
CONFIG_IP_NF_MATCH_MARK=m
CONFIG_IP_NF_MATCH_MULTIPORT=m
CONFIG_IP_NF_MATCH_TOS=m
CONFIG_IP_NF_MATCH_ECN=m
CONFIG_IP_NF_MATCH_DSCP=m
CONFIG_IP_NF_MATCH_AH_ESP=m
CONFIG_IP_NF_MATCH_LENGTH=m
CONFIG_IP_NF_MATCH_TTL=m
CONFIG_IP_NF_MATCH_TCPMSS=m
CONFIG_IP_NF_MATCH_UNCLEAN=m
CONFIG_IP_NF_MATCH_OWNER=m
CONFIG_IP_NF_FILTER=m
CONFIG_IP_NF_TARGET_REJECT=m
CONFIG_IP_NF_MANGLE=m
CONFIG_IP_NF_TARGET_TOS=m
CONFIG_IP_NF_TARGET_ECN=m
CONFIG_IP_NF_TARGET_DSCP=m
CONFIG_IP_NF_TARGET_MARK=m
CONFIG_IP_NF_TARGET_LOG=m
CONFIG_IP_NF_TARGET_ULOG=m
CONFIG_IP_NF_TARGET_TCPMSS=m
CONFIG_IP_NF_ARPTABLES=m
CONFIG_IP_NF_ARPFILTER=m
CONFIG_IPV6=m
CONFIG_IP6_NF_QUEUE=m
CONFIG_ATALK=m
CONFIG_NET_SCHED=y
CONFIG_NET_SCH_CBQ=m
CONFIG_NET_SCH_HTB=m
CONFIG_NET_SCH_CSZ=m
CONFIG_NET_SCH_PRIO=m
CONFIG_NET_SCH_RED=m
CONFIG_NET_SCH_SFQ=m
CONFIG_NET_SCH_TEQL=m
CONFIG_NET_SCH_TBF=m
CONFIG_NET_SCH_GRED=m
CONFIG_NET_SCH_INGRESS=m
CONFIG_NET_QOS=y
CONFIG_NET_ESTIMATOR=y
CONFIG_NET_CLS=y
CONFIG_NET_CLS_TCINDEX=m
CONFIG_NET_CLS_ROUTE4=m
CONFIG_NET_CLS_ROUTE=y
CONFIG_NET_CLS_FW=m
CONFIG_NET_CLS_U32=m
CONFIG_NET_CLS_RSVP=m
CONFIG_NET_CLS_RSVP6=m
CONFIG_NET_CLS_POLICE=y
CONFIG_IDE=y
CONFIG_BLK_DEV_IDE=y
CONFIG_BLK_DEV_IDEDISK=y
CONFIG_BLK_DEV_IDECD=m
CONFIG_BLK_DEV_IDEPCI=y
CONFIG_IDEPCI_SHARE_IRQ=y
CONFIG_BLK_DEV_IDEDMA_PCI=y
CONFIG_IDEDMA_PCI_AUTO=y
CONFIG_BLK_DEV_IDEDMA=y
CONFIG_BLK_DEV_ADMA=y
CONFIG_IDEDMA_AUTO=y
CONFIG_SCSI=y
CONFIG_BLK_DEV_SD=y
CONFIG_SD_EXTRA_DEVS=40
CONFIG_CHR_DEV_ST=m
CONFIG_BLK_DEV_SR=m
CONFIG_SR_EXTRA_DEVS=2
CONFIG_CHR_DEV_SG=m
CONFIG_SCSI_DEBUG_QUEUES=y
CONFIG_SCSI_MULTI_LUN=y
CONFIG_SCSI_CONSTANTS=y
CONFIG_SCSI_LOGGING=y
CONFIG_SCSI_AHA1740=m
CONFIG_SCSI_AACRAID=y
CONFIG_SCSI_AIC7XXX=y
CONFIG_AIC7XXX_CMDS_PER_DEVICE=253
CONFIG_AIC7XXX_RESET_DELAY_MS=15000
CONFIG_SCSI_MEGARAID=y
CONFIG_SCSI_GDTH=y
CONFIG_SCSI_IPS=y
CONFIG_NETDEVICES=y
CONFIG_DUMMY=m
CONFIG_BONDING=m
CONFIG_EQUALIZER=m
CONFIG_NET_ETHERNET=y
CONFIG_NET_VENDOR_3COM=y
CONFIG_VORTEX=m
CONFIG_NET_PCI=y
CONFIG_PCNET32=m
CONFIG_EEPRO100=y
CONFIG_NE2K_PCI=m
CONFIG_PLIP=m
CONFIG_PPP=m
CONFIG_PPP_MULTILINK=y
CONFIG_PPP_FILTER=y
CONFIG_PPP_ASYNC=m
CONFIG_PPP_SYNC_TTY=m
CONFIG_PPP_DEFLATE=m
CONFIG_PPP_BSDCOMP=m
CONFIG_SLIP=m
CONFIG_SLIP_COMPRESSED=y
CONFIG_SLIP_SMART=y
CONFIG_SLIP_MODE_SLIP6=y
CONFIG_SHAPER=m
CONFIG_INPUT=m
CONFIG_INPUT_KEYBDEV=m
CONFIG_INPUT_MOUSEDEV=m
CONFIG_INPUT_MOUSEDEV_SCREEN_X=1024
CONFIG_INPUT_MOUSEDEV_SCREEN_Y=768
CONFIG_VT=y
CONFIG_VT_CONSOLE=y
CONFIG_SERIAL=y
CONFIG_SERIAL_CONSOLE=y
CONFIG_SERIAL_EXTENDED=y
CONFIG_SERIAL_MANY_PORTS=y
CONFIG_SERIAL_SHARE_IRQ=y
CONFIG_UNIX98_PTYS=y
CONFIG_UNIX98_PTY_COUNT=256
CONFIG_PRINTER=m
CONFIG_LP_CONSOLE=y
CONFIG_MOUSE=y
CONFIG_PSMOUSE=y
CONFIG_WATCHDOG=y
CONFIG_SOFT_WATCHDOG=m
CONFIG_RTC=m
CONFIG_QUOTA=y
CONFIG_AUTOFS4_FS=y
CONFIG_EXT3_FS=y
CONFIG_JBD=y
CONFIG_JBD_DEBUG=y
CONFIG_FAT_FS=m
CONFIG_MSDOS_FS=m
CONFIG_UMSDOS_FS=m
CONFIG_VFAT_FS=m
CONFIG_TMPFS=y
CONFIG_RAMFS=y
CONFIG_ISO9660_FS=y
CONFIG_JOLIET=y
CONFIG_PROC_FS=y
CONFIG_DEVPTS_FS=y
CONFIG_EXT2_FS=y
CONFIG_CODA_FS=m
CONFIG_NFS_FS=y
CONFIG_NFS_V3=y
CONFIG_NFSD=y
CONFIG_NFSD_V3=y
CONFIG_SUNRPC=y
CONFIG_LOCKD=y
CONFIG_LOCKD_V4=y
CONFIG_SMB_FS=y
CONFIG_MSDOS_PARTITION=y
CONFIG_SMB_NLS=y
CONFIG_NLS=y
CONFIG_NLS_DEFAULT="iso8859-1"
CONFIG_NLS_CODEPAGE_437=y
CONFIG_NLS_CODEPAGE_850=y
CONFIG_NLS_CODEPAGE_866=m
CONFIG_NLS_ISO8859_1=y
CONFIG_NLS_ISO8859_15=m
CONFIG_NLS_KOI8_R=m
CONFIG_VGA_CONSOLE=y
CONFIG_VIDEO_SELECT=y
CONFIG_ZLIB_INFLATE=m
CONFIG_ZLIB_DEFLATE=m
-----BEGIN PGP SIGNATURE-----
Version: PGP 7.0.4
iQA/AwUBPfZxrVcv4X0c4GKrEQJ5WACfZvlo9cK/se4vxUVx0uOuYRoIlrEAn2/9
TOMLYwBnm6iHgKqu5a+K9BWO
=v4EB
-----END PGP SIGNATURE-----
> I'm experiencing serious problems with Kernel 2.4.20 on a IBM xSeries 350
> machine, having 4 700 MHz processors and 4 GB RAM (same on another machine
> with the same configuration, but only 3 GB RAM). The machine just com-
> pletely freezes after some time, ranging from 20 minutes to 3 hours. It
> is running IBM DB/2 with quite some load, the base system is RedHat 7.2
> with all the updates applied. There is no oops or other fault, just a
> plain freeze.
Can you watch /proc/meminfo and see how low "lowfree" gets?
If it gets low (eg below 50Mb), dump /proc/slabinfo as well.
M.
On Tue, Dec 10, 2002 at 04:10:21PM -0800, Martin J. Bligh wrote:
> > I'm experiencing serious problems with Kernel 2.4.20 on a IBM xSeries 350
> > machine, having 4 700 MHz processors and 4 GB RAM (same on another machine
> > with the same configuration, but only 3 GB RAM). The machine just com-
> > pletely freezes after some time, ranging from 20 minutes to 3 hours. It
> > is running IBM DB/2 with quite some load, the base system is RedHat 7.2
> > with all the updates applied. There is no oops or other fault, just a
> > plain freeze.
>
> Can you watch /proc/meminfo and see how low "lowfree" gets?
> If it gets low (eg below 50Mb), dump /proc/slabinfo as well.
I'm running off a Soyo Dragon KT400 board, single AMD 2400+
processor, 1GB ram (4GB limit set in kernel), and was also having
freezes, apparently related to having software raid 1 in use (on two
drives sitting on the on-board Highpoint controller). If I started a
large data transfer over the net, the machine would freeze after some
time ranging from a few minutes to an hour, with either 2.4.20-ac2 or
2.4.21-pre2. I tried letting the system resync before restarting, and
the first pass through it actually froze during resyncing, with
nothing special going on. Later, after a resync, I started trying all
sorts of things, from turning off XFree86 and running a minimal set of
loaded modules, to using mdadm to fail one of the drives (it was a
RAID1 setup) to force only a single disk to be in use. Right now,
I've taken it off of RAID entirely, and am mounting /dev/hdex
directly, and copying data to that, and it seems to be okay so far
(for the last hour or so).
cat /proc/meminfo gives:
total: used: free: shared: buffers: cached:
Mem: 1055412224 1045782528 9629696 0 90771456 720228352
Swap: 526376960 39202816 487174144
MemTotal: 1030676 kB
MemFree: 9404 kB
MemShared: 0 kB
Buffers: 88644 kB
Cached: 684644 kB
SwapCached: 18704 kB
Active: 540556 kB
Inact_dirty: 356560 kB
Inact_clean: 44764 kB
Inact_target: 188376 kB
HighTotal: 131008 kB
HighFree: 1024 kB
LowTotal: 899668 kB
LowFree: 8380 kB
SwapTotal: 514040 kB
SwapFree: 475756 kB
Committed_AS: 322008 kB
So if you were concerned about LowFree going low, it is.
/proc/slabinfo:
slabinfo - version: 1.1
kmem_cache 68 68 112 2 2 1
fib6_nodes 5 112 32 1 1 1
ip6_dst_cache 5 20 192 1 1 1
ndisc_cache 1 30 128 1 1 1
ip_conntrack 10 24 320 2 2 1
tcp_tw_bucket 0 0 128 0 0 1
tcp_bind_bucket 25 112 32 1 1 1
tcp_open_request 0 0 128 0 0 1
inet_peer_cache 0 0 64 0 0 1
ip_fib_hash 9 112 32 1 1 1
ip_dst_cache 12 40 192 2 2 1
arp_cache 3 30 128 1 1 1
urb_priv 4 59 64 1 1 1
blkdev_requests 1408 1410 128 47 47 1
nfs_write_data 0 0 384 0 0 1
nfs_read_data 0 0 384 0 0 1
nfs_page 0 0 128 0 0 1
journal_head 26 77 48 1 1 1
revoke_table 1 250 12 1 1 1
revoke_record 0 0 32 0 0 1
dnotify_cache 0 0 20 0 0 1
file_lock_cache 4 40 96 1 1 1
fasync_cache 1 202 16 1 1 1
uid_cache 6 112 32 1 1 1
skbuff_head_cache 163 260 192 13 13 1
sock 201 204 896 51 51 1
sigqueue 1 29 132 1 1 1
kiobuf 0 0 64 0 0 1
cdev_cache 22 472 64 8 8 1
bdev_cache 9 59 64 1 1 1
mnt_cache 18 59 64 1 1 1
inode_cache 54639 57071 512 8153 8153 1
dentry_cache 804 4050 128 135 135 1
dquot 0 0 128 0 0 1
filp 1563 1590 128 53 53 1
names_cache 0 2 4096 0 2 1
buffer_head 185515 191520 128 6368 6384 1
mm_struct 63 80 192 4 4 1
vm_area_struct 2749 2850 128 92 95 1
fs_cache 62 118 64 2 2 1
files_cache 62 63 448 7 7 1
signal_act 71 75 1344 24 25 1
pte_chain 70104 74592 8 221 222 1
size-131072(DMA) 0 0 131072 0 0 32
size-131072 0 0 131072 0 0 32
size-65536(DMA) 0 0 65536 0 0 16
size-65536 2 2 65536 2 2 16
size-32768(DMA) 0 0 32768 0 0 8
size-32768 2 2 32768 2 2 8
size-16384(DMA) 0 0 16384 0 0 4
size-16384 2 7 16384 2 7 4
size-8192(DMA) 0 0 8192 0 0 2
size-8192 15 19 8192 15 19 2
size-4096(DMA) 0 0 4096 0 0 1
size-4096 121 139 4096 121 139 1
size-2048(DMA) 0 0 2048 0 0 1
size-2048 50 130 2048 26 65 1
size-1024(DMA) 0 0 1024 0 0 1
size-1024 53 60 1024 14 15 1
size-512(DMA) 0 0 512 0 0 1
size-512 99 120 512 13 15 1
size-256(DMA) 0 0 256 0 0 1
size-256 86 120 256 6 8 1
size-128(DMA) 3 30 128 1 1 1
size-128 953 990 128 33 33 1
size-64(DMA) 0 0 64 0 0 1
size-64 776 1062 64 17 18 1
size-32(DMA) 52 59 64 1 1 1
size-32 714 767 64 13 13 1
Does this provide you with any useful information?
--
Zed Pobre <[email protected]> a.k.a. Zed Pobre <[email protected]>
PGP key and fingerprint available on finger; encrypted mail welcomed.
On Thu, Dec 26, 2002 at 03:43:38PM -0600, Zed Pobre wrote:
>
> I'm running off a Soyo Dragon KT400 board, single AMD 2400+
> processor, 1GB ram (4GB limit set in kernel), and was also having
> freezes, apparently related to having software raid 1 in use (on two
> drives sitting on the on-board Highpoint controller). If I started a
> large data transfer over the net, the machine would freeze after some
> time ranging from a few minutes to an hour, with either 2.4.20-ac2 or
> 2.4.21-pre2.
As a followup to this, taking it off RAID has greatly helped
stability, but not completely cured it, as I've managed to get another
hard lock while doing a 2GB or so rsync. It seems to be fine for
normal use, though, and I'm now contemplating turning RAID back on to
see if it stays stable for anything except large file transfers.
--
Zed Pobre <[email protected]> a.k.a. Zed Pobre <[email protected]>
PGP key and fingerprint available on finger; encrypted mail welcomed.