2005-10-27 17:47:40

by Michael Madore

[permalink] [raw]
Subject: PCI-DMA: high address but no IOMMU

Hi,

I am seeing the following errors in /var/log/messages when booting
2.6.14-rc5 on a dual Opteron nforce4 motherboard with 8GB of RAM:

Checking aperture...
CPU 0: aperture @ be8c000000 size 32 MB
Aperture from northbridge cpu 0 too small (32 MB)
No AGP bridge found
Your BIOS doesn't leave a aperture memory hole
Please enable the IOMMU option in the BIOS setup
This costs you 64 MB of RAM
Mapping aperture over 65536 KB of RAM @ 8000000

...

PCI-DMA: Disabling AGP.
PCI-DMA: More than 4GB of RAM and no IOMMU
PCI-DMA: 32bit PCI IO may malfunction.<6>PCI-DMA: Disabling IOMMU.

...

Attached scsi disk sda at scsi2, channel 0, id 0, lun 0
Kernel panic - not syncing: PCI-DMA: high address but no IOMMU.

With 2.6.13, the systems boots OK with these messages in the log:

Checking aperture...
CPU 0: aperture @ 8000000 size 32 MB
Aperture from northbridge cpu 0 too small (32 MB)
No AGP bridge found
Your BIOS doesn't leave a aperture memory hole
Please enable the IOMMU option in the BIOS setup
This costs you 64 MB of RAM
Mapping aperture over 65536 KB of RAM @ 8000000

...

PCI-DMA: Disabling AGP.
PCI-DMA: aperture base @ 8000000 size 65536 KB
PCI-DMA: Reserving 64MB of IOMMU area in the AGP aperture

Using git bisect, I narrowed the problem down to the following commit:

6142891a0c0209c91aa4a98f725de0d6e2ed4918 is first bad commit
diff-tree 6142891a0c0209c91aa4a98f725de0d6e2ed4918 (from
357e11d4cbbbb959a88a9bdbbf33a10f160b0823)
Author: Andi Kleen <[email protected]>
Date: Mon Sep 12 18:49:24 2005 +0200

[PATCH] x86-64: Avoid unnecessary double bouncing for swiotlb

PCI_DMA_BUS_IS_PHYS has to be zero even when the GART IOMMU is disabled
and the swiotlb is used. Otherwise the block layer does unnecessary
double bouncing.

Signed-off-by: Andi Kleen <[email protected]>
Signed-off-by: Linus Torvalds <[email protected]>

:040000 040000 d704d51d1e05f508f09c4388d3199cafbb9e3018
6a40204fd8b954634f2f7ea8f84861ed0a4bd88e M include

Reverting this change allows 2.6.14-rc5 to boot.

Mike


2005-10-27 17:57:09

by Nish Aravamudan

[permalink] [raw]
Subject: Re: PCI-DMA: high address but no IOMMU

On 10/27/05, Michael Madore <[email protected]> wrote:
> Hi,
>
> I am seeing the following errors in /var/log/messages when booting
> 2.6.14-rc5 on a dual Opteron nforce4 motherboard with 8GB of RAM:
>
> Checking aperture...
> CPU 0: aperture @ be8c000000 size 32 MB
> Aperture from northbridge cpu 0 too small (32 MB)
> No AGP bridge found
> Your BIOS doesn't leave a aperture memory hole
> Please enable the IOMMU option in the BIOS setup
> This costs you 64 MB of RAM
> Mapping aperture over 65536 KB of RAM @ 8000000
>
> ...
>
> PCI-DMA: Disabling AGP.
> PCI-DMA: More than 4GB of RAM and no IOMMU
> PCI-DMA: 32bit PCI IO may malfunction.<6>PCI-DMA: Disabling IOMMU.

I get the same message on my 2-way Opteron machine (ASUS K8N-DL mobo),
but I only have 2 GB of RAM :/ Seems odd the PCI-DMA subsystem thinks
I have more than 4 :) Anybody have any ideas?

Thanks,
Nish

2005-10-27 22:16:55

by Andi Kleen

[permalink] [raw]
Subject: Re: PCI-DMA: high address but no IOMMU

Michael Madore <[email protected]> writes:

> 2.6.14-rc5 on a dual Opteron nforce4 motherboard with 8GB of RAM:
>
> Checking aperture...
> CPU 0: aperture @ be8c000000 size 32 MB
> Aperture from northbridge cpu 0 too small (32 MB)
> No AGP bridge found
> Your BIOS doesn't leave a aperture memory hole
> Please enable the IOMMU option in the BIOS setup
> This costs you 64 MB of RAM
> Mapping aperture over 65536 KB of RAM @ 8000000
>
> ...
>
> PCI-DMA: Disabling AGP.
> PCI-DMA: More than 4GB of RAM and no IOMMU
> PCI-DMA: 32bit PCI IO may malfunction.<6>PCI-DMA: Disabling IOMMU.
>
> ...
>
> Attached scsi disk sda at scsi2, channel 0, id 0, lun 0
> Kernel panic - not syncing: PCI-DMA: high address but no IOMMU.
>
> With 2.6.13, the systems boots OK with these messages in the log:
>
> Checking aperture...
> CPU 0: aperture @ 8000000 size 32 MB
> Aperture from northbridge cpu 0 too small (32 MB)
> No AGP bridge found
> Your BIOS doesn't leave a aperture memory hole
> Please enable the IOMMU option in the BIOS setup
> This costs you 64 MB of RAM
> Mapping aperture over 65536 KB of RAM @ 8000000
>
> ...
>
> PCI-DMA: Disabling AGP.
> PCI-DMA: aperture base @ 8000000 size 65536 KB
> PCI-DMA: Reserving 64MB of IOMMU area in the AGP aperture

Can you post the full boot log?

> Using git bisect, I narrowed the problem down to the following commit:
>
> 6142891a0c0209c91aa4a98f725de0d6e2ed4918 is first bad commit
> diff-tree 6142891a0c0209c91aa4a98f725de0d6e2ed4918 (from
> 357e11d4cbbbb959a88a9bdbbf33a10f160b0823)
> Author: Andi Kleen <[email protected]>
> Date: Mon Sep 12 18:49:24 2005 +0200
>
> [PATCH] x86-64: Avoid unnecessary double bouncing for swiotlb
>
> PCI_DMA_BUS_IS_PHYS has to be zero even when the GART IOMMU is disabled
> and the swiotlb is used. Otherwise the block layer does unnecessary
> double bouncing.

Your system shouldn't be using swiotlb anyways.

-Andi

2005-10-27 22:39:22

by Michael Madore

[permalink] [raw]
Subject: Re: PCI-DMA: high address but no IOMMU

On 28 Oct 2005 00:16:51 +0200, Andi Kleen <[email protected]> wro> >
> > Checking aperture...
> > CPU 0: aperture @ 8000000 size 32 MB
> > Aperture from northbridge cpu 0 too small (32 MB)
> > No AGP bridge found
> > Your BIOS doesn't leave a aperture memory hole
> > Please enable the IOMMU option in the BIOS setup
> > This costs you 64 MB of RAM
> > Mapping aperture over 65536 KB of RAM @ 8000000
> >
> > ...
> >
> > PCI-DMA: Disabling AGP.
> > PCI-DMA: aperture base @ 8000000 size 65536 KB
> > PCI-DMA: Reserving 64MB of IOMMU area in the AGP aperture
>
> Can you post the full boot log?
>

Hi Andy,

Here is the full boot log from 2.6.14-rc5.

Mike

Bootdata ok (command line is ro root=LABEL=/ console=ttyS0,115200 console=tty0)
Linux version 2.6.14-rc5 ([email protected]) (gcc version 4.0.1
20050727 (Red Hat 4.0.1-5)) #1 SMP Tue Oct 25 11:20:20 PDT 2005
BIOS-provided physical RAM map:
BIOS-e820: 0000000000000000 - 000000000009f800 (usable)
BIOS-e820: 000000000009f800 - 00000000000a0000 (reserved)
BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
BIOS-e820: 0000000000100000 - 00000000cfff0000 (usable)
BIOS-e820: 00000000cfff0000 - 00000000cfff3000 (ACPI NVS)
BIOS-e820: 00000000cfff3000 - 00000000d0000000 (ACPI data)
BIOS-e820: 00000000e0000000 - 00000000f0000000 (reserved)
BIOS-e820: 00000000fec00000 - 0000000100000000 (reserved)
BIOS-e820: 0000000100000000 - 0000000200000000 (usable)
Scanning NUMA topology in Northbridge 24
Number of nodes 2
Node 0 MemBase 0000000000000000 Limit 00000000ffffffff
Node 1 MemBase 0000000100000000 Limit 00000001ffffffff
Using node hash shift of 22
Bootmem setup node 0 0000000000000000-00000000ffffffff
Bootmem setup node 1 0000000100000000-00000001ffffffff
Nvidia board detected. Ignoring ACPI timer override.
ACPI: PM-Timer IO Port: 0x1008
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
Processor #0 15:5 APIC version 16
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
Processor #1 15:5 APIC version 16
ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] disabled)
ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] disabled)
ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])
ACPI: IOAPIC (id[0x04] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 4, version 17, address 0xfec00000, GSI 0-23
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
ACPI: BIOS IRQ0 pin2 override ignored.
ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
ACPI: INT_SRC_OVR (bus 0 bus_irq 14 global_irq 14 high edge)
ACPI: INT_SRC_OVR (bus 0 bus_irq 15 global_irq 15 high edge)
Setting APIC routing to flat
Using ACPI (MADT) for SMP configuration information
Allocating PCI resources starting at d1000000 (gap: d0000000:10000000)
Checking aperture...
CPU 0: aperture @ be8c000000 size 32 MB
Aperture from northbridge cpu 0 too small (32 MB)
No AGP bridge found
Your BIOS doesn't leave a aperture memory hole
Please enable the IOMMU option in the BIOS setup
This costs you 64 MB of RAM
Mapping aperture over 65536 KB of RAM @ 8000000
Built 2 zonelists
Kernel command line: ro root=LABEL=/ console=ttyS0,115200 console=tty0
Initializing CPU#0
PID hash table entries: 4096 (order: 12, 131072 bytes)
time.c: Using 3.579545 MHz PM timer.
time.c: Detected 2211.346 MHz processor.
Console: colour VGA+ 80x25
Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes)
Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes)
Memory: 7402804k/8388608k available (2484k kernel code, 198920k
reserved, 1319k data, 236k init)
Calibrating delay using timer specific routine.. 4427.38 BogoMIPS (lpj=8854777)
Security Framework v1.0.0 initialized
SELinux: Initializing.
SELinux: Starting in permissive mode
selinux_register_security: Registering secondary module capability
Capability LSM initialized as secondary
Mount-cache hash table entries: 256
CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
CPU: L2 Cache: 1024K (64 bytes/line)
CPU 0(1) -> Node 0 -> Core 0
mtrr: v2.0 (20020519)
Using local APIC timer interrupts.
Detected 12.564 MHz APIC timer.
softlockup thread 0 started up.
Booting processor 1/2 APIC 0x1
Initializing CPU#1
Calibrating delay using timer specific routine.. 4422.99 BogoMIPS (lpj=8845992)
CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
CPU: L2 Cache: 1024K (64 bytes/line)
CPU 1(1) -> Node 1 -> Core 0
AMD Opteron(tm) Processor 248 stepping 08
CPU 1: Syncing TSC to CPU 0.
CPU 1: synchronized TSC with CPU 0 (last diff -126 cycles, maxerr 1130 cycles)
Brought up 2 CPUs
softlockup thread 1 started up.
Disabling vsyscall due to use of PM timer
time.c: Using PM based timekeeping.
testing NMI watchdog ... OK.
checking if image is initramfs... it is
NET: Registered protocol family 16
ACPI: bus type pci registered
PCI: Using configuration type 1
PCI: Using MMCONFIG at e0000000
ACPI: Subsystem revision 20050902
ACPI: Interpreter enabled
ACPI: Using IOAPIC for interrupt routing
ACPI: PCI Root Bridge [PCI0] (0000:00)
PCI: Probing PCI hardware (bus 00)
PCI: Transparent bridge - 0000:00:09.0
ACPI: PCI Interrupt Link [LNK1] (IRQs 5 *7 9 10 11 14 15)
ACPI: PCI Interrupt Link [LNK2] (IRQs 5 7 9 10 11 14 15) *0, disabled.
ACPI: PCI Interrupt Link [LNK3] (IRQs *5 7 9 10 11 14 15)
ACPI: PCI Interrupt Link [LNK4] (IRQs 5 7 9 10 11 14 15) *0, disabled.
ACPI: PCI Interrupt Link [LNK5] (IRQs 5 7 9 10 11 14 15) *0, disabled.
ACPI: PCI Interrupt Link [LUBA] (IRQs *5 7 9 10 11 14 15)
ACPI: PCI Interrupt Link [LUBB] (IRQs 5 7 9 10 11 14 15) *0, disabled.
ACPI: PCI Interrupt Link [LMAC] (IRQs *5 7 9 10 11 14 15)
ACPI: PCI Interrupt Link [LACI] (IRQs 5 7 9 10 *11 14 15)
ACPI: PCI Interrupt Link [LMCI] (IRQs 5 7 9 10 11 14 15) *0, disabled.
ACPI: PCI Interrupt Link [LSMB] (IRQs 5 7 9 10 *11 14 15)
ACPI: PCI Interrupt Link [LUB2] (IRQs 5 7 9 10 *11 14 15)
ACPI: PCI Interrupt Link [LIDE] (IRQs 5 7 9 10 11 14 15) *0, disabled.
ACPI: PCI Interrupt Link [LSID] (IRQs 5 7 9 10 *11 14 15)
ACPI: PCI Interrupt Link [LFID] (IRQs *5 7 9 10 11 14 15)
ACPI: PCI Interrupt Link [LPCA] (IRQs 5 7 9 10 11 14 15) *0, disabled.
ACPI: PCI Interrupt Link [APC1] (IRQs 16) *0, disabled.
ACPI: PCI Interrupt Link [APC2] (IRQs 17) *0, disabled.
ACPI: PCI Interrupt Link [APC3] (IRQs 18) *0, disabled.
ACPI: PCI Interrupt Link [APC4] (IRQs 19) *0, disabled.
ACPI: PCI Interrupt Link [APC5] (IRQs *16), disabled.
ACPI: PCI Interrupt Link [APCF] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCG] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCH] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCJ] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCK] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCS] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCL] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCZ] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APSI] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APSJ] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCP] (IRQs 20 21 22 23) *0, disabled.
Linux Plug and Play Support v0.97 (c) Adam Belay
pnp: PnP ACPI init
pnp: PnP ACPI: found 15 devices
usbcore: registered new driver usbfs
usbcore: registered new driver hub
PCI: Using ACPI for IRQ routing
PCI: If a device doesn't work, try "pci=routeirq". If it helps, post a report
PCI-DMA: Disabling AGP.
PCI-DMA: More than 4GB of RAM and no IOMMU
PCI-DMA: 32bit PCI IO may malfunction.<6>PCI-DMA: Disabling IOMMU.
pnp: 00:00: ioport range 0x1000-0x107f could not be reserved
pnp: 00:00: ioport range 0x1080-0x10ff has been reserved
pnp: 00:00: ioport range 0x1400-0x147f has been reserved
pnp: 00:00: ioport range 0x1480-0x14ff could not be reserved
pnp: 00:00: ioport range 0x1800-0x187f has been reserved
pnp: 00:00: ioport range 0x1880-0x18ff has been reserved
PCI: Bridge: 0000:00:09.0
IO window: a000-afff
MEM window: fde00000-fdefffff
PREFETCH window: fdf00000-fdffffff
PCI: Bridge: 0000:00:0c.0
IO window: 9000-9fff
MEM window: fdd00000-fddfffff
PREFETCH window: fdc00000-fdcfffff
PCI: Bridge: 0000:00:0d.0
IO window: 8000-8fff
MEM window: fdb00000-fdbfffff
PREFETCH window: fda00000-fdafffff
PCI: Bridge: 0000:00:0e.0
IO window: 7000-7fff
MEM window: fa000000-fcffffff
PREFETCH window: d0000000-dfffffff
IA32 emulation $Id: sys_ia32.c,v 1.32 2002/03/24 13:02:28 ak Exp $
audit: initializing netlink socket (disabled)
audit(1130326229.628:1): initialized
Total HugeTLB memory allocated, 0
VFS: Disk quotas dquot_6.5.1
Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
SELinux: Registering netfilter hooks
Initializing Cryptographic API
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
pcie_portdrv_probe->Dev[005d:10de] has invalid IRQ. Check vendor BIOS
assign_interrupt_mode Found MSI capability
pcie_portdrv_probe->Dev[005d:10de] has invalid IRQ. Check vendor BIOS
assign_interrupt_mode Found MSI capability
pcie_portdrv_probe->Dev[005d:10de] has invalid IRQ. Check vendor BIOS
assign_interrupt_mode Found MSI capability
ACPI: CPU0 (power states: C1[C1])
ACPI: CPU1 (power states: C1[C1])
Real Time Clock Driver v1.12
Linux agpgart interface v0.101 (c) Dave Jones
PNP: PS/2 Controller [PNP0303:PS2K,PNP0f13:PS2M] at 0x60,0x64 irq 1,12
serio: i8042 AUX port at 0x60,0x64 irq 12
serio: i8042 KBD port at 0x60,0x64 irq 1
Serial: 8250/16550 driver $Revision: 1.90 $ 32 ports, IRQ sharing enabled
?ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered
io scheduler cfq registered
RAMDISK driver initialized: 16 RAM disks of 16384K size 1024 blocksize
Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
NFORCE-CK804: IDE controller at PCI slot 0000:00:06.0
NFORCE-CK804: chipset revision 242
NFORCE-CK804: not 100% native mode: will probe irqs later
NFORCE-CK804: 0000:00:06.0 (rev f2) UDMA133 controller
ide0: BM-DMA at 0xe800-0xe807, BIOS settings: hda:DMA, hdb:DMA
ide1: BM-DMA at 0xe808-0xe80f, BIOS settings: hdc:DMA, hdd:DMA
hdc: ASUS CD-S500/A, ATAPI CD/DVD-ROM drive
ide1 at 0x170-0x177,0x376 on irq 15
hdc: ATAPI 50X CD-ROM drive, 128kB Cache, UDMA(33)
Uniform CD-ROM driver Revision: 3.20
ide-floppy driver 0.99.newide
usbcore: registered new driver hiddev
usbcore: registered new driver usbhid
drivers/usb/input/hid-core.c: v2.6:USB HID core driver
mice: PS/2 mouse device common for all mice
md: md driver 0.90.2 MAX_MD_DEVS=256, MD_SB_DISKS=27
md: bitmap version 3.39
NET: Registered protocol family 2
input: AT Translated Set 2 keyboard on isa0060/serio0
IP route cache hash table entries: 262144 (order: 9, 2097152 bytes)
TCP established hash table entries: 131072 (order: 10, 4194304 bytes)
TCP bind hash table entries: 65536 (order: 9, 2097152 bytes)
TCP: Hash tables configured (established 131072 bind 65536)
TCP reno registered
TCP bic registered
Initializing IPsec netlink socket
NET: Registered protocol family 1
NET: Registered protocol family 17
Freeing unused kernel memory: 236k freed
SCSI subsystem initialized
ACPI: PCI Interrupt Link [APSI] enabled at IRQ 23
ACPI: PCI Interrupt 0000:00:07.0[A] -> Link [APSI] -> GSI 23 (level,
low) -> IRQ 209
ata1: SATA max UDMA/133 cmd 0x9F0 ctl 0xBF2 bmdma 0xD400 irq 209
ata2: SATA max UDMA/133 cmd 0x970 ctl 0xB72 bmdma 0xD408 irq 209
ata1: no device found (phy stat 00000000)
scsi0 : sata_nv
ata2: no device found (phy stat 00000000)
scsi1 : sata_nv
ACPI: PCI Interrupt Link [APSJ] enabled at IRQ 22
ACPI: PCI Interrupt 0000:00:08.0[A] -> Link [APSJ] -> GSI 22 (level,
low) -> IRQ 217
ata3: SATA max UDMA/133 cmd 0x9E0 ctl 0xBE2 bmdma 0xC000 irq 217
ata4: SATA max UDMA/133 cmd 0x960 ctl 0xB62 bmdma 0xC008 irq 217
input: PS/2 Generic Mouse on isa0060/serio1
ata3: dev 0 ATA, max UDMA/133, 72303840 sectors: lba48
ata3(0): applying bridge limits
nv_sata: Primary device added
ata3: dev 0 configured for UDMA/100
scsi2 : sata_nv
nv_sata: Primary device removed
nv_sata: Secondary device added
nv_sata: Secondary device removed
ata4: no device found (phy stat 00000000)
scsi3 : sata_nv
Vendor: ATA Model: WDC WD360GD-00EL Rev: 32.0
Type: Direct-Access ANSI SCSI revision: 05
SCSI device sda: 72303840 512-byte hdwr sectors (37020 MB)
SCSI device sda: drive cache: write back
SCSI device sda: 72303840 512-byte hdwr sectors (37020 MB)
SCSI device sda: drive cache: write back
sda:<4>nv_sata: Primary device added
nv_sata: Primary device removed
nv_sata: Secondary device added
nv_sata: Secondary device removed
sda1 sda2 sda3
nv_sata: Primary device added
nv_sata: Primary device removed
nv_sata: Secondary device added
nv_sata: Secondary device removed
Attached scsi disk sda at scsi2, channel 0, id 0, lun 0
Kernel panic - not syncing: PCI-DMA: high address but no IOMMU.

2005-10-28 01:58:29

by Nishanth Aravamudan

[permalink] [raw]
Subject: Re: PCI-DMA: high address but no IOMMU

On 27.10.2005 [15:39:20 -0700], Michael Madore wrote:
> On 28 Oct 2005 00:16:51 +0200, Andi Kleen <[email protected]> wro> >
> > > Checking aperture...
> > > CPU 0: aperture @ 8000000 size 32 MB
> > > Aperture from northbridge cpu 0 too small (32 MB)
> > > No AGP bridge found
> > > Your BIOS doesn't leave a aperture memory hole
> > > Please enable the IOMMU option in the BIOS setup
> > > This costs you 64 MB of RAM
> > > Mapping aperture over 65536 KB of RAM @ 8000000
> > >
> > > ...
> > >
> > > PCI-DMA: Disabling AGP.
> > > PCI-DMA: aperture base @ 8000000 size 65536 KB
> > > PCI-DMA: Reserving 64MB of IOMMU area in the AGP aperture
> >
> > Can you post the full boot log?
> >
>
> Hi Andy,
>
> Here is the full boot log from 2.6.14-rc5.

Just as another datapoint, here is mine (ignore the inode issues, they
are due to a power failure yesterday):

[ 0.000000] Bootdata ok (command line is root=/dev/sda1 ro sbp2.serialize_io=0 )
[ 0.000000] Linux version 2.6.14-rc5 (nacc@arkanoid) (gcc version 4.0.2 20050808 (prerelease) (Ubuntu 4.0.1-4ubuntu9)) #1 SMP PREEMPT Mon Oct 24 12:22:41 PDT 2005
[ 0.000000] BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: 0000000000000000 - 000000000009f800 (usable)
[ 0.000000] BIOS-e820: 000000000009f800 - 00000000000a0000 (reserved)
[ 0.000000] BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
[ 0.000000] BIOS-e820: 0000000000100000 - 000000007fff0000 (usable)
[ 0.000000] BIOS-e820: 000000007fff0000 - 000000007fff3000 (ACPI NVS)
[ 0.000000] BIOS-e820: 000000007fff3000 - 0000000080000000 (ACPI data)
[ 0.000000] BIOS-e820: 00000000e0000000 - 00000000f0000000 (reserved)
[ 0.000000] BIOS-e820: 00000000fec00000 - 0000000100000000 (reserved)
[ 0.000000] ACPI: RSDP (v000 Nvidia ) @ 0x00000000000f7670
[ 0.000000] ACPI: RSDT (v001 Nvidia AWRDACPI 0x42302e31 AWRD 0x00000000) @ 0x000000007fff3040
[ 0.000000] ACPI: FADT (v001 Nvidia AWRDACPI 0x42302e31 AWRD 0x00000000) @ 0x000000007fff30c0
[ 0.000000] ACPI: SSDT (v001 PTLTD POWERNOW 0x00000001 LTP 0x00000001) @ 0x000000007fff9580
[ 0.000000] ACPI: SRAT (v001 AMD HAMMER 0x00000001 AMD 0x00000001) @ 0x000000007fff9740
[ 0.000000] ACPI: MCFG (v001 Nvidia AWRDACPI 0x42302e31 AWRD 0x00000000) @ 0x000000007fff9880
[ 0.000000] ACPI: MADT (v001 Nvidia AWRDACPI 0x42302e31 AWRD 0x00000000) @ 0x000000007fff9480
[ 0.000000] ACPI: DSDT (v001 NVIDIA AWRDACPI 0x00001000 MSFT 0x0100000e) @ 0x0000000000000000
[ 0.000000] SRAT: PXM 0 -> APIC 0 -> Node 0
[ 0.000000] SRAT: PXM 1 -> APIC 1 -> Node 1
[ 0.000000] SRAT: Node 0 PXM 0 0-9ffff
[ 0.000000] SRAT: Node 0 PXM 0 0-3fffffff
[ 0.000000] SRAT: Node 1 PXM 1 40000000-7fffffff
[ 0.000000] Using 20 for the hash shift. Max adder is 7ffeffff
[ 0.000000] Bootmem setup node 0 0000000000000000-000000003fffffff
[ 0.000000] Bootmem setup node 1 0000000040000000-000000007ffeffff
[ 0.000000] On node 0 totalpages: 262046
[ 0.000000] DMA zone: 3999 pages, LIFO batch:1
[ 0.000000] Normal zone: 258047 pages, LIFO batch:31
[ 0.000000] HighMem zone: 0 pages, LIFO batch:1
[ 0.000000] On node 1 totalpages: 262127
[ 0.000000] DMA zone: 0 pages, LIFO batch:1
[ 0.000000] Normal zone: 262127 pages, LIFO batch:31
[ 0.000000] HighMem zone: 0 pages, LIFO batch:1
[ 0.000000] Nvidia board detected. Ignoring ACPI timer override.
[ 0.000000] ACPI: PM-Timer IO Port: 0x1008
[ 0.000000] ACPI: Local APIC address 0xfee00000
[ 0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[ 0.000000] Processor #0 15:5 APIC version 16
[ 0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
[ 0.000000] Processor #1 15:5 APIC version 16
[ 0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] disabled)
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])
[ 0.000000] ACPI: IOAPIC (id[0x04] address[0xfec00000] gsi_base[0])
[ 0.000000] IOAPIC[0]: apic_id 4, version 17, address 0xfec00000, GSI 0-23
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[ 0.000000] ACPI: BIOS IRQ0 pin2 override ignored.
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 14 global_irq 14 high edge)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 15 global_irq 15 high edge)
[ 0.000000] ACPI: IRQ9 used by override.
[ 0.000000] ACPI: IRQ14 used by override.
[ 0.000000] ACPI: IRQ15 used by override.
[ 0.000000] Setting APIC routing to flat
[ 0.000000] Using ACPI (MADT) for SMP configuration information
[ 0.000000] Allocating PCI resources starting at 88000000 (gap: 80000000:60000000)
[ 0.000000] Checking aperture...
[ 0.000000] CPU 0: aperture @ a5f8000000 size 32 MB
[ 0.000000] Aperture from northbridge cpu 0 too small (32 MB)
[ 0.000000] No AGP bridge found
[ 0.000000] Your BIOS doesn't leave a aperture memory hole
[ 0.000000] Please enable the IOMMU option in the BIOS setup
[ 0.000000] This costs you 64 MB of RAM
[ 0.000000] Mapping aperture over 65536 KB of RAM @ 4000000
[ 0.000000] Built 2 zonelists
[ 0.000000] Kernel command line: root=/dev/sda1 ro sbp2.serialize_io=0
[ 0.000000] Initializing CPU#0
[ 0.000000] PID hash table entries: 4096 (order: 12, 131072 bytes)
[ 0.000000] time.c: Using 3.579545 MHz PM timer.
[ 0.000000] time.c: Detected 1809.292 MHz processor.
[ 48.403492] Console: colour VGA+ 80x25
[ 48.407197] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)
[ 48.412567] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)
[ 48.439277] Memory: 1988852k/2097088k available (3748k kernel code, 107848k reserved, 2507k data, 256k init)
[ 48.498671] Calibrating delay using timer specific routine.. 3621.13 BogoMIPS (lpj=1810568)
[ 48.498794] Mount-cache hash table entries: 256
[ 48.498958] CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
[ 48.498968] CPU: L2 Cache: 1024K (64 bytes/line)
[ 48.498978] CPU 0(1) -> Node 0 -> Core 0
[ 48.498993] mtrr: v2.0 (20020519)
[ 48.533350] Using local APIC timer interrupts.
[ 48.588634] Detected 12.564 MHz APIC timer.
[ 48.588709] softlockup thread 0 started up.
[ 48.588795] Booting processor 1/2 APIC 0x1
[ 48.599123] Initializing CPU#1
[ 48.659650] Calibrating delay using timer specific routine.. 3618.10 BogoMIPS (lpj=1809050)
[ 48.659661] CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
[ 48.659663] CPU: L2 Cache: 1024K (64 bytes/line)
[ 48.659667] CPU 1(1) -> Node 1 -> Core 0
[ 48.659825] AMD Opteron(tm) Processor 244 stepping 0a
[ 48.659837] CPU 1: Syncing TSC to CPU 0.
[ 48.660073] CPU 1: synchronized TSC with CPU 0 (last diff 41 cycles, maxerr 811 cycles)
[ 48.660079] Brought up 2 CPUs
[ 48.660095] softlockup thread 1 started up.
[ 48.660186] Disabling vsyscall due to use of PM timer
[ 48.660195] time.c: Using PM based timekeeping.
[ 48.660203] testing NMI watchdog ... OK.
[ 48.670771] NET: Registered protocol family 16
[ 48.670811] ACPI: bus type pci registered
[ 48.671057] PCI: Using configuration type 1
[ 48.675549] PCI: Using MMCONFIG at e0000000
[ 48.676451] ACPI: Subsystem revision 20050902
[ 48.688238] ACPI: Interpreter enabled
[ 48.688247] ACPI: Using IOAPIC for interrupt routing
[ 48.688957] ACPI: PCI Root Bridge [PCI0] (0000:00)
[ 48.688968] PCI: Probing PCI hardware (bus 00)
[ 48.695785] PCI: Transparent bridge - 0000:00:09.0
[ 48.696007] Boot video device is 0000:04:00.0
[ 48.696096] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
[ 48.761163] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.HUB0._PRT]
[ 48.764024] ACPI: PCI Interrupt Link [LNK1] (IRQs 5 *7 9 10 11 14 15)
[ 48.764452] ACPI: PCI Interrupt Link [LNK2] (IRQs 5 7 9 10 *11 14 15)
[ 48.764877] ACPI: PCI Interrupt Link [LNK3] (IRQs 5 7 9 10 *11 14 15)
[ 48.765299] ACPI: PCI Interrupt Link [LNK4] (IRQs 5 7 9 10 11 14 15) *0, disabled.
[ 48.765734] ACPI: PCI Interrupt Link [LNK5] (IRQs 5 7 9 10 11 14 15) *0, disabled.
[ 48.766169] ACPI: PCI Interrupt Link [LUBA] (IRQs *5 7 9 10 11 14 15)
[ 48.766594] ACPI: PCI Interrupt Link [LUBB] (IRQs 5 7 9 10 11 14 15) *0, disabled.
[ 48.767045] ACPI: PCI Interrupt Link [LMAC] (IRQs 5 7 9 10 11 14 15) *0, disabled.
[ 48.767480] ACPI: PCI Interrupt Link [LACI] (IRQs *5 7 9 10 11 14 15)
[ 48.767906] ACPI: PCI Interrupt Link [LMCI] (IRQs 5 7 9 10 11 14 15) *0, disabled.
[ 48.768338] ACPI: PCI Interrupt Link [LSMB] (IRQs 5 7 9 10 *11 14 15)
[ 48.768763] ACPI: PCI Interrupt Link [LUB2] (IRQs 5 7 9 10 *11 14 15)
[ 48.769188] ACPI: PCI Interrupt Link [LIDE] (IRQs 5 7 9 10 11 14 15) *0, disabled.
[ 48.769639] ACPI: PCI Interrupt Link [LSID] (IRQs 5 7 9 10 *11 14 15)
[ 48.770079] ACPI: PCI Interrupt Link [LFID] (IRQs *5 7 9 10 11 14 15)
[ 48.770514] ACPI: PCI Interrupt Link [LPCA] (IRQs 5 7 9 10 11 14 15) *0, disabled.
[ 48.771009] ACPI: PCI Interrupt Link [APC1] (IRQs 16) *0, disabled.
[ 48.771468] ACPI: PCI Interrupt Link [APC2] (IRQs 17) *0, disabled.
[ 48.771932] ACPI: PCI Interrupt Link [APC3] (IRQs 18) *0, disabled.
[ 48.772395] ACPI: PCI Interrupt Link [APC4] (IRQs 19) *0, disabled.
[ 48.772757] ACPI: PCI Interrupt Link [APC5] (IRQs *16), disabled.
[ 48.773246] ACPI: PCI Interrupt Link [APCF] (IRQs 20 21 22 23) *0, disabled.
[ 48.773751] ACPI: PCI Interrupt Link [APCG] (IRQs 20 21 22 23) *0, disabled.
[ 48.774239] ACPI: PCI Interrupt Link [APCH] (IRQs 20 21 22 23) *0, disabled.
[ 48.774728] ACPI: PCI Interrupt Link [APCJ] (IRQs 20 21 22 23) *0, disabled.
[ 48.775220] ACPI: PCI Interrupt Link [APCK] (IRQs 20 21 22 23) *0, disabled.
[ 48.775705] ACPI: PCI Interrupt Link [APCS] (IRQs 20 21 22 23) *0, disabled.
[ 48.776185] ACPI: PCI Interrupt Link [APCL] (IRQs 20 21 22 23) *0, disabled.
[ 48.776671] ACPI: PCI Interrupt Link [APCZ] (IRQs 20 21 22 23) *0, disabled.
[ 48.777164] ACPI: PCI Interrupt Link [APSI] (IRQs 20 21 22 23) *0, disabled.
[ 48.777657] ACPI: PCI Interrupt Link [APSJ] (IRQs 20 21 22 23) *0, disabled.
[ 48.778152] ACPI: PCI Interrupt Link [APCP] (IRQs 20 21 22 23) *0, disabled.
[ 48.782381] SCSI subsystem initialized
[ 48.782440] usbcore: registered new driver usbfs
[ 48.782492] usbcore: registered new driver hub
[ 48.782597] PCI: Using ACPI for IRQ routing
[ 48.782607] PCI: If a device doesn't work, try "pci=routeirq". If it helps, post a report
[ 48.782712] PCI-DMA: Disabling AGP.
[ 48.782722] PCI-DMA: More than 4GB of RAM and no IOMMU
[ 48.782723] PCI-DMA: 32bit PCI IO may malfunction.<6>PCI-DMA: Disabling IOMMU.
[ 48.783393] PCI: Bridge: 0000:00:09.0
[ 48.783403] IO window: 9000-afff
[ 48.783412] MEM window: fde00000-fdefffff
[ 48.783422] PREFETCH window: fdf00000-fdffffff
[ 48.783431] PCI: Bridge: 0000:00:0c.0
[ 48.783439] IO window: 8000-8fff
[ 48.783448] MEM window: fdd00000-fddfffff
[ 48.783457] PREFETCH window: fdc00000-fdcfffff
[ 48.783466] PCI: Bridge: 0000:00:0d.0
[ 48.783475] IO window: 7000-7fff
[ 48.783484] MEM window: fdb00000-fdbfffff
[ 48.783493] PREFETCH window: fda00000-fdafffff
[ 48.783503] PCI: Bridge: 0000:00:0e.0
[ 48.783511] IO window: 6000-6fff
[ 48.783521] MEM window: fd900000-fd9fffff
[ 48.783530] PREFETCH window: d8000000-dfffffff
[ 48.783544] PCI: Setting latency timer of device 0000:00:09.0 to 64
[ 48.783551] PCI: Setting latency timer of device 0000:00:0c.0 to 64
[ 48.783556] PCI: Setting latency timer of device 0000:00:0d.0 to 64
[ 48.783561] PCI: Setting latency timer of device 0000:00:0e.0 to 64
[ 48.783913] IA32 emulation $Id: sys_ia32.c,v 1.32 2002/03/24 13:02:28 ak Exp $
[ 48.785926] Total HugeTLB memory allocated, 0
[ 48.786361] Installing knfsd (copyright (C) 1996 [email protected]).
[ 48.786606] fuse init (API version 7.2)
[ 48.786727] Initializing Cryptographic API
[ 48.786857] PCI: Setting latency timer of device 0000:00:0c.0 to 64
[ 48.786861] pcie_portdrv_probe->Dev[005d:10de] has invalid IRQ. Check vendor BIOS
[ 48.786884] assign_interrupt_mode Found MSI capability
[ 48.786922] Allocate Port Service[pcie00]
[ 48.786964] Allocate Port Service[pcie03]
[ 48.787005] PCI: Setting latency timer of device 0000:00:0d.0 to 64
[ 48.787008] pcie_portdrv_probe->Dev[005d:10de] has invalid IRQ. Check vendor BIOS
[ 48.787030] assign_interrupt_mode Found MSI capability
[ 48.787054] Allocate Port Service[pcie00]
[ 48.787085] Allocate Port Service[pcie03]
[ 48.787125] PCI: Setting latency timer of device 0000:00:0e.0 to 64
[ 48.787128] pcie_portdrv_probe->Dev[005d:10de] has invalid IRQ. Check vendor BIOS
[ 48.787150] assign_interrupt_mode Found MSI capability
[ 48.787173] Allocate Port Service[pcie00]
[ 48.787203] Allocate Port Service[pcie03]
[ 48.787614] ACPI: PCI Interrupt Link [APC3] enabled at IRQ 18
[ 48.787632] ACPI: PCI Interrupt 0000:04:00.0[A] -> Link [APC3] -> GSI 18 (level, low) -> IRQ 209
[ 48.787721] radeonfb: Found Intel x86 BIOS ROM Image
[ 48.787731] radeonfb: Retreived PLL infos from BIOS
[ 48.787741] radeonfb: Reference=27.00 MHz (RefDiv=12) Memory=325.00 Mhz, System=200.00 MHz
[ 48.787754] radeonfb: PLL min 20000 max 40000
[ 49.585669] radeonfb: Monitor 1 type CRT found
[ 49.585678] radeonfb: EDID probed
[ 49.585686] radeonfb: Monitor 2 type no found
[ 49.586525] radeonfb (0000:04:00.0): ATI Radeon [`
[ 49.586598] ACPI: Power Button (FF) [PWRF]
[ 49.587207] ACPI: Power Button (CM) [PWRB]
[ 49.587354] Using specific hotkey driver
[ 49.587534] ACPI: CPU0 (power states: C1[C1])
[ 49.587558] ACPI: CPU1 (power states: C1[C1])
[ 49.607416] Real Time Clock Driver v1.12
[ 49.607499] Non-volatile memory driver v1.2
[ 49.607518] Linux agpgart interface v0.101 (c) Dave Jones
[ 49.607533] [drm] Initialized drm 1.0.0 20040925
[ 49.607559] Hangcheck: starting hangcheck timer 0.9.0 (tick is 180 seconds, margin is 60 seconds).
[ 49.607572] Hangcheck: Using monotonic_clock().
[ 49.609539] serio: i8042 AUX port at 0x60,0x64 irq 12
[ 49.609664] serio: i8042 KBD port at 0x60,0x64 irq 1
[ 49.609680] Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing disabled
[ 49.609798] ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[ 49.610235] parport0: PC-style at 0x378 [PCSPP(,...)]
[ 49.610333] io scheduler noop registered
[ 49.610376] io scheduler anticipatory registered
[ 49.610398] io scheduler deadline registered
[ 49.610446] io scheduler cfq registered
[ 49.610501] Floppy drive(s): fd0 is 1.44M
[ 49.626516] FDC 0 is a post-1991 82077
[ 49.628614] RAMDISK driver initialized: 16 RAM disks of 4096K size 1024 blocksize
[ 49.628983] loop: loaded (max 8 devices)
[ 49.629042] pktcdvd: v0.2.0a 2004-07-14 Jens Axboe ([email protected]) and [email protected]
[ 49.629102] tg3.c:v3.42 (Oct 3, 2005)
[ 49.629529] ACPI: PCI Interrupt Link [APC1] enabled at IRQ 16
[ 49.629544] ACPI: PCI Interrupt 0000:02:00.0[A] -> Link [APC1] -> GSI 16 (level, low) -> IRQ 217
[ 49.629573] PCI: Setting latency timer of device 0000:02:00.0 to 64
[ 49.635190] eth0: Tigon3 [partno(BCM95751) rev 4101 PHY(5750)] (PCI Express) 10/100/1000BaseT Ethernet 00:13:d4:04:42:47
[ 49.635232] eth0: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[0] Split[0] WireSpeed[1] TSOcap[1]
[ 49.635245] eth0: dma_rwctrl[76180000]
[ 49.635312] netconsole: not configured, aborting
[ 49.635322] Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
[ 49.635332] ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
[ 49.635384] NFORCE-CK804: IDE controller at PCI slot 0000:00:06.0
[ 49.635411] NFORCE-CK804: chipset revision 242
[ 49.635420] NFORCE-CK804: not 100% native mode: will probe irqs later
[ 49.635430] NFORCE-CK804: BIOS didn't set cable bits correctly. Enabling workaround.
[ 49.635445] NFORCE-CK804: 0000:00:06.0 (rev f2) UDMA133 controller
[ 49.635459] ide0: BM-DMA at 0xe800-0xe807, BIOS settings: hda:DMA, hdb:DMA
[ 49.635484] ide1: BM-DMA at 0xe808-0xe80f, BIOS settings: hdc:DMA, hdd:DMA
[ 49.635507] Probing IDE interface ide0...
[ 50.306755] hda: SONY DVD RW DW-Q28A, ATAPI CD/DVD-ROM drive
[ 50.919197] ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
[ 50.919293] Probing IDE interface ide1...
[ 51.437822] Probing IDE interface ide1...
[ 51.957966] hda: ATAPI 48X DVD-ROM DVD-R CD-R/RW drive, 2048kB Cache
[ 51.958020] Uniform CD-ROM driver Revision: 3.20
[ 51.960269] libata version 1.12 loaded.
[ 51.960331] sata_sil version 0.9
[ 51.960733] ACPI: PCI Interrupt Link [APC2] enabled at IRQ 17
[ 51.960750] ACPI: PCI Interrupt 0000:01:09.0[A] -> Link [APC2] -> GSI 17 (level, low) -> IRQ 225
[ 51.961226] ata1: SATA max UDMA/100 cmd 0xFFFFC20000004080 ctl 0xFFFFC2000000408A bmdma 0xFFFFC20000004000 irq 225
[ 51.961279] ata2: SATA max UDMA/100 cmd 0xFFFFC200000040C0 ctl 0xFFFFC200000040CA bmdma 0xFFFFC20000004008 irq 225
[ 51.961337] ata3: SATA max UDMA/100 cmd 0xFFFFC20000004280 ctl 0xFFFFC2000000428A bmdma 0xFFFFC20000004200 irq 225
[ 51.961377] ata4: SATA max UDMA/100 cmd 0xFFFFC200000042C0 ctl 0xFFFFC200000042CA bmdma 0xFFFFC20000004208 irq 225
[ 52.162722] ata1: no device found (phy stat 00000000)
[ 52.162731] scsi0 : sata_sil
[ 52.363725] ata2: no device found (phy stat 00000000)
[ 52.363734] scsi1 : sata_sil
[ 52.564729] ata3: no device found (phy stat 00000000)
[ 52.564738] scsi2 : sata_sil
[ 52.765734] ata4: no device found (phy stat 00000000)
[ 52.765742] scsi3 : sata_sil
[ 52.768501] sata_nv version 0.8
[ 52.769170] ACPI: PCI Interrupt Link [APSI] enabled at IRQ 23
[ 52.769186] ACPI: PCI Interrupt 0000:00:07.0[A] -> Link [APSI] -> GSI 23 (level, low) -> IRQ 233
[ 52.769508] PCI: Setting latency timer of device 0000:00:07.0 to 64
[ 52.769630] ata5: SATA max UDMA/133 cmd 0x9F0 ctl 0xBF2 bmdma 0xD400 irq 233
[ 52.769681] ata6: SATA max UDMA/133 cmd 0x970 ctl 0xB72 bmdma 0xD408 irq 233
[ 52.970738] ata5: no device found (phy stat 00000000)
[ 52.970747] scsi4 : sata_nv
[ 53.171741] ata6: no device found (phy stat 00000000)
[ 53.171750] scsi5 : sata_nv
[ 53.173771] ACPI: PCI Interrupt Link [APSJ] enabled at IRQ 22
[ 53.173787] ACPI: PCI Interrupt 0000:00:08.0[A] -> Link [APSJ] -> GSI 22 (level, low) -> IRQ 50
[ 53.174071] PCI: Setting latency timer of device 0000:00:08.0 to 64
[ 53.174203] ata7: SATA max UDMA/133 cmd 0x9E0 ctl 0xBE2 bmdma 0xC000 irq 50
[ 53.174249] ata8: SATA max UDMA/133 cmd 0x960 ctl 0xB62 bmdma 0xC008 irq 50
[ 53.529840] ata7: dev 0 cfg 49:2f00 82:706b 83:7e01 84:4023 85:7069 86:3c01 87:4023 88:407f
[ 53.529844] ata7: dev 0 ATA, max UDMA/133, 488397168 sectors: lba48
[ 53.529958] ata7: dev 0 configured for UDMA/133
[ 53.529962] nv_sata: Primary device added
[ 53.529971] nv_sata: Primary device removed
[ 53.529973] nv_sata: Secondary device added
[ 53.529975] nv_sata: Secondary device removed
[ 53.529998] scsi6 : sata_nv
[ 53.884844] ata8: dev 0 cfg 49:2f00 82:706b 83:7e01 84:4023 85:7069 86:3c01 87:4023 88:407f
[ 53.884848] ata8: dev 0 ATA, max UDMA/133, 488397168 sectors: lba48
[ 53.884946] nv_sata: Primary device added
[ 53.884949] ata8: dev 0 configured for UDMA/133
[ 53.884954] scsi7 : sata_nv
[ 53.884986] nv_sata: Primary device removed
[ 53.884997] nv_sata: Secondary device added
[ 53.885008] nv_sata: Secondary device removed
[ 53.885143] Vendor: ATA Model: WDC WD2500KS-00M Rev: 02.0
[ 53.885254] Type: Direct-Access ANSI SCSI revision: 05
[ 53.886052] Vendor: ATA Model: WDC WD2500KS-00M Rev: 02.0
[ 53.886163] Type: Direct-Access ANSI SCSI revision: 05
[ 53.886991] SCSI device sda: 488397168 512-byte hdwr sectors (250059 MB)
[ 53.887015] SCSI device sda: drive cache: write back
[ 53.887098] SCSI device sda: 488397168 512-byte hdwr sectors (250059 MB)
[ 53.887119] SCSI device sda: drive cache: write back
[ 53.887131] sda: sda1 sda2
[ 53.893978] Attached scsi disk sda at scsi6, channel 0, id 0, lun 0
[ 53.894083] SCSI device sdb: 488397168 512-byte hdwr sectors (250059 MB)
[ 53.894119] SCSI device sdb: drive cache: write back
[ 53.894214] SCSI device sdb: 488397168 512-byte hdwr sectors (250059 MB)
[ 53.894240] SCSI device sdb: drive cache: write back
[ 53.894255] sdb:
[ 53.904265] Attached scsi disk sdb at scsi7, channel 0, id 0, lun 0
[ 53.904408] ohci1394: $Rev: 1313 $ Ben Collins <[email protected]>
[ 53.904434] ACPI: PCI Interrupt 0000:01:08.0[A] -> Link [APC1] -> GSI 16 (level, low) -> IRQ 217
[ 53.954733] ohci1394: fw-host0: OHCI-1394 1.1 (PCI): IRQ=[217] MMIO=[fdeff000-fdeff7ff] Max Packet=[2048]
[ 53.954848] ieee1394: raw1394: /dev/raw1394 device initialized
[ 53.954894] sbp2: $Rev: 1306 $ Ben Collins <[email protected]>
[ 53.955491] ACPI: PCI Interrupt Link [APCL] enabled at IRQ 21
[ 53.955505] ACPI: PCI Interrupt 0000:00:02.1[B] -> Link [APCL] -> GSI 21 (level, low) -> IRQ 58
[ 53.955941] PCI: Setting latency timer of device 0000:00:02.1 to 64
[ 53.955949] ehci_hcd 0000:00:02.1: EHCI Host Controller
[ 53.955967] ehci_hcd 0000:00:02.1: debug port 1
[ 53.956188] ehci_hcd 0000:00:02.1: new USB bus registered, assigned bus number 1
[ 53.956212] ehci_hcd 0000:00:02.1: irq 58, io mem 0xfeb00000
[ 53.956250] PCI: cache line size of 64 is not supported by device 0000:00:02.1
[ 53.956254] ehci_hcd 0000:00:02.1: park 0
[ 53.956265] ehci_hcd 0000:00:02.1: USB 2.0 initialized, EHCI 1.00, driver 10 Dec 2004
[ 55.164290] hub 1-0:1.0: USB hub found
[ 55.164305] hub 1-0:1.0: 10 ports detected
[ 55.265891] ohci_hcd: 2005 April 22 USB 1.1 'Open' Host Controller (OHCI) Driver (PCI)
[ 55.266469] ACPI: PCI Interrupt Link [APCF] enabled at IRQ 20
[ 55.266486] ACPI: PCI Interrupt 0000:00:02.0[A] -> Link [APCF] -> GSI 20 (level, low) -> IRQ 66
[ 55.266763] PCI: Setting latency timer of device 0000:00:02.0 to 64
[ 55.266770] ohci_hcd 0000:00:02.0: OHCI Host Controller
[ 55.279997] ohci_hcd 0000:00:02.0: new USB bus registered, assigned bus number 2
[ 55.280021] ohci_hcd 0000:00:02.0: irq 66, io mem 0xfe02f000
[ 55.333951] hub 2-0:1.0: USB hub found
[ 55.333969] hub 2-0:1.0: 10 ports detected
[ 55.420093] ieee1394: Host added: ID:BUS[0-00:1023] GUID[0011d8000030641c]
[ 55.435873] USB Universal Host Controller Interface driver v2.3
[ 55.651987] usb 2-1: new low speed USB device using ohci_hcd and address 2
[ 55.802049] usbcore: registered new driver usblp
[ 55.802060] /home/nacc/linux/views/2.6.14-rc5/drivers/usb/class/usblp.c: v0.13: USB Printer Device Class driver
[ 55.802072] Initializing USB Mass Storage driver...
[ 55.802126] usbcore: registered new driver usb-storage
[ 55.802134] USB Mass Storage support registered.
[ 55.811884] input: USB HID v1.10 Keyboard [Logitech USB Receiver] on usb-0000:00:02.0-1
[ 55.828896] input: USB HID v1.10 Mouse [Logitech USB Receiver] on usb-0000:00:02.0-1
[ 55.828927] usbcore: registered new driver usbhid
[ 55.828941] /home/nacc/linux/views/2.6.14-rc5/drivers/usb/input/hid-core.c: v2.6:USB HID core driver
[ 55.829078] mice: PS/2 mouse device common for all mice
[ 55.829528] input: PC Speaker
[ 55.829539] i2c /dev entries driver
[ 55.829936] i2c_adapter i2c-4: nForce2 SMBus adapter at 0x1c00
[ 55.830047] i2c_adapter i2c-5: nForce2 SMBus adapter at 0x1c40
[ 57.728863] Advanced Linux Sound Architecture Driver Version 1.0.10rc1 (Mon Sep 12 08:13:09 2005 UTC).
[ 57.729804] ACPI: PCI Interrupt Link [APCJ] enabled at IRQ 23
[ 57.729816] ACPI: PCI Interrupt 0000:00:04.0[A] -> Link [APCJ] -> GSI 23 (level, low) -> IRQ 233
[ 57.730200] PCI: Setting latency timer of device 0000:00:04.0 to 64
[ 58.041846] intel8x0_measure_ac97_clock: measured 50788 usecs
[ 58.041862] intel8x0: clocking to 46881
[ 58.042968] ACPI: PCI Interrupt 0000:01:06.0[A] -> Link [APC3] -> GSI 18 (level, low) -> IRQ 209
[ 58.056490] ALSA device list:
[ 58.056504] #0: NVidia CK804 with ALC850 at 0xfe02d000, irq 233
[ 58.057093] #1: SBLive 5.1 [SB0060] (rev.7, serial:0x80611102) at 0xac00, irq 209
[ 58.057140] oprofile: using NMI interrupt.
[ 58.057279] NET: Registered protocol family 2
[ 58.067916] IP route cache hash table entries: 131072 (order: 8, 1048576 bytes)
[ 58.068874] TCP established hash table entries: 262144 (order: 10, 4194304 bytes)
[ 58.072347] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[ 58.073313] TCP: Hash tables configured (established 262144 bind 65536)
[ 58.073323] TCP reno registered
[ 58.073382] TCP bic registered
[ 58.073390] Initializing IPsec netlink socket
[ 58.073431] NET: Registered protocol family 1
[ 58.073444] NET: Registered protocol family 17
[ 58.073456] NET: Registered protocol family 15
[ 58.073613] powernow-k8: Found 2 AMD Athlon 64 / Opteron processors (version 1.50.3)
[ 58.073704] powernow-k8: 0 : fid 0xa (1800 MHz), vid 0x2 (1500 mV)
[ 58.073716] powernow-k8: 1 : fid 0x2 (1000 MHz), vid 0xe (1200 mV)
[ 58.073730] cpu_init done, current fid 0xa, vid 0x2
[ 58.073867] powernow-k8: 0 : fid 0xa (1800 MHz), vid 0x2 (1500 mV)
[ 58.073882] powernow-k8: 1 : fid 0x2 (1000 MHz), vid 0xe (1200 mV)
[ 58.073901] cpu_init done, current fid 0xa, vid 0x2
[ 58.074085] BIOS EDD facility v0.16 2004-Jun-25, 2 devices found
[ 58.074921] EXT3-fs: INFO: recovery required on readonly filesystem.
[ 58.074936] EXT3-fs: write access will be enabled during recovery.
[ 60.266079] kjournald starting. Commit interval 5 seconds
[ 60.266099] EXT3-fs: sda1: orphan cleanup on readonly fs
[ 60.266129] ext3_orphan_cleanup: deleting unreferenced inode 788564
[ 60.284162] ext3_orphan_cleanup: deleting unreferenced inode 1142513
[ 60.293045] ext3_orphan_cleanup: deleting unreferenced inode 1142509
[ 60.293058] ext3_orphan_cleanup: deleting unreferenced inode 1142511
[ 60.303372] ext3_orphan_cleanup: deleting unreferenced inode 1142510
[ 60.303550] ext3_orphan_cleanup: deleting unreferenced inode 1142508
[ 60.303713] ext3_orphan_cleanup: deleting unreferenced inode 1142507
[ 60.303904] ext3_orphan_cleanup: deleting unreferenced inode 1142506
[ 60.304075] ext3_orphan_cleanup: deleting unreferenced inode 1142505
[ 60.304242] ext3_orphan_cleanup: deleting unreferenced inode 1142504
[ 60.304405] ext3_orphan_cleanup: deleting unreferenced inode 1142503
[ 60.304425] ext3_orphan_cleanup: deleting unreferenced inode 1142502
[ 60.307807] ext3_orphan_cleanup: deleting unreferenced inode 1142481
[ 60.307820] ext3_orphan_cleanup: deleting unreferenced inode 1142480
[ 60.307831] ext3_orphan_cleanup: deleting unreferenced inode 1142479
[ 60.307985] ext3_orphan_cleanup: deleting unreferenced inode 1142457
[ 60.307999] ext3_orphan_cleanup: deleting unreferenced inode 1142456
[ 60.308011] ext3_orphan_cleanup: deleting unreferenced inode 1142455
[ 60.308023] ext3_orphan_cleanup: deleting unreferenced inode 1142454
[ 60.308034] ext3_orphan_cleanup: deleting unreferenced inode 1142452
[ 60.308046] ext3_orphan_cleanup: deleting unreferenced inode 1142451
[ 60.308207] ext3_orphan_cleanup: deleting unreferenced inode 1142450
[ 60.313737] ext3_orphan_cleanup: deleting unreferenced inode 1142449
[ 60.313744] EXT3-fs: sda1: 23 orphan inodes deleted
[ 60.313757] EXT3-fs: recovery complete.
[ 60.328823] EXT3-fs: mounted filesystem with ordered data mode.
[ 60.328880] VFS: Mounted root (ext3 filesystem) readonly.
[ 60.329119] Freeing unused kernel memory: 256k freed
[ 63.757896] EXT3 FS on sda1, internal journal
[ 66.526960] cdrom: open failed.
[ 67.966531] kjournald starting. Commit interval 5 seconds
[ 67.966830] EXT3 FS on sda2, internal journal
[ 67.966860] EXT3-fs: mounted filesystem with ordered data mode.
[ 74.637810] tg3: eth0: Link is up at 100 Mbps, full duplex.
[ 74.637835] tg3: eth0: Flow control is off for TX and off for RX.
[ 327.112535] can't create port

2005-10-30 00:27:40

by Matti Aarnio

[permalink] [raw]
Subject: Re: PCI-DMA: high address but no IOMMU - nForce4

On Fri, Oct 28, 2005 at 12:16:51AM +0200, Andi Kleen wrote:
> Michael Madore <[email protected]> writes:
> > 2.6.14-rc5 on a dual Opteron nforce4 motherboard with 8GB of RAM:
...
> > With 2.6.13, the systems boots OK with these messages in the log:
> >
> > Checking aperture...
> > CPU 0: aperture @ 8000000 size 32 MB
> > Aperture from northbridge cpu 0 too small (32 MB)
> > No AGP bridge found
> > Your BIOS doesn't leave a aperture memory hole
> > Please enable the IOMMU option in the BIOS setup
> > This costs you 64 MB of RAM
> > Mapping aperture over 65536 KB of RAM @ 8000000
> > ...
> > PCI-DMA: Disabling AGP.
> > PCI-DMA: aperture base @ 8000000 size 65536 KB
> > PCI-DMA: Reserving 64MB of IOMMU area in the AGP aperture
>
> Can you post the full boot log?

I will attach my own; A brand new Amd64 dual-core thing.
Works fine with mem=2500M, but blows up with mem=3G or
without any override and full 4G complement in use.

This board (ASUS A8N-SLI) does use NVIDIA nForce4 chipset with
bios-option to map (hoist) "excess memory" out from first 4G to
higher physical addresses so that it can be accessed by the
processor.

This board has no AGP at all in it, but it does have lots
of PCIE, and a bit of PCI-X thrown in for "legacy cards".
Somehow that detail breaks things when the machine really
should use bounce-buffering, or something similar -- I don't
know if Nvidia nForce4 chipset does have IOMMU, though...

If Nvidia did omit such essential piece of hardware from
a modern chipset, I do find it amazingly short-sighted...
(Of course they don't yield documentation of the chips to
public so that I can't quickly verify this detail...)


> > Using git bisect, I narrowed the problem down to the following commit:
> >
> > 6142891a0c0209c91aa4a98f725de0d6e2ed4918 is first bad commit
> > diff-tree 6142891a0c0209c91aa4a98f725de0d6e2ed4918 (from
> > 357e11d4cbbbb959a88a9bdbbf33a10f160b0823)
> > Author: Andi Kleen <[email protected]>
> > Date: Mon Sep 12 18:49:24 2005 +0200
> >
> > [PATCH] x86-64: Avoid unnecessary double bouncing for swiotlb
> >
> > PCI_DMA_BUS_IS_PHYS has to be zero even when the GART IOMMU is disabled
> > and the swiotlb is used. Otherwise the block layer does unnecessary
> > double bouncing.
>
> Your system shouldn't be using swiotlb anyways.



In my testing, using precompiled Fedora Core development series
kernels last kernel fully working with 4G memory is:
kernel-smp-2.6.13-1.1532_FC4.x86_64.rpm

next kernel package I found after that was:
kernel-smp-2.6.13-1.1555_FC5.i686.rpm

and that blows up like this lattest kernel below (as of 2 days ago)
I have kernel-2.6.14-1.1632_FC5.x86_64.rpm staged for next reboot,
which I need to do rather quick, as I omitted loading "devel" dataset
for this running one, and can't compile nvidia display driver...

.. and sure enough, it blows up, too. It takes a while longer, because
memory allocation order for IOs was changed just couple days ago from
"top down" to "bottom up" (or something of that kind), so that it takes
now longer before a "bad" block gets allocated... so much so that
boot process chuks log-level down nonexistent before things become
really interesting...


Below you will find TWO boots ending up in a failure.
First with two/three days old kernel, and then with full 2.6.14.


> -Andi

/Matti Aarnio


Bootdata ok (command line is ro root=/dev/md2 console=ttyS0,38400n8 console=tty0)
Linux version 2.6.13-1.1629_FC5 ([email protected]) (gcc version 4.0.2 20051007 (Red Hat 4.0.2-3)) #1 SMP Wed Oct 26 17:43:10 EDT 2005
BIOS-provided physical RAM map:
BIOS-e820: 0000000000000000 - 000000000009e400 (usable)
BIOS-e820: 000000000009e400 - 00000000000a0000 (reserved)
BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
BIOS-e820: 0000000000100000 - 00000000afff0000 (usable)
BIOS-e820: 00000000afff0000 - 00000000afff3000 (ACPI NVS)
BIOS-e820: 00000000afff3000 - 00000000b0000000 (ACPI data)
BIOS-e820: 00000000e0000000 - 00000000f0000000 (reserved)
BIOS-e820: 00000000fec00000 - 0000000100000000 (reserved)
BIOS-e820: 0000000100000000 - 0000000140000000 (usable)
SRAT: PXM 0 -> APIC 0 -> Node 0
SRAT: PXM 0 -> APIC 1 -> Node 0
SRAT: Node 0 PXM 0 0-9ffff
SRAT: Node 0 PXM 0 0-afffffff
SRAT: Node 0 PXM 0 0-13fffffff
Bootmem setup node 0 0000000000000000-000000013fffffff
Nvidia board detected. Ignoring ACPI timer override.
ACPI: PM-Timer IO Port: 0x4008
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
Processor #0 15:3 APIC version 16
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
Processor #1 15:3 APIC version 16
ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 2, version 17, address 0xfec00000, GSI 0-23
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
ACPI: BIOS IRQ0 pin2 override ignored.
ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
ACPI: INT_SRC_OVR (bus 0 bus_irq 14 global_irq 14 high edge)
ACPI: INT_SRC_OVR (bus 0 bus_irq 15 global_irq 15 high edge)
Setting APIC routing to physical flat
Using ACPI (MADT) for SMP configuration information
Allocating PCI resources starting at b4000000 (gap: b0000000:30000000)
Checking aperture...
CPU 0: aperture @ c10000000 size 32 MB
Aperture from northbridge cpu 0 too small (32 MB)
No AGP bridge found
Your BIOS doesn't leave a aperture memory hole
Please enable the IOMMU option in the BIOS setup
This costs you 64 MB of RAM
Mapping aperture over 65536 KB of RAM @ 8000000
Built 1 zonelists
Kernel command line: ro root=/dev/md2 console=ttyS0,38400n8 console=tty0
Initializing CPU#0
PID hash table entries: 4096 (order: 12, 131072 bytes)
time.c: Using 3.579545 MHz PM timer.
time.c: Detected 2211.381 MHz processor.
Console: colour VGA+ 80x25
Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)
Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)
Memory: 3780456k/5242880k available (2439k kernel code, 151248k reserved, 1458k data, 228k init)
Calibrating delay using timer specific routine.. 4427.25 BogoMIPS (lpj=8854511)
Security Framework v1.0.0 initialized
SELinux: Initializing.
SELinux: Starting in permissive mode
selinux_register_security: Registering secondary module capability
Capability LSM initialized as secondary
Mount-cache hash table entries: 256
CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
CPU: L2 Cache: 1024K (64 bytes/line)
CPU 0(2) -> Node 0 -> Core 0
mtrr: v2.0 (20020519)
Using local APIC timer interrupts.
Detected 12.564 MHz APIC timer.
softlockup thread 0 started up.
Booting processor 1/2 APIC 0x1
Initializing CPU#1
Calibrating delay using timer specific routine.. 4422.98 BogoMIPS (lpj=8845960)
CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
CPU: L2 Cache: 1024K (64 bytes/line)
CPU 1(2) -> Node 0 -> Core 1
AMD Athlon(tm) 64 X2 Dual Core Processor 4400+ stepping 02
CPU 1: Syncing TSC to CPU 0.
CPU 1: synchronized TSC with CPU 0 (last diff -77 cycles, maxerr 547 cycles)
Brought up 2 CPUs
softlockup thread 1 started up.
Disabling vsyscall due to use of PM timer
time.c: Using PM based timekeeping.
testing NMI watchdog ... OK.
checking if image is initramfs... it is
NET: Registered protocol family 16
ACPI: bus type pci registered
PCI: Using configuration type 1
PCI: Using MMCONFIG at e0000000
ACPI: Subsystem revision 20050902
ACPI: Interpreter enabled
ACPI: Using IOAPIC for interrupt routing
ACPI: PCI Root Bridge [PCI0] (0000:00)
PCI: Probing PCI hardware (bus 00)
PCI: Transparent bridge - 0000:00:09.0
ACPI: PCI Interrupt Link [LNK1] (IRQs *3 4 5 7 9 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNK2] (IRQs 3 4 5 7 9 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNK3] (IRQs 3 4 *5 7 9 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNK4] (IRQs *3 4 5 7 9 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNK5] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.
ACPI: PCI Interrupt Link [LUBA] (IRQs *3 4 5 7 9 10 11 12 14 15)
ACPI: PCI Interrupt Link [LUBB] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.
ACPI: PCI Interrupt Link [LMAC] (IRQs 3 4 5 7 9 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LACI] (IRQs *3 4 5 7 9 10 11 12 14 15)
ACPI: PCI Interrupt Link [LMCI] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.
ACPI: PCI Interrupt Link [LSMB] (IRQs 3 4 *5 7 9 10 11 12 14 15)
ACPI: PCI Interrupt Link [LUB2] (IRQs<7>Losing some ticks... checking if CPU frequency changed.
3 4 5 7 9 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LIDE] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.
ACPI: PCI Interrupt Link [LSID] (IRQs 3 4 5 7 9 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LFID] (IRQs 3 4 *5 7 9 10 11 12 14 15)
ACPI: PCI Interrupt Link [LPCA] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.
ACPI: PCI Interrupt Link [APC1] (IRQs 16) *0, disabled.
ACPI: PCI Interrupt Link [APC2] (IRQs 17) *0, disabled.
ACPI: PCI Interrupt Link [APC3] (IRQs 18) *0, disabled.
ACPI: PCI Interrupt Link [APC4] (IRQs 19) *0, disabled.
ACPI: PCI Interrupt Link [APC5] (IRQs *16), disabled.
ACPI: PCI Interrupt Link [APCF] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCG] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCH] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCJ] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCK] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCS] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCL] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCZ] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APSI] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APSJ] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCP] (IRQs 20 21 22 23) *0, disabled.
Linux Plug and Play Support v0.97 (c) Adam Belay
pnp: PnP ACPI init
pnp: PnP ACPI: found 15 devices
usbcore: registered new driver usbfs
usbcore: registered new driver hub
PCI: Using ACPI for IRQ routing
PCI: If a device doesn't work, try "pci=routeirq". If it helps, post a report
PCI-DMA: Disabling AGP.
PCI-DMA: More than 4GB of RAM and no IOMMU
PCI-DMA: 32bit PCI IO may malfunction.<6>PCI-DMA: Disabling IOMMU.
pnp: 00:00: ioport range 0x4000-0x407f could not be reserved
pnp: 00:00: ioport range 0x4080-0x40ff has been reserved
pnp: 00:00: ioport range 0x4400-0x447f has been reserved
pnp: 00:00: ioport range 0x4480-0x44ff could not be reserved
pnp: 00:00: ioport range 0x4800-0x487f has been reserved
pnp: 00:00: ioport range 0x4880-0x48ff has been reserved
PCI: Bridge: 0000:00:09.0
IO window: 9000-afff
MEM window: c8000000-c9ffffff
PREFETCH window: ca000000-ca0fffff
PCI: Bridge: 0000:00:0b.0
IO window: disabled.
MEM window: disabled.
PREFETCH window: disabled.
PCI: Bridge: 0000:00:0c.0
IO window: disabled.
MEM window: disabled.
PREFETCH window: disabled.
PCI: Bridge: 0000:00:0d.0
IO window: disabled.
MEM window: disabled.
PREFETCH window: disabled.
PCI: Bridge: 0000:00:0e.0
IO window: disabled.
MEM window: c0000000-c7ffffff
PREFETCH window: b0000000-bfffffff
IA32 emulation $Id: sys_ia32.c,v 1.32 2002/03/24 13:02:28 ak Exp $
audit: initializing netlink socket (disabled)
audit(1041385788.128:1): initialized
Total HugeTLB memory allocated, 0
VFS: Disk quotas dquot_6.5.1
Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
SELinux: Registering netfilter hooks
Initializing Cryptographic API
ksign: Installing public key data
Loading keyring
- Added public key DBF5CB6293850D8B
- key was been created 88976999 seconds in future
- User ID: Red Hat, Inc. (Kernel Module GPG key)
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
pcie_portdrv_probe->Dev[005d:10de] has invalid IRQ. Check vendor BIOS
assign_interrupt_mode Found MSI capability
pcie_portdrv_probe->Dev[005d:10de] has invalid IRQ. Check vendor BIOS
assign_interrupt_mode Found MSI capability
pcie_portdrv_probe->Dev[005d:10de] has invalid IRQ. Check vendor BIOS
assign_interrupt_mode Found MSI capability
pcie_portdrv_probe->Dev[005d:10de] has invalid IRQ. Check vendor BIOS
assign_interrupt_mode Found MSI capability
ACPI: Fan [FAN] (on)
ACPI: CPU0 (power states: C1[C1])
ACPI: CPU1 (power states: C1[C1])
ACPI: Thermal Zone [THRM] (40 C)
Real Time Clock Driver v1.12
Linux agpgart interface v0.101 (c) Dave Jones
PNP: PS/2 Controller [PNP0303:PS2K,PNP0f13:PS2M] at 0x60,0x64 irq 1,12
serio: i8042 AUX port at 0x60,0x64 irq 12
serio: i8042 KBD port at 0x60,0x64 irq 1
Serial: 8250/16550 driver $Revision: 1.90 $ 32 ports, IRQ sharing enabled
?ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered
io scheduler cfq registered
RAMDISK driver initialized: 16 RAM disks of 16384K size 1024 blocksize
Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
NFORCE-CK804: IDE controller at PCI slot 0000:00:06.0
NFORCE-CK804: chipset revision 242
NFORCE-CK804: not 100% native mode: will probe irqs later
NFORCE-CK804: 0000:00:06.0 (rev f2) UDMA133 controller
ide0: BM-DMA at 0xf000-0xf007, BIOS settings: hda:DMA, hdb:DMA
ide1: BM-DMA at 0xf008-0xf00f, BIOS settings: hdc:DMA, hdd:DMA
hda: IBM-DTLA-307060, ATA DISK drive
ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
hdc: HL-DT-STDVD-ROM GDR8163B, ATAPI CD/DVD-ROM drive
ide1 at 0x170-0x177,0x376 on irq 15
hda: max request size: 128KiB
hda: 120103200 sectors (61492 MB) w/1916KiB Cache, CHS=65535/16/63, UDMA(100)
hda: cache flushes not supported
hda:<0>Kernel panic - not syncing: PCI-DMA: high address but no IOMMU.


Call Trace:<ffffffff80139ed1>{panic+133} <ffffffff80169359>{mempool_alloc+82}
<ffffffff8016dda0>{poison_obj+49} <ffffffff80169359>{mempool_alloc+82}
<ffffffff8016dbba>{dbg_redzone1+28} <ffffffff80169359>{mempool_alloc+82}
<ffffffff8016ec99>{cache_alloc_debugcheck_after+271}
<ffffffff8016f2cb>{kmem_cache_alloc+149} <ffffffff801227db>{dma_map_sg+881}
<ffffffff802a77aa>{ide_build_dmatable+44} <ffffffff802a78fc>{ide_dma_setup+52}
<ffffffff802a8dc5>{ide_do_rw_disk+947} <ffffffff8029f7db>{ide_do_request+1618}
<ffffffff8035d038>{_spin_lock_irqsave+9} <ffffffff801432fe>{lock_timer_base+27}
<ffffffff80144097>{del_timer+102} <ffffffff8027d8f9>{__elv_add_request+82}
<ffffffff80282273>{__make_request+1272} <ffffffff80160000>{proc_cpuset_show+173}
<ffffffff8016dbba>{dbg_redzone1+28} <ffffffff80169359>{mempool_alloc+82}
<ffffffff8027f122>{generic_make_request+567} <ffffffff801502b0>{autoremove_wake_function+0}
<ffffffff8027f1f8>{submit_bio+193} <ffffffff8018e518>{submit_bh+245}
<ffffffff8019016f>{block_read_full_page+619} <ffffffff80194514>{blkdev_get_block+0}
<ffffffff8035d0f1>{_write_unlock_irq+9} <ffffffff80193529>{blkdev_readpage+0}
<ffffffff80166554>{add_to_page_cache+180} <ffffffff80193529>{blkdev_readpage+0}
<ffffffff8016711d>{read_cache_page+126} <ffffffff801c9f68>{read_dev_sector+43}
<ffffffff801cb447>{read_lba+73} <ffffffff801cb702>{efi_partition+155}
<ffffffff801c9dde>{rescan_partitions+134} <ffffffff8016dda0>{poison_obj+49}
<ffffffff801c9dde>{rescan_partitions+134} <ffffffff801c9e69>{rescan_partitions+273}
<ffffffff8019407c>{do_open+283} <ffffffff801943d0>{blkdev_get+101}
<ffffffff8016dda0>{poison_obj+49} <ffffffff801ca0ce>{register_disk+208}
<ffffffff80282b8a>{add_disk+52} <ffffffff802aa791>{ide_disk_probe+2859}
<ffffffff8027868d>{driver_probe_device+63} <ffffffff802787a9>{__driver_attach+76}
<ffffffff8027875d>{__driver_attach+0} <ffffffff80277c17>{bus_for_each_dev+70}
<ffffffff80278074>{bus_add_driver+112} <ffffffff8010c22b>{init+482}
<ffffffff8010faa2>{child_rip+8} <ffffffff8010c049>{init+0}
<ffffffff8010fa9a>{child_rip+0}





Bootdata ok (command line is ro root=/dev/md2 console=ttyS0,38400n8 console=tty0 )
Linux version 2.6.14-1.1632_FC5 ([email protected]) (gcc version 4.0.2 20051007 (Red Hat 4.0.2-3)) #1 SMP Thu Oct 27 22:07:01 EDT 2005
BIOS-provided physical RAM map:
BIOS-e820: 0000000000000000 - 000000000009e400 (usable)
BIOS-e820: 000000000009e400 - 00000000000a0000 (reserved)
BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
BIOS-e820: 0000000000100000 - 00000000afff0000 (usable)
BIOS-e820: 00000000afff0000 - 00000000afff3000 (ACPI NVS)
BIOS-e820: 00000000afff3000 - 00000000b0000000 (ACPI data)
BIOS-e820: 00000000e0000000 - 00000000f0000000 (reserved)
BIOS-e820: 00000000fec00000 - 0000000100000000 (reserved)
BIOS-e820: 0000000100000000 - 0000000140000000 (usable)
SRAT: PXM 0 -> APIC 0 -> Node 0
SRAT: PXM 0 -> APIC 1 -> Node 0
SRAT: Node 0 PXM 0 0-9ffff
SRAT: Node 0 PXM 0 0-afffffff
SRAT: Node 0 PXM 0 0-13fffffff
Bootmem setup node 0 0000000000000000-000000013fffffff
Nvidia board detected. Ignoring ACPI timer override.
ACPI: PM-Timer IO Port: 0x4008
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
Processor #0 15:3 APIC version 16
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
Processor #1 15:3 APIC version 16
ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 2, version 17, address 0xfec00000, GSI 0-23
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
ACPI: BIOS IRQ0 pin2 override ignored.
ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
ACPI: INT_SRC_OVR (bus 0 bus_irq 14 global_irq 14 high edge)
ACPI: INT_SRC_OVR (bus 0 bus_irq 15 global_irq 15 high edge)
Setting APIC routing to physical flat
Using ACPI (MADT) for SMP configuration information
Allocating PCI resources starting at b4000000 (gap: b0000000:30000000)
Checking aperture...
CPU 0: aperture @ 8000000 size 32 MB
Aperture from northbridge cpu 0 too small (32 MB)
No AGP bridge found
Your BIOS doesn't leave a aperture memory hole
Please enable the IOMMU option in the BIOS setup
This costs you 64 MB of RAM
Mapping aperture over 65536 KB of RAM @ 8000000
Built 1 zonelists
Kernel command line: ro root=/dev/md2 console=ttyS0,38400n8 console=tty0
Initializing CPU#0
PID hash table entries: 4096 (order: 12, 131072 bytes)
time.c: Using 3.579545 MHz PM timer.
time.c: Detected 2211.382 MHz processor.
Console: colour VGA+ 80x25
Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)
Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)
Memory: 3780452k/5242880k available (2439k kernel code, 151252k reserved, 1459k data, 232k init)
Calibrating delay using timer specific routine.. 4427.26 BogoMIPS (lpj=8854521)
Security Framework v1.0.0 initialized
SELinux: Initializing.
SELinux: Starting in permissive mode
selinux_register_security: Registering secondary module capability
Capability LSM initialized as secondary
Mount-cache hash table entries: 256
CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
CPU: L2 Cache: 1024K (64 bytes/line)
CPU 0(2) -> Node 0 -> Core 0
mtrr: v2.0 (20020519)
Using local APIC timer interrupts.
Detected 12.564 MHz APIC timer.
softlockup thread 0 started up.
Booting processor 1/2 APIC 0x1
Initializing CPU#1
Calibrating delay using timer specific routine.. 4422.98 BogoMIPS (lpj=8845961)
CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
CPU: L2 Cache: 1024K (64 bytes/line)
CPU 1(2) -> Node 0 -> Core 1
AMD Athlon(tm) 64 X2 Dual Core Processor 4400+ stepping 02
CPU 1: Syncing TSC to CPU 0.
CPU 1: synchronized TSC with CPU 0 (last diff -77 cycles, maxerr 547 cycles)
Brought up 2 CPUs
softlockup thread 1 started up.
Disabling vsyscall due to use of PM timer
time.c: Using PM based timekeeping.
testing NMI watchdog ... OK.
checking if image is initramfs... it is
NET: Registered protocol family 16
ACPI: bus type pci registered
PCI: Using configuration type 1
PCI: Using MMCONFIG at e0000000
ACPI: Subsystem revision 20050902
ACPI: Interpreter enabled
ACPI: Using IOAPIC for interrupt routing
ACPI: PCI Root Bridge [PCI0] (0000:00)
PCI: Probing PCI hardware (bus 00)
PCI: Transparent bridge - 0000:00:09.0
ACPI: PCI Interrupt Link [LNK1] (IRQs *3 4 5 7 9 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNK2] (IRQs 3 4 5 7 9 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNK3] (IRQs 3 4 *5 7 9 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNK4] (IRQs *3 4 5 7 9 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNK5] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.
ACPI: PCI Interrupt Link [LUBA] (IRQs *3 4 5 7 9 10 11 12 14 15)
ACPI: PCI Interrupt Link [LUBB] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.
ACPI: PCI Interrupt Link [LMAC] (IRQs 3 4 5 7 9 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LACI] (IRQs *3 4 5 7 9 10 11 12 14 15)
ACPI: PCI Interrupt Link [LMCI] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.
ACPI: PCI Interrupt Link [LSMB] (IRQs 3 4 *5 7 9 10 11 12 14 15)
ACPI: PCI Interrupt Link [LUB2] (IRQs 3 4 5 7 9 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LIDE] (IRQs<7>Losing some ticks... checking if CPU frequency changed.
3 4 5 7 9 10 11 12 14 15) *0, disabled.
ACPI: PCI Interrupt Link [LSID] (IRQs 3 4 5 7 9 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LFID] (IRQs 3 4 *5 7 9 10 11 12 14 15)
ACPI: PCI Interrupt Link [LPCA] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.
ACPI: PCI Interrupt Link [APC1] (IRQs 16) *0, disabled.
ACPI: PCI Interrupt Link [APC2] (IRQs 17) *0, disabled.
ACPI: PCI Interrupt Link [APC3] (IRQs 18) *0, disabled.
ACPI: PCI Interrupt Link [APC4] (IRQs 19) *0, disabled.
ACPI: PCI Interrupt Link [APC5] (IRQs *16), disabled.
ACPI: PCI Interrupt Link [APCF] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCG] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCH] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCJ] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCK] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCS] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCL] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCZ] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APSI] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APSJ] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCP] (IRQs 20 21 22 23) *0, disabled.
Linux Plug and Play Support v0.97 (c) Adam Belay
pnp: PnP ACPI init
pnp: PnP ACPI: found 15 devices
usbcore: registered new driver usbfs
usbcore: registered new driver hub
PCI: Using ACPI for IRQ routing
PCI: If a device doesn't work, try "pci=routeirq". If it helps, post a report
PCI-DMA: Disabling AGP.
PCI-DMA: More than 4GB of RAM and no IOMMU
PCI-DMA: 32bit PCI IO may malfunction.<6>PCI-DMA: Disabling IOMMU.
pnp: 00:00: ioport range 0x4000-0x407f could not be reserved
pnp: 00:00: ioport range 0x4080-0x40ff has been reserved
pnp: 00:00: ioport range 0x4400-0x447f has been reserved
pnp: 00:00: ioport range 0x4480-0x44ff could not be reserved
pnp: 00:00: ioport range 0x4800-0x487f has been reserved
pnp: 00:00: ioport range 0x4880-0x48ff has been reserved
PCI: Bridge: 0000:00:09.0
IO window: 9000-afff
MEM window: c8000000-c9ffffff
PREFETCH window: ca000000-ca0fffff
PCI: Bridge: 0000:00:0b.0
IO window: disabled.
MEM window: disabled.
PREFETCH window: disabled.
PCI: Bridge: 0000:00:0c.0
IO window: disabled.
MEM window: disabled.
PREFETCH window: disabled.
PCI: Bridge: 0000:00:0d.0
IO window: disabled.
MEM window: disabled.
PREFETCH window: disabled.
PCI: Bridge: 0000:00:0e.0
IO window: disabled.
MEM window: c0000000-c7ffffff
PREFETCH window: b0000000-bfffffff
IA32 emulation $Id: sys_ia32.c,v 1.32 2002/03/24 13:02:28 ak Exp $
audit: initializing netlink socket (disabled)
audit(1130629766.148:1): initialized
Total HugeTLB memory allocated, 0
VFS: Disk quotas dquot_6.5.1
Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
SELinux: Registering netfilter hooks
Initializing Cryptographic API
ksign: Installing public key data
Loading keyring
- Added public key BFB24792A9623ECB
- User ID: Red Hat, Inc. (Kernel Module GPG key)
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
pcie_portdrv_probe->Dev[005d:10de] has invalid IRQ. Check vendor BIOS
assign_interrupt_mode Found MSI capability
pcie_portdrv_probe->Dev[005d:10de] has invalid IRQ. Check vendor BIOS
assign_interrupt_mode Found MSI capability
pcie_portdrv_probe->Dev[005d:10de] has invalid IRQ. Check vendor BIOS
assign_interrupt_mode Found MSI capability
pcie_portdrv_probe->Dev[005d:10de] has invalid IRQ. Check vendor BIOS
assign_interrupt_mode Found MSI capability
ACPI: Fan [FAN] (on)
ACPI: CPU0 (power states: C1[C1])
ACPI: CPU1 (power states: C1[C1])
ACPI: Thermal Zone [THRM] (40 C)
Real Time Clock Driver v1.12
Linux agpgart interface v0.101 (c) Dave Jones
PNP: PS/2 Controller [PNP0303:PS2K,PNP0f13:PS2M] at 0x60,0x64 irq 1,12
serio: i8042 AUX port at 0x60,0x64 irq 12
serio: i8042 KBD port at 0x60,0x64 irq 1
Serial: 8250/16550 driver $Revision: 1.90 $ 32 ports, IRQ sharing enabled
?ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered
io scheduler cfq registered
RAMDISK driver initialized: 16 RAM disks of 16384K size 1024 blocksize
Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
NFORCE-CK804: IDE controller at PCI slot 0000:00:06.0
NFORCE-CK804: chipset revision 242
NFORCE-CK804: not 100% native mode: will probe irqs later
NFORCE-CK804: 0000:00:06.0 (rev f2) UDMA133 controller
ide0: BM-DMA at 0xf000-0xf007, BIOS settings: hda:DMA, hdb:DMA
ide1: BM-DMA at 0xf008-0xf00f, BIOS settings: hdc:DMA, hdd:DMA
hda: IBM-DTLA-307060, ATA DISK drive
isa bounce pool size: 16 pages
ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
hdc: HL-DT-STDVD-ROM GDR8163B, ATAPI CD/DVD-ROM drive
ide1 at 0x170-0x177,0x376 on irq 15
hda: max request size: 128KiB
hda: 120103200 sectors (61492 MB) w/1916KiB Cache, CHS=65535/16/63, UDMA(100)
hda: cache flushes not supported
hda: hda1 hda2 hda4 < hda5 >
hdc: ATAPI 52X DVD-ROM drive, 256kB Cache, UDMA(33)
Uniform CD-ROM driver Revision: 3.20
ide-floppy driver 0.99.newide
usbcore: registered new driver hiddev
usbcore: registered new driver usbhid
drivers/usb/input/hid-core.c: v2.6:USB HID core driver
mice: PS/2 mouse device common for all mice
md: md driver 0.90.2 MAX_MD_DEVS=256, MD_SB_DISKS=27
md: bitmap version 3.39
NET: Registered protocol family 2
input: AT Translated Set 2 keyboard on isa0060/serio0
IP route cache hash table entries: 131072 (order: 8, 1048576 bytes)
TCP established hash table entries: 131072 (order: 10, 4194304 bytes)
TCP bind hash table entries: 65536 (order: 9, 2097152 bytes)
TCP: Hash tables configured (established 131072 bind 65536)
TCP reno registered
TCP bic registered
Initializing IPsec netlink socket
NET: Registered protocol family 1
NET: Registered protocol family 17
powernow-k8: Found 2 AMD Athlon 64 / Opteron processors (version 1.50.4)
powernow-k8: 0 : fid 0xe (2200 MHz), vid 0x8 (1350 mV)
powernow-k8: 1 : fid 0xc (2000 MHz), vid 0xa (1300 mV)
powernow-k8: 2 : fid 0xa (1800 MHz), vid 0xc (1250 mV)
powernow-k8: 3 : fid 0x2 (1000 MHz), vid 0x12 (1100 mV)
cpu_init done, current fid 0xe, vid 0x8
ACPI wakeup devices:
HUB0 XVR0 XVR1 XVR2 XVR3 USB0 USB2 MMAC MMCI UAR1
ACPI: (supports S0 S1 S3 S4 S5)
Freeing unused kernel memory: 232k freed
SCSI subsystem initialized
ACPI: PCI Interrupt Link [APC4] enabled at IRQ 19
ACPI: PCI Interrupt 0000:05:0a.0[A] -> Link [APC4] -> GSI 19 (level, low) -> IRQ 217
ata1: SATA max UDMA/100 cmd 0xFFFFC20000004080 ctl 0xFFFFC2000000408A bmdma 0xFFFFC20000004000 irq 217
ata2: SATA max UDMA/100 cmd 0xFFFFC200000040C0 ctl 0xFFFFC200000040CA bmdma 0xFFFFC20000004008 irq 217
ata3: SATA max UDMA/100 cmd 0xFFFFC20000004280 ctl 0xFFFFC2000000428A bmdma 0xFFFFC20000004200 irq 217
ata4: SATA max UDMA/100 cmd 0xFFFFC200000042C0 ctl 0xFFFFC200000042CA bmdma 0xFFFFC20000004208 irq 217
input: PS2++ Logitech Mouse on isa0060/serio1
ata1: dev 0 ATA, max UDMA/133, 490234752 sectors: lba48
ata1: dev 0 configured for UDMA/100
scsi0 : sata_sil
ata2: dev 0 ATA, max UDMA/133, 490234752 sectors: lba48
ata2: dev 0 configured for UDMA/100
scsi1 : sata_sil
ata3: no device found (phy stat 00000000)
scsi2 : sata_sil
ata4: no device found (phy stat 00000000)
scsi3 : sata_sil
Vendor: ATA Model: Maxtor 7L250S0 Rev: BANC
Type: Direct-Access ANSI SCSI revision: 05
SCSI device sda: 490234752 512-byte hdwr sectors (251000 MB)
SCSI device sda: drive cache: write back
SCSI device sda: 490234752 512-byte hdwr sectors (251000 MB)
SCSI device sda: drive cache: write back
sda: sda1 sda2 sda3
Attached scsi disk sda at scsi0, channel 0, id 0, lun 0
Vendor: ATA Model: Maxtor 7L250S0 Rev: BANC
Type: Direct-Access ANSI SCSI revision: 05
SCSI device sdb: 490234752 512-byte hdwr sectors (251000 MB)
SCSI device sdb: drive cache: write back
SCSI device sdb: 490234752 512-byte hdwr sectors (251000 MB)
SCSI device sdb: drive cache: write back
sdb: sdb1 sdb2 sdb3
Attached scsi disk sdb at scsi1, channel 0, id 0, lun 0
ACPI: PCI Interrupt Link [APSI] enabled at IRQ 23
ACPI: PCI Interrupt 0000:00:07.0[A] -> Link [APSI] -> GSI 23 (level, low) -> IRQ 225
ata5: SATA max UDMA/133 cmd 0x9F0 ctl 0xBF2 bmdma 0xD800 irq 225
ata6: SATA max UDMA/133 cmd 0x970 ctl 0xB72 bmdma 0xD808 irq 225
ata5: no device found (phy stat 00000000)
scsi4 : sata_nv
ata6: no device found (phy stat 00000000)
scsi5 : sata_nv
ACPI: PCI Interrupt Link [APSJ] enabled at IRQ 22
ACPI: PCI Interrupt 0000:00:08.0[A] -> Link [APSJ] -> GSI 22 (level, low) -> IRQ 233
ata7: SATA max UDMA/133 cmd 0x9E0 ctl 0xBE2 bmdma 0xC400 irq 233
ata8: SATA max UDMA/133 cmd 0x960 ctl 0xB62 bmdma 0xC408 irq 233
ata7: no device found (phy stat 00000000)
scsi6 : sata_nv
ata8: no device found (phy stat 00000000)
scsi7 : sata_nv
md: raid1 personality registered as nr 3
md: Autodetecting RAID arrays.
md: autorun ...
md: considering sdb3 ...
md: adding sdb3 ...
md: sdb2 has different UUID to sdb3
md: sdb1 has different UUID to sdb3
md: adding sda3 ...
md: sda2 has different UUID to sdb3
md: sda1 has different UUID to sdb3
md: hda5 has different UUID to sdb3
md: hda2 has different UUID to sdb3
md: hda1 has different UUID to sdb3
md: created md2
md: bind<sda3>
md: bind<sdb3>
md: running: <sdb3><sda3>
raid1: raid set md2 active with 2 out of 2 mirrors
md: considering sdb2 ...
md: adding sdb2 ...
md: sdb1 has different UUID to sdb2
md: adding sda2 ...
md: sda1 has different UUID to sdb2
md: hda5 has different UUID to sdb2
md: hda2 has different UUID to sdb2
md: hda1 has different UUID to sdb2
md: created md1
md: bind<sda2>
md: bind<sdb2>
md: running: <sdb2><sda2>
raid1: raid set md1 active with 2 out of 2 mirrors
md: considering sdb1 ...
md: adding sdb1 ...
md: adding sda1 ...
md: hda5 has different UUID to sdb1
md: hda2 has different UUID to sdb1
md: hda1 has different UUID to sdb1
md: created md0
md: bind<sda1>
md: bind<sdb1>
md: running: <sdb1><sda1>
raid1: raid set md0 active with 2 out of 2 mirrors
md: considering hda5 ...
md: adding hda5 ...
md: hda2 has different UUID to hda5
md: hda1 has different UUID to hda5
md: md2 already running, cannot run hda5
md: export_rdev(hda5)
md: considering hda2 ...
md: adding hda2 ...
md: hda1 has different UUID to hda2
md: md1 already running, cannot run hda2
md: export_rdev(hda2)
md: considering hda1 ...
md: adding hda1 ...
md: md0 already running, cannot run hda1
md: export_rdev(hda1)
md: ... autorun DONE.
kjournald starting. Commit interval 5 seconds
EXT3-fs: mounted filesystem with ordered data mode.
SELinux: Disabled at runtime.
SELinux: Unregistering netfilter hooks
Kernel panic - not syncing: PCI-DMA: high address but no IOMMU.

2005-10-30 14:29:23

by Nishanth Aravamudan

[permalink] [raw]
Subject: Re: PCI-DMA: high address but no IOMMU

On 27.10.2005 [18:59:00 -0700], Nishanth Aravamudan wrote:
> On 27.10.2005 [15:39:20 -0700], Michael Madore wrote:
> > On 28 Oct 2005 00:16:51 +0200, Andi Kleen <[email protected]> wro> >
> > > > Checking aperture...
> > > > CPU 0: aperture @ 8000000 size 32 MB
> > > > Aperture from northbridge cpu 0 too small (32 MB)
> > > > No AGP bridge found
> > > > Your BIOS doesn't leave a aperture memory hole
> > > > Please enable the IOMMU option in the BIOS setup
> > > > This costs you 64 MB of RAM
> > > > Mapping aperture over 65536 KB of RAM @ 8000000
> > > >
> > > > ...
> > > >
> > > > PCI-DMA: Disabling AGP.
> > > > PCI-DMA: aperture base @ 8000000 size 65536 KB
> > > > PCI-DMA: Reserving 64MB of IOMMU area in the AGP aperture
> > >
> > > Can you post the full boot log?
> > >
> >
> > Hi Andy,
> >
> > Here is the full boot log from 2.6.14-rc5.
>
> Just as another datapoint, here is mine (ignore the inode issues, they
> are due to a power failure yesterday):

Ah, silly me, I set IOMMU_DEBUG to Y at some point without realizing.
Taking that away removed the issues and I now only get:

[ 0.000000] Checking aperture...
[ 0.000000] CPU 0: aperture @ 4000000 size 32 MB
[ 0.000000] Aperture from northbridge cpu 0 too small (32 MB)
[ 0.000000] No AGP bridge found

...

[ 47.737770] PCI-DMA: Disabling IOMMU.

Which makes a lot more sense.

Sorry for the noise.

Thanks,
Nish

2005-10-30 14:58:20

by Andi Kleen

[permalink] [raw]
Subject: Re: PCI-DMA: high address but no IOMMU

On Sunday 30 October 2005 15:29, Nishanth Aravamudan wrote:

>
> Ah, silly me, I set IOMMU_DEBUG to Y at some point without realizing.
> Taking that away removed the issues and I now only get:
>
> [ 0.000000] Checking aperture...
> [ 0.000000] CPU 0: aperture @ 4000000 size 32 MB
> [ 0.000000] Aperture from northbridge cpu 0 too small (32 MB)
> [ 0.000000] No AGP bridge found
>
> ...
>
> [ 47.737770] PCI-DMA: Disabling IOMMU.
>
> Which makes a lot more sense.

And everything works when you disable IOMMU_DEBUG? Is that the case
with the other reporters of this problem too?

-Andi

2005-10-30 21:26:18

by Nishanth Aravamudan

[permalink] [raw]
Subject: Re: PCI-DMA: high address but no IOMMU

On 30.10.2005 [15:59:15 +0100], Andi Kleen wrote:
> On Sunday 30 October 2005 15:29, Nishanth Aravamudan wrote:
>
> >
> > Ah, silly me, I set IOMMU_DEBUG to Y at some point without realizing.
> > Taking that away removed the issues and I now only get:
> >
> > [ 0.000000] Checking aperture...
> > [ 0.000000] CPU 0: aperture @ 4000000 size 32 MB
> > [ 0.000000] Aperture from northbridge cpu 0 too small (32 MB)
> > [ 0.000000] No AGP bridge found
> >
> > ...
> >
> > [ 47.737770] PCI-DMA: Disabling IOMMU.
> >
> > Which makes a lot more sense.
>
> And everything works when you disable IOMMU_DEBUG? Is that the case
> with the other reporters of this problem too?

Sorry, I realize in retrospect that my post may have been misleading. I
was only commenting that I was seeing the same messages (but not the
same "Kernel panic - not syncing: PCI-DMA: high address but no IOMMU.")
So it works with either IOMMU_DEBUG (which I guess forces the IOMMU on?
-- hence the output of "PCI-DMA: More than 4GB of RAM and no IOMMU"?) or
not. Also note that I only have 2 GB of RAM, so I believe the kernel
made the right decision in disabling the IOMMU (which is used with more
than 3 GB of RAM?) Still, if Michael has IOMMU_DEBUG enabled, it might
change things.

Thanks,
Nish

2005-11-01 05:21:32

by Marc Perkel

[permalink] [raw]
Subject: Re: PCI-DMA: high address but no IOMMU - nForce4

> On Fri, Oct 28, 2005 at 12:16:51AM +0200, Andi Kleen wrote:
>
> I will attach my own; A brand new Amd64 dual-core thing.
> Works fine with mem=2500M, but blows up with mem=3G or
> without any override and full 4G complement in use.
>
> This board (ASUS A8N-SLI) does use NVIDIA nForce4 chipset with
> bios-option to map (hoist) "excess memory" out from first 4G to
> higher physical addresses so that it can be accessed by the
> processor.
>
> This board has no AGP at all in it, but it does have lots
> of PCIE, and a bit of PCI-X thrown in for "legacy cards".
> Somehow that detail breaks things when the machine really
> should use bounce-buffering, or something similar -- I don't
> know if Nvidia nForce4 chipset does have IOMMU, though...
>
> If Nvidia did omit such essential piece of hardware from
> a modern chipset, I do find it amazingly short-sighted...
> (Of course they don't yield documentation of the chips to
> public so that I can't quickly verify this detail...)


For what it's worth I have almost the exact same hardware and got the same
error. Athlon X2 4400 with the same ASUS board. Reverting to 2.6.13.2
kernel works.

2005-11-01 16:35:59

by Marc Perkel

[permalink] [raw]
Subject: Re: PCI-DMA: high address but no IOMMU - nForce4



Matti Aarnio wrote:

>Works fine with mem=2500M, but blows up with mem=3G or
>without any override and full 4G complement in use.
>
>This board (ASUS A8N-SLI) does use NVIDIA nForce4 chipset with
>bios-option to map (hoist) "excess memory" out from first 4G to
>higher physical addresses so that it can be accessed by the
>processor.
>
>This board has no AGP at all in it, but it does have lots
>of PCIE, and a bit of PCI-X thrown in for "legacy cards".
>Somehow that detail breaks things when the machine really
>should use bounce-buffering, or something similar -- I don't
>know if Nvidia nForce4 chipset does have IOMMU, though...
>
>If Nvidia did omit such essential piece of hardware from
>a modern chipset, I do find it amazingly short-sighted...
>(Of course they don't yield documentation of the chips to
>public so that I can't quickly verify this detail...)
>
>
>

I'm having the same problem I have the same ASUS motherboard running a
dual core Athlon and 4 gigs of ram. Worked fine with the 2.6.13.2 kernel
which I am now running but fails with 2.6.14. No DEBUG related issues
for me. I do have a PCI VGA card in it.

Sure would like to see these X2 problems fixed. Rather not have to run
down to the datacenter all the time. :(

Bootdata ok (command line is ro root=/dev/sda4 vga=1 notsc)
Linux version 2.6.13.2 ([email protected]) (gcc version 4.0.1
20050727 (Red Hat 4.0.1-5)) #3 SMP Tue Sep 20 17:01:09 PDT 2005
BIOS-provided physical RAM map:
BIOS-e820: 0000000000000000 - 000000000009f800 (usable)
BIOS-e820: 000000000009f800 - 00000000000a0000 (reserved)
BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
BIOS-e820: 0000000000100000 - 00000000bfff0000 (usable)
BIOS-e820: 00000000bfff0000 - 00000000bfff3000 (ACPI NVS)
BIOS-e820: 00000000bfff3000 - 00000000c0000000 (ACPI data)
BIOS-e820: 00000000e0000000 - 00000000f0000000 (reserved)
BIOS-e820: 00000000fec00000 - 0000000100000000 (reserved)
BIOS-e820: 0000000100000000 - 0000000140000000 (usable)
ACPI: RSDP (v000 Nvidia ) @
0x00000000000f7dc0
ACPI: RSDT (v001 Nvidia AWRDACPI 0x42302e31 AWRD 0x00000000) @
0x00000000bfff3040
ACPI: FADT (v001 Nvidia AWRDACPI 0x42302e31 AWRD 0x00000000) @
0x00000000bfff30c0
ACPI: SRAT (v001 AMD HAMMER 0x00000001 AMD 0x00000001) @
0x00000000bfff9900
ACPI: MCFG (v001 Nvidia AWRDACPI 0x42302e31 AWRD 0x00000000) @
0x00000000bfff9a40
ACPI: MADT (v001 Nvidia AWRDACPI 0x42302e31 AWRD 0x00000000) @
0x00000000bfff9840
ACPI: DSDT (v001 NVIDIA AWRDACPI 0x00001000 MSFT 0x0100000e) @
0x0000000000000000
Scanning NUMA topology in Northbridge 24
Number of nodes 1
Node 0 MemBase 0000000000000000 Limit 000000013fffffff
Using 25 for the hash shift. Max adder is 13fffffff
Using node hash shift of 25
Bootmem setup node 0 0000000000000000-000000013fffffff
On node 0 totalpages: 1048462
DMA zone: 3999 pages, LIFO batch:1
Normal zone: 1044463 pages, LIFO batch:31
HighMem zone: 0 pages, LIFO batch:1
Nvidia board detected. Ignoring ACPI timer override.
ACPI: PM-Timer IO Port: 0x4008
ACPI: Local APIC address 0xfee00000
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
Processor #0 15:3 APIC version 16
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
Processor #1 15:3 APIC version 16
ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 2, version 17, address 0xfec00000, GSI 0-23
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
ACPI: BIOS IRQ0 pin2 override ignored.
ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
ACPI: INT_SRC_OVR (bus 0 bus_irq 14 global_irq 14 high edge)
ACPI: INT_SRC_OVR (bus 0 bus_irq 15 global_irq 15 high edge)
ACPI: IRQ9 used by override.
ACPI: IRQ14 used by override.
ACPI: IRQ15 used by override.
Setting APIC routing to flat
Using ACPI (MADT) for SMP configuration information
Allocating PCI resources starting at c0000000 (gap: c0000000:20000000)
Checking aperture...
CPU 0: aperture @ 8000000 size 32 MB
Aperture from northbridge cpu 0 too small (32 MB)
No AGP bridge found
Your BIOS doesn't leave a aperture memory hole
Please enable the IOMMU option in the BIOS setup
This costs you 64 MB of RAM
Mapping aperture over 65536 KB of RAM @ 8000000
Built 1 zonelists
Kernel command line: ro root=/dev/sda4 vga=1 notsc
Initializing CPU#0
PID hash table entries: 4096 (order: 12, 131072 bytes)
time.c: Using 3.579545 MHz PM timer.
time.c: Detected 2211.376 MHz processor.
Console: colour VGA+ 80x50
Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes)
Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes)
Memory: 4038524k/5242880k available (2355k kernel code, 0k reserved,
1171k data, 200k init)
Calibrating delay using timer specific routine.. 4427.24 BogoMIPS
(lpj=8854484)
Security Framework v1.0.0 initialized
Capability LSM initialized
Mount-cache hash table entries: 256
CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
CPU: L2 Cache: 1024K (64 bytes/line)
CPU 0(2) -> Node 0 -> Core 0
mtrr: v2.0 (20020519)
Using local APIC timer interrupts.
Detected 12.564 MHz APIC timer.
Booting processor 1/2 APIC 0x1
Initializing CPU#1
Calibrating delay using timer specific routine.. 4422.97 BogoMIPS
(lpj=8845948)
CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
CPU: L2 Cache: 1024K (64 bytes/line)
CPU 1(2) -> Node 0 -> Core 1
AMD Athlon(tm) 64 X2 Dual Core Processor 4400+ stepping 02
CPU 1: Syncing TSC to CPU 0.
CPU 1: synchronized TSC with CPU 0 (last diff -82 cycles, maxerr 595 cycles)
Brought up 2 CPUs
Disabling vsyscall due to use of PM timer
time.c: Using PM based timekeeping.
testing NMI watchdog ... OK.
checking if image is initramfs... it is
NET: Registered protocol family 16
ACPI: bus type pci registered
PCI: Using configuration type 1
ACPI: Subsystem revision 20050408
ACPI: Interpreter enabled
ACPI: Using IOAPIC for interrupt routing
ACPI: PCI Root Bridge [PCI0] (0000:00)
PCI: Probing PCI hardware (bus 00)
ACPI: Assume root bridge [\_SB_.PCI0] segment is 0
Boot video device is 0000:05:07.0
PCI: Transparent bridge - 0000:00:09.0
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.HUB0._PRT]
ACPI: PCI Interrupt Link [LNK1] (IRQs 3 4 5 *7 9 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNK2] (IRQs *3 4 5 7 9 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNK3] (IRQs 3 4 5 7 9 10 11 12 14 15) *0,
disabled.
ACPI: PCI Interrupt Link [LNK4] (IRQs 3 4 *5 7 9 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNK5] (IRQs 3 4 5 7 9 10 11 12 14 15) *0,
disabled.
ACPI: PCI Interrupt Link [LUBA] (IRQs 3 *4 5 7 9 10 11 12 14 15)
ACPI: PCI Interrupt Link [LUBB] (IRQs 3 4 5 7 9 10 11 12 14 15) *0,
disabled.
ACPI: PCI Interrupt Link [LMAC] (IRQs 3 4 5 7 9 10 11 12 14 15) *0,
disabled.
ACPI: PCI Interrupt Link [LACI] (IRQs 3 4 5 7 9 10 11 12 14 15) *0,
disabled.
ACPI: PCI Interrupt Link [LMCI] (IRQs 3 4 5 7 9 10 11 12 14 15) *0,
disabled.
ACPI: PCI Interrupt Link [LSMB] (IRQs 3 4 5 7 9 10 11 *12 14 15)
ACPI: PCI Interrupt Link [LUB2] (IRQs 3 4 5 7 9 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LIDE] (IRQs 3 4 5 7 9 10 11 12 14 15) *0,
disabled.
ACPI: PCI Interrupt Link [LSID] (IRQs 3 4 5 7 9 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LFID] (IRQs 3 4 *5 7 9 10 11 12 14 15)
ACPI: PCI Interrupt Link [LPCA] (IRQs 3 4 5 7 9 10 11 12 14 15) *0,
disabled.
ACPI: PCI Interrupt Link [APC1] (IRQs 16) *0, disabled.
ACPI: PCI Interrupt Link [APC2] (IRQs 17) *0, disabled.
ACPI: PCI Interrupt Link [APC3] (IRQs 18) *0, disabled.
ACPI: PCI Interrupt Link [APC4] (IRQs 19) *0, disabled.
ACPI: PCI Interrupt Link [APC5] (IRQs *16), disabled.
ACPI: PCI Interrupt Link [APCF] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCG] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCH] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCJ] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCK] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCS] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCL] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCZ] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APSI] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APSJ] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCP] (IRQs 20 21 22 23) *0, disabled.
Linux Plug and Play Support v0.97 (c) Adam Belay
usbcore: registered new driver usbfs
usbcore: registered new driver hub
PCI: Using ACPI for IRQ routing
PCI: If a device doesn't work, try "pci=routeirq". If it helps, post a
report
PCI-DMA: Disabling AGP.
PCI-DMA: aperture base @ 8000000 size 65536 KB
PCI-DMA: Reserving 64MB of IOMMU area in the AGP aperture
PCI: Bridge: 0000:00:09.0
IO window: 9000-afff
MEM window: d0000000-d1ffffff
PREFETCH window: c0000000-cfffffff
PCI: Bridge: 0000:00:0b.0
IO window: disabled.
MEM window: disabled.
PREFETCH window: disabled.
PCI: Bridge: 0000:00:0c.0
IO window: disabled.
MEM window: disabled.
PREFETCH window: disabled.
PCI: Bridge: 0000:00:0d.0
IO window: disabled.
MEM window: disabled.
PREFETCH window: disabled.
PCI: Bridge: 0000:00:0e.0
IO window: disabled.
MEM window: disabled.
PREFETCH window: disabled.
PCI: Setting latency timer of device 0000:00:09.0 to 64
PCI: Setting latency timer of device 0000:00:0b.0 to 64
PCI: Setting latency timer of device 0000:00:0c.0 to 64
PCI: Setting latency timer of device 0000:00:0d.0 to 64
PCI: Setting latency timer of device 0000:00:0e.0 to 64
IA32 emulation $Id: sys_ia32.c,v 1.32 2002/03/24 13:02:28 ak Exp $
audit: initializing netlink socket (disabled)
audit(1130793066.276:1): initialized
Total HugeTLB memory allocated, 0
JFS: nTxBlock = 8192, nTxLock = 65536
Initializing Cryptographic API
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
PCI: Setting latency timer of device 0000:00:0b.0 to 64
pcie_portdrv_probe->Dev[005d:10de] has invalid IRQ. Check vendor BIOS
assign_interrupt_mode Found MSI capability
Allocate Port Service[pcie00]
PCI: Setting latency timer of device 0000:00:0c.0 to 64
pcie_portdrv_probe->Dev[005d:10de] has invalid IRQ. Check vendor BIOS
assign_interrupt_mode Found MSI capability
Allocate Port Service[pcie00]
PCI: Setting latency timer of device 0000:00:0d.0 to 64
pcie_portdrv_probe->Dev[005d:10de] has invalid IRQ. Check vendor BIOS
assign_interrupt_mode Found MSI capability
Allocate Port Service[pcie00]
PCI: Setting latency timer of device 0000:00:0e.0 to 64
pcie_portdrv_probe->Dev[005d:10de] has invalid IRQ. Check vendor BIOS
assign_interrupt_mode Found MSI capability
Allocate Port Service[pcie00]
ACPI: Fan [FAN] (on)
ACPI: CPU0 (power states: C1[C1])
ACPI: CPU1 (power states: C1[C1])
ACPI: Thermal Zone [THRM] (40 C)
Real Time Clock Driver v1.12
Linux agpgart interface v0.101 (c) Dave Jones
PNP: No PS/2 controller found. Probing ports directly.
serio: i8042 AUX port at 0x60,0x64 irq 12
serio: i8042 KBD port at 0x60,0x64 irq 1
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered
io scheduler cfq registered
RAMDISK driver initialized: 16 RAM disks of 16384K size 1024 blocksize
8139cp: 10/100 PCI Ethernet driver v1.2 (Mar 22, 2004)
8139cp: pci dev 0000:05:06.0 (id 10ec:8139 rev 10) is not an 8139C+
compatible chip
8139cp: Try the "8139too" driver instead.
Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
NFORCE-CK804: IDE controller at PCI slot 0000:00:06.0
NFORCE-CK804: chipset revision 242
NFORCE-CK804: not 100% native mode: will probe irqs later
NFORCE-CK804: 0000:00:06.0 (rev f2) UDMA133 controller
ide0: BM-DMA at 0xf000-0xf007, BIOS settings: hda:DMA, hdb:DMA
ide1: BM-DMA at 0xf008-0xf00f, BIOS settings: hdc:DMA, hdd:DMA
Probing IDE interface ide0...
Probing IDE interface ide1...
Probing IDE interface ide0...
Probing IDE interface ide1...
ide-floppy driver 0.99.newide
usbcore: registered new driver hiddev
usbcore: registered new driver usbhid
drivers/usb/input/hid-core.c: v2.01:USB HID core driver
mice: PS/2 mouse device common for all mice
md: md driver 0.90.2 MAX_MD_DEVS=256, MD_SB_DISKS=27
md: bitmap version 3.38
NET: Registered protocol family 2
IP route cache hash table entries: 262144 (order: 9, 2097152 bytes)
TCP established hash table entries: 262144 (order: 10, 4194304 bytes)
TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
TCP: Hash tables configured (established 262144 bind 65536)
TCP reno registered
TCP bic registered
Initializing IPsec netlink socket
NET: Registered protocol family 1
NET: Registered protocol family 17
Freeing unused kernel memory: 200k freed
SCSI subsystem initialized
libata version 1.12 loaded.
sata_sil version 0.9
ACPI: PCI Interrupt Link [APC4] enabled at IRQ 19
ACPI: PCI Interrupt 0000:05:0a.0[A] -> Link [APC4] -> GSI 19 (level,
low) -> IRQ 16
ata1: SATA max UDMA/100 cmd 0xFFFFC20000006080 ctl 0xFFFFC2000000608A
bmdma 0xFFFFC20000006000 irq 16
ata2: SATA max UDMA/100 cmd 0xFFFFC200000060C0 ctl 0xFFFFC200000060CA
bmdma 0xFFFFC20000006008 irq 16
ata3: SATA max UDMA/100 cmd 0xFFFFC20000006280 ctl 0xFFFFC2000000628A
bmdma 0xFFFFC20000006200 irq 16
ata4: SATA max UDMA/100 cmd 0xFFFFC200000062C0 ctl 0xFFFFC200000062CA
bmdma 0xFFFFC20000006208 irq 16
ata1: no device found (phy stat 00000000)
scsi0 : sata_sil
ata2: no device found (phy stat 00000000)
scsi1 : sata_sil
ata3: no device found (phy stat 00000000)
scsi2 : sata_sil
ata4: no device found (phy stat 00000000)
scsi3 : sata_sil
sata_nv version 0.6
ACPI: PCI Interrupt Link [APSI] enabled at IRQ 23
ACPI: PCI Interrupt 0000:00:07.0[A] -> Link [APSI] -> GSI 23 (level,
low) -> IRQ 17
PCI: Setting latency timer of device 0000:00:07.0 to 64
ata5: SATA max UDMA/133 cmd 0x9F0 ctl 0xBF2 bmdma 0xD400 irq 17
ata6: SATA max UDMA/133 cmd 0x970 ctl 0xB72 bmdma 0xD408 irq 17
ata5: dev 0 cfg 49:2f00 82:7c6b 83:7f09 84:4673 85:7c68 86:3e01 87:4663
88:407f
ata5: dev 0 ATA, max UDMA/133, 586114704 sectors: lba48
nv_sata: Primary device added
nv_sata: Primary device removed
nv_sata: Secondary device added
nv_sata: Secondary device removed
ata5: dev 0 configured for UDMA/133
scsi4 : sata_nv
ata6: dev 0 cfg 49:2f00 82:7c6b 83:7f09 84:4063 85:7c68 86:3e01 87:4063
88:407f
ata6: dev 0 ATA, max UDMA/133, 398297088 sectors: lba48
nv_sata: Primary device added
nv_sata: Primary device removed
nv_sata: Secondary device added
nv_sata: Secondary device removed
ata6: dev 0 configured for UDMA/133
scsi5 : sata_nv
Vendor: ATA Model: Maxtor 7L300S0 Rev: BANC
Type: Direct-Access ANSI SCSI revision: 05
SCSI device sda: 586114704 512-byte hdwr sectors (300091 MB)
SCSI device sda: drive cache: write back
SCSI device sda: 586114704 512-byte hdwr sectors (300091 MB)
SCSI device sda: drive cache: write back
sda:<4>nv_sata: Primary device added
nv_sata: Primary device removed
nv_sata: Secondary device added
nv_sata: Secondary device removed
sda1 sda2 sda3 sda4
nv_sata: Primary device added
nv_sata: Primary device removed
nv_sata: Secondary device added
nv_sata: Secondary device removed
Attached scsi disk sda at scsi4, channel 0, id 0, lun 0
Vendor: ATA Model: Maxtor 6B200M0 Rev: BANC
Type: Direct-Access ANSI SCSI revision: 05
SCSI device sdb: 398297088 512-byte hdwr sectors (203928 MB)
SCSI device sdb: drive cache: write back
SCSI device sdb: 398297088 512-byte hdwr sectors (203928 MB)
SCSI device sdb: drive cache: write back
sdb:<4>nv_sata: Primary device added
nv_sata: Primary device removed
nv_sata: Secondary device added
nv_sata: Secondary device removed
sdb1 sdb2 sdb3
nv_sata: Primary device added
nv_sata: Primary device removed
nv_sata: Secondary device added
nv_sata: Secondary device removed
Attached scsi disk sdb at scsi5, channel 0, id 0, lun 0
ACPI: PCI Interrupt Link [APSJ] enabled at IRQ 22
ACPI: PCI Interrupt 0000:00:08.0[A] -> Link [APSJ] -> GSI 22 (level,
low) -> IRQ 18
PCI: Setting latency timer of device 0000:00:08.0 to 64
ata7: SATA max UDMA/133 cmd 0x9E0 ctl 0xBE2 bmdma 0xC000 irq 18
ata8: SATA max UDMA/133 cmd 0x960 ctl 0xB62 bmdma 0xC008 irq 18
ata7: dev 0 cfg 49:2f00 82:7c6b 83:7f09 84:4673 85:7c68 86:3e01 87:4663
88:407f
ata7: dev 0 ATA, max UDMA/133, 586114704 sectors: lba48
nv_sata: Primary device added
nv_sata: Primary device removed
nv_sata: Secondary device added
nv_sata: Secondary device removed
ata7: dev 0 configured for UDMA/133
scsi6 : sata_nv
ata8: no device found (phy stat 00000000)
scsi7 : sata_nv
Vendor: ATA Model: Maxtor 7L300S0 Rev: BANC
Type: Direct-Access ANSI SCSI revision: 05
SCSI device sdc: 586114704 512-byte hdwr sectors (300091 MB)
SCSI device sdc: drive cache: write back
SCSI device sdc: 586114704 512-byte hdwr sectors (300091 MB)
SCSI device sdc: drive cache: write back
sdc:<4>nv_sata: Primary device added
nv_sata: Primary device removed
nv_sata: Secondary device added
nv_sata: Secondary device removed
sdc1 sdc2 sdc3 sdc4
nv_sata: Primary device added
nv_sata: Primary device removed
nv_sata: Secondary device added
nv_sata: Secondary device removed
Attached scsi disk sdc at scsi6, channel 0, id 0, lun 0
md: raid1 personality registered as nr 3
md: Autodetecting RAID arrays.
md: autorun ...
md: considering sdc3 ...
md: adding sdc3 ...
md: adding sda3 ...
md: created md0
md: bind<sda3>
md: bind<sdc3>
md: running: <sdc3><sda3>
raid1: raid set md0 active with 2 out of 2 mirrors
md: ... autorun DONE.
kjournald starting. Commit interval 5 seconds
EXT3-fs: mounted filesystem with ordered data mode.
floppy0: no floppy controllers found
8139too Fast Ethernet driver 0.9.27
ACPI: PCI Interrupt Link [APC1] enabled at IRQ 16
ACPI: PCI Interrupt 0000:05:06.0[A] -> Link [APC1] -> GSI 16 (level,
low) -> IRQ 19
eth0: RealTek RTL8139 at 0x9000, 00:50:fc:54:8d:c5, IRQ 19
eth0: Identified 8139 chip type 'RTL-8139C'
shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
i2c_adapter i2c-0: nForce2 SMBus adapter at 0x4c00
i2c_adapter i2c-1: nForce2 SMBus adapter at 0x4c40
ACPI: PCI Interrupt Link [APCL] enabled at IRQ 21
ACPI: PCI Interrupt 0000:00:02.1[B] -> Link [APCL] -> GSI 21 (level,
low) -> IRQ 20
PCI: Setting latency timer of device 0000:00:02.1 to 64
ehci_hcd 0000:00:02.1: EHCI Host Controller
ehci_hcd 0000:00:02.1: debug port 1
ehci_hcd 0000:00:02.1: new USB bus registered, assigned bus number 1
ehci_hcd 0000:00:02.1: irq 20, io mem 0xfeb00000
PCI: cache line size of 64 is not supported by device 0000:00:02.1
ehci_hcd 0000:00:02.1: park 0
ehci_hcd 0000:00:02.1: USB 2.0 initialized, EHCI 1.00, driver 10 Dec 2004
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 10 ports detected
ohci_hcd: 2005 April 22 USB 1.1 'Open' Host Controller (OHCI) Driver (PCI)
ACPI: PCI Interrupt Link [APCF] enabled at IRQ 20
ACPI: PCI Interrupt 0000:00:02.0[A] -> Link [APCF] -> GSI 20 (level,
low) -> IRQ 21
PCI: Setting latency timer of device 0000:00:02.0 to 64
ohci_hcd 0000:00:02.0: OHCI Host Controller
ohci_hcd 0000:00:02.0: new USB bus registered, assigned bus number 2
ohci_hcd 0000:00:02.0: irq 21, io mem 0xd2002000
hub 2-0:1.0: USB hub found
hub 2-0:1.0: 10 ports detected
eth0: link up, 100Mbps, full-duplex, lpa 0xC5E1
usb 2-4: new low speed USB device using ohci_hcd and address 2
input: USB HID v1.10 Keyboard [USB Keyboard + Mouse] on usb-0000:00:02.0-4
input: USB HID v1.10 Mouse [USB Keyboard + Mouse] on usb-0000:00:02.0-4
audit(1130821877.994:2): user pid=1152 uid=0 auid=4294967295
msg='hwclock: op=changing system time id=0 res=success'
ACPI: Power Button (FF) [PWRF]
ACPI: Power Button (CM) [PWRB]
md: Autodetecting RAID arrays.
md: autorun ...
md: ... autorun DONE.
device-mapper: 4.4.0-ioctl (2005-01-12) initialised: [email protected]
EXT3 FS on sda4, internal journal
kjournald starting. Commit interval 5 seconds
EXT3 FS on sdc4, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
kjournald starting. Commit interval 5 seconds
EXT3 FS on sdb3, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
kjournald starting. Commit interval 5 seconds
EXT3 FS on sda1, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
kjournald starting. Commit interval 5 seconds
EXT3 FS on sdc1, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
kjournald starting. Commit interval 5 seconds
EXT3 FS on md0, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
Adding 2008116k swap on /dev/sda2. Priority:-1 extents:1
Adding 11984480k swap on /dev/sdb2. Priority:-2 extents:1
Adding 2008116k swap on /dev/sdc2. Priority:-3 extents:1

2005-11-02 15:38:31

by Andi Kleen

[permalink] [raw]
Subject: Re: PCI-DMA: high address but no IOMMU - nForce4

[full quote]
 
Am Di 01.11.2005 06:21 schrieb Marc Perkel <[email protected]>:

> > On Fri, Oct 28, 2005 at 12:16:51AM +0200, Andi Kleen wrote:
> >
> > I will attach my own; A brand new Amd64 dual-core thing.
> > Works fine with mem=2500M, but blows up with mem=3G or
> > without any override and full 4G complement in use.
> >
> > This board (ASUS A8N-SLI) does use NVIDIA nForce4 chipset with
> > bios-option to map (hoist) "excess memory" out from first 4G to
> > higher physical addresses so that it can be accessed by the
> > processor.
> >
> > This board has no AGP at all in it, but it does have lots
> > of PCIE, and a bit of PCI-X thrown in for "legacy cards".
> > Somehow that detail breaks things when the machine really
> > should use bounce-buffering, or something similar -- I don't
> > know if Nvidia nForce4 chipset does have IOMMU, though...
> >
> > If Nvidia did omit such essential piece of hardware from
> > a modern chipset, I do find it amazingly short-sighted...
> > (Of course they don't yield documentation of the chips to
> > public so that I can't quickly verify this detail...)
>
>
> For what it's worth I have almost the exact same hardware and got the
> same
> error. Athlon X2 4400 with the same ASUS board. Reverting to 2.6.13.2
> kernel works.
>

 
This sounds like the PCI-X BIOS misconfiguration issue that Andy C.
recently
tracked down. Andy do you agree?
 
If yes it's a BIOS problem, but we can probably work around it with a
quirk.
 
-Andi

2005-11-06 12:35:17

by Matti Aarnio

[permalink] [raw]
Subject: Re: PCI-DMA: high address but no IOMMU - nForce4

On Wed, Nov 02, 2005 at 04:38:20PM +0100, Andreas Kleen wrote:
> Date: Wed, 2 Nov 2005 16:38:20 +0100 (CET)
> From: Andreas Kleen <[email protected]>
> To: Marc Perkel <[email protected]>
> Subject: Re: PCI-DMA: high address but no IOMMU - nForce4
>
> [full quote]

[severe clipping]
?
> Am Di 01.11.2005 06:21 schrieb Marc Perkel <[email protected]>:
>
> > > On Fri, Oct 28, 2005 at 12:16:51AM +0200, Andi Kleen wrote:
> > >
> > > I will attach my own; A brand new Amd64 dual-core thing.
> > > Works fine with mem=2500M, but blows up with mem=3G or
> > > without any override and full 4G complement in use.
> > >
> > > This board (ASUS A8N-SLI) does use NVIDIA nForce4 chipset with
> > > bios-option to map (hoist) "excess memory" out from first 4G to
> > > higher physical addresses so that it can be accessed by the
> > > processor.
> > >
> > > This board has no AGP at all in it, but it does have lots
> > > of PCIE, and a bit of PCI-X thrown in for "legacy cards".
> > > Somehow that detail breaks things when the machine really
> > > should use bounce-buffering, or something similar -- I don't
> > > know if Nvidia nForce4 chipset does have IOMMU, though...
> >
> > For what it's worth I have almost the exact same hardware and got the
> > same
> > error. Athlon X2 4400 with the same ASUS board. Reverting to 2.6.13.2
> > kernel works.
> ?
> This sounds like the PCI-X BIOS misconfiguration issue that Andy C.
> recently tracked down. Andy do you agree?
> ?
> If yes it's a BIOS problem, but we can probably work around it with a
> quirk.
>
> -Andi

Well.. sort of. Thinking goes probably like this:
"The GART is AGP thingie, it shall be initialized minimally
or not at all in a system that has no AGP."

which naturally backfires, when indeed all IO bus things will
use GART, not only AGP..


I am using Fedora Core development kernels for x86_64, and am able
to get system to work (mostly) with all 4 GB of memory by using
following boot parameters:

iommu=soft swiotlb=65536

with all of 2.6.14 series kernel versions for past week (or two).
I did try some other options as well, like:

iommu=noagp,force,memaper=3

but that didn't succeed in booting my box all the way, and always
in the end crashing with the message in $SUBJECT, above.

Plain 2.4.14 works completely with mem=2600M boot-option, but
it does still tell:

Checking aperture...
CPU 0: aperture @ 0 size 32 MB
No AGP bridge found

and somewhere (AMD documents?) I spotted a mention that having
aperture overlaying memory is "a bad idea", thus when memory
starts at zero, and aperture starts there...

A quirk, very least.



There is separate issue with recent change in mm/memory.c
contained get_user_pages() function (?) that fail my
BTTV card access -- and I might be wrong again, I did
suspect I2C at first, but strace shows fault to happen with
VIDIOC_QBUF ioctl...

/Matti Aarnio

Subject: Re: PCI-DMA: high address but no IOMMU (still there)



--On 27 October 2005 10:47 -0700 Michael Madore <[email protected]>
wrote:

> Hi,
>
> I am seeing the following errors in /var/log/messages when booting
> 2.6.14-rc5 on a dual Opteron nforce4 motherboard with 8GB of RAM:

For the record, I was seeing the same problem with 2.6.15-rc5 (it
wasn't there on 2.6.12), but the thread I'm replying to isolated the
problem patch.

A workaround here (Phoenix BIOS, Dual Opteron 275, 8GB RAM, 1.02.2895,
Tyan Thunder K8WE (S2895)) is to set the following in BIOS:

* Set Operating System to "Linux"
* Hammer Configuration->Memory Hole->IOMMU set to Enable
* Hammer Configuration->MTRR mapping set to "Discrete"

No idea why this fixes it, nor why it wasn't necessary before,
but it at least boots now.

It hangs in a pretty cryptic way on a default config kernel (well, Ubuntu
Dapper defaults) so it would be nice if this was resolved.

--
Alex Bligh