2008-08-13 23:03:52

by Alan D. Brunelle

Subject: Linux 2.6.27-rc3: kernel BUG at mm/vmalloc.c - bisected

00:00.0 Host bridge: Intel Corporation 5400 Chipset Memory Controller Hub (rev 20)
Subsystem: Hewlett-Packard Company Unknown device 1306
Flags: bus master, fast devsel, latency 0, IRQ 255
Capabilities: <access denied>

00:01.0 PCI bridge: Intel Corporation 5400 Chipset PCI Express Port 1 (rev 20) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=80, subordinate=80, sec-latency=0
Capabilities: <access denied>

00:03.0 PCI bridge: Intel Corporation 5400 Chipset PCI Express Port 3 (rev 20) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=a0, subordinate=a0, sec-latency=0
Capabilities: <access denied>

00:05.0 PCI bridge: Intel Corporation 5400 Chipset PCI Express Port 5 (rev 20) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=60, subordinate=60, sec-latency=0
I/O behind bridge: 00001000-00001fff
Memory behind bridge: f0000000-f2ffffff
Prefetchable memory behind bridge: 00000000d0000000-00000000dfffffff
Capabilities: <access denied>

00:09.0 PCI bridge: Intel Corporation 5400 Chipset PCI Express Port 9 (rev 20) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=10, subordinate=40, sec-latency=0
I/O behind bridge: 00002000-00002fff
Memory behind bridge: f3000000-f31fffff
Prefetchable memory behind bridge: 00000000f3600000-00000000f37fffff
Capabilities: <access denied>

00:10.0 Host bridge: Intel Corporation 5400 Chipset FSB Registers (rev 20)
Subsystem: Hewlett-Packard Company Unknown device 1306
Flags: fast devsel

00:10.1 Host bridge: Intel Corporation 5400 Chipset FSB Registers (rev 20)
Subsystem: Hewlett-Packard Company Unknown device 1306
Flags: fast devsel

00:10.2 Host bridge: Intel Corporation 5400 Chipset FSB Registers (rev 20)
Subsystem: Hewlett-Packard Company Unknown device 1306
Flags: fast devsel

00:10.3 Host bridge: Intel Corporation 5400 Chipset FSB Registers (rev 20)
Subsystem: Intel Corporation Unknown device 8086
Flags: fast devsel

00:10.4 Host bridge: Intel Corporation 5400 Chipset FSB Registers (rev 20)
Subsystem: Intel Corporation Unknown device 8086
Flags: fast devsel

00:11.0 Host bridge: Intel Corporation 5400 Chipset CE/SF Registers (rev 20)
Subsystem: Hewlett-Packard Company Unknown device 1306
Flags: fast devsel

00:15.0 Host bridge: Intel Corporation 5400 Chipset FBD Registers (rev 20)
Subsystem: Hewlett-Packard Company Unknown device 1306
Flags: fast devsel

00:15.1 Host bridge: Intel Corporation 5400 Chipset FBD Registers (rev 20)
Subsystem: Hewlett-Packard Company Unknown device 1306
Flags: fast devsel

00:16.0 Host bridge: Intel Corporation 5400 Chipset FBD Registers (rev 20)
Subsystem: Hewlett-Packard Company Unknown device 1306
Flags: fast devsel

00:16.1 Host bridge: Intel Corporation 5400 Chipset FBD Registers (rev 20)
Subsystem: Hewlett-Packard Company Unknown device 1306
Flags: fast devsel

00:1b.0 Audio device: Intel Corporation 631xESB/632xESB High Definition Audio Controller (rev 09)
Subsystem: Hewlett-Packard Company Unknown device 1306
Flags: bus master, fast devsel, latency 0, IRQ 3
Memory at f3500000 (64-bit, non-prefetchable) [size=16K]
Capabilities: <access denied>

00:1c.0 PCI bridge: Intel Corporation 631xESB/632xESB/3100 Chipset PCI Express Root Port 1 (rev 09) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=0e, subordinate=0e, sec-latency=0
Memory behind bridge: f3300000-f33fffff
Capabilities: <access denied>

00:1c.1 PCI bridge: Intel Corporation 631xESB/632xESB/3100 Chipset PCI Express Root Port 2 (rev 09) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=0f, subordinate=0f, sec-latency=0
Memory behind bridge: f3200000-f32fffff
Capabilities: <access denied>

00:1d.0 USB Controller: Intel Corporation 631xESB/632xESB/3100 Chipset UHCI USB Controller #1 (rev 09) (prog-if 00 [UHCI])
Subsystem: Hewlett-Packard Company Unknown device 1306
Flags: bus master, medium devsel, latency 0, IRQ 16
I/O ports at 3000 [size=32]

00:1d.1 USB Controller: Intel Corporation 631xESB/632xESB/3100 Chipset UHCI USB Controller #2 (rev 09) (prog-if 00 [UHCI])
Subsystem: Hewlett-Packard Company Unknown device 1306
Flags: bus master, medium devsel, latency 0, IRQ 19
I/O ports at 3020 [size=32]

00:1d.2 USB Controller: Intel Corporation 631xESB/632xESB/3100 Chipset UHCI USB Controller #3 (rev 09) (prog-if 00 [UHCI])
Subsystem: Hewlett-Packard Company Unknown device 1306
Flags: bus master, medium devsel, latency 0, IRQ 18
I/O ports at 3040 [size=32]

00:1d.3 USB Controller: Intel Corporation 631xESB/632xESB/3100 Chipset UHCI USB Controller #4 (rev 09) (prog-if 00 [UHCI])
Subsystem: Hewlett-Packard Company Unknown device 1306
Flags: bus master, medium devsel, latency 0, IRQ 22
I/O ports at 3060 [size=32]

00:1d.7 USB Controller: Intel Corporation 631xESB/632xESB/3100 Chipset EHCI USB2 Controller (rev 09) (prog-if 20 [EHCI])
Subsystem: Hewlett-Packard Company Unknown device 1306
Flags: bus master, medium devsel, latency 0, IRQ 16
Memory at f3504000 (32-bit, non-prefetchable) [size=1K]
Capabilities: <access denied>

00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev d9) (prog-if 01 [Subtractive decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=01, subordinate=01, sec-latency=32
Memory behind bridge: f3400000-f34fffff
Capabilities: <access denied>

00:1f.0 ISA bridge: Intel Corporation 631xESB/632xESB/3100 Chipset LPC Interface Controller (rev 09)
Subsystem: Hewlett-Packard Company Unknown device 1306
Flags: bus master, medium devsel, latency 0

00:1f.1 IDE interface: Intel Corporation 631xESB/632xESB IDE Controller (rev 09) (prog-if 8a [Master SecP PriP])
Subsystem: Hewlett-Packard Company Unknown device 1306
Flags: bus master, medium devsel, latency 0, IRQ 17
I/O ports at 01f0 [size=8]
I/O ports at 03f4 [size=1]
I/O ports at 0170 [size=8]
I/O ports at 0374 [size=1]
I/O ports at 30a0 [size=16]

00:1f.2 IDE interface: Intel Corporation 631xESB/632xESB/3100 Chipset SATA IDE Controller (rev 09) (prog-if 8f [Master SecP SecO PriP PriO])
Subsystem: Hewlett-Packard Company Unknown device 1306
Flags: bus master, 66MHz, medium devsel, latency 0, IRQ 19
I/O ports at 30d0 [size=8]
I/O ports at 30e8 [size=4]
I/O ports at 30d8 [size=8]
I/O ports at 30ec [size=4]
I/O ports at 30b0 [size=16]
Memory at f3504400 (32-bit, non-prefetchable) [size=1K]
Capabilities: <access denied>

01:05.0 FireWire (IEEE 1394): Texas Instruments TSB43AB22/A IEEE-1394a-2000 Controller (PHY/Link) (prog-if 10 [OHCI])
Subsystem: Hewlett-Packard Company Unknown device 1306
Flags: bus master, medium devsel, latency 32, IRQ 19
Memory at f3404000 (32-bit, non-prefetchable) [size=2K]
Memory at f3400000 (32-bit, non-prefetchable) [size=16K]
Capabilities: <access denied>

0e:00.0 Ethernet controller: Broadcom Corporation NetXtreme BCM5755 Gigabit Ethernet PCI Express (rev 02)
Subsystem: Hewlett-Packard Company Unknown device 1306
Flags: bus master, fast devsel, latency 0, IRQ 2294
Memory at f3300000 (64-bit, non-prefetchable) [size=64K]
Expansion ROM at <ignored> [disabled]
Capabilities: <access denied>

0f:00.0 Ethernet controller: Broadcom Corporation NetXtreme BCM5755 Gigabit Ethernet PCI Express (rev 02)
Subsystem: Hewlett-Packard Company Unknown device 1306
Flags: bus master, fast devsel, latency 0, IRQ 17
Memory at f3200000 (64-bit, non-prefetchable) [size=64K]
Capabilities: <access denied>

10:00.0 PCI bridge: Intel Corporation 6311ESB/6321ESB PCI Express Upstream Port (rev 01) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=10, secondary=1e, subordinate=40, sec-latency=0
Capabilities: <access denied>

10:00.3 PCI bridge: Intel Corporation 6311ESB/6321ESB PCI Express to PCI-X Bridge (rev 01) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=10, secondary=11, subordinate=11, sec-latency=64
I/O behind bridge: 00002000-00002fff
Memory behind bridge: f3000000-f30fffff
Prefetchable memory behind bridge: 00000000f3600000-00000000f37fffff
Capabilities: <access denied>

11:06.0 SCSI storage controller: LSI Logic / Symbios Logic SAS1068 PCI-X Fusion-MPT SAS (rev 02)
Subsystem: Hewlett-Packard Company Unknown device 0a98
Flags: bus master, 66MHz, medium devsel, latency 72, IRQ 2295
I/O ports at 2000 [disabled] [size=256]
Memory at f3010000 (64-bit, non-prefetchable) [size=16K]
Memory at f3000000 (64-bit, non-prefetchable) [size=64K]
[virtual] Expansion ROM at f3600000 [disabled] [size=2M]
Capabilities: <access denied>

1e:00.0 PCI bridge: Intel Corporation 6311ESB/6321ESB PCI Express Downstream Port E1 (rev 01) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=1e, secondary=20, subordinate=20, sec-latency=0
Capabilities: <access denied>

1e:01.0 PCI bridge: Intel Corporation 6311ESB/6321ESB PCI Express Downstream Port E2 (rev 01) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=1e, secondary=40, subordinate=40, sec-latency=0
Capabilities: <access denied>

60:00.0 VGA compatible controller: nVidia Corporation Quadro FX 370 (rev a1) (prog-if 00 [VGA controller])
Subsystem: nVidia Corporation Unknown device 0491
Flags: bus master, fast devsel, latency 0, IRQ 3
Memory at f2000000 (32-bit, non-prefetchable) [size=16M]
Memory at d0000000 (64-bit, prefetchable) [size=256M]
Memory at f0000000 (64-bit, non-prefetchable) [size=32M]
I/O ports at 1000 [size=128]
Capabilities: <access denied>

Attachments:

2008-08-13 23:27:47

by Alan D. Brunelle

Subject: Re: Linux 2.6.27-rc3: kernel BUG at mm/vmalloc.c - bisected

[ 0.000000] Initializing cgroup subsys cpuset
[ 0.000000] Linux version 2.6.27-rc2 (adb@cail) (gcc version 4.2.3 (Ubuntu 4.2.3-2ubuntu7)) #14 SMP Wed Aug 13 18:32:21 EDT 2008
[ 0.000000] Command line: root=UUID=d3e6e98e-d461-447d-852a-692103795804 ro console=tty0 console=ttyS0,115200n8
[ 0.000000] KERNEL supported cpus:
[ 0.000000] Intel GenuineIntel
[ 0.000000] AMD AuthenticAMD
[ 0.000000] Centaur CentaurHauls
[ 0.000000] BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: 0000000000000000 - 000000000009ec00 (usable)
[ 0.000000] BIOS-e820: 000000000009ec00 - 00000000000a0000 (reserved)
[ 0.000000] BIOS-e820: 00000000000e8000 - 0000000000100000 (reserved)
[ 0.000000] BIOS-e820: 0000000000100000 - 00000000cffc2840 (usable)
[ 0.000000] BIOS-e820: 00000000cffc2840 - 00000000d0000000 (reserved)
[ 0.000000] BIOS-e820: 00000000e0000000 - 00000000f0000000 (reserved)
[ 0.000000] BIOS-e820: 00000000fec00000 - 0000000100000000 (reserved)
[ 0.000000] BIOS-e820: 0000000100000000 - 0000000230000000 (usable)
[ 0.000000] last_pfn = 0x230000 max_arch_pfn = 0x3ffffffff
[ 0.000000] last_pfn = 0xcffc2 max_arch_pfn = 0x3ffffffff
[ 0.000000] init_memory_mapping
[ 0.000000] last_map_addr: cffc2000 end: cffc2000
[ 0.000000] init_memory_mapping
[ 0.000000] last_map_addr: 230000000 end: 230000000
[ 0.000000] RAMDISK: 3505d000 - 37fef80c
[ 0.000000] DMI 2.5 present.
[ 0.000000] ACPI: RSDP 000E9810, 0024 (r2 HPQOEM)
[ 0.000000] ACPI: XSDT CFFC52EC, 005C (r1 HPQOEM SLIC-WKS 20080505 0)
[ 0.000000] ACPI: FACP CFFC5494, 00F4 (r3 HPQOEM SEABURG 1 0)
[ 0.000000] ACPI Error (tbfadt-0453): 32/64X address mismatch in "Gpe0Block": [0000F828] [000000000001F030], using 64X [20080609]
[ 0.000000] ACPI: DSDT CFFC5A7A, 26A4 (r1 HPQOEM DSDT 1 MSFT 100000E)
[ 0.000000] ACPI: FACS CFFC5200, 0040
[ 0.000000] ACPI: SSDT CFFC811E, 701D (r1 HPQOEM PROJECT 1 MSFT 100000E)
[ 0.000000] ACPI: APIC CFFC5588, 00D4 (r1 HPQOEM SEABURG 1 0)
[ 0.000000] ACPI: ASF! CFFC565C, 006A (r32 HPQOEM SEABURG 1 0)
[ 0.000000] ACPI: MCFG CFFC585E, 003C (r1 HPQOEM SEABURG 1 0)
[ 0.000000] ACPI: HPET CFFC5A10, 0038 (r1 HPQOEM SEABURG 1 0)
[ 0.000000] ACPI: TCPA CFFC5A48, 0032 (r1 HPQOEM SEABURG 1 0)
[ 0.000000] ACPI: DMI detected: Hewlett-Packard
[ 0.000000] No NUMA configuration found
[ 0.000000] Faking a node at 0000000000000000-0000000230000000
[ 0.000000] Bootmem setup node 0 0000000000000000-0000000230000000
[ 0.000000] NODE_DATA [0000000000011000 - 0000000000034fff]
[ 0.000000] bootmap [0000000000035000 - 000000000007afff] pages 46
[ 0.000000] (7 early reservations) ==> bootmem [0000000000 - 0230000000]
[ 0.000000] #0 [0000000000 - 0000001000] BIOS data page ==> [0000000000 - 0000001000]
[ 0.000000] #1 [0000006000 - 0000008000] TRAMPOLINE ==> [0000006000 - 0000008000]
[ 0.000000] #2 [0000200000 - 0001178b9c] TEXT DATA BSS ==> [0000200000 - 0001178b9c]
[ 0.000000] #3 [003505d000 - 0037fef80c] RAMDISK ==> [003505d000 - 0037fef80c]
[ 0.000000] #4 [000009ec00 - 0000100000] BIOS reserved ==> [000009ec00 - 0000100000]
[ 0.000000] #5 [0000008000 - 000000c000] PGTABLE ==> [0000008000 - 000000c000]
[ 0.000000] #6 [000000c000 - 0000011000] PGTABLE ==> [000000c000 - 0000011000]
[ 0.000000] found SMP MP-table at [ffff8800000fe700] 000fe700
[ 0.000000] Zone PFN ranges:
[ 0.000000] DMA 0x00000000 -> 0x00001000
[ 0.000000] DMA32 0x00001000 -> 0x00100000
[ 0.000000] Normal 0x00100000 -> 0x00230000
[ 0.000000] Movable zone start PFN for each node
[ 0.000000] early_node_map[3] active PFN ranges
[ 0.000000] 0: 0x00000000 -> 0x0000009e
[ 0.000000] 0: 0x00000100 -> 0x000cffc2
[ 0.000000] 0: 0x00100000 -> 0x00230000
[ 0.000000] ACPI: PM-Timer IO Port: 0xf808
[ 0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x06] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x01] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x07] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x08] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x09] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0a] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x0b] disabled)
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x08] high edge lint[0x1])
[ 0.000000] ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0])
[ 0.000000] IOAPIC[0]: apic_id 1, version 0, address 0xfec00000, GSI 0-23
[ 0.000000] ACPI: IOAPIC (id[0x02] address[0xfec89000] gsi_base[24])
[ 0.000000] IOAPIC[1]: apic_id 2, version 0, address 0xfec89000, GSI 24-47
[ 0.000000] ACPI: IOAPIC (id[0x03] address[0xfec88000] gsi_base[48])
[ 0.000000] IOAPIC[2]: apic_id 3, version 0, address 0xfec88000, GSI 48-71
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[ 0.000000] Setting APIC routing to flat
[ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[ 0.000000] Using ACPI (MADT) for SMP configuration information
[ 0.000000] SMP: Allowing 8 CPUs, 4 hotplug CPUs
[ 0.000000] PM: Registered nosave memory: 000000000009e000 - 000000000009f000
[ 0.000000] PM: Registered nosave memory: 000000000009f000 - 00000000000a0000
[ 0.000000] PM: Registered nosave memory: 00000000000a0000 - 00000000000e8000
[ 0.000000] PM: Registered nosave memory: 00000000000e8000 - 0000000000100000
[ 0.000000] PM: Registered nosave memory: 00000000cffc2000 - 00000000cffc3000
[ 0.000000] PM: Registered nosave memory: 00000000cffc3000 - 00000000d0000000
[ 0.000000] PM: Registered nosave memory: 00000000d0000000 - 00000000e0000000
[ 0.000000] PM: Registered nosave memory: 00000000e0000000 - 00000000f0000000
[ 0.000000] PM: Registered nosave memory: 00000000f0000000 - 00000000fec00000
[ 0.000000] PM: Registered nosave memory: 00000000fec00000 - 0000000100000000
[ 0.000000] Allocating PCI resources starting at d1000000 (gap: d0000000:10000000)
[ 0.000000] PERCPU: Allocating 71080 bytes of per cpu data
[ 0.000000] Built 1 zonelists in Zone order, mobility grouping on. Total pages: 2065521
[ 0.000000] Policy zone: Normal
[ 0.000000] Kernel command line: root=UUID=d3e6e98e-d461-447d-852a-692103795804 ro console=tty0 console=ttyS0,115200n8
[ 0.000000] Initializing CPU#0
[ 0.000000] PID hash table entries: 4096 (order: 12, 32768 bytes)
[ 0.000000] Extended CMOS year: 2000
[ 0.000000] TSC calibrated against PM_TIMER
[ 0.000000] Detected 3400.102 MHz processor.
[ 0.010000] Console: colour VGA+ 80x25
[ 0.010000] console [tty0] enabled
[ 0.010000] console [ttyS0] enabled
[ 0.010000] Checking aperture...
[ 0.010000] No AGP bridge found
[ 0.010000] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[ 0.010000] Placing software IO TLB between 0x20000000 - 0x24000000
[ 0.010000] Memory: 8139676k/9175040k available (2652k kernel code, 248292k reserved, 1559k data, 504k init)
[ 0.010000] SLUB: Genslabs=13, HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1
[ 0.010000] Calibrating delay loop (skipped), value calculated using timer frequency.. 6800.20 BogoMIPS (lpj=34001020)
[ 0.020000] Security Framework initialized
[ 0.020000] SELinux: Disabled at boot.
[ 0.020000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes)
[ 0.030000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes)
[ 0.040000] Mount-cache hash table entries: 256
[ 0.046175] Initializing cgroup subsys ns
[ 0.050000] Initializing cgroup subsys cpuacct
[ 0.058645] CPU: L1 I cache: 32K, L1 D cache: 32K
[ 0.060000] CPU: L2 cache: 6144K
[ 0.060000] CPU 0/0 -> Node 0
[ 0.070000] CPU: Physical Processor ID: 0
[ 0.070000] CPU: Processor Core ID: 0
[ 0.077722] CPU0: Thermal monitoring enabled (TM2)
[ 0.080000] using mwait in idle threads.
[ 0.080000] ACPI: Core revision 20080609
[ 0.100000] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[ 0.209952] CPU0: Intel(R) Xeon(R) CPU X5272 @ 3.40GHz stepping 06
[ 0.220000] Using local APIC timer interrupts.
[ 0.230000] Detected 25.000 MHz APIC timer.
[ 0.237348] Booting processor 1/6 ip 6000
[ 0.250000] Initializing CPU#1
[ 0.250000] Calibrating delay using timer specific routine.. 6800.31 BogoMIPS (lpj=34001550)
[ 0.250000] CPU: L1 I cache: 32K, L1 D cache: 32K
[ 0.250000] CPU: L2 cache: 6144K
[ 0.250000] CPU 1/6 -> Node 0
[ 0.250000] CPU: Physical Processor ID: 3
[ 0.250000] CPU: Processor Core ID: 0
[ 0.250000] CPU1: Thermal monitoring enabled (TM2)
[ 0.398166] CPU1: Intel(R) Xeon(R) CPU X5272 @ 3.40GHz stepping 06
[ 0.415380] checking TSC synchronization [CPU#0 -> CPU#1]: passed.
[ 0.430000] Booting processor 2/1 ip 6000
[ 0.450000] Initializing CPU#2
[ 0.450000] Calibrating delay using timer specific routine.. 6800.31 BogoMIPS (lpj=34001584)
[ 0.450000] CPU: L1 I cache: 32K, L1 D cache: 32K
[ 0.450000] CPU: L2 cache: 6144K
[ 0.450000] CPU 2/1 -> Node 0
[ 0.450000] CPU: Physical Processor ID: 0
[ 0.450000] CPU: Processor Core ID: 1
[ 0.450000] CPU2: Thermal monitoring enabled (TM2)
[ 0.591123] CPU2: Intel(R) Xeon(R) CPU X5272 @ 3.40GHz stepping 06
[ 0.615380] checking TSC synchronization [CPU#0 -> CPU#2]: passed.
[ 0.630000] Booting processor 3/7 ip 6000
[ 0.650000] Initializing CPU#3
[ 0.650000] Calibrating delay using timer specific routine.. 6800.32 BogoMIPS (lpj=34001644)
[ 0.650000] CPU: L1 I cache: 32K, L1 D cache: 32K
[ 0.650000] CPU: L2 cache: 6144K
[ 0.650000] CPU 3/7 -> Node 0
[ 0.650000] CPU: Physical Processor ID: 3
[ 0.650000] CPU: Processor Core ID: 1
[ 0.650000] CPU3: Thermal monitoring enabled (TM2)
[ 0.791619] CPU3: Intel(R) Xeon(R) CPU X5272 @ 3.40GHz stepping 06
[ 0.815380] checking TSC synchronization [CPU#0 -> CPU#3]: passed.
[ 0.830000] Brought up 4 CPUs
[ 0.833199] Total of 4 processors activated (27201.15 BogoMIPS).
[ 0.840000] net_namespace: 1552 bytes
[ 0.850000] NET: Registered protocol family 16
[ 0.850000] ACPI: bus type pci registered
[ 0.860000] PCI: MCFG configuration 0: base e0000000 segment 0 buses 0 - 255
[ 0.860000] PCI: MCFG area at e0000000 reserved in E820
[ 0.870000] PCI: Using MMCONFIG at e0000000 - efffffff
[ 0.877408] PCI: Using configuration type 1 for base access
[ 0.890000] ACPI: Interpreter enabled
[ 0.890000] ACPI: (supports S0 S3 S4 S5)
[ 0.900000] ACPI: Using IOAPIC for interrupt routing
[ 0.910000] ACPI: PCI Root Bridge [PCI0] (0000:00)
[ 0.910000] pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
[ 0.920000] pci 0000:00:00.0: PME# disabled
[ 0.920000] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[ 0.930000] pci 0000:00:01.0: PME# disabled
[ 0.930000] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
[ 0.940000] pci 0000:00:03.0: PME# disabled
[ 0.940000] pci 0000:00:05.0: PME# supported from D0 D3hot D3cold
[ 0.950000] pci 0000:00:05.0: PME# disabled
[ 0.950000] pci 0000:00:09.0: PME# supported from D0 D3hot D3cold
[ 0.960000] pci 0000:00:09.0: PME# disabled
[ 0.960000] pci 0000:00:1b.0: PME# supported from D0 D3hot D3cold
[ 0.970000] pci 0000:00:1b.0: PME# disabled
[ 0.970000] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[ 0.980000] pci 0000:00:1c.0: PME# disabled
[ 0.980000] pci 0000:00:1c.1: PME# supported from D0 D3hot D3cold
[ 0.990000] pci 0000:00:1c.1: PME# disabled
[ 0.990000] pci 0000:00:1d.7: PME# supported from D0 D3hot D3cold
[ 1.000000] pci 0000:00:1d.7: PME# disabled
[ 1.000000] pci 0000:00:1f.2: PME# supported from D3hot
[ 1.009600] pci 0000:00:1f.2: PME# disabled
[ 1.014811] pci 0000:10:00.0: PME# supported from D0 D3hot D3cold
[ 1.020000] pci 0000:10:00.0: PME# disabled
[ 1.030000] pci 0000:10:00.3: PME# supported from D0 D3hot D3cold
[ 1.030000] pci 0000:10:00.3: PME# disabled
[ 1.040000] pci 0000:1e:00.0: PME# supported from D0 D3hot D3cold
[ 1.040000] pci 0000:1e:00.0: PME# disabled
[ 1.050000] pci 0000:1e:01.0: PME# supported from D0 D3hot D3cold
[ 1.057074] pci 0000:1e:01.0: PME# disabled
[ 1.070000] pci 0000:0e:00.0: PME# supported from D3hot D3cold
[ 1.070000] pci 0000:0e:00.0: PME# disabled
[ 1.080000] pci 0000:0f:00.0: PME# supported from D3hot D3cold
[ 1.080000] pci 0000:0f:00.0: PME# disabled
[ 1.090000] pci 0000:01:05.0: PME# supported from D0 D1 D2 D3hot
[ 1.090000] pci 0000:01:05.0: PME# disabled
[ 1.100000] pci 0000:00:1e.0: transparent bridge
[ 1.120000] ACPI: PCI Interrupt Link [LNKA] (IRQs *3 4 5 6 7 10 11 14 15)
[ 1.130000] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 *5 6 7 10 11 14 15)
[ 1.140000] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 *7 10 11 14 15)
[ 1.150000] ACPI: PCI Interrupt Link [LNKD] (IRQs *3 4 5 6 7 10 11 14 15)
[ 1.150000] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 10 11 14 15) *0, disabled.
[ 1.160000] ACPI: PCI Interrupt Link [LNKF] (IRQs *3 4 5 6 7 10 11 14 15)
[ 1.170000] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 *5 6 7 10 11 14 15)
[ 1.180000] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 10 11 14 15) *0, disabled.
[ 1.180000] Linux Plug and Play Support v0.97 (c) Adam Belay
[ 1.190000] pnp: PnP ACPI init
[ 1.190000] ACPI: bus type pnp registered
[ 1.200000] pnp 00:10: mem resource (0x0-0x9ffff) overlaps 0000:11:06.0 BAR 6 (0x0-0x1fffff), disabling
[ 1.210000] pnp 00:10: mem resource (0xc0000-0xe7fff) overlaps 0000:11:06.0 BAR 6 (0x0-0x1fffff), disabling
[ 1.219758] pnp 00:10: mem resource (0xe8000-0xeffff) overlaps 0000:11:06.0 BAR 6 (0x0-0x1fffff), disabling
[ 1.229515] pnp 00:10: mem resource (0xf0000-0xfffff) overlaps 0000:11:06.0 BAR 6 (0x0-0x1fffff), disabling
[ 1.239273] pnp 00:10: mem resource (0x100000-0xcfffffff) overlaps 0000:11:06.0 BAR 6 (0x0-0x1fffff), disabling
[ 1.250000] pnp: PnP ACPI: found 18 devices
[ 1.250000] ACPI: ACPI bus type pnp unregistered
[ 1.260000] PCI: Using ACPI for IRQ routing
[ 1.307254] NET: Registered protocol family 8
[ 1.310000] NET: Registered protocol family 20
[ 1.310000] NetLabel: Initializing
[ 1.320000] NetLabel: domain hash size = 128
[ 1.320000] NetLabel: protocols = UNLABELED CIPSOv4
[ 1.329370] NetLabel: unlabeled traffic allowed by default
[ 1.330000] PCI-GART: No AMD northbridge found.
[ 1.340000] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[ 1.340000] hpet0: 3 64-bit timers, 14318180 Hz
[ 1.388527] system 00:0d: ioport range 0x4d0-0x4d1 has been reserved
[ 1.390001] system 00:0e: ioport range 0x400-0x41f has been reserved
[ 1.400003] system 00:0e: ioport range 0x420-0x43f has been reserved
[ 1.402768] system 00:0e: ioport range 0x440-0x45f has been reserved
[ 1.412769] system 00:0e: ioport range 0x460-0x47f has been reserved
[ 1.419141] system 00:0e: ioport range 0x480-0x48f has been reserved
[ 1.421891] system 00:0e: ioport range 0x490-0x49f has been reserved
[ 1.431892] system 00:0e: ioport range 0xf800-0xf81f has been reserved
[ 1.438438] system 00:0e: ioport range 0xf820-0xf83f has been reserved
[ 1.441187] system 00:0e: ioport range 0xf840-0xf85f has been reserved
[ 1.451188] system 00:0e: ioport range 0xf860-0xf87f has been reserved
[ 1.457733] system 00:0e: ioport range 0xfa00-0xfa3f has been reserved
[ 1.460827] system 00:0e: ioport range 0xfc00-0xfc7f has been reserved
[ 1.470829] system 00:0e: ioport range 0xfc80-0xfcff has been reserved
[ 1.477374] system 00:0e: ioport range 0xfe00-0xfe7f has been reserved
[ 1.480470] system 00:0e: ioport range 0xfe80-0xfeff has been reserved
[ 1.490473] system 00:0f: iomem range 0xfed1c000-0xfed1ffff could not be reserved
[ 1.497981] system 00:0f: iomem range 0xffe00000-0xffffffff could not be reserved
[ 1.501076] system 00:0f: iomem range 0xfee00000-0xfeefffff could not be reserved
[ 1.511077] system 00:0f: iomem range 0xfe700000-0xfe7003ff has been reserved
[ 1.518228] system 00:0f: iomem range 0xfe600000-0xfe6fffff has been reserved
[ 1.525379] system 00:0f: iomem range 0xfe000000-0xfe01ffff has been reserved
[ 1.530400] system 00:10: iomem range 0xfeda0000-0xfedbffff could not be reserved
[ 1.540403] system 00:11: iomem range 0xe0000000-0xefffffff could not be reserved
[ 1.553225] pci 0000:00:01.0: PCI bridge, secondary bus 0000:80
[ 1.553225] pci 0000:00:01.0: IO window: disabled
[ 1.562576] pci 0000:00:01.0: MEM window: disabled
[ 1.564311] pci 0000:00:01.0: PREFETCH window: disabled
[ 1.574315] pci 0000:00:03.0: PCI bridge, secondary bus 0000:a0
[ 1.580256] pci 0000:00:03.0: IO window: disabled
[ 1.580662] pci 0000:00:03.0: MEM window: disabled
[ 1.580664] pci 0000:00:03.0: PREFETCH window: disabled
[ 1.590549] pci 0000:60:00.0: BAR 6: can't allocate mem resource [0xe0000000-0xdfffffff]
[ 1.600550] pci 0000:00:05.0: PCI bridge, secondary bus 0000:60
[ 1.604088] pci 0000:00:05.0: IO window: 0x1000-0x1fff
[ 1.610027] pci 0000:00:05.0: MEM window: 0xf0000000-0xf2ffffff
[ 1.620029] pci 0000:00:05.0: PREFETCH window: 0x000000d0000000-0x000000dfffffff
[ 1.621475] pci 0000:1e:00.0: PCI bridge, secondary bus 0000:20
[ 1.631476] pci 0000:1e:00.0: IO window: disabled
[ 1.635013] pci 0000:1e:00.0: MEM window: disabled
[ 1.644944] pci 0000:1e:00.0: PREFETCH window: disabled
[ 1.644996] pci 0000:1e:01.0: PCI bridge, secondary bus 0000:40
[ 1.650979] pci 0000:1e:01.0: IO window: disabled
[ 1.660417] pci 0000:1e:01.0: MEM window: disabled
[ 1.661256] pci 0000:1e:01.0: PREFETCH window: disabled
[ 1.671305] pci 0000:10:00.0: PCI bridge, secondary bus 0000:1e
[ 1.671711] pci 0000:10:00.0: IO window: disabled
[ 1.681759] pci 0000:10:00.0: MEM window: disabled
[ 1.682597] pci 0000:10:00.0: PREFETCH window: disabled
[ 1.692645] pci 0000:10:00.3: PCI bridge, secondary bus 0000:11
[ 1.693051] pci 0000:10:00.3: IO window: 0x2000-0x2fff
[ 1.703098] pci 0000:10:00.3: MEM window: 0xf3000000-0xf30fffff
[ 1.704374] pci 0000:10:00.3: PREFETCH window: 0x000000f3600000-0x000000f37fffff
[ 1.712014] pci 0000:00:09.0: PCI bridge, secondary bus 0000:10
[ 1.720533] pci 0000:00:09.0: IO window: 0x2000-0x2fff
[ 1.724115] pci 0000:00:09.0: MEM window: 0xf3000000-0xf31fffff
[ 1.734117] pci 0000:00:09.0: PREFETCH window: 0x000000f3600000-0x000000f37fffff
[ 1.741711] pci 0000:00:1c.0: PCI bridge, secondary bus 0000:0e
[ 1.743158] pci 0000:00:1c.0: IO window: disabled
[ 1.753161] pci 0000:00:1c.0: MEM window: 0xf3300000-0xf33fffff
[ 1.754002] pci 0000:00:1c.0: PREFETCH window: disabled
[ 1.760115] pci 0000:00:1c.1: PCI bridge, secondary bus 0000:0f
[ 1.770117] pci 0000:00:1c.1: IO window: disabled
[ 1.771478] pci 0000:00:1c.1: MEM window: 0xf3200000-0xf32fffff
[ 1.781480] pci 0000:00:1c.1: PREFETCH window: disabled
[ 1.782493] pci 0000:00:1e.0: PCI bridge, secondary bus 0000:01
[ 1.792494] pci 0000:00:1e.0: IO window: disabled
[ 1.793856] pci 0000:00:1e.0: MEM window: 0xf3400000-0xf34fffff
[ 1.803858] pci 0000:00:1e.0: PREFETCH window: disabled
[ 1.804882] pci 0000:00:01.0: PCI INT A -> GSI 24 (level, low) -> IRQ 24
[ 1.811610] pci 0000:00:03.0: PCI INT A -> GSI 26 (level, low) -> IRQ 26
[ 1.820303] pci 0000:00:05.0: PCI INT A -> GSI 28 (level, low) -> IRQ 28
[ 1.823759] pci 0000:00:09.0: PCI INT A -> GSI 32 (level, low) -> IRQ 32
[ 1.830481] pci 0000:10:00.0: PCI INT A -> GSI 32 (level, low) -> IRQ 32
[ 1.840621] pci 0000:1e:00.0: PCI INT A -> GSI 32 (level, low) -> IRQ 32
[ 1.847578] pci 0000:1e:01.0: PCI INT A -> GSI 46 (level, low) -> IRQ 46
[ 1.850834] pci 0000:00:1c.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
[ 1.860845] pci 0000:00:1c.1: PCI INT B -> GSI 17 (level, low) -> IRQ 17
[ 1.867593] NET: Registered protocol family 2
[ 1.961492] IP route cache hash table entries: 262144 (order: 9, 2097152 bytes)
[ 1.970001] TCP established hash table entries: 524288 (order: 11, 8388608 bytes)
[ 1.982824] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[ 1.992747] TCP: Hash tables configured (established 524288 bind 65536)
[ 1.999753] TCP reno registered
[ 2.020145] NET: Registered protocol family 1
[ 2.030001] checking if image is initramfs... it is
[ 5.870001] Freeing initrd memory: 48714k freed
[ 5.893055] audit: initializing netlink socket (disabled)
[ 5.901898] type=2000 audit(1218667667.896:1): initialized
[ 5.918420] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[ 5.929327] VFS: Disk quotas dquot_6.5.1
[ 5.929327] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 5.938141] msgmni has been set to 15992
[ 5.938141] io scheduler noop registered
[ 5.946136] io scheduler anticipatory registered
[ 5.946136] io scheduler deadline registered (default)
[ 5.957085] io scheduler cfq registered
[ 5.957085] pcieport-driver 0000:00:01.0: found MSI capability
[ 5.967072] pcieport-driver 0000:00:03.0: found MSI capability
[ 5.973153] pcieport-driver 0000:00:05.0: found MSI capability
[ 5.974528] pcieport-driver 0000:00:09.0: found MSI capability
[ 5.982203] pcieport-driver 0000:00:1c.0: found MSI capability
[ 5.982203] pcieport-driver 0000:00:1c.1: found MSI capability
[ 5.994261] pcieport-driver 0000:1e:00.0: found MSI capability
[ 6.003570] pcieport-driver 0000:1e:01.0: found MSI capability
[ 6.012361] ACPI Error (dsfield-0139): [CAPD] Namespace lookup failure, AE_ALREADY_EXISTS
[ 6.022364] ACPI Error (psparse-0530): Method parse/execution failed [\_SB_.PCI0._OSC] (Node ffff88022f04afc0), AE_ALREADY_EXISTS
[ 6.032711] ACPI: Marking method _OSC as Serialized because of AE_ALREADY_EXISTS error
[ 6.042379] ACPI Error (dsfield-0139): [CAPD] Namespace lookup failure, AE_ALREADY_EXISTS
[ 6.051728] ACPI Error (psparse-0530): Method parse/execution failed [\_SB_.PCI0._OSC] (Node ffff88022f04afc0), AE_ALREADY_EXISTS
[ 6.059959] ACPI Error (dsfield-0139): [CAPD] Namespace lookup failure, AE_ALREADY_EXISTS
[ 6.068340] ACPI Error (psparse-0530): Method parse/execution failed [\_SB_.PCI0._OSC] (Node ffff88022f04afc0), AE_ALREADY_EXISTS
[ 6.080213] ACPI Error (dsfield-0139): [CAPD] Namespace lookup failure, AE_ALREADY_EXISTS
[ 6.088580] ACPI Error (psparse-0530): Method parse/execution failed [\_SB_.PCI0._OSC] (Node ffff88022f04afc0), AE_ALREADY_EXISTS
[ 6.101999] ACPI Error (dsfield-0139): [CAPD] Namespace lookup failure, AE_ALREADY_EXISTS
[ 6.112002] ACPI Error (psparse-0530): Method parse/execution failed [\_SB_.PCI0._OSC] (Node ffff88022f04afc0), AE_ALREADY_EXISTS
[ 6.122176] ACPI Error (dsfield-0139): [CAPD] Namespace lookup failure, AE_ALREADY_EXISTS
[ 6.132178] ACPI Error (psparse-0530): Method parse/execution failed [\_SB_.PCI0._OSC] (Node ffff88022f04afc0), AE_ALREADY_EXISTS
[ 6.142337] ACPI Error (dsfield-0139): [CAPD] Namespace lookup failure, AE_ALREADY_EXISTS
[ 6.152341] ACPI Error (psparse-0530): Method parse/execution failed [\_SB_.PCI0._OSC] (Node ffff88022f04afc0), AE_ALREADY_EXISTS
[ 6.162515] ACPI Error (dsfield-0139): [CAPD] Namespace lookup failure, AE_ALREADY_EXISTS
[ 6.172517] ACPI Error (psparse-0530): Method parse/execution failed [\_SB_.PCI0._OSC] (Node ffff88022f04afc0), AE_ALREADY_EXISTS
[ 6.211876] Linux agpgart interface v0.103
[ 6.211876] Serial: 8250/16550 driver4 ports, IRQ sharing enabled
[ 6.222428] serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[ 6.231253] 00:09: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[ 6.236609] brd: module loaded
[ 6.241601] input: Macintosh mouse button emulation as /class/input/input0
[ 6.242769] PNP: PS/2 Controller [PNP0303:KBD,PNP0f0e:PS2M] at 0x60,0x64 irq 1,12
[ 6.250003] serio: i8042 KBD port at 0x60,0x64 irq 1
[ 6.253618] serio: i8042 AUX port at 0x60,0x64 irq 12
[ 6.311936] mice: PS/2 mouse device common for all mice
[ 6.311936] cpuidle: using governor ladder
[ 6.311936] cpuidle: using governor menu
[ 6.323498] registered taskstats version 1
[ 6.323498] drivers/rtc/hctosys.c: unable to open rtc device (rtc0)
[ 6.333501] BIOS EDD facility v0.16 2004-Jun-25, 5 devices found
[ 6.341941] Freeing unused kernel memory: 504k freed
Loading, please wait...
Begin: Loading essential drivers... ...
[ 6.452574] fuse init (API version 7.9)
[ 6.461876] ------------[ cut here ]------------
[ 6.461876] kernel BUG at mm/vmalloc.c:217!
[ 6.461876] invalid opcode: 0000 [1] SMP 
[ 6.461876] CPU 1 
[ 6.461876] Modules linked in: processor(+) fan thermal_sys fuse
[ 6.461876] Pid: 1256, comm: modprobe Not tainted 2.6.27-rc2 #14
[ 6.461876] RIP: 0010:[<ffffffff802a227e>] [<ffffffff802a227e>] __get_vm_area_node+0x1fe/0x210
[ 6.461876] RSP: 0018:ffff88021b157538 EFLAGS: 00010206
[ 6.461876] RAX: ffffffff8022151a RBX: ffffc20000000000 RCX: ffffe1ffffffffff
[ 6.461876] RDX: 00000000ffffffff RSI: 00000000000000d0 RDI: 0000000000002000
[ 6.461876] RBP: ffff88021b157578 R08: 00000000ffffffff R09: 00000000000000d0
[ 6.461876] R10: 0000000000001000 R11: 0000000000000000 R12: 0000000000000010
[ 6.461876] R13: 00000000cffc3000 R14: 00000000cffc3b51 R15: 00000000cffc480a
[ 6.461876] FS: 00007f13ac7606e0(0000) GS:ffff88022fc02980(0000) knlGS:0000000000000000
[ 6.461876] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 6.461876] CR2: 000000000044f360 CR3: 000000021ad66000 CR4: 00000000000006e0
[ 6.461876] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 6.461876] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 6.461876] Process modprobe (pid: 1256, threadinfo ffff88021b156000, task ffff88021ac3c890)
[ 6.461876] Stack: ffffe1ffffffffff 0000000000000001 ffff88021b157558 0000000000002000
[ 6.461876] 0000000000000010 00000000cffc3000 00000000cffc3b51 00000000cffc480a
[ 6.461876] ffff88021b157598 ffffffff802a2301 ffffffff8047f559 00000000cffc480a
[ 6.461876] Call Trace:
[ 6.461876] [<ffffffff802a2301>] get_vm_area_caller+0x31/0x40
[ 6.461876] [<ffffffff8047f559>] ? acpi_os_map_memory+0x12/0x29
[ 6.461876] [<ffffffff80225078>] __ioremap_caller+0x188/0x340
[ 6.461876] [<ffffffff8047f559>] ? acpi_os_map_memory+0x12/0x29
[ 6.461876] [<ffffffff8038f1ce>] ? acpi_ex_system_memory_space_handler+0x0/0x1be
[ 6.461876] [<ffffffff80225342>] ioremap_nocache+0x12/0x20
[ 6.461876] [<ffffffff8047f559>] acpi_os_map_memory+0x12/0x29
[ 6.461876] [<ffffffff8038f2a0>] acpi_ex_system_memory_space_handler+0xd2/0x1be
[ 6.461876] [<ffffffff8038f1ce>] ? acpi_ex_system_memory_space_handler+0x0/0x1be
[ 6.461876] [<ffffffff8038805c>] acpi_ev_address_space_dispatch+0x172/0x1c1
[ 6.461876] [<ffffffff8038c5e8>] acpi_ex_access_region+0x209/0x226
[ 6.461876] [<ffffffff8038c6f4>] acpi_ex_field_datum_io+0xef/0x183
[ 6.461876] [<ffffffff8038c814>] acpi_ex_extract_from_field+0x8c/0x1a1
[ 6.461876] [<ffffffff8039ac13>] ? acpi_ut_create_internal_object_dbg+0x26/0x90
[ 6.461876] [<ffffffff8038b303>] acpi_ex_read_data_from_field+0x120/0x159
[ 6.461876] [<ffffffff8039018c>] acpi_ex_resolve_node_to_value+0x190/0x240
[ 6.461876] [<ffffffff8038bda2>] acpi_ex_resolve_to_value+0x256/0x268
[ 6.461876] [<ffffffff80386586>] acpi_ds_evaluate_name_path+0x7a/0xff
[ 6.461876] [<ffffffff8038522e>] acpi_ds_exec_end_op+0x94/0x3ca
[ 6.461876] [<ffffffff80395395>] acpi_ps_parse_loop+0x6a3/0x876
[ 6.461876] [<ffffffff803945de>] acpi_ps_parse_aml+0x7e/0x2bb
[ 6.461876] [<ffffffff80395b87>] acpi_ps_execute_method+0x129/0x1d6
[ 6.461876] [<ffffffff803927a8>] acpi_ns_evaluate+0x150/0x1b4
[ 6.461876] [<ffffffff803922b8>] acpi_evaluate_object+0x140/0x1fc
[ 6.461876] [<ffffffff8021bf37>] ? arch_acpi_processor_init_pdc+0x97/0x160
[ 6.461876] [<ffffffffa01971bd>] ? acpi_processor_notify+0x0/0x108 [processor]
[ 6.461876] [<ffffffffa019b23e>] acpi_processor_start+0x612/0x774 [processor]
[ 6.461876] [<ffffffff8031234b>] ? __sysfs_add_one+0x6b/0xa0
[ 6.461876] [<ffffffff803133de>] ? sysfs_do_create_link+0xbe/0x140
[ 6.461876] [<ffffffff8039d01a>] acpi_start_single_object+0x2d/0x52
[ 6.461876] [<ffffffff8039e603>] acpi_device_probe+0x7e/0x92
[ 6.461876] [<ffffffff803d195b>] driver_probe_device+0x9b/0x1a0
[ 6.461876] [<ffffffff803d1ae6>] __driver_attach+0x86/0x90
[ 6.461876] [<ffffffff803d1a60>] ? __driver_attach+0x0/0x90
[ 6.461876] [<ffffffff803d0f84>] bus_for_each_dev+0x54/0x80
[ 6.461876] [<ffffffff80359f0a>] ? kobject_get+0x1a/0x30
[ 6.461876] [<ffffffff803d179c>] driver_attach+0x1c/0x20
[ 6.461876] [<ffffffff803d15b9>] bus_add_driver+0x1e9/0x260
[ 6.461876] [<ffffffffa0222000>] ? acpi_processor_init+0x0/0x107 [processor]
[ 6.461876] [<ffffffff803d1d7f>] driver_register+0x5f/0x140
[ 6.461876] [<ffffffffa0222000>] ? acpi_processor_init+0x0/0x107 [processor]
[ 6.461876] [<ffffffff8039e913>] acpi_bus_register_driver+0x3e/0x40
[ 6.461876] [<ffffffffa0222094>] acpi_processor_init+0x94/0x107 [processor]
[ 6.461876] [<ffffffff802a2a8d>] ? __vunmap+0x8d/0xf0
[ 6.461876] [<ffffffff80209040>] _stext+0x40/0x180
[ 6.461876] [<ffffffff80262902>] sys_init_module+0x142/0x1dc0
[ 6.461876] [<ffffffff8047e430>] ? cpu_down+0x0/0x70
[ 6.461876] [<ffffffff8020c34b>] system_call_fastpath+0x16/0x1b
[ 6.461876] 
[ 6.461876] 
[ 6.461876] Code: f0 81 05 a2 3f 34 00 00 00 00 01 e9 78 ff ff ff 48 c7 c7 08 c7 58 80 31 c0 e8 ef a3 f9 ff 48 c7 45 d0 00 00 00 00 e9 5d ff ff ff <0f> 0b eb fe 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 55 41 89 
[ 6.461876] RIP [<ffffffff802a227e>] __get_vm_area_node+0x1fe/0x210
[ 6.461876] RSP <ffff88021b157538>
[ 6.940630] BUG: unable to handle kernel paging request at ffff880827ff7990
[ 6.947687] IP: [<ffffffff80237360>] task_tick_fair+0x40/0xd0
[ 6.947823] PGD 202063 PUD 0 
[ 6.947823] Oops: 0000 [2] SMP 
[ 6.947823] CPU 1 
[ 6.947823] Modules linked in: processor(+) fan thermal_sys fuse
[ 6.947823] Pid: 1256, comm: modprobe Tainted: G D 2.6.27-rc2 #14
[ 6.947823] RIP: 0010:[<ffffffff80237360>] [<ffffffff80237360>] task_tick_fair+0x40/0xd0
[ 6.947823] RSP: 0018:ffff88022f0a3e38 EFLAGS: 00010082
[ 6.947823] RAX: ffff880028033980 RBX: ffffffff81024c80 RCX: 0000000000000004
[ 6.947823] RDX: 00000000ffff8802 RSI: ffff88021ac3c890 RDI: ffff880028054c80
[ 6.947823] RBP: ffff88022f0a3e68 R08: 0000000000000400 R09: 0000000000000010
[ 6.947823] R10: ffff8800a7030000 R11: 0000000000000000 R12: ffff88021ac3c890
[ 6.947823] R13: 0000000000000000 R14: ffff880028050aa0 R15: ffff88021ac3c8c8
[ 6.947823] FS: 00007f13ac7606e0(0000) GS:ffff88022fc02980(0000) knlGS:0000000000000000
[ 6.947823] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 6.947823] CR2: ffff880827ff7990 CR3: 000000021ad66000 CR4: 00000000000006e0
[ 6.947823] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 6.947823] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 6.947823] Process modprobe (pid: 1256, threadinfo ffff88021b156000, task ffff88021ac3c890)
[ 6.947823] Stack: ffff88022f0a3e68 ffff880028054c80 0000000000000001 ffff88021ac3c890
[ 6.947823] ffff880028050aa0 7fffffffffffffff ffff88022f0a3e98 ffffffff802386a3
[ 6.947823] ffff88022f0a3e98 0000000000000001 0000000000000000 ffff88021ac3c890
[ 6.947823] Call Trace:
[ 6.947823] <IRQ> [<ffffffff802386a3>] scheduler_tick+0xc3/0x210
[ 6.947823] [<ffffffff80245f01>] update_process_times+0x51/0x70
[ 6.947823] [<ffffffff8025bb4d>] tick_sched_timer+0x6d/0xe0
[ 6.947823] [<ffffffff80253c6f>] __run_hrtimer+0x8f/0xa0
[ 6.947823] [<ffffffff80254918>] hrtimer_interrupt+0x118/0x180
[ 6.947823] [<ffffffff8021d433>] smp_apic_timer_interrupt+0x83/0xc0
[ 6.947823] [<ffffffff8020d046>] apic_timer_interrupt+0x66/0x70
[ 6.947823] <EOI> [<ffffffff80490b6a>] ? oops_end+0x4a/0x90
[ 6.947823] [<ffffffff8020dfee>] ? die+0x5e/0x90
[ 6.947823] [<ffffffff804910b0>] ? do_trap+0x130/0x150
[ 6.947823] [<ffffffff8020e5c2>] ? do_invalid_op+0x92/0xb0
[ 6.947823] [<ffffffff802a227e>] ? __get_vm_area_node+0x1fe/0x210
[ 6.947823] [<ffffffff804907c9>] ? error_exit+0x0/0x51
[ 6.947823] [<ffffffff8022151a>] ? flat_send_IPI_allbutself+0x6a/0x80
[ 6.947823] [<ffffffff802a227e>] ? __get_vm_area_node+0x1fe/0x210
[ 6.947823] [<ffffffff802a2301>] ? get_vm_area_caller+0x31/0x40
[ 6.947823] [<ffffffff8047f559>] ? acpi_os_map_memory+0x12/0x29
[ 6.947823] [<ffffffff80225078>] ? __ioremap_caller+0x188/0x340
[ 6.947823] [<ffffffff8047f559>] ? acpi_os_map_memory+0x12/0x29
[ 6.947823] [<ffffffff8038f1ce>] ? acpi_ex_system_memory_space_handler+0x0/0x1be
[ 6.947823] [<ffffffff80225342>] ? ioremap_nocache+0x12/0x20
[ 6.947823] [<ffffffff8047f559>] ? acpi_os_map_memory+0x12/0x29
[ 6.947823] [<ffffffff8038f2a0>] ? acpi_ex_system_memory_space_handler+0xd2/0x1be
[ 6.947823] [<ffffffff8038f1ce>] ? acpi_ex_system_memory_space_handler+0x0/0x1be
[ 6.947823] [<ffffffff8038805c>] ? acpi_ev_address_space_dispatch+0x172/0x1c1
[ 6.947823] [<ffffffff8038c5e8>] ? acpi_ex_access_region+0x209/0x226
[ 6.947823] [<ffffffff8038c6f4>] ? acpi_ex_field_datum_io+0xef/0x183
[ 6.947823] [<ffffffff8038c814>] ? acpi_ex_extract_from_field+0x8c/0x1a1
[ 6.947823] [<ffffffff8039ac13>] ? acpi_ut_create_internal_object_dbg+0x26/0x90
[ 6.947823] [<ffffffff8038b303>] ? acpi_ex_read_data_from_field+0x120/0x159
[ 6.947823] [<ffffffff8039018c>] ? acpi_ex_resolve_node_to_value+0x190/0x240
[ 6.947823] [<ffffffff8038bda2>] ? acpi_ex_resolve_to_value+0x256/0x268
[ 6.947823] [<ffffffff80386586>] ? acpi_ds_evaluate_name_path+0x7a/0xff
[ 6.947823] [<ffffffff8038522e>] ? acpi_ds_exec_end_op+0x94/0x3ca
[ 6.947823] [<ffffffff80395395>] ? acpi_ps_parse_loop+0x6a3/0x876
[ 6.947823] [<ffffffff803945de>] ? acpi_ps_parse_aml+0x7e/0x2bb
[ 6.947823] [<ffffffff80395b87>] ? acpi_ps_execute_method+0x129/0x1d6
[ 6.947823] [<ffffffff803927a8>] ? acpi_ns_evaluate+0x150/0x1b4
[ 6.947823] [<ffffffff803922b8>] ? acpi_evaluate_object+0x140/0x1fc
[ 6.947823] [<ffffffff8021bf37>] ? arch_acpi_processor_init_pdc+0x97/0x160
[ 6.947823] [<ffffffffa01971bd>] ? acpi_processor_notify+0x0/0x108 [processor]
[ 6.947823] [<ffffffffa019b23e>] ? acpi_processor_start+0x612/0x774 [processor]
[ 6.947823] [<ffffffff8031234b>] ? __sysfs_add_one+0x6b/0xa0
[ 6.947823] [<ffffffff803133de>] ? sysfs_do_create_link+0xbe/0x140
[ 6.947823] [<ffffffff8039d01a>] ? acpi_start_single_object+0x2d/0x52
[ 6.947823] [<ffffffff8039e603>] ? acpi_device_probe+0x7e/0x92
[ 6.947823] [<ffffffff803d195b>] ? driver_probe_device+0x9b/0x1a0
[ 6.947823] [<ffffffff803d1ae6>] ? __driver_attach+0x86/0x90
[ 6.947823] [<ffffffff803d1a60>] ? __driver_attach+0x0/0x90
[ 6.947823] [<ffffffff803d0f84>] ? bus_for_each_dev+0x54/0x80
[ 6.947823] [<ffffffff80359f0a>] ? kobject_get+0x1a/0x30
[ 6.947823] [<ffffffff803d179c>] ? driver_attach+0x1c/0x20
[ 6.947823] [<ffffffff803d15b9>] ? bus_add_driver+0x1e9/0x260
[ 6.947823] [<ffffffffa0222000>] ? acpi_processor_init+0x0/0x107 [processor]
[ 6.947823] [<ffffffff803d1d7f>] ? driver_register+0x5f/0x140
[ 6.947823] [<ffffffffa0222000>] ? acpi_processor_init+0x0/0x107 [processor]
[ 6.947823] [<ffffffff8039e913>] ? acpi_bus_register_driver+0x3e/0x40
[ 6.947823] [<ffffffffa0222094>] ? acpi_processor_init+0x94/0x107 [processor]
[ 6.947823] [<ffffffff802a2a8d>] ? __vunmap+0x8d/0xf0
[ 6.947823] [<ffffffff80209040>] ? _stext+0x40/0x180
[ 6.947823] [<ffffffff80262902>] ? sys_init_module+0x142/0x1dc0
[ 6.947823] [<ffffffff8047e430>] ? cpu_down+0x0/0x70
[ 6.947823] [<ffffffff8020c34b>] ? system_call_fastpath+0x16/0x1b
[ 6.947823] 
[ 6.947823] 
[ 6.947823] Code: c7 38 4c 89 6d e8 48 89 5d d8 4c 89 75 f0 49 89 f4 41 89 d5 74 65 48 8b 46 08 48 c7 c3 80 4c 02 81 8b 50 1c 48 8b 05 68 a3 91 00 <48> 8b 04 d0 48 03 58 08 4c 8d 73 70 4c 89 f7 e8 7c 53 ff ff 45 
[ 6.947823] RIP [<ffffffff80237360>] task_tick_fair+0x40/0xd0
[ 6.947823] RSP <ffff88022f0a3e38>
[ 6.947823] CR2: ffff880827ff7990
[ 6.947823] ---[ end trace 01cb030c995eed4a ]---
[ 6.947823] Kernel panic - not syncing: Aiee, killing interrupt handler!
[ 6.947823] ------------[ cut here ]------------
[ 6.947823] WARNING: at kernel/smp.c:326 smp_call_function_mask+0x25e/0x270()
[ 6.947823] Modules linked in: processor(+) fan thermal_sys fuse
[ 6.947823] Pid: 1256, comm: modprobe Tainted: G D 2.6.27-rc2 #14
[ 6.947823] 
[ 6.947823] Call Trace:
[ 6.947823] <IRQ> [<ffffffff8023b5cf>] warn_on_slowpath+0x5f/0x80
[ 6.947823] [<ffffffff8026040e>] smp_call_function_mask+0x25e/0x270
[ 6.947823] [<ffffffff8021c270>] ? stop_this_cpu+0x0/0x30
[ 6.947823] [<ffffffff8035f1fd>] ? string+0x3d/0xd0
[ 6.947823] [<ffffffff8035f6cb>] ? vsnprintf+0x43b/0x720
[ 6.947823] [<ffffffff8035f1fd>] ? string+0x3d/0xd0
[ 6.947823] [<ffffffff8035f1fd>] ? string+0x3d/0xd0
[ 6.947823] [<ffffffff8035f6cb>] ? vsnprintf+0x43b/0x720
[ 6.947823] [<ffffffff8035e99e>] ? number+0x2ae/0x2d0
[ 6.947823] [<ffffffff8035e99e>] ? number+0x2ae/0x2d0
[ 6.947823] [<ffffffff802650fd>] ? kallsyms_lookup+0x5d/0xa0
[ 6.947823] [<ffffffff8035e99e>] ? number+0x2ae/0x2d0
[ 6.947823] [<ffffffff8035f6cb>] ? vsnprintf+0x43b/0x720
[ 6.947823] [<ffffffff8035fa18>] ? sprintf+0x68/0x70
[ 6.947823] [<ffffffff8035f1fd>] ? string+0x3d/0xd0
[ 6.947823] [<ffffffff8035f5f0>] ? vsnprintf+0x360/0x720
[ 6.947823] [<ffffffff803606c7>] ? delay_tsc+0x37/0x60
[ 6.947823] [<ffffffff8037d261>] ? vgacon_set_cursor_size+0xb1/0x130
[ 6.947823] [<ffffffff8049307d>] ? __atomic_notifier_call_chain+0xd/0x10
[ 6.947823] [<ffffffff80493091>] ? atomic_notifier_call_chain+0x11/0x20
[ 6.947823] [<ffffffff8021c270>] ? stop_this_cpu+0x0/0x30
[ 6.947823] [<ffffffff80260460>] smp_call_function+0x40/0x50
[ 6.947823] [<ffffffff8021c2f3>] native_smp_send_stop+0x23/0x40
[ 6.947823] [<ffffffff8023b90f>] panic+0xaf/0x190
[ 6.947823] [<ffffffff8023c6c7>] ? printk+0x67/0x70
[ 6.947823] [<ffffffff802557e1>] ? blocking_notifier_call_chain+0x11/0x20
[ 6.947823] [<ffffffff8023f389>] do_exit+0x8f9/0x9a0
[ 6.947823] [<ffffffff803bc8a9>] ? do_unblank_screen+0x19/0x130
[ 6.947823] [<ffffffff80490ba7>] oops_end+0x87/0x90
[ 6.947823] [<ffffffff80492e63>] do_page_fault+0x663/0x800
[ 6.947823] [<ffffffff804907c9>] error_exit+0x0/0x51
[ 6.947823] [<ffffffff80237360>] ? task_tick_fair+0x40/0xd0
[ 6.947823] [<ffffffff802386a3>] scheduler_tick+0xc3/0x210
[ 6.947823] [<ffffffff80245f01>] update_process_times+0x51/0x70
[ 6.947823] [<ffffffff8025bb4d>] tick_sched_timer+0x6d/0xe0
[ 6.947823] [<ffffffff80253c6f>] __run_hrtimer+0x8f/0xa0
[ 6.947823] [<ffffffff80254918>] hrtimer_interrupt+0x118/0x180
[ 6.947823] [<ffffffff8021d433>] smp_apic_timer_interrupt+0x83/0xc0
[ 6.947823] [<ffffffff8020d046>] apic_timer_interrupt+0x66/0x70
[ 6.947823] <EOI> [<ffffffff80490b6a>] ? oops_end+0x4a/0x90
[ 6.947823] [<ffffffff8020dfee>] ? die+0x5e/0x90
[ 6.947823] [<ffffffff804910b0>] ? do_trap+0x130/0x150
[ 6.947823] [<ffffffff8020e5c2>] ? do_invalid_op+0x92/0xb0
[ 6.947823] [<ffffffff802a227e>] ? __get_vm_area_node+0x1fe/0x210
[ 6.947823] [<ffffffff804907c9>] ? error_exit+0x0/0x51
[ 6.947823] [<ffffffff8022151a>] ? flat_send_IPI_allbutself+0x6a/0x80
[ 6.947823] [<ffffffff802a227e>] ? __get_vm_area_node+0x1fe/0x210
[ 6.947823] [<ffffffff802a2301>] ? get_vm_area_caller+0x31/0x40
[ 6.947823] [<ffffffff8047f559>] ? acpi_os_map_memory+0x12/0x29
[ 6.947823] [<ffffffff80225078>] ? __ioremap_caller+0x188/0x340
[ 6.947823] [<ffffffff8047f559>] ? acpi_os_map_memory+0x12/0x29
[ 6.947823] [<ffffffff8038f1ce>] ? acpi_ex_system_memory_space_handler+0x0/0x1be
[ 6.947823] [<ffffffff80225342>] ? ioremap_nocache+0x12/0x20
[ 6.947823] [<ffffffff8047f559>] ? acpi_os_map_memory+0x12/0x29
[ 6.947823] [<ffffffff8038f2a0>] ? acpi_ex_system_memory_space_handler+0xd2/0x1be
[ 6.947823] [<ffffffff8038f1ce>] ? acpi_ex_system_memory_space_handler+0x0/0x1be
[ 6.947823] [<ffffffff8038805c>] ? acpi_ev_address_space_dispatch+0x172/0x1c1
[ 6.947823] [<ffffffff8038c5e8>] ? acpi_ex_access_region+0x209/0x226
[ 6.947823] [<ffffffff8038c6f4>] ? acpi_ex_field_datum_io+0xef/0x183
[ 6.947823] [<ffffffff8038c814>] ? acpi_ex_extract_from_field+0x8c/0x1a1
[ 6.947823] [<ffffffff8039ac13>] ? acpi_ut_create_internal_object_dbg+0x26/0x90
[ 6.947823] [<ffffffff8038b303>] ? acpi_ex_read_data_from_field+0x120/0x159
[ 6.947823] [<ffffffff8039018c>] ? acpi_ex_resolve_node_to_value+0x190/0x240
[ 6.947823] [<ffffffff8038bda2>] ? acpi_ex_resolve_to_value+0x256/0x268
[ 6.947823] [<ffffffff80386586>] ? acpi_ds_evaluate_name_path+0x7a/0xff
[ 6.947823] [<ffffffff8038522e>] ? acpi_ds_exec_end_op+0x94/0x3ca
[ 6.947823] [<ffffffff80395395>] ? acpi_ps_parse_loop+0x6a3/0x876
[ 6.947823] [<ffffffff803945de>] ? acpi_ps_parse_aml+0x7e/0x2bb
[ 6.947823] [<ffffffff80395b87>] ? acpi_ps_execute_method+0x129/0x1d6
[ 6.947823] [<ffffffff803927a8>] ? acpi_ns_evaluate+0x150/0x1b4
[ 6.947823] [<ffffffff803922b8>] ? acpi_evaluate_object+0x140/0x1fc
[ 6.947823] [<ffffffff8021bf37>] ? arch_acpi_processor_init_pdc+0x97/0x160
[ 6.947823] [<ffffffffa01971bd>] ? acpi_processor_notify+0x0/0x108 [processor]
[ 6.947823] [<ffffffffa019b23e>] ? acpi_processor_start+0x612/0x774 [processor]
[ 6.947823] [<ffffffff8031234b>] ? __sysfs_add_one+0x6b/0xa0
[ 6.947823] [<ffffffff803133de>] ? sysfs_do_create_link+0xbe/0x140
[ 6.947823] [<ffffffff8039d01a>] ? acpi_start_single_object+0x2d/0x52
[ 6.947823] [<ffffffff8039e603>] ? acpi_device_probe+0x7e/0x92
[ 6.947823] [<ffffffff803d195b>] ? driver_probe_device+0x9b/0x1a0
[ 6.947823] [<ffffffff803d1ae6>] ? __driver_attach+0x86/0x90
[ 6.947823] [<ffffffff803d1a60>] ? __driver_attach+0x0/0x90
[ 6.947823] [<ffffffff803d0f84>] ? bus_for_each_dev+0x54/0x80
[ 6.947823] [<ffffffff80359f0a>] ? kobject_get+0x1a/0x30
[ 6.947823] [<ffffffff803d179c>] ? driver_attach+0x1c/0x20
[ 6.947823] [<ffffffff803d15b9>] ? bus_add_driver+0x1e9/0x260
[ 6.947823] [<ffffffffa0222000>] ? acpi_processor_init+0x0/0x107 [processor]
[ 6.947823] [<ffffffff803d1d7f>] ? driver_register+0x5f/0x140
[ 6.947823] [<ffffffffa0222000>] ? acpi_processor_init+0x0/0x107 [processor]
[ 6.947823] [<ffffffff8039e913>] ? acpi_bus_register_driver+0x3e/0x40
[ 6.947823] [<ffffffffa0222094>] ? acpi_processor_init+0x94/0x107 [processor]
[ 6.947823] [<ffffffff802a2a8d>] ? __vunmap+0x8d/0xf0
[ 6.947823] [<ffffffff80209040>] ? _stext+0x40/0x180
[ 6.947823] [<ffffffff80262902>] ? sys_init_module+0x142/0x1dc0
[ 6.947823] [<ffffffff8047e430>] ? cpu_down+0x0/0x70
[ 6.947823] [<ffffffff8020c34b>] ? system_call_fastpath+0x16/0x1b
[ 6.947823] 
[ 6.947823] ---[ end trace 01cb030c995eed4a ]---

Attachments:

2008-08-14 16:11:59

by Rafael J. Wysocki

Subject: Re: Linux 2.6.27-rc3: kernel BUG at mm/vmalloc.c - bisected

On Thursday, 14 of August 2008, Alan D. Brunelle wrote:
> I ran into this trying 2.6.27-rc3 today:
>
> [6.461876] kernel BUG at mm/vmalloc.c:217!
>
> (full boot log attached)
>
> I bisected it to:
>
> git-bisect bad 1c89ac55017f982355c7761e1c912c88c941483d
>
> which is:
>
> commit 1c89ac55017f982355c7761e1c912c88c941483d
> Merge: 88fa08f... b1b135c...
> Author: Linus Torvalds <[email protected]>
> Date: Tue Aug 12 08:40:19 2008 -0700
>
> Merge
> git://git.kernel.org/pub/scm/linux/kernel/git/rusty/linux-2.6-for-linus

This is a merge commit that introduced several changes into the
kernel. It would be helpful to search through these changes.

> *
> git://git.kernel.org/pub/scm/linux/kernel/git/rusty/linux-2.6-for-linus:
> fix spinlock recursion in hvc_console
> stop_machine: remove unused variable
> modules: extend initcall_debug functionality to the module loader
> export virtio_rng.h
> lguest: use get_user_pages_fast() instead of get_user_pages()
> mm: Make generic weak get_user_pages_fast and EXPORT_GPL it
> lguest: don't set MAC address for guest unless specified
>
> Backing out to the previous commit boots just fine. I've attached the
> boot.log, config file, lspci.txt and git-bisect-log. If there is
> anything else I can do, I'd be happy to oblige, but I'm checking out
> right now. I'll check in tomorrow morning (Eastern USA).

Thanks,
Rafael

2008-08-14 19:21:33

by Alan D. Brunelle

Subject: Re: Linux 2.6.27-rc3: kernel BUG at mm/vmalloc.c - bisected

Rafael J. Wysocki wrote:
> On Thursday, 14 of August 2008, Alan D. Brunelle wrote:
>> I ran into this trying 2.6.27-rc3 today:
>>
>> [6.461876] kernel BUG at mm/vmalloc.c:217!
>>
>> (full boot log attached)
>>
>> I bisected it to:
>>
>> git-bisect bad 1c89ac55017f982355c7761e1c912c88c941483d
>>
>> which is:
>>
>> commit 1c89ac55017f982355c7761e1c912c88c941483d
>> Merge: 88fa08f... b1b135c...
>> Author: Linus Torvalds <[email protected]>
>> Date: Tue Aug 12 08:40:19 2008 -0700
>>
>> Merge
>> git://git.kernel.org/pub/scm/linux/kernel/git/rusty/linux-2.6-for-linus
>
> This is a merge commit that introduced several changes into the
> kernel. It would be helpful to search through these changes.

I came in this morning, and did a 'git bisect reset' and 'git pull'
built, and everything booted fine. I don't know if some fix came in for
something else, or if the problem got "hidden" (some sort of timing
thing, so the problem still lurks). If you feel it's important to track
this down, if you could give me instructions on how to break apart that
one merge, I could then try individual kernels from there...

Thanks,
Alan

2008-08-14 20:26:26

by Rafael J. Wysocki

Subject: Re: Linux 2.6.27-rc3: kernel BUG at mm/vmalloc.c - bisected

On Thursday, 14 of August 2008, Alan D. Brunelle wrote:
> Rafael J. Wysocki wrote:
> > On Thursday, 14 of August 2008, Alan D. Brunelle wrote:
> >> I ran into this trying 2.6.27-rc3 today:
> >>
> >> [6.461876] kernel BUG at mm/vmalloc.c:217!
> >>
> >> (full boot log attached)
> >>
> >> I bisected it to:
> >>
> >> git-bisect bad 1c89ac55017f982355c7761e1c912c88c941483d
> >>
> >> which is:
> >>
> >> commit 1c89ac55017f982355c7761e1c912c88c941483d
> >> Merge: 88fa08f... b1b135c...
> >> Author: Linus Torvalds <[email protected]>
> >> Date: Tue Aug 12 08:40:19 2008 -0700
> >>
> >> Merge
> >> git://git.kernel.org/pub/scm/linux/kernel/git/rusty/linux-2.6-for-linus
> >
> > This is a merge commit that introduced several changes into the
> > kernel. It would be helpful to search through these changes.
>
> I came in this morning, and did a 'git bisect reset' and 'git pull'
> built, and everything booted fine. I don't know if some fix came in for
> something else, or if the problem got "hidden" (some sort of timing
> thing, so the problem still lurks). If you feel it's important to track
> this down, if you could give me instructions on how to break apart that
> one merge, I could then try individual kernels from there...

I have created a Bugzilla entry at
http://bugzilla.kernel.org/show_bug.cgi?id=11342
for this problem. I'll close it now, but please reopen if if the problem
reappears.

Thanks,
Rafael

2008-08-19 19:46:42

by Andrew Morton

Subject: Re: Linux 2.6.27-rc3: kernel BUG at mm/vmalloc.c - bisected

On Wed, 13 Aug 2008 19:03:20 -0400
"Alan D. Brunelle" <[email protected]> wrote:

> I ran into this trying 2.6.27-rc3 today:
>
> [6.461876] kernel BUG at mm/vmalloc.c:217!
>
> (full boot log attached)
>
> I bisected it to:
>
> git-bisect bad 1c89ac55017f982355c7761e1c912c88c941483d
>
> which is:
>
> commit 1c89ac55017f982355c7761e1c912c88c941483d
> Merge: 88fa08f... b1b135c...
> Author: Linus Torvalds <[email protected]>
> Date: Tue Aug 12 08:40:19 2008 -0700
>
> Merge
> git://git.kernel.org/pub/scm/linux/kernel/git/rusty/linux-2.6-for-linus
>
> *
> git://git.kernel.org/pub/scm/linux/kernel/git/rusty/linux-2.6-for-linus:
> fix spinlock recursion in hvc_console
> stop_machine: remove unused variable
> modules: extend initcall_debug functionality to the module loader
> export virtio_rng.h
> lguest: use get_user_pages_fast() instead of get_user_pages()
> mm: Make generic weak get_user_pages_fast and EXPORT_GPL it
> lguest: don't set MAC address for guest unless specified
>
> Backing out to the previous commit boots just fine. I've attached the
> boot.log, config file, lspci.txt and git-bisect-log. If there is
> anything else I can do, I'd be happy to oblige, but I'm checking out
> right now. I'll check in tomorrow morning (Eastern USA).
>
> Alan
>
>
> [boot.log text/plain (5.2KB)]
> [6.461876] kernel BUG at mm/vmalloc.c:217!

Please confirm that this happened at

static struct vm_struct *
__get_vm_area_node(unsigned long size, unsigned long flags, unsigned long start,
unsigned long end, int node, gfp_t gfp_mask, void *caller)
{
struct vm_struct **p, *tmp, *area;
unsigned long align = 1;
unsigned long addr;

--> BUG_ON(in_interrupt());


> [6.461876] invalid opcode: 0000 [1] SMP
> [6.461876] CPU 1
> [6.461876] Modules linked in: processor(+) fan thermal_sys fuse
> [6.461876] Pid: 1256, comm: modprobe Not tainted 2.6.27-rc2 #14
> [6.461876] RIP: 0010:[<ffffffff802a227e>] [<ffffffff802a227e>] __get_vm_area_node+0x1fe/0x210
> [6.461876] RSP: 0018:ffff88021b157538 EFLAGS: 00010206
> [6.461876] RAX: ffffffff8022151a RBX: ffffc20000000000 RCX: ffffe1ffffffffff
> [6.461876] RDX: 00000000ffffffff RSI: 00000000000000d0 RDI: 0000000000002000
> [6.461876] RBP: ffff88021b157578 R08: 00000000ffffffff R09: 00000000000000d0
> [6.461876] R10: 0000000000001000 R11: 0000000000000000 R12: 0000000000000010
> [6.461876] R13: 00000000cffc3000 R14: 00000000cffc3b51 R15: 00000000cffc480a
> [6.461876] FS: 00007f13ac7606e0(0000) GS:ffff88022fc02980(0000) knlGS:0000000000000000
> [6.461876] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> [6.461876] CR2: 000000000044f360 CR3: 000000021ad66000 CR4: 00000000000006e0
> [6.461876] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [6.461876] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
> [6.461876] Process modprobe (pid: 1256, threadinfo ffff88021b156000, task ffff88021ac3c890)
> [6.461876] Stack: ffffe1ffffffffff 0000000000000001 ffff88021b157558 0000000000002000
> [6.461876] 0000000000000010 00000000cffc3000 00000000cffc3b51 00000000cffc480a
> [6.461876] ffff88021b157598 ffffffff802a2301 ffffffff8047f559 00000000cffc480a
> [6.461876] Call Trace:
> [6.461876] [<ffffffff802a2301>] get_vm_area_caller+0x31/0x40
> [6.461876] [<ffffffff8047f559>] ? acpi_os_map_memory+0x12/0x29
> [6.461876] [<ffffffff80225078>] __ioremap_caller+0x188/0x340
> [6.461876] [<ffffffff8047f559>] ? acpi_os_map_memory+0x12/0x29
> [6.461876] [<ffffffff8038f1ce>] ? acpi_ex_system_memory_space_handler+0x0/0x1be
> [6.461876] [<ffffffff80225342>] ioremap_nocache+0x12/0x20
> [6.461876] [<ffffffff8047f559>] acpi_os_map_memory+0x12/0x29
> [6.461876] [<ffffffff8038f2a0>] acpi_ex_system_memory_space_handler+0xd2/0x1be
> [6.461876] [<ffffffff8038f1ce>] ? acpi_ex_system_memory_space_handler+0x0/0x1be
> [6.461876] [<ffffffff8038805c>] acpi_ev_address_space_dispatch+0x172/0x1c1
> [6.461876] [<ffffffff8038c5e8>] acpi_ex_access_region+0x209/0x226
> [6.461876] [<ffffffff8038c6f4>] acpi_ex_field_datum_io+0xef/0x183
> [6.461876] [<ffffffff8038c814>] acpi_ex_extract_from_field+0x8c/0x1a1
> [6.461876] [<ffffffff8039ac13>] ? acpi_ut_create_internal_object_dbg+0x26/0x90
> [6.461876] [<ffffffff8038b303>] acpi_ex_read_data_from_field+0x120/0x159
> [6.461876] [<ffffffff8039018c>] acpi_ex_resolve_node_to_value+0x190/0x240
> [6.461876] [<ffffffff8038bda2>] acpi_ex_resolve_to_value+0x256/0x268
> [6.461876] [<ffffffff80386586>] acpi_ds_evaluate_name_path+0x7a/0xff
> [6.461876] [<ffffffff8038522e>] acpi_ds_exec_end_op+0x94/0x3ca
> [6.461876] [<ffffffff80395395>] acpi_ps_parse_loop+0x6a3/0x876
> [6.461876] [<ffffffff803945de>] acpi_ps_parse_aml+0x7e/0x2bb
> [6.461876] [<ffffffff80395b87>] acpi_ps_execute_method+0x129/0x1d6
> [6.461876] [<ffffffff803927a8>] acpi_ns_evaluate+0x150/0x1b4
> [6.461876] [<ffffffff803922b8>] acpi_evaluate_object+0x140/0x1fc
> [6.461876] [<ffffffff8021bf37>] ? arch_acpi_processor_init_pdc+0x97/0x160
> [6.461876] [<ffffffffa01971bd>] ? acpi_processor_notify+0x0/0x108 [processor]
> [6.461876] [<ffffffffa019b23e>] acpi_processor_start+0x612/0x774 [processor]
> [6.461876] [<ffffffff8031234b>] ? __sysfs_add_one+0x6b/0xa0
> [6.461876] [<ffffffff803133de>] ? sysfs_do_create_link+0xbe/0x140
> [6.461876] [<ffffffff8039d01a>] acpi_start_single_object+0x2d/0x52
> [6.461876] [<ffffffff8039e603>] acpi_device_probe+0x7e/0x92
> [6.461876] [<ffffffff803d195b>] driver_probe_device+0x9b/0x1a0
> [6.461876] [<ffffffff803d1ae6>] __driver_attach+0x86/0x90
> [6.461876] [<ffffffff803d1a60>] ? __driver_attach+0x0/0x90
> [6.461876] [<ffffffff803d0f84>] bus_for_each_dev+0x54/0x80
> [6.461876] [<ffffffff80359f0a>] ? kobject_get+0x1a/0x30
> [6.461876] [<ffffffff803d179c>] driver_attach+0x1c/0x20
> [6.461876] [<ffffffff803d15b9>] bus_add_driver+0x1e9/0x260
> [6.461876] [<ffffffffa0222000>] ? acpi_processor_init+0x0/0x107 [processor]
> [6.461876] [<ffffffff803d1d7f>] driver_register+0x5f/0x140
> [6.461876] [<ffffffffa0222000>] ? acpi_processor_init+0x0/0x107 [processor]
> [6.461876] [<ffffffff8039e913>] acpi_bus_register_driver+0x3e/0x40
> [6.461876] [<ffffffffa0222094>] acpi_processor_init+0x94/0x107 [processor]
> [6.461876] [<ffffffff802a2a8d>] ? __vunmap+0x8d/0xf0
> [6.461876] [<ffffffff80209040>] _stext+0x40/0x180
> [6.461876] [<ffffffff80262902>] sys_init_module+0x142/0x1dc0
> [6.461876] [<ffffffff8047e430>] ? cpu_down+0x0/0x70
> [6.461876] [<ffffffff8020c34b>] system_call_fastpath+0x16/0x1b

Thing is, the code *isn't* in an interrupt. Something got screwed up.

What can happen is that some code has a lock imbalance or a
preempt_disable imbalance and it does preempt_disable() so many times
that the counter overflows eight bits and starts to increment the
softirq counter, then the hardirq counter, then in_interrupt() starts
incorrectly returning true then blam.

You could confirm/debug it with something along the lines of this:

--- a/mm/vmalloc.c~a
+++ a/mm/vmalloc.c
@@ -214,7 +214,9 @@ __get_vm_area_node(unsigned long size, u
unsigned long align = 1;
unsigned long addr;

- BUG_ON(in_interrupt());
+ if (preempt_count() > 10)
+ printk("%s: preempt_count()=%d\n", __func__, preempt_count());
+ WARN_ON(in_interrupt());
if (flags & VM_IOREMAP) {
int bit = fls(size);

_


But this bug could be in practically anywhere in the kernel and
bisection is by far the best way to find it. It's sad and odd that
bisection landed you on a merge commit. I'd suggest that you persist
with the bisection (please).
http://www.kernel.org/doc/local/git-quick.html#example might be useful.

2008-08-22 15:37:46

by Alan D. Brunelle

Subject: Re: Linux 2.6.27-rc3: kernel BUG at mm/vmalloc.c - bisected

Andrew Morton wrote:

>
> You could confirm/debug it with something along the lines of this:
>
> --- a/mm/vmalloc.c~a
> +++ a/mm/vmalloc.c
> @@ -214,7 +214,9 @@ __get_vm_area_node(unsigned long size, u
> unsigned long align = 1;
> unsigned long addr;
>
> - BUG_ON(in_interrupt());
> + if (preempt_count() > 10)
> + printk("%s: preempt_count()=%d\n", __func__, preempt_count());
> + WARN_ON(in_interrupt());
> if (flags & VM_IOREMAP) {
> int bit = fls(size);
>
> _
>
>
> But this bug could be in practically anywhere in the kernel and
> bisection is by far the best way to find it. It's sad and odd that
> bisection landed you on a merge commit. I'd suggest that you persist
> with the bisection (please).
> http://www.kernel.org/doc/local/git-quick.html#example might be useful.

Sorry, was off on other things for the last couple of days:

I /did/ bisect it down to the aforementioned merge, the question is: How
to crack open that merge into it's composite pieces? (Where do I go to
bisect within that?)

I'll try the patch above, and see what that reports.

Alan

2008-08-22 16:26:07

by Andrew Morton

Subject: Re: Linux 2.6.27-rc3: kernel BUG at mm/vmalloc.c - bisected

On Fri, 22 Aug 2008 11:37:33 -0400 "Alan D. Brunelle" <[email protected]> wrote:

> Andrew Morton wrote:
>
> >
> > You could confirm/debug it with something along the lines of this:
> >
> > --- a/mm/vmalloc.c~a
> > +++ a/mm/vmalloc.c
> > @@ -214,7 +214,9 @@ __get_vm_area_node(unsigned long size, u
> > unsigned long align = 1;
> > unsigned long addr;
> >
> > - BUG_ON(in_interrupt());
> > + if (preempt_count() > 10)
> > + printk("%s: preempt_count()=%d\n", __func__, preempt_count());
> > + WARN_ON(in_interrupt());
> > if (flags & VM_IOREMAP) {
> > int bit = fls(size);
> >
> > _
> >
> >
> > But this bug could be in practically anywhere in the kernel and
> > bisection is by far the best way to find it. It's sad and odd that
> > bisection landed you on a merge commit. I'd suggest that you persist
> > with the bisection (please).
> > http://www.kernel.org/doc/local/git-quick.html#example might be useful.
>
> Sorry, was off on other things for the last couple of days:
>
> I /did/ bisect it down to the aforementioned merge, the question is: How
> to crack open that merge into it's composite pieces? (Where do I go to
> bisect within that?)

urgh, it's irritating when git-bisect directs you to a merge commit - it
hasn't done it for me for ages.

One (probably wrong) approach is to run

gitk 1c89ac55017f982355c7761e1c912c88c941483d

then peer at the output, work out which real commits were in that
merge.

It looks like the merge ended with
b1b135c8d619cb2c7045d6ee4e48375882518bb5 and started with
40c42076ebd362dc69210cccea101ac80b6d4bd4, so perhaps you can do

git bisect bad b1b135c8d619cb2c7045d6ee4e48375882518bb5
git bisect good 40c42076ebd362dc69210cccea101ac80b6d4bd4

That has an off-by-one error, in that it assumes that
40c42076ebd362dc69210cccea101ac80b6d4bd4 is good, which we don't know.
Perhaps one can pick the preceding commit in the `git log' output to
fix that.

Anyway, I've sent sufficient wrongness to the right list for us to work
out how to do this for real ;)

2008-08-22 17:17:05

by Petr Baudis

Subject: Re: Linux 2.6.27-rc3: kernel BUG at mm/vmalloc.c - bisected

On Fri, Aug 22, 2008 at 09:25:49AM -0700, Andrew Morton wrote:
> On Fri, 22 Aug 2008 11:37:33 -0400 "Alan D. Brunelle" <[email protected]> wrote:
>
> > I /did/ bisect it down to the aforementioned merge, the question is: How
> > to crack open that merge into it's composite pieces? (Where do I go to
> > bisect within that?)
>
> urgh, it's irritating when git-bisect directs you to a merge commit - it
> hasn't done it for me for ages.

Hmm, but doesn't that happen only when it's actually really the merge
commit that introduces the bug? Both parents of the merge commit were
marked as good by the user, so...

> One (probably wrong) approach is to run
>
> gitk 1c89ac55017f982355c7761e1c912c88c941483d
>
> then peer at the output, work out which real commits were in that
> merge.
>
> It looks like the merge ended with
> b1b135c8d619cb2c7045d6ee4e48375882518bb5 and started with
> 40c42076ebd362dc69210cccea101ac80b6d4bd4, so perhaps you can do
>
> git bisect bad b1b135c8d619cb2c7045d6ee4e48375882518bb5
> git bisect good 40c42076ebd362dc69210cccea101ac80b6d4bd4

...I don't quite get this - according to the bisection log,

# good: [b1b135c8d619cb2c7045d6ee4e48375882518bb5] fix spinlock recursion in hvc_console

and now you want to mark it as bad?

You could try to revert some of the merged commits at the point of the
merge, though.

--
Petr "Pasky" Baudis
The next generation of interesting software will be done
on the Macintosh, not the IBM PC. -- Bill Gates

2008-08-22 17:51:56

by Andrew Morton

Subject: Re: Linux 2.6.27-rc3: kernel BUG at mm/vmalloc.c - bisected

On Fri, 22 Aug 2008 19:16:51 +0200
Petr Baudis <[email protected]> wrote:

> On Fri, Aug 22, 2008 at 09:25:49AM -0700, Andrew Morton wrote:
> > On Fri, 22 Aug 2008 11:37:33 -0400 "Alan D. Brunelle" <[email protected]> wrote:
> >
> > > I /did/ bisect it down to the aforementioned merge, the question is: How
> > > to crack open that merge into it's composite pieces? (Where do I go to
> > > bisect within that?)
> >
> > urgh, it's irritating when git-bisect directs you to a merge commit - it
> > hasn't done it for me for ages.
>
> Hmm, but doesn't that happen only when it's actually really the merge
> commit that introduces the bug? Both parents of the merge commit were
> marked as good by the user, so...

A merge commit doesn't contain any kernel changes? It's the individual
commits (aka "patches") which were in that merge which broke stuff.
Confused.

We're trying to dive inside that merge commit to find out which of the
real commits caused the regression.

> > One (probably wrong) approach is to run
> >
> > gitk 1c89ac55017f982355c7761e1c912c88c941483d
> >
> > then peer at the output, work out which real commits were in that
> > merge.
> >
> > It looks like the merge ended with
> > b1b135c8d619cb2c7045d6ee4e48375882518bb5 and started with
> > 40c42076ebd362dc69210cccea101ac80b6d4bd4, so perhaps you can do
> >
> > git bisect bad b1b135c8d619cb2c7045d6ee4e48375882518bb5
> > git bisect good 40c42076ebd362dc69210cccea101ac80b6d4bd4
>
> ...I don't quite get this - according to the bisection log,
>
> # good: [b1b135c8d619cb2c7045d6ee4e48375882518bb5] fix spinlock recursion in hvc_console
>
> and now you want to mark it as bad?

<what bisection log?>

I assume that Alan's bisection search ended up saying that the merge
commit (1c89ac55017f982355c7761e1c912c88c941483d) was the first bad
commit.

Now I don't know what's going on.

> You could try to revert some of the merged commits at the point of the
> merge, though.

2008-08-22 18:07:57

by Alan D. Brunelle

Subject: Re: Linux 2.6.27-rc3: kernel BUG at mm/vmalloc.c - bisected

Andrew Morton wrote:
> On Fri, 22 Aug 2008 19:16:51 +0200
> Petr Baudis <[email protected]> wrote:
>
>> On Fri, Aug 22, 2008 at 09:25:49AM -0700, Andrew Morton wrote:
>>> On Fri, 22 Aug 2008 11:37:33 -0400 "Alan D. Brunelle" <[email protected]> wrote:
>>>
>>>> I /did/ bisect it down to the aforementioned merge, the question is: How
>>>> to crack open that merge into it's composite pieces? (Where do I go to
>>>> bisect within that?)
>>> urgh, it's irritating when git-bisect directs you to a merge commit - it
>>> hasn't done it for me for ages.
>> Hmm, but doesn't that happen only when it's actually really the merge
>> commit that introduces the bug? Both parents of the merge commit were
>> marked as good by the user, so...
>
> A merge commit doesn't contain any kernel changes? It's the individual
> commits (aka "patches") which were in that merge which broke stuff.
> Confused.
>
> We're trying to dive inside that merge commit to find out which of the
> real commits caused the regression.
>
>>> One (probably wrong) approach is to run
>>>
>>> gitk 1c89ac55017f982355c7761e1c912c88c941483d
>>>
>>> then peer at the output, work out which real commits were in that
>>> merge.
>>>
>>> It looks like the merge ended with
>>> b1b135c8d619cb2c7045d6ee4e48375882518bb5 and started with
>>> 40c42076ebd362dc69210cccea101ac80b6d4bd4, so perhaps you can do
>>>
>>> git bisect bad b1b135c8d619cb2c7045d6ee4e48375882518bb5
>>> git bisect good 40c42076ebd362dc69210cccea101ac80b6d4bd4
>> ...I don't quite get this - according to the bisection log,
>>
>> # good: [b1b135c8d619cb2c7045d6ee4e48375882518bb5] fix spinlock recursion in hvc_console
>>
>> and now you want to mark it as bad?
>
> <what bisection log?>
>
> I assume that Alan's bisection search ended up saying that the merge
> commit (1c89ac55017f982355c7761e1c912c88c941483d) was the first bad
> commit.
>
> Now I don't know what's going on.
>
>> You could try to revert some of the merged commits at the point of the
>> merge, though.

You're right - this is where the bisection ended up (in fact, just
removing this merge commit allowed later kernels to boot just fine).

I've patched the kernel w/ your suggestion, and now I'm getting
something a bit different - and I'm looking into this...

Begin: Loading essential drivers... ...

[ 6.594525] fuse init (API version 7.9)

[ 6.618686] ACPI: SSDT CFFD0D0A, 08C4 (r1 HPQOEM CPU_TM2 1
MSFT 100000E)
[ 6.621481] BUG: unable to handle kernel NULL pointer dereference at
0000000000000858
[ 6.625017] IP: [<ffffffff8025e282>] debug_mutex_add_waiter+0x32/0x80

[ 6.625017] PGD 21a456067 PUD 21a45f067 PMD 0

[ 6.625017] Oops: 0002 [1] SMP

[ 6.625017] CPU 1

[ 6.625017] Modules linked in: processor(+) fan thermal_sys fuse

[ 6.625017] Pid: 1259, comm: modprobe Not tainted 2.6.27-rc3 #24

[ 6.625017] RIP: 0010:[<ffffffff8025e282>] [<ffffffff8025e282>]
debug_mutex_add_waiter+0x32/0x80

[ 6.625017] RSP: 0018:ffff88021a073998 EFLAGS: 00010002

[ 6.625017] RAX: 0000000000000000 RBX: ffff88021a0739d8 RCX:
0000000000000000

[ 6.625017] RDX: 0000000000000001 RSI: ffff88021a0739d8 RDI:
ffffffffa0091a60

[ 6.625017] RBP: ffff88021a0739b8 R08: ffffffff811deea0 R09:
ffff8800a6fdb000

[ 6.625017] R10: ffffffffa008f524 R11: 0000000000000000 R12:
ffffffffa0091a60

[ 6.625017] R13: ffff88021a072000 R14: ffff88021a9840a0 R15:
ffffffffa0091a98

[ 6.625017] FS: 00007f40ce2de6e0(0000) GS:ffff88022fc02a00(0000)
knlGS:0000000000000000

[ 6.625017] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b

[ 6.625017] CR2: 0000000000000858 CR3: 000000022d86b000 CR4:
00000000000006e0

[ 6.625017] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
0000000000000000

[ 6.625017] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
0000000000000400

[ 6.625017] Process modprobe (pid: 1259, threadinfo ffff88021a072000,
task ffff88021a9840a0)
[ 6.625017] Stack: 0000000000000000 ffffffffa0091a60
0000000000000246 ffffffffa008f524

[ 6.625017] ffff88021a073a38 ffffffff8049f556 ffffffffa008f524
ffffffffa0091a18

[ 6.625017] ffff88021a0739d8 ffff88021a0739d8 1111111111111111
1111111111111111

[ 6.625017] Call Trace:

[ 6.625017] [<ffffffffa008f524>] ? get_idr+0x44/0xa0 [thermal_sys]

[ 6.625017] [<ffffffff8049f556>] mutex_lock_nested+0xa6/0x250

[ 6.625017] [<ffffffffa008f524>] ? get_idr+0x44/0xa0 [thermal_sys]

[ 6.625017] [<ffffffff80363584>] ? idr_pre_get+0x44/0x90

[ 6.625017] [<ffffffffa008f524>] get_idr+0x44/0xa0 [thermal_sys]

[ 6.625017] [<ffffffffa008fe43>]
thermal_cooling_device_register+0x83/0x250 [thermal_sys]

[ 6.625017] [<ffffffffa019b2a3>] acpi_processor_start+0x64b/0x774
[processor]
[ 6.625017] [<ffffffff8031a90b>] ? __sysfs_add_one+0x6b/0xa0

[ 6.625017] [<ffffffff8031b9fc>] ? sysfs_do_create_link+0xbc/0x150

[ 6.625017] [<ffffffff803a7f1e>] acpi_start_single_object+0x2d/0x52

[ 6.625017] [<ffffffff803a9516>] acpi_device_probe+0x7e/0x92

[ 6.625017] [<ffffffff803dd3ab>] driver_probe_device+0x9b/0x1a0

[ 6.625017] [<ffffffff803dd536>] __driver_attach+0x86/0x90

[ 6.625017] [<ffffffff803dd4b0>] ? __driver_attach+0x0/0x90

[ 6.625017] [<ffffffff803dc8fd>] bus_for_each_dev+0x5d/0x90

[ 6.625017] [<ffffffff803dd1ec>] driver_attach+0x1c/0x20

[ 6.625017] [<ffffffff803dcf39>] bus_add_driver+0x1e9/0x260

[ 6.625017] [<ffffffffa0222000>] ? acpi_processor_init+0x0/0x107
[processor]

[ 6.625017] [<ffffffff803dd70f>] driver_register+0x5f/0x140

[ 6.625017] [<ffffffffa0222000>] ? acpi_processor_init+0x0/0x107
[processor]

[ 6.625017] [<ffffffff803a9826>] acpi_bus_register_driver+0x3e/0x40

[ 6.625017] [<ffffffffa0222094>] acpi_processor_init+0x94/0x107
[processor]

[ 6.625017] [<ffffffff80209040>] _stext+0x40/0x180

[ 6.625017] [<ffffffff802a88d1>] ? __vunmap+0xa1/0x110

[ 6.625017] [<ffffffff80267642>] sys_init_module+0x142/0x1dc0

[ 6.625017] [<ffffffff80367ad6>] ? __up_read+0x46/0xb0

[ 6.625017] [<ffffffff8048e530>] ? cpu_down+0x0/0x70

[ 6.625017] [<ffffffff8020c34b>] system_call_fastpath+0x16/0x1b

[ 6.625017]

2008-08-22 19:37:47

by Björn Steinbrink

Subject: Re: Linux 2.6.27-rc3: kernel BUG at mm/vmalloc.c - bisected

On 2008.08.22 10:51:36 -0700, Andrew Morton wrote:
> On Fri, 22 Aug 2008 19:16:51 +0200 Petr Baudis <[email protected]> wrote:
> > On Fri, Aug 22, 2008 at 09:25:49AM -0700, Andrew Morton wrote:
> > > One (probably wrong) approach is to run
> > >
> > > gitk 1c89ac55017f982355c7761e1c912c88c941483d
> > >
> > > then peer at the output, work out which real commits were in that
> > > merge.
> > >
> > > It looks like the merge ended with
> > > b1b135c8d619cb2c7045d6ee4e48375882518bb5 and started with
> > > 40c42076ebd362dc69210cccea101ac80b6d4bd4, so perhaps you can do
> > >
> > > git bisect bad b1b135c8d619cb2c7045d6ee4e48375882518bb5
> > > git bisect good 40c42076ebd362dc69210cccea101ac80b6d4bd4
> >
> > ...I don't quite get this - according to the bisection log,
> >
> > # good: [b1b135c8d619cb2c7045d6ee4e48375882518bb5] fix spinlock recursion in hvc_console
> >
> > and now you want to mark it as bad?
>
> <what bisection log?>

Alan provided his bisection log as an attachment to the original bug
report.

> I assume that Alan's bisection search ended up saying that the merge
> commit (1c89ac55017f982355c7761e1c912c88c941483d) was the first bad
> commit.

Yep, and that's totally correct as far as bisect is concerned. The
parents of that merge commit are:
88fa08f67bee1a0c765237bdac106a32872f57d2
b1b135c8d619cb2c7045d6ee4e48375882518bb5

And Alan marked both of them as good.

So, unless Alan made a mistake during his bisection, each of the
branches is correct, but the merge did not lead to a correct result. So
while there were no textual conflicts, there were still incompatible
changes regarding the code semantics and compatibility was not restored
during the merge.

To get an overview over what got merged together you can can use
something like:
gitk --left-right 1c89ac55017^1...1c89ac55017^2

Which shows all commits that were on only one side of the merge, with
nice "arrows" that indicate from which side the commit is coming. The
conflict should be between one commit from the left and one commit from
the right side, obviously.

Bj?rn

2008-08-22 19:47:38

by Alan D. Brunelle

Subject: Re: Linux 2.6.27-rc3: kernel BUG at mm/vmalloc.c - bisected

Loading, please wait...
Begin: Loading essential drivers... ...
[ 6.604300] fuse init (API version 7.9)
[ 6.625529] ACPI: SSDT CFFD0D0A, 08C4 (r1 HPQOEM CPU_TM2 1 MSFT 100000E)
[ 6.631954] BUG: unable to handle kernel NULL pointer dereference at 0000000000000858
[ 6.640583] IP: [<ffffffff8025e282>] debug_mutex_add_waiter+0x32/0x80
[ 6.640583] PGD 21a84f067 PUD 21ad55067 PMD 0
[ 6.642421] Oops: 0002 [1] SMP
[ 6.642421] CPU 2
[ 6.642421] Modules linked in: processor(+) fan thermal_sys fuse
[ 6.642421] Pid: 1259, comm: modprobe Not tainted 2.6.27-rc3 #26
[ 6.642421] RIP: 0010:[<ffffffff8025e282>] [<ffffffff8025e282>] debug_mutex_add_waiter+0x32/0x80
[ 6.642421] RSP: 0018:ffff88021a1a5998 EFLAGS: 00010002
[ 6.642421] RAX: 0000000000000000 RBX: ffff88021a1a59d8 RCX: 0000000000000000
[ 6.642421] RDX: 0000000000000001 RSI: ffff88021a1a59d8 RDI: ffffffffa0091a60
[ 6.642421] RBP: ffff88021a1a59b8 R08: ffffffff811deea0 R09: ffff8800a6fed000
[ 6.642421] R10: ffffffffa008f524 R11: 0000000000000002 R12: ffffffffa0091a60
[ 6.642421] R13: ffff88021a1a4000 R14: ffff88021a34c0a0 R15: ffffffffa0091a98
[ 6.642421] FS: 00007f2c513606e0(0000) GS:ffff88022fc02e00(0000) knlGS:0000000000000000
[ 6.642421] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 6.642421] CR2: 0000000000000858 CR3: 000000021a8f7000 CR4: 00000000000006e0
[ 6.642421] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 6.642421] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 6.642421] Process modprobe (pid: 1259, threadinfo ffff88021a1a4000, task ffff88021a34c0a0)
[ 6.642421] Stack: 0000000000000000 ffffffffa0091a60 0000000000000246 ffffffffa008f524
[ 6.642421] ffff88021a1a5a38 ffffffff8049f556 ffffffffa008f524 ffffffffa0091a18
[ 6.642421] ffff88021a1a59d8 ffff88021a1a59d8 1111111111111111 1111111111111111
[ 6.642421] Call Trace:
[ 6.642421] [<ffffffffa008f524>] ? get_idr+0x44/0xa0 [thermal_sys]
[ 6.642421] [<ffffffff8049f556>] mutex_lock_nested+0xa6/0x250
[ 6.642421] [<ffffffffa008f524>] ? get_idr+0x44/0xa0 [thermal_sys]
[ 6.642421] [<ffffffff80363584>] ? idr_pre_get+0x44/0x90
[ 6.642421] [<ffffffffa008f524>] get_idr+0x44/0xa0 [thermal_sys]
[ 6.642421] [<ffffffffa008fe43>] thermal_cooling_device_register+0x83/0x250 [thermal_sys]
[ 6.642421] [<ffffffffa019b2a3>] acpi_processor_start+0x64b/0x774 [processor]
[ 6.642421] [<ffffffff8031a90b>] ? __sysfs_add_one+0x6b/0xa0
[ 6.642421] [<ffffffff8031b9fc>] ? sysfs_do_create_link+0xbc/0x150
[ 6.642421] [<ffffffff803a7f1e>] acpi_start_single_object+0x2d/0x52
[ 6.642421] [<ffffffff803a9516>] acpi_device_probe+0x7e/0x92
[ 6.642421] [<ffffffff803dd3ab>] driver_probe_device+0x9b/0x1a0
[ 6.642421] [<ffffffff803dd536>] __driver_attach+0x86/0x90
[ 6.642421] [<ffffffff803dd4b0>] ? __driver_attach+0x0/0x90
[ 6.642421] [<ffffffff803dc8fd>] bus_for_each_dev+0x5d/0x90
[ 6.642421] [<ffffffff803dd1ec>] driver_attach+0x1c/0x20
[ 6.642421] [<ffffffff803dcf39>] bus_add_driver+0x1e9/0x260
[ 6.642421] [<ffffffffa0222000>] ? acpi_processor_init+0x0/0x107 [processor]
[ 6.642421] [<ffffffff803dd70f>] driver_register+0x5f/0x140
[ 6.642421] [<ffffffffa0222000>] ? acpi_processor_init+0x0/0x107 [processor]
[ 6.642421] [<ffffffff803a9826>] acpi_bus_register_driver+0x3e/0x40
[ 6.642421] [<ffffffffa0222094>] acpi_processor_init+0x94/0x107 [processor]
[ 6.642421] [<ffffffff80209040>] _stext+0x40/0x180
[ 6.642421] [<ffffffff802a88d1>] ? __vunmap+0xa1/0x110
[ 6.642421] [<ffffffff80267642>] sys_init_module+0x142/0x1dc0
[ 6.642421] [<ffffffff80367ad6>] ? __up_read+0x46/0xb0
[ 6.642421] [<ffffffff8048e530>] ? cpu_down+0x0/0x70
[ 6.642421] [<ffffffff8020c34b>] system_call_fastpath+0x16/0x1b
[ 6.642421]
[ 6.642421]
[ 6.642421] Code: 20 48 89 5d e8 4c 89 65 f0 48 89 f3 4c 89 6d f8 8b 47 08 49 89 d5 49 89 fc 89 c2 25 ff ff 00 00 c1 ea 10 39 c2 74 1d 49 8b 4
[ 6.652421] RIP [<ffffffff8025e282>] debug_mutex_add_waiter+0x32/0x80
[ 6.652421] RSP <ffff88021a1a5998>
[ 6.652421] CR2: 0000000000000858
[ 6.652421] ---[ end trace 53d26a9a6cd6aa38 ]---
[ 6.991546] ------------[ cut here ]------------
[ 6.996188] kernel BUG at kernel/sched.c:1155!
[ 7.005292] invalid opcode: 0000 [2] SMP
[ 7.005292] CPU 2
[ 7.005292] Modules linked in: processor(+) fan thermal_sys fuse
[ 7.011541] Pid: 1259, comm: modprobe Tainted: G D 2.6.27-rc3 #26
[ 7.011541] RIP: 0010:[<ffffffff8022cc2b>] [<ffffffff8022cc2b>] resched_task+0x6b/0x70
[ 7.011541] RSP: 0018:ffff88022f0efe98 EFLAGS: 00010046
[ 7.011541] RAX: 00000000000006ee RBX: ffff880028092e00 RCX: ffffffff81046000
[ 7.011541] RDX: 00000000000006ee RSI: ffff88021a34c0a0 RDI: ffffffff805ee660
[ 7.011541] RBP: ffff88022f0efe98 R08: 0000000000000000 R09: 0000000000000001
[ 7.011541] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88021a34c0a0
[ 7.011541] R13: 0000000000000001 R14: ffff880028092e98 R15: ffff88021a34c0d8
[ 7.011541] FS: 00007f2c513606e0(0000) GS:ffff88022fc02e00(0000) knlGS:0000000000000000
[ 7.011541] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 7.011541] CR2: 0000000000000858 CR3: 000000021a8f7000 CR4: 00000000000006e0
[ 7.011541] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 7.011541] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 7.011541] Process modprobe (pid: 1259, threadinfo ffff88021a1a4000, task ffff88021a34c0a0)
[ 7.011541] Stack: ffff88022f0efed8 ffffffff8023774f ffff88022f0efed8 ffff8800280b6e00
[ 7.011541] ffffffff80238510 ffff8800280b2b20 ffff8800280b2aa0 7fffffffffffffff
[ 7.011541] ffff88022f0efef8 ffffffff8023855d ffff8800280b2aa0 ffff8800280b7660
[ 7.011541] Call Trace:
[ 7.011541] <IRQ> [<ffffffff8023774f>] task_tick_fair+0xbf/0xd0
[ 7.011541] [<ffffffff80238510>] ? hrtick+0x0/0x90
[ 7.011541] [<ffffffff8023855d>] hrtick+0x4d/0x90
[ 7.011541] [<ffffffff80254f65>] __run_hrtimer+0x95/0xb0
[ 7.011541] [<ffffffff80255c4b>] hrtimer_interrupt+0x11b/0x190
[ 7.011541] [<ffffffff8021d643>] smp_apic_timer_interrupt+0x83/0xc0
[ 7.011541] [<ffffffff8020d0e6>] apic_timer_interrupt+0x66/0x70
[ 7.011541] <EOI> [<ffffffff804a12eb>] ? _spin_unlock_irq+0x2b/0x30
[ 7.011541] [<ffffffff804a0b75>] ? __down_read+0xa5/0xb7
[ 7.011541] [<ffffffff8026fad5>] ? acct_collect+0x45/0x1d0
[ 7.011541] [<ffffffff8049fb57>] ? down_read+0x37/0x40
[ 7.011541] [<ffffffff8026fad5>] ? acct_collect+0x45/0x1d0
[ 7.011541] [<ffffffff8026fad5>] ? acct_collect+0x45/0x1d0
[ 7.011541] [<ffffffff8023f27d>] ? do_exit+0x18d/0x9b0
[ 7.011541] [<ffffffff803c7d19>] ? do_unblank_screen+0x19/0x130
[ 7.011541] [<ffffffff804a1a17>] ? oops_end+0x87/0x90
[ 7.011541] [<ffffffff804a3cd3>] ? do_page_fault+0x663/0x800
[ 7.011541] [<ffffffff804a15ed>] ? error_exit+0x0/0x9a
[ 7.011541] [<ffffffffa008f524>] ? get_idr+0x44/0xa0 [thermal_sys]
[ 7.011541] [<ffffffff8025e282>] ? debug_mutex_add_waiter+0x32/0x80
[ 7.011541] [<ffffffffa008f524>] ? get_idr+0x44/0xa0 [thermal_sys]
[ 7.011541] [<ffffffff8049f556>] ? mutex_lock_nested+0xa6/0x250
[ 7.011541] [<ffffffffa008f524>] ? get_idr+0x44/0xa0 [thermal_sys]
[ 7.011541] [<ffffffff80363584>] ? idr_pre_get+0x44/0x90
[ 7.011541] [<ffffffffa008f524>] ? get_idr+0x44/0xa0 [thermal_sys]
[ 7.011541] [<ffffffffa008fe43>] ? thermal_cooling_device_register+0x83/0x250 [thermal_sys]
[ 7.011541] [<ffffffffa019b2a3>] ? acpi_processor_start+0x64b/0x774 [processor]
[ 7.011541] [<ffffffff8031a90b>] ? __sysfs_add_one+0x6b/0xa0
[ 7.011541] [<ffffffff8031b9fc>] ? sysfs_do_create_link+0xbc/0x150
[ 7.011541] [<ffffffff803a7f1e>] ? acpi_start_single_object+0x2d/0x52
[ 7.011541] [<ffffffff803a9516>] ? acpi_device_probe+0x7e/0x92
[ 7.011541] [<ffffffff803dd3ab>] ? driver_probe_device+0x9b/0x1a0
[ 7.011541] [<ffffffff803dd536>] ? __driver_attach+0x86/0x90
[ 7.011541] [<ffffffff803dd4b0>] ? __driver_attach+0x0/0x90
[ 7.011541] [<ffffffff803dc8fd>] ? bus_for_each_dev+0x5d/0x90
[ 7.011541] [<ffffffff803dd1ec>] ? driver_attach+0x1c/0x20
[ 7.011541] [<ffffffff803dcf39>] ? bus_add_driver+0x1e9/0x260
[ 7.011541] [<ffffffffa0222000>] ? acpi_processor_init+0x0/0x107 [processor]
[ 7.011541] [<ffffffff803dd70f>] ? driver_register+0x5f/0x140
[ 7.011541] [<ffffffffa0222000>] ? acpi_processor_init+0x0/0x107 [processor]
[ 7.011541] [<ffffffff803a9826>] ? acpi_bus_register_driver+0x3e/0x40
[ 7.011541] [<ffffffffa0222094>] ? acpi_processor_init+0x94/0x107 [processor]
[ 7.011541] [<ffffffff80209040>] ? _stext+0x40/0x180
[ 7.011541] [<ffffffff802a88d1>] ? __vunmap+0xa1/0x110
[ 7.011541] [<ffffffff80267642>] ? sys_init_module+0x142/0x1dc0
[ 7.011541] [<ffffffff80367ad6>] ? __up_read+0x46/0xb0
[ 7.011541] [<ffffffff8048e530>] ? cpu_down+0x0/0x70
[ 7.011541] [<ffffffff8020c34b>] ? system_call_fastpath+0x16/0x1b
[ 7.011541]
[ 7.011541]
[ 7.011541] Code: 8b 47 08 8b 50 1c 65 8b 04 25 24 00 00 00 39 c2 74 0d 0f ae f0 48 8b 47 08 f6 40 18 04 74 02 c9 c3 89 d7 ff 15 1f 7b 3c 00 c
[ 7.021541] RIP [<ffffffff8022cc2b>] resched_task+0x6b/0x70
[ 7.021541] RSP <ffff88022f0efe98>
[ 7.021541] ---[ end trace 53d26a9a6cd6aa38 ]---
[ 7.021541] Kernel panic - not syncing: Aiee, killing interrupt handler!
[ 7.021541] ------------[ cut here ]------------
[ 7.021541] WARNING: at kernel/smp.c:328 smp_call_function_mask+0x25a/0x260()
[ 7.021541] Modules linked in: processor(+) fan thermal_sys fuse
[ 7.021541] Pid: 1259, comm: modprobe Tainted: G D 2.6.27-rc3 #26
[ 7.021541]
[ 7.021541] Call Trace:
[ 7.021541] <IRQ> [<ffffffff8023bacf>] warn_on_slowpath+0x5f/0x80
[ 7.021541] [<ffffffff802650ca>] smp_call_function_mask+0x25a/0x260
[ 7.021541] [<ffffffff8036957d>] ? string+0x3d/0xd0
[ 7.021541] [<ffffffff80369a4b>] ? vsnprintf+0x43b/0x720
[ 7.021541] [<ffffffff8036957d>] ? string+0x3d/0xd0
[ 7.021541] [<ffffffff8036957d>] ? string+0x3d/0xd0
[ 7.021541] [<ffffffff80369a4b>] ? vsnprintf+0x43b/0x720
[ 7.021541] [<ffffffff80368d1e>] ? number+0x2ae/0x2d0
[ 7.021541] [<ffffffff80368d1e>] ? number+0x2ae/0x2d0
[ 7.021541] [<ffffffff80269e4d>] ? kallsyms_lookup+0x5d/0xa0
[ 7.021541] [<ffffffff80368d1e>] ? number+0x2ae/0x2d0
[ 7.021541] [<ffffffff80369a4b>] ? vsnprintf+0x43b/0x720
[ 7.021541] [<ffffffff80369d98>] ? sprintf+0x68/0x70
[ 7.021541] [<ffffffff8036957d>] ? string+0x3d/0xd0
[ 7.021541] [<ffffffff804a3f63>] ? __atomic_notifier_call_chain+0x83/0xa0
[ 7.021541] [<ffffffff804a3ee0>] ? __atomic_notifier_call_chain+0x0/0xa0
[ 7.021541] [<ffffffff804a0eb6>] ? _spin_unlock+0x26/0x30
[ 7.021541] [<ffffffff8021c470>] ? stop_this_cpu+0x0/0x30
[ 7.021541] [<ffffffff80265110>] smp_call_function+0x40/0x50
[ 7.021541] [<ffffffff8021c4f3>] native_smp_send_stop+0x23/0x40
[ 7.021541] [<ffffffff8023be1f>] panic+0xaf/0x190
[ 7.021541] [<ffffffff8023cc77>] ? printk+0x67/0x70
[ 7.021541] [<ffffffff8049f4a9>] ? mutex_unlock+0x9/0x10
[ 7.021541] [<ffffffff80256c91>] ? blocking_notifier_call_chain+0x11/0x20
[ 7.021541] [<ffffffff8023f9f9>] do_exit+0x909/0x9b0
[ 7.021541] [<ffffffff803c7d19>] ? do_unblank_screen+0x19/0x130
[ 7.021541] [<ffffffff804a1a17>] oops_end+0x87/0x90
[ 7.021541] [<ffffffff8020e08e>] die+0x5e/0x90
[ 7.021541] [<ffffffff804a1f20>] do_trap+0x130/0x150
[ 7.021541] [<ffffffff8020e662>] do_invalid_op+0x92/0xb0
[ 7.021541] [<ffffffff8022cc2b>] ? resched_task+0x6b/0x70
[ 7.021541] [<ffffffff8025788e>] ? sched_clock_cpu+0x14e/0x190
[ 7.021541] [<ffffffff804a15ed>] error_exit+0x0/0x9a
[ 7.021541] [<ffffffff8022cc2b>] ? resched_task+0x6b/0x70
[ 7.021541] [<ffffffff8023774f>] task_tick_fair+0xbf/0xd0
[ 7.021541] [<ffffffff80238510>] ? hrtick+0x0/0x90
[ 7.021541] [<ffffffff8023855d>] hrtick+0x4d/0x90
[ 7.021541] [<ffffffff80254f65>] __run_hrtimer+0x95/0xb0
[ 7.021541] [<ffffffff80255c4b>] hrtimer_interrupt+0x11b/0x190
[ 7.021541] [<ffffffff8021d643>] smp_apic_timer_interrupt+0x83/0xc0
[ 7.021541] [<ffffffff8020d0e6>] apic_timer_interrupt+0x66/0x70
[ 7.021541] <EOI> [<ffffffff804a12eb>] ? _spin_unlock_irq+0x2b/0x30
[ 7.021541] [<ffffffff804a0b75>] ? __down_read+0xa5/0xb7
[ 7.021541] [<ffffffff8026fad5>] ? acct_collect+0x45/0x1d0
[ 7.021541] [<ffffffff8049fb57>] ? down_read+0x37/0x40
[ 7.021541] [<ffffffff8026fad5>] ? acct_collect+0x45/0x1d0
[ 7.021541] [<ffffffff8026fad5>] ? acct_collect+0x45/0x1d0
[ 7.021541] [<ffffffff8023f27d>] ? do_exit+0x18d/0x9b0
[ 7.021541] [<ffffffff803c7d19>] ? do_unblank_screen+0x19/0x130
[ 7.021541] [<ffffffff804a1a17>] ? oops_end+0x87/0x90
[ 7.021541] [<ffffffff804a3cd3>] ? do_page_fault+0x663/0x800
[ 7.021541] [<ffffffff804a15ed>] ? error_exit+0x0/0x9a
[ 7.021541] [<ffffffffa008f524>] ? get_idr+0x44/0xa0 [thermal_sys]
[ 7.021541] [<ffffffff8025e282>] ? debug_mutex_add_waiter+0x32/0x80
[ 7.021541] [<ffffffffa008f524>] ? get_idr+0x44/0xa0 [thermal_sys]
[ 7.021541] [<ffffffff8049f556>] ? mutex_lock_nested+0xa6/0x250
[ 7.021541] [<ffffffffa008f524>] ? get_idr+0x44/0xa0 [thermal_sys]
[ 7.021541] [<ffffffff80363584>] ? idr_pre_get+0x44/0x90
[ 7.021541] [<ffffffffa008f524>] ? get_idr+0x44/0xa0 [thermal_sys]
[ 7.021541] [<ffffffffa008fe43>] ? thermal_cooling_device_register+0x83/0x250 [thermal_sys]
[ 7.021541] [<ffffffffa019b2a3>] ? acpi_processor_start+0x64b/0x774 [processor]
[ 7.021541] [<ffffffff8031a90b>] ? __sysfs_add_one+0x6b/0xa0
[ 7.021541] [<ffffffff8031b9fc>] ? sysfs_do_create_link+0xbc/0x150
[ 7.021541] [<ffffffff803a7f1e>] ? acpi_start_single_object+0x2d/0x52
[ 7.021541] [<ffffffff803a9516>] ? acpi_device_probe+0x7e/0x92
[ 7.021541] [<ffffffff803dd3ab>] ? driver_probe_device+0x9b/0x1a0
[ 7.021541] [<ffffffff803dd536>] ? __driver_attach+0x86/0x90
[ 7.021541] [<ffffffff803dd4b0>] ? __driver_attach+0x0/0x90
[ 7.021541] [<ffffffff803dc8fd>] ? bus_for_each_dev+0x5d/0x90
[ 7.021541] [<ffffffff803dd1ec>] ? driver_attach+0x1c/0x20
[ 7.021541] [<ffffffff803dcf39>] ? bus_add_driver+0x1e9/0x260
[ 7.021541] [<ffffffffa0222000>] ? acpi_processor_init+0x0/0x107 [processor]
[ 7.021541] [<ffffffff803dd70f>] ? driver_register+0x5f/0x140
[ 7.021541] [<ffffffffa0222000>] ? acpi_processor_init+0x0/0x107 [processor]
[ 7.021541] [<ffffffff803a9826>] ? acpi_bus_register_driver+0x3e/0x40
[ 7.021541] [<ffffffffa0222094>] ? acpi_processor_init+0x94/0x107 [processor]
[ 7.021541] [<ffffffff80209040>] ? _stext+0x40/0x180
[ 7.021541] [<ffffffff802a88d1>] ? __vunmap+0xa1/0x110
[ 7.021541] [<ffffffff80267642>] ? sys_init_module+0x142/0x1dc0
[ 7.021541] [<ffffffff80367ad6>] ? __up_read+0x46/0xb0
[ 7.021541] [<ffffffff8048e530>] ? cpu_down+0x0/0x70
[ 7.021541] [<ffffffff8020c34b>] ? system_call_fastpath+0x16/0x1b
[ 7.021541]
[ 7.021541] ---[ end trace 53d26a9a6cd6aa38 ]---
[ 7.990001] BUG: spinlock lockup on CPU#0, swapper/0, ffff8800280b6e00
[ 7.990001] Pid: 0, comm: swapper Tainted: G D W 2.6.27-rc3 #26
[ 7.990001]
[ 7.990001] Call Trace:
[ 7.990001] <IRQ> [<ffffffff8036ee4e>] _raw_spin_lock+0x18e/0x1a0
[ 7.990001] [<ffffffff804a0fc4>] _spin_lock+0x34/0x40
[ 7.990001] [<ffffffff80230ed6>] ? sched_rt_period_timer+0x126/0x1e0
[ 7.990001] [<ffffffff80230ed6>] sched_rt_period_timer+0x126/0x1e0
[ 7.990001] [<ffffffff80230db0>] ? sched_rt_period_timer+0x0/0x1e0
[ 7.990001] [<ffffffff80254f65>] __run_hrtimer+0x95/0xb0
[ 7.990001] [<ffffffff80255c4b>] hrtimer_interrupt+0x11b/0x190
[ 7.990001] [<ffffffff8021d643>] smp_apic_timer_interrupt+0x83/0xc0
[ 7.990001] [<ffffffff8020d0e6>] apic_timer_interrupt+0x66/0x70
[ 7.990001] <EOI> [<ffffffff802138a0>] ? mwait_idle+0x40/0x50
[ 7.990001] [<ffffffff8020a8d2>] ? enter_idle+0x22/0x30
[ 7.990001] [<ffffffff8020ae5c>] ? cpu_idle+0x4c/0xc0
[ 7.990001] [<ffffffff8048d7d1>] ? rest_init+0x61/0x70
[ 7.990001]

CTRL-A Z for help |115200 8N1 | NOR | Minicom 2.3-rc | VT102 | Online 00:03

Attachments:

2008-08-22 19:55:54

by Jeff King

Subject: Re: Linux 2.6.27-rc3: kernel BUG at mm/vmalloc.c - bisected

On Fri, Aug 22, 2008 at 09:37:30PM +0200, Björn Steinbrink wrote:

> Yep, and that's totally correct as far as bisect is concerned. The
> parents of that merge commit are:
> 88fa08f67bee1a0c765237bdac106a32872f57d2
> b1b135c8d619cb2c7045d6ee4e48375882518bb5
>
> And Alan marked both of them as good.
>
> So, unless Alan made a mistake during his bisection, each of the
> branches is correct, but the merge did not lead to a correct result. So
> while there were no textual conflicts, there were still incompatible
> changes regarding the code semantics and compatibility was not restored
> during the merge.

One thing that I have seen proposed (but never tried myself) is that you
can linearize the changes using "rebase -i" (or cherry-picking), and
then bisect that result. That is, given a history

A-B-C-D
\ /
E-F

where the merge "D" introduces the bug, you could try creating:

A-B-C-E'-F'

and bisecting that. And you should know that C is good from your
previous bisection, but that F' probably is not, since it should be
textually the same as D (unless, of course, you had textual conflicts
during the rebase that you fixed up differently).

So in essence you are testing each of E and F, but based on the other
work. So you should be able to find the one patch that causes the
conflict. And depending on the conflict, you may get more information by
doing it the other way. I.e.,:

A-E-F-B'-C'

-Peff

2008-08-22 20:17:29

by Alan D. Brunelle

Subject: Re: Linux 2.6.27-rc3: kernel BUG at mm/vmalloc.c - bisected

Alan D. Brunelle wrote:
> Bj?rn Steinbrink wrote:
>> On 2008.08.22 10:51:36 -0700, Andrew Morton wrote:
>>> On Fri, 22 Aug 2008 19:16:51 +0200 Petr Baudis <[email protected]> wrote:
>>>> On Fri, Aug 22, 2008 at 09:25:49AM -0700, Andrew Morton wrote:
>>>>> One (probably wrong) approach is to run
>>>>>
>>>>> gitk 1c89ac55017f982355c7761e1c912c88c941483d
>>>>>
>>>>> then peer at the output, work out which real commits were in that
>>>>> merge.
>>>>>
>>>>> It looks like the merge ended with
>>>>> b1b135c8d619cb2c7045d6ee4e48375882518bb5 and started with
>>>>> 40c42076ebd362dc69210cccea101ac80b6d4bd4, so perhaps you can do
>>>>>
>>>>> git bisect bad b1b135c8d619cb2c7045d6ee4e48375882518bb5
>>>>> git bisect good 40c42076ebd362dc69210cccea101ac80b6d4bd4
>>>> ...I don't quite get this - according to the bisection log,
>>>>
>>>> # good: [b1b135c8d619cb2c7045d6ee4e48375882518bb5] fix spinlock recursion in hvc_console
>>>>
>>>> and now you want to mark it as bad?
>>> <what bisection log?>
>> Alan provided his bisection log as an attachment to the original bug
>> report.
>>
>>> I assume that Alan's bisection search ended up saying that the merge
>>> commit (1c89ac55017f982355c7761e1c912c88c941483d) was the first bad
>>> commit.
>> Yep, and that's totally correct as far as bisect is concerned. The
>> parents of that merge commit are:
>> 88fa08f67bee1a0c765237bdac106a32872f57d2
>> b1b135c8d619cb2c7045d6ee4e48375882518bb5
>>
>> And Alan marked both of them as good.
>>
>> So, unless Alan made a mistake during his bisection, each of the
>> branches is correct, but the merge did not lead to a correct result. So
>> while there were no textual conflicts, there were still incompatible
>> changes regarding the code semantics and compatibility was not restored
>> during the merge.
>
> It's important to note that even if I did make a mistake during the
> bisection process (and I certainly wouldn't discount that), recent
> kernels still fail: but when I take out that commit from a recent
> kernel, it fails.

s/fails/succeeds/

>
> I put in Andrew's suggested patch (to help find things), and now I
> repeatedly get the problems in the attached log.
>
> Not being an x86 knowledgeable person, I'm a bit concerned about the RSP
> value?! (I enabled stack overflow checking, but that didn't stop things.)
>
> Alan
>

2008-08-22 21:05:44

by Junio C Hamano

Subject: Re: Linux 2.6.27-rc3: kernel BUG at mm/vmalloc.c - bisected

Andrew Morton <[email protected]> writes:

> On Fri, 22 Aug 2008 19:16:51 +0200
> Petr Baudis <[email protected]> wrote:
>
>> On Fri, Aug 22, 2008 at 09:25:49AM -0700, Andrew Morton wrote:
> ...
>> > urgh, it's irritating when git-bisect directs you to a merge commit - it
>> > hasn't done it for me for ages.
>>
>> Hmm, but doesn't that happen only when it's actually really the merge
>> commit that introduces the bug? Both parents of the merge commit were
>> marked as good by the user, so...
>
> A merge commit doesn't contain any kernel changes? It's the individual
> commits (aka "patches") which were in that merge which broke stuff.
> Confused.
>
> We're trying to dive inside that merge commit to find out which of the
> real commits caused the regression.

You may find neither parents were buggy, but the result of the merge is.

A trivial example is when one branch changes the semantics of an existing
function and converts all the call sites to the updated semantics, while
the other branch adds a new call site that still relies on the old
behaviour of that function. The merge most likely won't textually
conflict, and neither git merge nor quilt patch would report conflicts,
but the end result is that the new call site added by the latter branch
now gets an unexpected outcome from the function and can misbehave. You
cannot blame the breakage to either branch for such a breakage.

2008-08-22 21:17:43

by Andrew Morton

Subject: Re: Linux 2.6.27-rc3: kernel BUG at mm/vmalloc.c - bisected

On Fri, 22 Aug 2008 14:05:21 -0700
Junio C Hamano <[email protected]> wrote:

> Andrew Morton <[email protected]> writes:
>
> > On Fri, 22 Aug 2008 19:16:51 +0200
> > Petr Baudis <[email protected]> wrote:
> >
> >> On Fri, Aug 22, 2008 at 09:25:49AM -0700, Andrew Morton wrote:
> > ...
> >> > urgh, it's irritating when git-bisect directs you to a merge commit - it
> >> > hasn't done it for me for ages.
> >>
> >> Hmm, but doesn't that happen only when it's actually really the merge
> >> commit that introduces the bug? Both parents of the merge commit were
> >> marked as good by the user, so...
> >
> > A merge commit doesn't contain any kernel changes? It's the individual
> > commits (aka "patches") which were in that merge which broke stuff.
> > Confused.
> >
> > We're trying to dive inside that merge commit to find out which of the
> > real commits caused the regression.
>
> You may find neither parents were buggy, but the result of the merge is.
>
> A trivial example is when one branch changes the semantics of an existing
> function and converts all the call sites to the updated semantics, while
> the other branch adds a new call site that still relies on the old
> behaviour of that function. The merge most likely won't textually
> conflict, and neither git merge nor quilt patch would report conflicts,
> but the end result is that the new call site added by the latter branch
> now gets an unexpected outcome from the function and can misbehave. You
> cannot blame the breakage to either branch for such a breakage.

Sure, but

a) whoever added a change like that without also causing the build to
break is slappable and

b) there are now two commits (one in each branch) either one of
which, when applied on top of the other branch will introduce the
regression.

That's useful infomation, but we don't know how to get
git-bisect to give it to us.


It's pretty simple. If git-bisect tells us that the regression was
introduced by a merge commit, we want to perform a bisection within
that merge's individual commits.

2008-08-22 21:21:38

by Jeff King

Subject: Re: Linux 2.6.27-rc3: kernel BUG at mm/vmalloc.c - bisected

On Fri, Aug 22, 2008 at 02:16:51PM -0700, Andrew Morton wrote:

> Sure, but
>
> a) whoever added a change like that without also causing the build to
> break is slappable and

Well, the point is to find out _who_ to slap. ;)

> b) there are now two commits (one in each branch) either one of
> which, when applied on top of the other branch will introduce the
> regression.
>
> That's useful infomation, but we don't know how to get
> git-bisect to give it to us.
>
> It's pretty simple. If git-bisect tells us that the regression was
> introduced by a merge commit, we want to perform a bisection within
> that merge's individual commits.

I mentioned linearizing the two lines of development in another
message in this thread. But there are, of course, two linearizations,
neither of which might be possible to generate automatically, and one
might give you a better answer than the other.

-Peff

2008-08-22 21:36:47

by Björn Steinbrink

Subject: Re: Linux 2.6.27-rc3: kernel BUG at mm/vmalloc.c - bisected

On 2008.08.22 14:16:51 -0700, Andrew Morton wrote:
> It's pretty simple. If git-bisect tells us that the regression was
> introduced by a merge commit, we want to perform a bisection within
> that merge's individual commits.

bisect already did that. It asked for the left side and the right side,
both were good. What you can still do is creating a _new_ history where
the commits are not in parallel but linearized, like Jeff described. But
that's (in general) not a trivial task as you need to reapply individual
commit patches which can cause conflicts that were already solved in the
existing merges to show up again. Or, it can even produce new conflicts,
for example when a commit on one side was reverted before the merge
happened. In that case, you get into a state with changes that were
never visible before.

Bj?rn

2008-08-25 18:15:03

by Vegard Nossum

Subject: Re: Linux 2.6.27-rc3: kernel BUG at mm/vmalloc.c - bisected

On Tue, Aug 19, 2008 at 9:46 PM, Andrew Morton
<[email protected]> wrote:
> Thing is, the code *isn't* in an interrupt. Something got screwed up.
>
> What can happen is that some code has a lock imbalance or a
> preempt_disable imbalance and it does preempt_disable() so many times
> that the counter overflows eight bits and starts to increment the
> softirq counter, then the hardirq counter, then in_interrupt() starts
> incorrectly returning true then blam.

Hm.

Config doesn't even have CONFIG_PREEMPT, so preempt_disable() should be a no-op.


Vegard

--
"The animistic metaphor of the bug that maliciously sneaked in while
the programmer was not looking is intellectually dishonest as it
disguises that the error is the programmer's own creation."
-- E. W. Dijkstra, EWD1036