2017-12-23 08:01:58

by Jakub Kicinski

[permalink] [raw]
Subject: linux/master crashes on boot with KASAN=y

Hi!

I bisected a crash on boot to this:

commit 21506525fb8ddb0342f2a2370812d47f6a1f3833 (HEAD, refs/bisect/bad)
Author: Andy Lutomirski <[email protected]>
Date: Mon Dec 4 15:07:16 2017 +0100

x86/kasan/64: Teach KASAN about the cpu_entry_area

The cpu_entry_area will contain stacks. Make sure that KASAN has
appropriate shadow mappings for them.

Signed-off-by: Andy Lutomirski <[email protected]>
Signed-off-by: Andrey Ryabinin <[email protected]>
Signed-off-by: Thomas Gleixner <[email protected]>
...
Link: https://lkml.kernel.org/r/[email protected]
Signed-off-by: Ingo Molnar <[email protected]>

.config attached, this is the log:

[ 0.000000] Linux version 4.14.0-perf-00104-g21506525fb8d (gcc version 7.2.0
[ 0.000000] Command line: BOOT_IMAGE=/vmlinuz-4.14.0-perf-00104-g21506525fb8d root=UUID=e8eb0462-53ff-4222-ac86-620b37429da7 ro con
[ 0.000000] KERNEL supported cpus:
[ 0.000000] Intel GenuineIntel
[ 0.000000] AMD AuthenticAMD
[ 0.000000] Centaur CentaurHauls
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256
[ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format.
[ 0.000000] e820: BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009cfff] usable
[ 0.000000] BIOS-e820: [mem 0x000000000009d000-0x000000000009ffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007a288fff] usable
[ 0.000000] BIOS-e820: [mem 0x000000007a289000-0x000000007af0afff] reserved
[ 0.000000] BIOS-e820: [mem 0x000000007af0b000-0x000000007b93afff] ACPI NVS
[ 0.000000] BIOS-e820: [mem 0x000000007b93b000-0x000000007bab6fff] ACPI data
[ 0.000000] BIOS-e820: [mem 0x000000007bab7000-0x000000007bafffff] usable
[ 0.000000] BIOS-e820: [mem 0x000000007bb00000-0x000000008fffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000feda8000-0x00000000fedabfff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000ff310000-0x00000000ffffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable
[ 0.000000] NX (Execute Disable) protection: active
[ 0.000000] random: fast init done
[ 0.000000] SMBIOS 2.8 present.
[ 0.000000] DMI: Dell Inc. PowerEdge R730/072T6D, BIOS 2.3.4 11/08/2016
[ 0.000000] tsc: Fast TSC calibration using PIT
[ 0.000000] e820: last_pfn = 0x880000 max_arch_pfn = 0x400000000
[ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT
[ 0.000000] e820: last_pfn = 0x7bb00 max_arch_pfn = 0x400000000
[ 0.000000] Scanning 1 areas for low memory corruption
[ 0.000000] Using GB pages for direct mapping
[ 0.000000] RAMDISK: [mem 0x31276000-0x34932fff]
[ 0.000000] ACPI: Early table checksum verification disabled
[ 0.000000] ACPI: RSDP 0x00000000000FE320 000024 (v02 DELL )
[ 0.000000] ACPI: XSDT 0x000000007BAB50E8 0000C4 (v01 DELL PE_SC3 00000000 01000013)
[ 0.000000] ACPI: FACP 0x000000007BAB1000 0000F4 (v04 DELL PE_SC3 00000000 DELL 00000001)
[ 0.000000] ACPI: DSDT 0x000000007BA99000 010768 (v02 DELL PE_SC3 00000003 DELL 00000001)
[ 0.000000] ACPI: FACS 0x000000007B90B000 000040
[ 0.000000] ACPI: MCEJ 0x000000007BAB4000 000130 (v01 INTEL 00000001 INTL 0100000D)
[ 0.000000] ACPI: WD__ 0x000000007BAB3000 000134 (v01 DELL PE_SC3 00000001 DELL 00000001)
[ 0.000000] ACPI: SLIC 0x000000007BAB2000 000024 (v01 DELL PE_SC3 00000001 DELL 00000001)
[ 0.000000] ACPI: HPET 0x000000007BAB0000 000038 (v01 DELL PE_SC3 00000001 DELL 00000001)
[ 0.000000] ACPI: APIC 0x000000007BAAF000 000AFC (v02 DELL PE_SC3 00000000 DELL 00000001)
[ 0.000000] ACPI: MCFG 0x000000007BAAE000 00003C (v01 DELL PE_SC3 00000001 DELL 00000001)
[ 0.000000] ACPI: MSCT 0x000000007BAAD000 000090 (v01 DELL PE_SC3 00000001 DELL 00000001)
[ 0.000000] ACPI: SLIT 0x000000007BAAC000 00006C (v01 DELL PE_SC3 00000001 DELL 00000001)
[ 0.000000] ACPI: SRAT 0x000000007BAAA000 001130 (v03 DELL PE_SC3 00000001 DELL 00000001)
[ 0.000000] ACPI: SSDT 0x000000007B956000 1424A9 (v02 DELL PE_SC3 00004000 INTL 20121114)
[ 0.000000] ACPI: SSDT 0x000000007B953000 00217F (v02 DELL PE_SC3 00000002 INTL 20121114)
[ 0.000000] ACPI: SSDT 0x000000007B952000 00006E (v02 DELL PE_SC3 00000002 INTL 20121114)
[ 0.000000] ACPI: PRAD 0x000000007B951000 000132 (v02 DELL PE_SC3 00000002 INTL 20121114)
[ 0.000000] ACPI: SPCR 0x000000007B950000 000050 (v01 00000000 00000000)
[ 0.000000] ACPI: DMAR 0x000000007B94F000 000120 (v01 DELL PE_SC3 00000001 DELL 00000001)
[ 0.000000] ACPI: HEST 0x000000007B94E000 00017C (v01 DELL PE_SC3 00000002 DELL 00000001)
[ 0.000000] ACPI: BERT 0x000000007B94D000 000030 (v01 DELL PE_SC3 00000002 DELL 00000001)
[ 0.000000] ACPI: ERST 0x000000007B94C000 000230 (v01 DELL PE_SC3 00000002 DELL 00000001)
[ 0.000000] ACPI: EINJ 0x000000007B94B000 000150 (v01 DELL PE_SC3 00000002 DELL 00000001)
[ 0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[ 0.000000] SRAT: PXM 1 -> APIC 0x20 -> Node 1
[ 0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[ 0.000000] SRAT: PXM 1 -> APIC 0x22 -> Node 1
[ 0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[ 0.000000] SRAT: PXM 1 -> APIC 0x24 -> Node 1
[ 0.000000] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[ 0.000000] SRAT: PXM 1 -> APIC 0x26 -> Node 1
[ 0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0
[ 0.000000] SRAT: PXM 1 -> APIC 0x28 -> Node 1
[ 0.000000] SRAT: PXM 0 -> APIC 0x10 -> Node 0
[ 0.000000] SRAT: PXM 1 -> APIC 0x30 -> Node 1
[ 0.000000] SRAT: PXM 0 -> APIC 0x12 -> Node 0
[ 0.000000] SRAT: PXM 1 -> APIC 0x32 -> Node 1
[ 0.000000] SRAT: PXM 0 -> APIC 0x14 -> Node 0
[ 0.000000] SRAT: PXM 1 -> APIC 0x34 -> Node 1
[ 0.000000] SRAT: PXM 0 -> APIC 0x16 -> Node 0
[ 0.000000] SRAT: PXM 1 -> APIC 0x36 -> Node 1
[ 0.000000] SRAT: PXM 0 -> APIC 0x18 -> Node 0
[ 0.000000] SRAT: PXM 1 -> APIC 0x38 -> Node 1
[ 0.000000] ACPI: SRAT: Node 0 PXM 0 [mem 0x00000000-0x47fffffff]
[ 0.000000] ACPI: SRAT: Node 1 PXM 1 [mem 0x480000000-0x87fffffff]
[ 0.000000] NODE_DATA(0) allocated [mem 0x47fffc000-0x47fffffff]
[ 0.000000] NODE_DATA(1) allocated [mem 0x87fffb000-0x87fffefff]
[ 0.000000] Zone ranges:
[ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff]
[ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]
[ 0.000000] Normal [mem 0x0000000100000000-0x000000087fffffff]
[ 0.000000] Movable zone start for each node
[ 0.000000] Early memory node ranges
[ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009cfff]
[ 0.000000] node 0: [mem 0x0000000000100000-0x000000007a288fff]
[ 0.000000] node 0: [mem 0x000000007bab7000-0x000000007bafffff]
[ 0.000000] node 0: [mem 0x0000000100000000-0x000000047fffffff]
[ 0.000000] node 1: [mem 0x0000000480000000-0x000000087fffffff]
[ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000047fffffff]
[ 0.000000] Initmem setup node 1 [mem 0x0000000480000000-0x000000087fffffff]
[ 0.000000] kasan: KernelAddressSanitizer initialized
[ 0.000000] ACPI: PM-Timer IO Port: 0x408
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x08] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x09] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x10] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x11] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x12] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x13] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x14] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x15] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x16] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x17] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x18] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x19] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x20] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x21] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x22] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x23] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x24] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x25] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x26] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x27] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x28] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x29] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x30] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x31] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x32] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x33] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x34] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x35] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x36] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x37] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x38] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x39] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x40] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x41] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x42] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x43] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x44] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x45] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x46] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x47] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x48] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x49] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x50] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x51] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x52] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x53] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x54] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x55] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x56] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x57] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x58] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x59] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x60] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x61] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x62] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x63] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x64] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x65] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x66] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x67] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x68] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x69] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x70] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x71] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x72] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x73] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x74] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x75] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x76] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x77] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x78] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x79] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x80] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x81] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x82] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x83] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x84] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x85] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x86] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x87] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x88] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x89] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x90] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x91] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x92] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x93] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x94] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x95] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x96] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x97] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x98] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x99] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa0] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa1] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa2] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa3] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa4] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa5] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa6] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa7] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa8] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa9] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xaa] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xab] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xac] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xad] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xae] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xaf] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb0] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb1] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb2] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb3] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb4] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb5] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb6] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb7] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb8] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb9] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xba] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xbb] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xbc] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xbd] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xbe] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xbf] high level lint[0x1])
[ 0.000000] IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23
[ 0.000000] IOAPIC[1]: apic_id 9, version 32, address 0xfec01000, GSI 24-47
[ 0.000000] IOAPIC[2]: apic_id 10, version 32, address 0xfec40000, GSI 48-71
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[ 0.000000] Using ACPI (MADT) for SMP configuration information
[ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[ 0.000000] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later)
[ 0.000000] smpboot: Allowing 20 CPUs, 0 hotplug CPUs
[ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[ 0.000000] PM: Registered nosave memory: [mem 0x0009d000-0x0009ffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x7a289000-0x7af0afff]
[ 0.000000] PM: Registered nosave memory: [mem 0x7af0b000-0x7b93afff]
[ 0.000000] PM: Registered nosave memory: [mem 0x7b93b000-0x7bab6fff]
[ 0.000000] PM: Registered nosave memory: [mem 0x7bb00000-0x8fffffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfeda7fff]
[ 0.000000] PM: Registered nosave memory: [mem 0xfeda8000-0xfedabfff]
[ 0.000000] PM: Registered nosave memory: [mem 0xfedac000-0xff30ffff]
[ 0.000000] PM: Registered nosave memory: [mem 0xff310000-0xffffffff]
[ 0.000000] e820: [mem 0x90000000-0xfeda7fff] available for PCI devices
[ 0.000000] Booting paravirtualized kernel on bare hardware
[ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[ 0.000000] setup_percpu: NR_CPUS:256 nr_cpumask_bits:256 nr_cpu_ids:20 nr_node_ids:2
[ 0.000000] percpu: Embedded 47 pages/cpu @ffff8803ed800000 s152216 r8192 d32104 u524288
[ 0.000000] Built 2 zonelists, mobility grouping on. Total pages: 8233933
[ 0.000000] Policy zone: Normal
[ 0.000000] Kernel command line: BOOT_IMAGE=/vmlinuz-4.14.0-perf-00104-g21506525fb8d root=UUID=e8eb0462-53ff-4222-ac86-620b37429dan
[ 0.000000] DMAR: IOMMU enabled
[ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[ 0.000000] Memory: 28580668K/33458616K available (14243K kernel code, 4153K rwdata, 5120K rodata, 1744K init, 9092K bss, 4877948K)
[ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=20, Nodes=2
[ 0.000000] ftrace: allocating 32829 entries in 129 pages
[ 0.000000] Preemptible hierarchical RCU implementation.
[ 0.000000] RCU event tracing is enabled.
[ 0.000000] RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=20.
[ 0.000000] Tasks RCU enabled.
[ 0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=20
[ 0.000000] NR_IRQS: 16640, nr_irqs: 1400, preallocated irqs: 16
[ 0.000000] Console: colour VGA+ 80x25
[ 0.000000] console [tty0] enabled
[ 0.000000] console [ttyS0] enabled
[ 0.000000] mempolicy: Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[ 0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns
[ 0.000000] tsc: Fast TSC calibration using PIT
[ 0.004000] tsc: Detected 2199.972 MHz processor
[ 0.008000] Calibrating delay loop (skipped), value calculated using timer frequency.. 4399.94 BogoMIPS (lpj=8799888)
[ 0.012003] pid_max: default: 32768 minimum: 301
[ 0.016050] ACPI: Core revision 20170728
[ 4.714411] ACPI: 4 ACPI AML tables successfully acquired and loaded
[ 4.716162] Security Framework initialized
[ 4.720007] Yama: becoming mindful.
[ 4.724339] AppArmor: AppArmor initialized
[ 4.741032] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[ 4.752152] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[ 4.756209] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes)
[ 4.760170] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes)
[ 4.765020] CPU: Physical Processor ID: 0
[ 4.768004] CPU: Processor Core ID: 0
[ 4.772009] ENERGY_PERF_BIAS: Set to 'normal', was 'performance'
[ 4.776003] ENERGY_PERF_BIAS: View and update with x86_energy_perf_policy(8)
[ 4.780007] mce: CPU supports 22 MCE banks
[ 4.784035] CPU0: Thermal monitoring enabled (TM1)
[ 4.788022] process: using mwait in idle threads
[ 4.792005] Last level iTLB entries: 4KB 128, 2MB 8, 4MB 8
[ 4.796003] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4
[ 4.804513] Freeing SMP alternatives memory: 32K
[ 4.812073] smpboot: Max logical packages: 2
[ 4.816015] DMAR: Host address width 46
[ 4.820004] DMAR: DRHD base: 0x000000fbffc000 flags: 0x0
[ 4.824073] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020df
[ 4.828004] DMAR: DRHD base: 0x000000c7ffc000 flags: 0x1
[ 4.832061] DMAR: dmar1: reg_base_addr c7ffc000 ver 1:0 cap 8d2078c106f0466 ecap f020df
[ 4.836004] DMAR: RMRR base: 0x0000007ae07000 end: 0x0000007af06fff
[ 4.840027] DMAR: ATSR flags: 0x0
[ 4.844019] DMAR: ATSR flags: 0x0
[ 4.848021] DMAR-IR: IOAPIC id 10 under DRHD base 0xfbffc000 IOMMU 0
[ 4.852005] DMAR-IR: IOAPIC id 8 under DRHD base 0xc7ffc000 IOMMU 1
[ 4.856004] DMAR-IR: IOAPIC id 9 under DRHD base 0xc7ffc000 IOMMU 1
[ 4.860004] DMAR-IR: HPET id 0 under DRHD base 0xc7ffc000
[ 4.864004] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit.
[ 4.864005] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting.
[ 4.876022] DMAR-IR: Enabled IRQ remapping in xapic mode
[ 4.880000] x2apic: IRQ remapping doesn't support X2APIC mode
[ 4.880004] Switched APIC routing to physical flat.
[ 4.885531] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[ 4.928000] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2630 v4 @ 2.20GHz (family: 0x6, model: 0x4f, stepping: 0x1)
[ 4.948042] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver.
[ 4.952027] ... version: 3
[ 4.956006] ... bit width: 48
[ 4.960002] ... generic registers: 8
[ 4.964002] ... value mask: 0000ffffffffffff
[ 4.968002] ... max period: 00007fffffffffff
[ 4.972002] ... fixed-purpose events: 3
[ 4.976002] ... event mask: 00000007000000ff
[ 4.988005] Hierarchical SRCU implementation.
[ 5.009477] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter.
[ 5.020004] smp: Bringing up secondary CPUs ...
[ 5.056094] x86: Booting SMP configuration:
[ 5.060009] .... node #1, CPUs: #1
[ 5.180004] .... node #0, CPUs: #2
[ 5.216004] .... node #1, CPUs: #3
[ 5.252004] .... node #0, CPUs: #4
[ 5.288004] .... node #1, CPUs: #5
[ 5.324004] .... node #0, CPUs: #6
[ 5.360004] .... node #1, CPUs: #7
[ 5.396004] .... node #0, CPUs: #8
[ 5.432005] .... node #1, CPUs: #9
[ 5.468004] .... node #0, CPUs: #10
[ 5.504005] .... node #1, CPUs: #11
[ 5.540004] .... node #0, CPUs: #12
[ 5.576004] .... node #1, CPUs: #13
[ 5.612004] .... node #0, CPUs: #14
[ 5.648004] .... node #1, CPUs: #15
[ 5.684004] .... node #0, CPUs: #16
[ 5.720005] .... node #1, CPUs: #17
[ 5.756004] .... node #0, CPUs: #18
[ 5.792005] .... node #1, CPUs: #19
[ 5.793122] smp: Brought up 2 nodes, 20 CPUs
[ 5.800006] smpboot: Total of 20 processors activated (87998.16 BogoMIPS)
[ 5.813883] devtmpfs: initialized
[ 5.816522] x86/mm: Memory block size: 128MB
[ 5.859046] evm: security.selinux
[ 5.860004] evm: security.SMACK64
[ 5.864002] evm: security.SMACK64EXEC
[ 5.868002] evm: security.SMACK64TRANSMUTE
[ 5.872002] evm: security.SMACK64MMAP
[ 5.876002] evm: security.ima
[ 5.880002] evm: security.capability
[ 5.884098] PM: Registering ACPI NVS region [mem 0x7af0b000-0x7b93afff] (10682368 bytes)
[ 5.901374] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[ 5.904119] futex hash table entries: 8192 (order: 7, 524288 bytes)
[ 5.912102] pinctrl core: initialized pinctrl subsystem
[ 5.917054] NET: Registered protocol family 16
[ 5.921938] cpuidle: using governor ladder
[ 5.924016] cpuidle: using governor menu
[ 5.928218] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[ 5.932004] ACPI: bus type PCI registered
[ 5.936003] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[ 5.944437] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
[ 5.948042] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820
[ 5.952064] PCI: Using configuration type 1 for base access
[ 5.956038] PCI: Dell System detected, enabling pci=bfsort.
[ 5.984520] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
[ 5.988062] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[ 5.992514] ACPI: Added _OSI(Module Device)
[ 5.996139] ACPI: Added _OSI(Processor Device)
[ 6.000003] ACPI: Added _OSI(3.0 _SCP Extensions)
[ 6.004003] ACPI: Added _OSI(Processor Aggregator Device)
[ 15.293962] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[ 15.615248] ACPI: Interpreter enabled
[ 15.620130] ACPI: (supports S0 S5)
[ 15.624003] ACPI: Using IOAPIC for interrupt routing
[ 15.628733] HEST: Table parsing has been initialized.
[ 15.636007] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[ 15.653355] ACPI: Enabled 2 GPEs in block 00 to 3F
[ 16.049131] ACPI: PCI Root Bridge [UNC1] (domain 0000 [bus ff])
[ 16.056037] acpi PNP0A03:02: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[ 16.069796] acpi PNP0A03:02: PCIe AER handled by firmware
[ 16.085525] acpi PNP0A03:02: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[ 16.092004] acpi PNP0A03:02: FADT indicates ASPM is unsupported, using BIOS configuration
[ 16.104212] PCI host bridge to bus 0000:ff
[ 16.108016] pci_bus 0000:ff: root bus resource [bus ff]
[ 16.148481] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus 7f])
[ 16.156037] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[ 16.169839] acpi PNP0A03:03: PCIe AER handled by firmware
[ 16.187007] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[ 16.196004] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration
[ 16.205100] PCI host bridge to bus 0000:7f
[ 16.212006] pci_bus 0000:7f: root bus resource [bus 7f]
[ 16.272600] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
[ 16.280038] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[ 16.293168] acpi PNP0A08:00: PCIe AER handled by firmware
[ 16.308355] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[ 16.316004] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[ 16.336027] PCI host bridge to bus 0000:00
[ 16.340015] pci_bus 0000:00: root bus resource [io 0x0000-0x03bb window]
[ 16.348014] pci_bus 0000:00: root bus resource [io 0x03bc-0x03df window]
[ 16.356014] pci_bus 0000:00: root bus resource [io 0x03e0-0x0cf7 window]
[ 16.364014] pci_bus 0000:00: root bus resource [io 0x1000-0x7fff window]
[ 16.372014] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[ 16.380014] pci_bus 0000:00: root bus resource [mem 0x90000000-0xc7ffbfff window]
[ 16.388014] pci_bus 0000:00: root bus resource [mem 0x38000000000-0x3bfffffffff window]
[ 16.396004] pci_bus 0000:00: root bus resource [bus 00-7e]
[ 16.469435] pci 0000:00:1c.0: Enabling MPC IRBNCE
[ 16.476006] pci 0000:00:1c.0: Intel PCH root port ACS workaround enabled
[ 16.486199] pci 0000:00:1c.7: Enabling MPC IRBNCE
[ 16.492006] pci 0000:00:1c.7: Intel PCH root port ACS workaround enabled
[ 16.513450] pci 0000:00:01.0: PCI bridge to [bus 03]
[ 16.521472] pci 0000:04:00.0: VF(n) BAR0 space: [mem 0x00000000-0x001fffff 64bit] (contains BAR0 for 64 VFs)
[ 16.532015] pci 0000:04:00.0: VF(n) BAR2 space: [mem 0x00000000-0x03ffffff 64bit] (contains BAR2 for 64 VFs)
[ 16.556020] pci 0000:00:02.0: PCI bridge to [bus 04]
[ 16.588025] pci 0000:00:03.0: PCI bridge to [bus 02]
[ 16.616024] pci 0000:00:03.1: PCI bridge to [bus 01]
[ 16.622127] pci 0000:05:00.0: VF(n) BAR0 space: [mem 0x00000000-0x001fffff 64bit] (contains BAR0 for 64 VFs)
[ 16.636016] pci 0000:05:00.0: VF(n) BAR2 space: [mem 0x00000000-0x03ffffff 64bit] (contains BAR2 for 64 VFs)
[ 16.660018] pci 0000:00:03.2: PCI bridge to [bus 05]
[ 16.664243] pci 0000:00:1c.0: PCI bridge to [bus 06]
[ 16.692139] pci 0000:00:1c.7: PCI bridge to [bus 07-0b]
[ 16.708478] pci 0000:07:00.0: PCI bridge to [bus 08-0b]
[ 16.723570] pci 0000:08:00.0: PCI bridge to [bus 09-0a]
[ 16.739207] pci 0000:09:00.0: PCI bridge to [bus 0a]
[ 16.753467] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 9 10 11 12 14 *15)
[ 16.762187] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 9 10 11 12 *14 15)
[ 16.784339] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 7 9 10 *11 12 14 15)
[ 16.794209] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 *6 7 9 10 11 12 14 15)
[ 16.805159] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled.
[ 16.816823] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled.
[ 16.828486] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled.
[ 16.840144] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled.
[ 16.858104] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
[ 16.864038] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[ 16.879129] acpi PNP0A08:01: PCIe AER handled by firmware
[ 16.894980] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[ 16.904005] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[ 16.920142] PCI host bridge to bus 0000:80
[ 16.924015] pci_bus 0000:80: root bus resource [io 0x8000-0xffff window]
[ 16.932014] pci_bus 0000:80: root bus resource [mem 0xc8000000-0xfbffbfff window]
[ 16.940015] pci_bus 0000:80: root bus resource [mem 0x3c000000000-0x3ffffffffff window]
[ 16.948004] pci_bus 0000:80: root bus resource [bus 80-fe]
[ 16.988878] pci 0000:80:01.0: PCI bridge to [bus 81]
[ 16.997024] pci 0000:82:00.0: VF(n) BAR0 space: [mem 0x00000000-0x001fffff 64bit] (contains BAR0 for 64 VFs)
[ 17.008015] pci 0000:82:00.0: VF(n) BAR2 space: [mem 0x00000000-0x03ffffff 64bit] (contains BAR2 for 64 VFs)
[ 17.032020] pci 0000:80:02.0: PCI bridge to [bus 82]
[ 17.036604] pci 0000:80:03.0: PCI bridge to [bus 83]
[ 17.044156] pci 0000:80:03.2: PCI bridge to [bus 84]
[ 17.052222] pci 0000:0a:00.0: vgaarb: setting as boot VGA device
[ 17.056000] pci 0000:0a:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[ 17.068009] pci 0000:0a:00.0: vgaarb: bridge control possible
[ 17.076002] vgaarb: loaded
[ 17.080681] SCSI subsystem initialized
[ 17.084324] ACPI: bus type USB registered
[ 17.088172] usbcore: registered new interface driver usbfs
[ 17.096103] usbcore: registered new interface driver hub
[ 17.100132] usbcore: registered new device driver usb
[ 17.108321] pps_core: LinuxPPS API ver. 1 registered
[ 17.112003] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <[email protected]>
[ 17.124043] PTP clock support registered
[ 17.128085] EDAC MC: Ver: 3.0.0
[ 17.132879] PCI: Using ACPI for IRQ routing
[ 17.146756] NetLabel: Initializing
[ 17.152004] NetLabel: domain hash size = 128
[ 17.156003] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO
[ 17.160174] NetLabel: unlabeled traffic allowed by default
[ 17.168099] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[ 17.176004] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[ 17.184100] clocksource: Switched to clocksource hpet
[ 17.250559] VFS: Disk quotas dquot_6.6.0
[ 17.255110] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 17.263884] AppArmor: AppArmor Filesystem Enabled
[ 17.269346] pnp: PnP ACPI init
[ 17.287150] system 00:01: [io 0x0500-0x053f] has been reserved
[ 17.293893] system 00:01: [io 0x0400-0x047f] has been reserved
[ 17.300634] system 00:01: [io 0x0540-0x057f] has been reserved
[ 17.307372] system 00:01: [io 0x0600-0x061f] has been reserved
[ 17.314113] system 00:01: [io 0x0ca0-0x0ca5] has been reserved
[ 17.320853] system 00:01: [io 0x0880-0x0883] has been reserved
[ 17.327591] system 00:01: [io 0x0800-0x081f] has been reserved
[ 17.334340] system 00:01: [mem 0xfeda8000-0xfedcbfff] could not be reserved
[ 17.342257] system 00:01: [mem 0xff000000-0xffffffff] could not be reserved
[ 17.350163] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved
[ 17.357680] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved
[ 17.365199] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved
[ 17.372716] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved
[ 17.391538] system 00:04: [io 0x0ca8] has been reserved
[ 17.397600] system 00:04: [io 0x0cac] has been reserved
[ 17.406281] pnp: PnP ACPI: found 5 devices
[ 17.428885] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[ 17.438936] pci 0000:04:00.0: can't claim BAR 6 [mem 0xff000000-0xffffffff pref]: no compatible bridge window
[ 17.450146] pci 0000:02:00.0: can't claim BAR 6 [mem 0xfffc0000-0xffffffff pref]: no compatible bridge window
[ 17.461355] pci 0000:02:00.1: can't claim BAR 6 [mem 0xfffc0000-0xffffffff pref]: no compatible bridge window
[ 17.472564] pci 0000:01:00.0: can't claim BAR 6 [mem 0xfffc0000-0xffffffff pref]: no compatible bridge window
[ 17.483771] pci 0000:01:00.1: can't claim BAR 6 [mem 0xfffc0000-0xffffffff pref]: no compatible bridge window
[ 17.495070] pci 0000:05:00.0: can't claim BAR 6 [mem 0xff000000-0xffffffff pref]: no compatible bridge window
[ 17.506277] pci 0000:82:00.0: can't claim BAR 6 [mem 0xff000000-0xffffffff pref]: no compatible bridge window
[ 17.518351] pci 0000:00:02.0: BAR 14: assigned [mem 0xaf000000-0xb4ffffff]
[ 17.526141] pci 0000:00:03.2: BAR 14: assigned [mem 0xb5000000-0xbaffffff]
[ 17.533928] pci 0000:00:03.0: BAR 14: assigned [mem 0x9d000000-0x9d0fffff]
[ 17.541714] pci 0000:00:03.1: BAR 14: assigned [mem 0x9d100000-0x9d1fffff]
[ 17.549514] pci 0000:00:01.0: PCI bridge to [bus 03]
[ 17.555187] pci 0000:04:00.0: BAR 6: assigned [mem 0xaf000000-0xafffffff pref]
[ 17.563387] pci 0000:04:00.0: BAR 9: assigned [mem 0xb0000000-0xb3ffffff 64bit]
[ 17.571684] pci 0000:04:00.0: BAR 7: assigned [mem 0xb4000000-0xb41fffff 64bit]
[ 17.579988] pci 0000:00:02.0: PCI bridge to [bus 04]
[ 17.585637] pci 0000:00:02.0: bridge window [mem 0xaf000000-0xb4ffffff]
[ 17.593326] pci 0000:00:02.0: bridge window [mem 0x90000000-0x9cffffff 64bit pref]
[ 17.602121] pci 0000:02:00.0: BAR 6: assigned [mem 0x9d000000-0x9d03ffff pref]
[ 17.610318] pci 0000:02:00.1: BAR 6: assigned [mem 0x9d040000-0x9d07ffff pref]
[ 17.618521] pci 0000:00:03.0: PCI bridge to [bus 02]
[ 17.624169] pci 0000:00:03.0: bridge window [mem 0x9d000000-0x9d0fffff]
[ 17.631858] pci 0000:00:03.0: bridge window [mem 0xaea00000-0xaeafffff 64bit pref]
[ 17.640653] pci 0000:01:00.0: BAR 6: assigned [mem 0x9d100000-0x9d13ffff pref]
[ 17.648848] pci 0000:01:00.1: BAR 6: assigned [mem 0x9d140000-0x9d17ffff pref]
[ 17.657053] pci 0000:00:03.1: PCI bridge to [bus 01]
[ 17.662709] pci 0000:00:03.1: bridge window [mem 0x9d100000-0x9d1fffff]
[ 17.670399] pci 0000:00:03.1: bridge window [mem 0xaeb00000-0xaebfffff 64bit pref]
[ 17.679201] pci 0000:05:00.0: BAR 6: assigned [mem 0xb5000000-0xb5ffffff pref]
[ 17.687396] pci 0000:05:00.0: BAR 9: assigned [mem 0xb6000000-0xb9ffffff 64bit]
[ 17.695692] pci 0000:05:00.0: BAR 7: assigned [mem 0xba000000-0xba1fffff 64bit]
[ 17.703998] pci 0000:00:03.2: PCI bridge to [bus 05]
[ 17.709646] pci 0000:00:03.2: bridge window [mem 0xb5000000-0xbaffffff]
[ 17.717335] pci 0000:00:03.2: bridge window [mem 0xa0000000-0xacffffff 64bit pref]
[ 17.726116] pci 0000:00:1c.0: PCI bridge to [bus 06]
[ 17.731771] pci 0000:09:00.0: PCI bridge to [bus 0a]
[ 17.737565] pci 0000:09:00.0: bridge window [mem 0xae000000-0xae8fffff]
[ 17.745340] pci 0000:09:00.0: bridge window [mem 0xad000000-0xadffffff 64bit pref]
[ 17.754315] pci 0000:08:00.0: PCI bridge to [bus 09-0a]
[ 17.760400] pci 0000:08:00.0: bridge window [mem 0xae000000-0xae8fffff]
[ 17.768184] pci 0000:08:00.0: bridge window [mem 0xad000000-0xadffffff 64bit pref]
[ 17.777158] pci 0000:07:00.0: PCI bridge to [bus 08-0b]
[ 17.783217] pci 0000:07:00.0: bridge window [mem 0xae000000-0xae9fffff]
[ 17.791001] pci 0000:07:00.0: bridge window [mem 0xad000000-0xadffffff 64bit pref]
[ 17.799999] pci 0000:00:1c.7: PCI bridge to [bus 07-0b]
[ 17.805936] pci 0000:00:1c.7: bridge window [mem 0xae000000-0xae9fffff]
[ 17.813626] pci 0000:00:1c.7: bridge window [mem 0xad000000-0xadffffff 64bit pref]
[ 17.824584] pci 0000:80:02.0: BAR 14: assigned [mem 0xd6000000-0xdbffffff]
[ 17.832375] pci 0000:80:01.0: PCI bridge to [bus 81]
[ 17.838051] pci 0000:82:00.0: BAR 6: assigned [mem 0xd6000000-0xd6ffffff pref]
[ 17.846250] pci 0000:82:00.0: BAR 9: assigned [mem 0xd7000000-0xdaffffff 64bit]
[ 17.854546] pci 0000:82:00.0: BAR 7: assigned [mem 0xdb000000-0xdb1fffff 64bit]
[ 17.862851] pci 0000:80:02.0: PCI bridge to [bus 82]
[ 17.868499] pci 0000:80:02.0: bridge window [mem 0xd6000000-0xdbffffff]
[ 17.876189] pci 0000:80:02.0: bridge window [mem 0xc8000000-0xd4ffffff 64bit pref]
[ 17.884968] pci 0000:80:03.0: PCI bridge to [bus 83]
[ 17.890618] pci 0000:80:03.2: PCI bridge to [bus 84]
[ 17.896909] NET: Registered protocol family 2
[ 17.903154] TCP established hash table entries: 262144 (order: 9, 2097152 bytes)
[ 17.913490] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[ 17.921560] TCP: Hash tables configured (established 262144 bind 65536)
[ 17.929690] UDP hash table entries: 16384 (order: 7, 524288 bytes)
[ 17.937153] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes)
[ 17.945658] NET: Registered protocol family 1
[ 17.984056] pci 0000:0a:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[ 17.994619] Trying to unpack rootfs image as initramfs...
[ 20.061436] Freeing initrd memory: 56052K
[ 20.068062] DMAR: dmar0: Using Queued invalidation
[ 20.083611] DMAR: dmar1: Using Queued invalidation
[ 20.089108] DMAR: Setting RMRR:
[ 20.094960] DMAR: Setting identity map for device 0000:00:1a.0 [0x7ae07000 - 0x7af06fff]
[ 20.106241] DMAR: Setting identity map for device 0000:00:1d.0 [0x7ae07000 - 0x7af06fff]
[ 20.115424] DMAR: Prepare 0-16MiB unity mapping for LPC
[ 20.123424] DMAR: Setting identity map for device 0000:00:1f.0 [0x0 - 0xffffff]
[ 20.131720] DMAR: Intel(R) Virtualization Technology for Directed I/O
[ 20.139500] iommu: Adding device 0000:00:00.0 to group 0
[ 20.145679] iommu: Adding device 0000:00:01.0 to group 1
[ 20.151854] iommu: Adding device 0000:00:02.0 to group 2
[ 20.158042] iommu: Adding device 0000:00:03.0 to group 3
[ 20.164226] iommu: Adding device 0000:00:03.1 to group 4
[ 20.170412] iommu: Adding device 0000:00:03.2 to group 5
[ 20.176752] iommu: Adding device 0000:00:05.0 to group 6
[ 20.182882] iommu: Adding device 0000:00:05.1 to group 6
[ 20.189011] iommu: Adding device 0000:00:05.2 to group 6
[ 20.195130] iommu: Adding device 0000:00:05.4 to group 6
[ 20.201387] iommu: Adding device 0000:00:11.0 to group 7
[ 20.207517] iommu: Adding device 0000:00:11.4 to group 7
[ 20.213769] iommu: Adding device 0000:00:16.0 to group 8
[ 20.219900] iommu: Adding device 0000:00:16.1 to group 8
[ 20.226074] iommu: Adding device 0000:00:1a.0 to group 9
[ 20.232250] iommu: Adding device 0000:00:1c.0 to group 10
[ 20.238530] iommu: Adding device 0000:00:1c.7 to group 11
[ 20.244802] iommu: Adding device 0000:00:1d.0 to group 12
[ 20.251153] iommu: Adding device 0000:00:1f.0 to group 13
[ 20.257388] iommu: Adding device 0000:00:1f.2 to group 13
[ 20.263748] iommu: Adding device 0000:01:00.0 to group 14
[ 20.269985] iommu: Adding device 0000:01:00.1 to group 14
[ 20.276345] iommu: Adding device 0000:02:00.0 to group 15
[ 20.282582] iommu: Adding device 0000:02:00.1 to group 15
[ 20.288856] iommu: Adding device 0000:04:00.0 to group 16
[ 20.295130] iommu: Adding device 0000:05:00.0 to group 17
[ 20.301409] iommu: Adding device 0000:07:00.0 to group 18
[ 20.307679] iommu: Adding device 0000:08:00.0 to group 19
[ 20.313976] iommu: Adding device 0000:09:00.0 to group 19
[ 20.320157] iommu: Adding device 0000:0a:00.0 to group 19
[ 20.326553] iommu: Adding device 0000:7f:08.0 to group 20
[ 20.332784] iommu: Adding device 0000:7f:08.2 to group 20
[ 20.339014] iommu: Adding device 0000:7f:08.3 to group 20
[ 20.345409] iommu: Adding device 0000:7f:09.0 to group 21
[ 20.351647] iommu: Adding device 0000:7f:09.2 to group 21
[ 20.357878] iommu: Adding device 0000:7f:09.3 to group 21
[ 20.364315] iommu: Adding device 0000:7f:0b.0 to group 22
[ 20.370547] iommu: Adding device 0000:7f:0b.1 to group 22
[ 20.376783] iommu: Adding device 0000:7f:0b.2 to group 22
[ 20.383014] iommu: Adding device 0000:7f:0b.3 to group 22
[ 20.389621] iommu: Adding device 0000:7f:0c.0 to group 23
[ 20.395854] iommu: Adding device 0000:7f:0c.1 to group 23
[ 20.402087] iommu: Adding device 0000:7f:0c.2 to group 23
[ 20.408326] iommu: Adding device 0000:7f:0c.3 to group 23
[ 20.414559] iommu: Adding device 0000:7f:0c.4 to group 23
[ 20.420791] iommu: Adding device 0000:7f:0c.5 to group 23
[ 20.427024] iommu: Adding device 0000:7f:0c.6 to group 23
[ 20.433256] iommu: Adding device 0000:7f:0c.7 to group 23
[ 20.439612] iommu: Adding device 0000:7f:0d.0 to group 24
[ 20.445847] iommu: Adding device 0000:7f:0d.1 to group 24
[ 20.452331] iommu: Adding device 0000:7f:0f.0 to group 25
[ 20.458566] iommu: Adding device 0000:7f:0f.1 to group 25
[ 20.464798] iommu: Adding device 0000:7f:0f.4 to group 25
[ 20.471039] iommu: Adding device 0000:7f:0f.5 to group 25
[ 20.477275] iommu: Adding device 0000:7f:0f.6 to group 25
[ 20.483752] iommu: Adding device 0000:7f:10.0 to group 26
[ 20.489989] iommu: Adding device 0000:7f:10.1 to group 26
[ 20.496226] iommu: Adding device 0000:7f:10.5 to group 26
[ 20.502463] iommu: Adding device 0000:7f:10.6 to group 26
[ 20.508700] iommu: Adding device 0000:7f:10.7 to group 26
[ 20.515094] iommu: Adding device 0000:7f:12.0 to group 27
[ 20.521337] iommu: Adding device 0000:7f:12.1 to group 27
[ 20.527575] iommu: Adding device 0000:7f:12.2 to group 27
[ 20.534460] iommu: Adding device 0000:7f:13.0 to group 28
[ 20.540746] iommu: Adding device 0000:7f:13.1 to group 28
[ 20.547018] iommu: Adding device 0000:7f:13.2 to group 28
[ 20.553288] iommu: Adding device 0000:7f:13.3 to group 28
[ 20.559574] iommu: Adding device 0000:7f:13.4 to group 28
[ 20.565845] iommu: Adding device 0000:7f:13.5 to group 28
[ 20.572128] iommu: Adding device 0000:7f:13.6 to group 28
[ 20.578406] iommu: Adding device 0000:7f:13.7 to group 28
[ 20.585011] iommu: Adding device 0000:7f:14.0 to group 29
[ 20.591253] iommu: Adding device 0000:7f:14.1 to group 29
[ 20.597494] iommu: Adding device 0000:7f:14.2 to group 29
[ 20.603734] iommu: Adding device 0000:7f:14.3 to group 29
[ 20.609974] iommu: Adding device 0000:7f:14.4 to group 29
[ 20.616215] iommu: Adding device 0000:7f:14.5 to group 29
[ 20.622454] iommu: Adding device 0000:7f:14.6 to group 29
[ 20.628694] iommu: Adding device 0000:7f:14.7 to group 29
[ 20.635139] iommu: Adding device 0000:7f:15.0 to group 30
[ 20.641448] iommu: Adding device 0000:7f:15.1 to group 30
[ 20.647692] iommu: Adding device 0000:7f:15.2 to group 30
[ 20.653932] iommu: Adding device 0000:7f:15.3 to group 30
[ 20.660327] iommu: Adding device 0000:7f:16.0 to group 31
[ 20.666570] iommu: Adding device 0000:7f:16.6 to group 31
[ 20.672813] iommu: Adding device 0000:7f:16.7 to group 31
[ 20.679291] iommu: Adding device 0000:7f:17.0 to group 32
[ 20.685525] iommu: Adding device 0000:7f:17.4 to group 32
[ 20.691777] iommu: Adding device 0000:7f:17.5 to group 32
[ 20.698013] iommu: Adding device 0000:7f:17.6 to group 32
[ 20.704256] iommu: Adding device 0000:7f:17.7 to group 32
[ 20.710733] iommu: Adding device 0000:7f:1e.0 to group 33
[ 20.716978] iommu: Adding device 0000:7f:1e.1 to group 33
[ 20.723223] iommu: Adding device 0000:7f:1e.2 to group 33
[ 20.729467] iommu: Adding device 0000:7f:1e.3 to group 33
[ 20.735718] iommu: Adding device 0000:7f:1e.4 to group 33
[ 20.742071] iommu: Adding device 0000:7f:1f.0 to group 34
[ 20.748323] iommu: Adding device 0000:7f:1f.2 to group 34
[ 20.754595] iommu: Adding device 0000:80:01.0 to group 35
[ 20.760865] iommu: Adding device 0000:80:02.0 to group 36
[ 20.767139] iommu: Adding device 0000:80:03.0 to group 37
[ 20.773413] iommu: Adding device 0000:80:03.2 to group 38
[ 20.779849] iommu: Adding device 0000:80:05.0 to group 39
[ 20.786099] iommu: Adding device 0000:80:05.1 to group 39
[ 20.792352] iommu: Adding device 0000:80:05.2 to group 39
[ 20.798618] iommu: Adding device 0000:80:05.4 to group 39
[ 20.804901] iommu: Adding device 0000:82:00.0 to group 40
[ 20.811297] iommu: Adding device 0000:ff:08.0 to group 41
[ 20.817546] iommu: Adding device 0000:ff:08.2 to group 41
[ 20.823795] iommu: Adding device 0000:ff:08.3 to group 41
[ 20.830190] iommu: Adding device 0000:ff:09.0 to group 42
[ 20.836439] iommu: Adding device 0000:ff:09.2 to group 42
[ 20.842694] iommu: Adding device 0000:ff:09.3 to group 42
[ 20.849131] iommu: Adding device 0000:ff:0b.0 to group 43
[ 20.855381] iommu: Adding device 0000:ff:0b.1 to group 43
[ 20.861629] iommu: Adding device 0000:ff:0b.2 to group 43
[ 20.867878] iommu: Adding device 0000:ff:0b.3 to group 43
[ 20.874479] iommu: Adding device 0000:ff:0c.0 to group 44
[ 20.880729] iommu: Adding device 0000:ff:0c.1 to group 44
[ 20.886985] iommu: Adding device 0000:ff:0c.2 to group 44
[ 20.893234] iommu: Adding device 0000:ff:0c.3 to group 44
[ 20.899489] iommu: Adding device 0000:ff:0c.4 to group 44
[ 20.905740] iommu: Adding device 0000:ff:0c.5 to group 44
[ 20.911993] iommu: Adding device 0000:ff:0c.6 to group 44
[ 20.918244] iommu: Adding device 0000:ff:0c.7 to group 44
[ 20.924597] iommu: Adding device 0000:ff:0d.0 to group 45
[ 20.930849] iommu: Adding device 0000:ff:0d.1 to group 45
[ 20.937325] iommu: Adding device 0000:ff:0f.0 to group 46
[ 20.943578] iommu: Adding device 0000:ff:0f.1 to group 46
[ 20.949830] iommu: Adding device 0000:ff:0f.4 to group 46
[ 20.956095] iommu: Adding device 0000:ff:0f.5 to group 46
[ 20.962348] iommu: Adding device 0000:ff:0f.6 to group 46
[ 20.968815] iommu: Adding device 0000:ff:10.0 to group 47
[ 20.975074] iommu: Adding device 0000:ff:10.1 to group 47
[ 20.981327] iommu: Adding device 0000:ff:10.5 to group 47
[ 20.987580] iommu: Adding device 0000:ff:10.6 to group 47
[ 20.993823] iommu: Adding device 0000:ff:10.7 to group 47
[ 21.000220] iommu: Adding device 0000:ff:12.0 to group 48
[ 21.006475] iommu: Adding device 0000:ff:12.1 to group 48
[ 21.012737] iommu: Adding device 0000:ff:12.2 to group 48
[ 21.019616] iommu: Adding device 0000:ff:13.0 to group 49
[ 21.025906] iommu: Adding device 0000:ff:13.1 to group 49
[ 21.032196] iommu: Adding device 0000:ff:13.2 to group 49
[ 21.038485] iommu: Adding device 0000:ff:13.3 to group 49
[ 21.044776] iommu: Adding device 0000:ff:13.4 to group 49
[ 21.051067] iommu: Adding device 0000:ff:13.5 to group 49
[ 21.057359] iommu: Adding device 0000:ff:13.6 to group 49
[ 21.063662] iommu: Adding device 0000:ff:13.7 to group 49
[ 21.070273] iommu: Adding device 0000:ff:14.0 to group 50
[ 21.076532] iommu: Adding device 0000:ff:14.1 to group 50
[ 21.082794] iommu: Adding device 0000:ff:14.2 to group 50
[ 21.089052] iommu: Adding device 0000:ff:14.3 to group 50
[ 21.095309] iommu: Adding device 0000:ff:14.4 to group 50
[ 21.101566] iommu: Adding device 0000:ff:14.5 to group 50
[ 21.107823] iommu: Adding device 0000:ff:14.6 to group 50
[ 21.114081] iommu: Adding device 0000:ff:14.7 to group 50
[ 21.120519] iommu: Adding device 0000:ff:15.0 to group 51
[ 21.126779] iommu: Adding device 0000:ff:15.1 to group 51
[ 21.133044] iommu: Adding device 0000:ff:15.2 to group 51
[ 21.139305] iommu: Adding device 0000:ff:15.3 to group 51
[ 21.145690] iommu: Adding device 0000:ff:16.0 to group 52
[ 21.151957] iommu: Adding device 0000:ff:16.6 to group 52
[ 21.158218] iommu: Adding device 0000:ff:16.7 to group 52
[ 21.164699] iommu: Adding device 0000:ff:17.0 to group 53
[ 21.170957] iommu: Adding device 0000:ff:17.4 to group 53
[ 21.177218] iommu: Adding device 0000:ff:17.5 to group 53
[ 21.183490] iommu: Adding device 0000:ff:17.6 to group 53
[ 21.189758] iommu: Adding device 0000:ff:17.7 to group 53
[ 21.196244] iommu: Adding device 0000:ff:1e.0 to group 54
[ 21.202499] iommu: Adding device 0000:ff:1e.1 to group 54
[ 21.218919] iommu: Adding device 0000:ff:1e.2 to group 54
[ 21.225182] iommu: Adding device 0000:ff:1e.3 to group 54
[ 21.231444] iommu: Adding device 0000:ff:1e.4 to group 54
[ 21.237802] iommu: Adding device 0000:ff:1f.0 to group 55
[ 21.244073] iommu: Adding device 0000:ff:1f.2 to group 55
[ 21.258695] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 655360 ms ovfl timer
[ 21.267765] RAPL PMU: hw unit of domain pp0-core 2^-14 Joules
[ 21.274286] RAPL PMU: hw unit of domain package 2^-14 Joules
[ 21.280710] RAPL PMU: hw unit of domain dram 2^-16 Joules
[ 21.291701] Scanning for low memory corruption every 60 seconds
[ 21.302479] audit: initializing netlink subsys (disabled)
[ 21.308775] audit: type=2000 audit(1514015929.308:1): state=initialized audit_enabled=0 res=1
[ 21.315486] Initialise system trusted keyrings
[ 21.315700] workingset: timestamp_bits=40 max_order=23 bucket_order=0
[ 21.336813] zbud: loaded
[ 21.346023] fuse init (API version 7.26)
[ 21.353291] Key type asymmetric registered
[ 21.357966] Asymmetric key parser 'x509' registered
[ 21.363796] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 249)
[ 21.372329] io scheduler noop registered
[ 21.376813] io scheduler deadline registered (default)
[ 21.383100] io scheduler cfq registered
[ 21.387484] io scheduler mq-deadline registered
[ 21.392647] io scheduler kyber registered
[ 21.437254] pcieport 0000:00:01.0: Signaling PME with IRQ 25
[ 21.443909] pcieport 0000:00:02.0: Signaling PME with IRQ 26
[ 21.450542] pcieport 0000:00:03.0: Signaling PME with IRQ 27
[ 21.457169] pcieport 0000:00:03.1: Signaling PME with IRQ 28
[ 21.463796] pcieport 0000:00:03.2: Signaling PME with IRQ 29
[ 21.470425] pcieport 0000:00:1c.0: Signaling PME with IRQ 30
[ 21.477063] pcieport 0000:00:1c.7: Signaling PME with IRQ 31
[ 21.483811] pcieport 0000:80:01.0: Signaling PME with IRQ 33
[ 21.490454] pcieport 0000:80:02.0: Signaling PME with IRQ 34
[ 21.497087] pcieport 0000:80:03.0: Signaling PME with IRQ 35
[ 21.503731] pcieport 0000:80:03.2: Signaling PME with IRQ 36
[ 21.518593] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[ 21.527070] ACPI: Power Button [PWRF]
[ 21.549032] ERST: Error Record Serialization Table (ERST) support is initialized.
[ 21.557531] pstore: using zlib compression
[ 21.562210] pstore: Registered erst as persistent store backend
[ 21.569952] ghes_edac: This EDAC driver relies on BIOS to enumerate memory and get error reports.
[ 21.579990] ghes_edac: Unfortunately, not all BIOSes reflect the memory layout correctly.
[ 21.589253] ghes_edac: So, the end result of using this driver varies from vendor to vendor.
[ 21.598806] ghes_edac: If you find incorrect reports, please contact your hardware vendor
[ 21.608066] ghes_edac: to correct its BIOS.
[ 21.612836] ghes_edac: This system has 24 DIMM sockets.
[ 21.620629] EDAC MC0: Giving out device to module ghes_edac.c controller ghes_edac: DEV ghes (INTERRUPT)
[ 21.632663] EDAC MC1: Giving out device to module ghes_edac.c controller ghes_edac: DEV ghes (INTERRUPT)
[ 21.644740] EDAC MC2: Giving out device to module ghes_edac.c controller ghes_edac: DEV ghes (INTERRUPT)
[ 21.657948] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[ 21.666906] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[ 21.694620] 00:02: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A
[ 21.723770] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[ 21.766933] brd: module loaded
[ 21.780443] loop: module loaded
[ 21.784433] mei_me 0000:00:16.0: Device doesn't have valid ME Interface
[ 21.784795] tun: Universal TUN/TAP device driver, 1.6
[ 21.785036] PPP generic driver version 2.4.2
[ 21.785321] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[ 21.785322] ehci-pci: EHCI PCI platform driver
[ 21.817218] ehci-pci 0000:00:1a.0: EHCI Host Controller
[ 21.823184] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[ 21.831589] ehci-pci 0000:00:1a.0: debug port 2
[ 21.840785] ehci-pci 0000:00:1a.0: irq 18, io mem 0xaec03000
[ 21.860053] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[ 21.866936] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[ 21.874625] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 21.882817] usb usb1: Product: EHCI Host Controller
[ 21.888364] usb usb1: Manufacturer: Linux 4.14.0-perf-00104-g21506525fb8d ehci_hcd
[ 21.896943] usb usb1: SerialNumber: 0000:00:1a.0
[ 21.902984] hub 1-0:1.0: USB hub found
[ 21.907357] hub 1-0:1.0: 2 ports detected
[ 21.916093] ehci-pci 0000:00:1d.0: EHCI Host Controller
[ 21.922060] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[ 21.930464] ehci-pci 0000:00:1d.0: debug port 2
[ 21.939597] ehci-pci 0000:00:1d.0: irq 18, io mem 0xaec02000
[ 21.960072] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[ 21.966965] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[ 21.974654] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 21.982846] usb usb2: Product: EHCI Host Controller
[ 21.988394] usb usb2: Manufacturer: Linux 4.14.0-perf-00104-g21506525fb8d ehci_hcd
[ 21.996974] usb usb2: SerialNumber: 0000:00:1d.0
[ 22.003033] hub 2-0:1.0: USB hub found
[ 22.007416] hub 2-0:1.0: 2 ports detected
[ 22.014342] ehci-platform: EHCI generic platform driver
[ 22.020339] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[ 22.027355] ohci-pci: OHCI PCI platform driver
[ 22.032481] ohci-platform: OHCI generic platform driver
[ 22.038453] uhci_hcd: USB Universal Host Controller Interface driver
[ 22.046081] i8042: PNP: No PS/2 controller found.
[ 22.051757] mousedev: PS/2 mouse device common for all mice
[ 22.058327] rtc_cmos 00:00: RTC can wake from S4
[ 22.063999] rtc_cmos 00:00: rtc core: registered rtc_cmos as rtc0
[ 22.070959] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs
[ 22.079676] i2c /dev entries driver
[ 22.083722] IR NEC protocol handler initialized
[ 22.088880] IR RC5(x/sz) protocol handler initialized
[ 22.094621] IR RC6 protocol handler initialized
[ 22.099778] IR JVC protocol handler initialized
[ 22.104935] IR Sony protocol handler initialized
[ 22.110189] IR SANYO protocol handler initialized
[ 22.115541] IR Sharp protocol handler initialized
[ 22.120893] IR MCE Keyboard/mouse protocol handler initialized
[ 22.127506] IR XMP protocol handler initialized
[ 22.132671] intel_pstate: Intel P-state driver initializing
[ 22.143860] NET: Registered protocol family 10
[ 22.151019] Segment Routing with IPv6
[ 22.155276] NET: Registered protocol family 17
[ 22.160367] Key type dns_resolver registered
[ 22.174291] RAS: Correctable Errors collector initialized.
[ 22.180669] microcode: sig=0x406f1, pf=0x1, revision=0xb00001e
[ 22.188455] microcode: Microcode Update Driver: v2.2.
[ 22.188479] sched_clock: Marking stable (22188405378, 0)->(22536953363, -348547985)
[ 22.203862] registered taskstats version 1
[ 22.208542] Loading compiled-in X.509 certificates
[ 22.214599] zswap: loaded using pool lzo/zbud
[ 22.224927] Key type trusted registered
[ 22.234069] Key type encrypted registered
[ 22.238664] AppArmor: AppArmor sha1 policy hashing enabled
[ 22.244896] ima: No TPM chip found, activating TPM-bypass! (rc=-19)
[ 22.252094] usb 1-1: new high-speed USB device number 2 using ehci-pci
[ 22.252146] evm: HMAC attrs: 0x1
[ 22.298410] rtc_cmos 00:00: setting system clock to 2017-12-23 07:58:53 UTC (1514015933)
[ 22.307576] tsc: Refined TSC clocksource calibration: 2199.998 MHz
[ 22.307606] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x1fb63109b96, max_idle_ns: 440795265316 ns
[ 22.325954] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found
[ 22.332763] EDD information not available.
[ 22.342521] Freeing unused kernel memory: 1744K
[ 22.347682] Write protecting the kernel read-only data: 20480k
[ 22.348058] usb 2-1: new high-speed USB device number 2 using ehci-pci
[ 22.362338] Freeing unused kernel memory: 84K
[ 22.372993] Freeing unused kernel memory: 1024K
Loading, please wait...
starting version 229
[ 22.424642] usb 1-1: New USB device found, idVendor=8087, idProduct=800a
[ 22.432238] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[ 22.441196] hub 1-1:1.0: USB hub found
[ 22.445764] hub 1-1:1.0: 6 ports detected
[ 22.508644] usb 2-1: New USB device found, idVendor=8087, idProduct=8002
[ 22.516236] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[ 22.525179] hub 2-1:1.0: USB hub found
[ 22.529661] hub 2-1:1.0: 8 ports detected
[ 22.562224] BUG: unable to handle kernel paging request at fffffbffffe8ee04
[ 22.562234] IP: check_memory_region+0x5c/0x190
[ 22.562235] PGD 87ffd9067 P4D 87ffd9067 PUD 87ffd8067 PMD 87ffd7067 PTE 0
[ 22.562239] Oops: 0000 [#1] PREEMPT SMP KASAN
[ 22.562241] Modules linked in:
[ 22.562244] CPU: 7 PID: 231 Comm: udevadm Not tainted 4.14.0-perf-00104-g21506525fb8d #47
[ 22.562246] Hardware name: Dell Inc. PowerEdge R730/072T6D, BIOS 2.3.4 11/08/2016
[ 22.562247] task: ffff8803e1438000 task.stack: ffff8803e15b0000
[ 22.562249] RIP: 0010:check_memory_region+0x5c/0x190
[ 22.562250] RSP: 0018:ffff88086f18bb00 EFLAGS: 00010006
[ 22.562252] RAX: fffffbffffe8ee04 RBX: ffffffffff477033 RCX: ffffffff878580cb
[ 22.562254] RDX: 0000000000000000 RSI: 0000000000000014 RDI: ffffffffff477020
[ 22.562255] RBP: fffffbffffe8ee07 R08: 1fffffffffe8ee04 R09: fffffbffffe8ee04
[ 22.562256] R10: 0000000000000003 R11: fffffbffffe8ee06 R12: ffffffffff477020
[ 22.562257] R13: 0000000000100000 R14: 0000000000000014 R15: 0000000000000014
[ 22.562259] FS: 00007fb8482868c0(0000) GS:ffff88086f180000(0000) knlGS:0000000000000000
[ 22.562260] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 22.562261] CR2: fffffbffffe8ee04 CR3: 0000000864783005 CR4: 00000000003606e0
[ 22.562262] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 22.562263] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 22.562264] Call Trace:
[ 22.562265] <NMI>
[ 22.562268] memcpy+0x1f/0x50
[ 22.562275] ghes_copy_tofrom_phys+0xab/0x180
[ 22.562279] ghes_read_estatus+0xfb/0x280
[ 22.562281] ? ghes_copy_tofrom_phys+0x180/0x180
[ 22.562286] ? perf_cpu_time_max_percent_handler+0x110/0x110
[ 22.562289] ghes_notify_nmi+0x2b2/0x410
[ 22.562294] ? cyc2ns_read_end+0x20/0x20
[ 22.562296] ? ghes_proc_in_irq+0xf0/0xf0
[ 22.562299] ? cyc2ns_read_end+0x20/0x20
[ 22.562303] ? refresh_pce+0x110/0x110
[ 22.562306] nmi_handle+0x115/0x2c0
[ 22.562310] ? __register_nmi_handler+0x300/0x300
[ 22.562316] ? rcu_nmi_enter+0xd2/0x110
[ 22.562317] ? rcu_irq_enter_irqson+0x30/0x30
[ 22.562321] ? printk_safe_flush_on_panic+0x100/0x100
[ 22.562324] default_do_nmi+0x57/0x110
[ 22.562326] do_nmi+0xf8/0x150
[ 22.562330] end_repeat_nmi+0x1a/0x1e
[ 22.562335] RIP: 0010:putname+0x60/0x70
[ 22.562335] RSP: 0018:ffff8803e15b7c28 EFLAGS: 00000246
[ 22.562337] RAX: ffff880861b6801c RBX: ffff880861b68000 RCX: ffffffff873eb51e
[ 22.562338] RDX: dffffc0000000000 RSI: dffffc0000000000 RDI: ffff8803ed53a140
[ 22.562339] RBP: ffff880861b6801c R08: 0000000000000000 R09: 0000000000000000
[ 22.562340] R10: ffff8803e15b7db8 R11: ffffed010c36d1ff R12: 0000000000000000
[ 22.562341] R13: ffff880861b68000 R14: 0000000000000000 R15: ffff8803e15b7de8
[ 22.562344] ? putname+0x3e/0x70
[ 22.562347] ? putname+0x60/0x70
[ 22.562349] ? putname+0x60/0x70
[ 22.562350] </NMI>
[ 22.562352] filename_lookup+0x1ce/0x2d0
[ 22.562357] ? trace_event_raw_event_rcu_torture_read+0x190/0x190
[ 22.562359] ? filename_parentat+0x300/0x300
[ 22.562361] ? do_sys_open+0x1ed/0x370
[ 22.562368] ? digsig_verify+0xa30/0xa30
[ 22.562371] ? kmem_cache_alloc+0xb3/0x1c0
[ 22.562373] ? getname_flags+0xf9/0x2a0
[ 22.562376] ? cp_old_stat+0x3b0/0x3b0
[ 22.562379] ? vfs_statx+0xb0/0x120
[ 22.562380] vfs_statx+0xb0/0x120
[ 22.562383] ? vfs_statx_fd+0x80/0x80
[ 22.562387] SyS_newlstat+0x70/0xc0
[ 22.562389] ? SyS_newstat+0xc0/0xc0
[ 22.562393] entry_SYSCALL_64_fastpath+0x1e/0x81
[ 22.562395] RIP: 0033:0x7fb8470f0c55
[ 22.562396] RSP: 002b:00007fffaf979b58 EFLAGS: 00000246 ORIG_RAX: 0000000000000006
[ 22.562398] RAX: ffffffffffffffda RBX: 0000560aa505aef0 RCX: 00007fb8470f0c55
[ 22.562399] RDX: 00007fffaf979ba0 RSI: 00007fffaf979ba0 RDI: 0000560aa505b1f0
[ 22.562399] RBP: 0000000000000000 R08: 00007fb8473bebd8 R09: 0000000000000000
[ 22.562400] R10: 00007fb8473beb78 R11: 0000000000000246 R12: 0000000000000000
[ 22.562401] R13: 0000560aa505aef0 R14: 00007fffaf979c70 R15: 0000000000000000
[ 22.562403] Code: 89 f8 49 89 db 49 c1 e8 03 49 c1 eb 03 4d 01 cb 4d 01 c1 49 8d 6b 01 4c 89 c8 49 89 ea 4d 29 ca 49 83 fa 10 7f 3
[ 22.562426] RIP: check_memory_region+0x5c/0x190 RSP: ffff88086f18bb00
[ 22.562427] CR2: fffffbffffe8ee04
[ 22.936077] usb 1-1.6: new high-speed USB device number 3 using ehci-pci
[ 23.026537] ---[ end trace 7fe9dab94328ad97 ]---
[ 23.034630] Kernel panic - not syncing: Fatal exception in interrupt
[ 23.034647] Kernel Offset: 0x6000000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)
[ 23.068634] ---[ end Kernel panic - not syncing: Fatal exception in interrupt


Attachments:
(No filename) (66.60 kB)
.config.gz (26.85 kB)
Download all attachments

2017-12-23 08:19:55

by Jakub Kicinski

[permalink] [raw]
Subject: Re: linux/master crashes on boot with KASAN=y

On Sat, 23 Dec 2017 00:01:43 -0800, Jakub Kicinski wrote:
> commit 21506525fb8ddb0342f2a2370812d47f6a1f3833 (HEAD, refs/bisect/bad)
> Author: Andy Lutomirski <[email protected]>
> Date: Mon Dec 4 15:07:16 2017 +0100
>
> x86/kasan/64: Teach KASAN about the cpu_entry_area
>
> The cpu_entry_area will contain stacks. Make sure that KASAN has
> appropriate shadow mappings for them.

> [ 22.562224] BUG: unable to handle kernel paging request at fffffbffffe8ee04
> [ 22.562234] IP: check_memory_region+0x5c/0x190
> [ 22.562235] PGD 87ffd9067 P4D 87ffd9067 PUD 87ffd8067 PMD 87ffd7067 PTE 0

Reverting this doesn't get me far, though. Boot stops after:

[ 0.216037] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver.
[ 0.220029] ... version: 3
[ 0.224007] ... bit width: 48
[ 0.228002] ... generic registers: 8
[ 0.232002] ... value mask: 0000ffffffffffff
[ 0.236002] ... max period: 00007fffffffffff
[ 0.240002] ... fixed-purpose events: 3
[ 0.244002] ... event mask: 00000007000000ff
[ 0.256006] Hierarchical SRCU implementation.
[ 0.277436] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter.
[ 0.288005] smp: Bringing up secondary CPUs ...
[ 0.324086] x86: Booting SMP configuration:
[ 0.328009] .... node #1, CPUs: #1
[ 0.448004] .... node #0, CPUs: #2
[ 0.484005] .... node #1, CPUs: #3
[ 0.520004] .... node #0, CPUs: #4
[ 0.556005] .... node #1, CPUs: #5
[ 0.592004] .... node #0, CPUs: #6
[ 0.628005] .... node #1, CPUs: #7
[ 0.664004] .... node #0, CPUs: #8
[ 0.700006] .... node #1, CPUs: #9
[ 0.736004] .... node #0, CPUs: #10
[ 0.772006] .... node #1, CPUs: #11
[ 0.808004] .... node #0, CPUs: #12
[ 0.844005] .... node #1, CPUs: #13
[ 0.880004] .... node #0, CPUs: #14
[ 0.916005] .... node #1, CPUs: #15
[ 0.952004] .... node #0, CPUs: #16
[ 0.988006] .... node #1, CPUs: #17
[ 1.024004] .... node #0, CPUs: #18

Without producing any splat.

2017-12-23 12:44:52

by Andrey Ryabinin

[permalink] [raw]
Subject: Re: linux/master crashes on boot with KASAN=y

On 12/23/2017 11:01 AM, Jakub Kicinski wrote:
> Hi!
>
> I bisected a crash on boot to this:
>
> commit 21506525fb8ddb0342f2a2370812d47f6a1f3833 (HEAD, refs/bisect/bad)
> Author: Andy Lutomirski <[email protected]>
> Date: Mon Dec 4 15:07:16 2017 +0100
>
> x86/kasan/64: Teach KASAN about the cpu_entry_area


Thanks.
There is nothing wrong with this patch, it just uncovered older bug.
The actual problem comes from f06bdd4001c2 ("x86/mm: Adapt MODULES_END based on fixmap section size")
which is made kasan_mem_to_shadow(MODULES_END) potentially unaligned to page boundary.
And when we feed unaligned address to kasan_populate_zero_shadow() it doesn't do the right thing.

Could you tell me if the fix bellow works for you?

---
arch/x86/include/asm/kasan.h | 8 ++++++++
arch/x86/include/asm/pgtable_64_types.h | 4 +++-
2 files changed, 11 insertions(+), 1 deletion(-)

diff --git a/arch/x86/include/asm/kasan.h b/arch/x86/include/asm/kasan.h
index b577dd0916aa..0c580e4b2ccc 100644
--- a/arch/x86/include/asm/kasan.h
+++ b/arch/x86/include/asm/kasan.h
@@ -5,6 +5,14 @@
#include <linux/const.h>
#define KASAN_SHADOW_OFFSET _AC(CONFIG_KASAN_SHADOW_OFFSET, UL)

+#ifndef KASAN_SHADOW_SCALE_SHIFT
+# ifdef CONFIG_KASAN
+# define KASAN_SHADOW_SCALE_SHIFT 3
+# else
+# define KASAN_SHADOW_SCALE_SHIFT 0
+# endif
+#endif
+
/*
* Compiler uses shadow offset assuming that addresses start
* from 0. Kernel addresses don't start from 0, so shadow
diff --git a/arch/x86/include/asm/pgtable_64_types.h b/arch/x86/include/asm/pgtable_64_types.h
index 6d5f45dcd4a1..d34a90d6c374 100644
--- a/arch/x86/include/asm/pgtable_64_types.h
+++ b/arch/x86/include/asm/pgtable_64_types.h
@@ -6,6 +6,7 @@

#ifndef __ASSEMBLY__
#include <linux/types.h>
+#include <asm/kasan.h>
#include <asm/kaslr.h>

/*
@@ -96,7 +97,8 @@ typedef struct { pteval_t pte; } pte_t;
#define VMALLOC_END (VMALLOC_START + _AC((VMALLOC_SIZE_TB << 40) - 1, UL))
#define MODULES_VADDR (__START_KERNEL_map + KERNEL_IMAGE_SIZE)
/* The module sections ends with the start of the fixmap */
-#define MODULES_END __fix_to_virt(__end_of_fixed_addresses + 1)
+#define MODULES_END (__fix_to_virt(__end_of_fixed_addresses + 1) & \
+ ~((PAGE_SIZE << KASAN_SHADOW_SCALE_SHIFT) - 1))
#define MODULES_LEN (MODULES_END - MODULES_VADDR)
#define ESPFIX_PGD_ENTRY _AC(-2, UL)
#define ESPFIX_BASE_ADDR (ESPFIX_PGD_ENTRY << P4D_SHIFT)
--
2.13.6

2017-12-24 01:22:13

by Jakub Kicinski

[permalink] [raw]
Subject: Re: linux/master crashes on boot with KASAN=y

On Sat, 23 Dec 2017 15:41:27 +0300, Andrey Ryabinin wrote:
> On 12/23/2017 11:01 AM, Jakub Kicinski wrote:
> > Hi!
> >
> > I bisected a crash on boot to this:
> >
> > commit 21506525fb8ddb0342f2a2370812d47f6a1f3833 (HEAD, refs/bisect/bad)
> > Author: Andy Lutomirski <[email protected]>
> > Date: Mon Dec 4 15:07:16 2017 +0100
> >
> > x86/kasan/64: Teach KASAN about the cpu_entry_area
>
>
> Thanks.
> There is nothing wrong with this patch, it just uncovered older bug.
> The actual problem comes from f06bdd4001c2 ("x86/mm: Adapt MODULES_END based on fixmap section size")
> which is made kasan_mem_to_shadow(MODULES_END) potentially unaligned to page boundary.
> And when we feed unaligned address to kasan_populate_zero_shadow() it doesn't do the right thing.
>
> Could you tell me if the fix bellow works for you?

Works for me, thank you!

Tested-by: Jakub Kicinski <[email protected]>

> arch/x86/include/asm/kasan.h | 8 ++++++++
> arch/x86/include/asm/pgtable_64_types.h | 4 +++-
> 2 files changed, 11 insertions(+), 1 deletion(-)
>
> diff --git a/arch/x86/include/asm/kasan.h b/arch/x86/include/asm/kasan.h
> index b577dd0916aa..0c580e4b2ccc 100644
> --- a/arch/x86/include/asm/kasan.h
> +++ b/arch/x86/include/asm/kasan.h
> @@ -5,6 +5,14 @@
> #include <linux/const.h>
> #define KASAN_SHADOW_OFFSET _AC(CONFIG_KASAN_SHADOW_OFFSET, UL)
>
> +#ifndef KASAN_SHADOW_SCALE_SHIFT
> +# ifdef CONFIG_KASAN
> +# define KASAN_SHADOW_SCALE_SHIFT 3
> +# else
> +# define KASAN_SHADOW_SCALE_SHIFT 0
> +# endif
> +#endif
> +
> /*
> * Compiler uses shadow offset assuming that addresses start
> * from 0. Kernel addresses don't start from 0, so shadow
> diff --git a/arch/x86/include/asm/pgtable_64_types.h b/arch/x86/include/asm/pgtable_64_types.h
> index 6d5f45dcd4a1..d34a90d6c374 100644
> --- a/arch/x86/include/asm/pgtable_64_types.h
> +++ b/arch/x86/include/asm/pgtable_64_types.h
> @@ -6,6 +6,7 @@
>
> #ifndef __ASSEMBLY__
> #include <linux/types.h>
> +#include <asm/kasan.h>
> #include <asm/kaslr.h>
>
> /*
> @@ -96,7 +97,8 @@ typedef struct { pteval_t pte; } pte_t;
> #define VMALLOC_END (VMALLOC_START + _AC((VMALLOC_SIZE_TB << 40) - 1, UL))
> #define MODULES_VADDR (__START_KERNEL_map + KERNEL_IMAGE_SIZE)
> /* The module sections ends with the start of the fixmap */
> -#define MODULES_END __fix_to_virt(__end_of_fixed_addresses + 1)
> +#define MODULES_END (__fix_to_virt(__end_of_fixed_addresses + 1) & \
> + ~((PAGE_SIZE << KASAN_SHADOW_SCALE_SHIFT) - 1))
> #define MODULES_LEN (MODULES_END - MODULES_VADDR)
> #define ESPFIX_PGD_ENTRY _AC(-2, UL)
> #define ESPFIX_BASE_ADDR (ESPFIX_PGD_ENTRY << P4D_SHIFT)

2017-12-24 01:49:12

by Andy Lutomirski

[permalink] [raw]
Subject: Re: linux/master crashes on boot with KASAN=y

On Sat, Dec 23, 2017 at 4:41 AM, Andrey Ryabinin
<[email protected]> wrote:
> On 12/23/2017 11:01 AM, Jakub Kicinski wrote:
>> Hi!
>>
>> I bisected a crash on boot to this:
>>
>> commit 21506525fb8ddb0342f2a2370812d47f6a1f3833 (HEAD, refs/bisect/bad)
>> Author: Andy Lutomirski <[email protected]>
>> Date: Mon Dec 4 15:07:16 2017 +0100
>>
>> x86/kasan/64: Teach KASAN about the cpu_entry_area
>
>
> Thanks.
> There is nothing wrong with this patch, it just uncovered older bug.
> The actual problem comes from f06bdd4001c2 ("x86/mm: Adapt MODULES_END based on fixmap section size")
> which is made kasan_mem_to_shadow(MODULES_END) potentially unaligned to page boundary.
> And when we feed unaligned address to kasan_populate_zero_shadow() it doesn't do the right thing.
>
> Could you tell me if the fix bellow works for you?
>
> ---
> arch/x86/include/asm/kasan.h | 8 ++++++++
> arch/x86/include/asm/pgtable_64_types.h | 4 +++-
> 2 files changed, 11 insertions(+), 1 deletion(-)
>
> diff --git a/arch/x86/include/asm/kasan.h b/arch/x86/include/asm/kasan.h
> index b577dd0916aa..0c580e4b2ccc 100644
> --- a/arch/x86/include/asm/kasan.h
> +++ b/arch/x86/include/asm/kasan.h
> @@ -5,6 +5,14 @@
> #include <linux/const.h>
> #define KASAN_SHADOW_OFFSET _AC(CONFIG_KASAN_SHADOW_OFFSET, UL)
>
> +#ifndef KASAN_SHADOW_SCALE_SHIFT
> +# ifdef CONFIG_KASAN
> +# define KASAN_SHADOW_SCALE_SHIFT 3
> +# else
> +# define KASAN_SHADOW_SCALE_SHIFT 0
> +# endif
> +#endif
> +
> /*
> * Compiler uses shadow offset assuming that addresses start
> * from 0. Kernel addresses don't start from 0, so shadow
> diff --git a/arch/x86/include/asm/pgtable_64_types.h b/arch/x86/include/asm/pgtable_64_types.h
> index 6d5f45dcd4a1..d34a90d6c374 100644
> --- a/arch/x86/include/asm/pgtable_64_types.h
> +++ b/arch/x86/include/asm/pgtable_64_types.h
> @@ -6,6 +6,7 @@
>
> #ifndef __ASSEMBLY__
> #include <linux/types.h>
> +#include <asm/kasan.h>
> #include <asm/kaslr.h>
>
> /*
> @@ -96,7 +97,8 @@ typedef struct { pteval_t pte; } pte_t;
> #define VMALLOC_END (VMALLOC_START + _AC((VMALLOC_SIZE_TB << 40) - 1, UL))
> #define MODULES_VADDR (__START_KERNEL_map + KERNEL_IMAGE_SIZE)
> /* The module sections ends with the start of the fixmap */
> -#define MODULES_END __fix_to_virt(__end_of_fixed_addresses + 1)
> +#define MODULES_END (__fix_to_virt(__end_of_fixed_addresses + 1) & \
> + ~((PAGE_SIZE << KASAN_SHADOW_SCALE_SHIFT) - 1))

Could this be #define MODULES_END KASAN_ROUND_DOWN(__fix_to_virt(...)) instead?

2017-12-26 11:47:14

by Andrey Ryabinin

[permalink] [raw]
Subject: Re: linux/master crashes on boot with KASAN=y



On 12/24/2017 04:48 AM, Andy Lutomirski wrote:
> On Sat, Dec 23, 2017 at 4:41 AM, Andrey Ryabinin
> <[email protected]> wrote:
>> On 12/23/2017 11:01 AM, Jakub Kicinski wrote:
>>> Hi!
>>>
>>> I bisected a crash on boot to this:
>>>
>>> commit 21506525fb8ddb0342f2a2370812d47f6a1f3833 (HEAD, refs/bisect/bad)
>>> Author: Andy Lutomirski <[email protected]>
>>> Date: Mon Dec 4 15:07:16 2017 +0100
>>>
>>> x86/kasan/64: Teach KASAN about the cpu_entry_area
>>
>>
>> Thanks.
>> There is nothing wrong with this patch, it just uncovered older bug.
>> The actual problem comes from f06bdd4001c2 ("x86/mm: Adapt MODULES_END based on fixmap section size")
>> which is made kasan_mem_to_shadow(MODULES_END) potentially unaligned to page boundary.
>> And when we feed unaligned address to kasan_populate_zero_shadow() it doesn't do the right thing.
>>
>> Could you tell me if the fix bellow works for you?
>>
>> ---
>> arch/x86/include/asm/kasan.h | 8 ++++++++
>> arch/x86/include/asm/pgtable_64_types.h | 4 +++-
>> 2 files changed, 11 insertions(+), 1 deletion(-)
>>
>> diff --git a/arch/x86/include/asm/kasan.h b/arch/x86/include/asm/kasan.h
>> index b577dd0916aa..0c580e4b2ccc 100644
>> --- a/arch/x86/include/asm/kasan.h
>> +++ b/arch/x86/include/asm/kasan.h
>> @@ -5,6 +5,14 @@
>> #include <linux/const.h>
>> #define KASAN_SHADOW_OFFSET _AC(CONFIG_KASAN_SHADOW_OFFSET, UL)
>>
>> +#ifndef KASAN_SHADOW_SCALE_SHIFT
>> +# ifdef CONFIG_KASAN
>> +# define KASAN_SHADOW_SCALE_SHIFT 3
>> +# else
>> +# define KASAN_SHADOW_SCALE_SHIFT 0
>> +# endif
>> +#endif
>> +
>> /*
>> * Compiler uses shadow offset assuming that addresses start
>> * from 0. Kernel addresses don't start from 0, so shadow
>> diff --git a/arch/x86/include/asm/pgtable_64_types.h b/arch/x86/include/asm/pgtable_64_types.h
>> index 6d5f45dcd4a1..d34a90d6c374 100644
>> --- a/arch/x86/include/asm/pgtable_64_types.h
>> +++ b/arch/x86/include/asm/pgtable_64_types.h
>> @@ -6,6 +6,7 @@
>>
>> #ifndef __ASSEMBLY__
>> #include <linux/types.h>
>> +#include <asm/kasan.h>
>> #include <asm/kaslr.h>
>>
>> /*
>> @@ -96,7 +97,8 @@ typedef struct { pteval_t pte; } pte_t;
>> #define VMALLOC_END (VMALLOC_START + _AC((VMALLOC_SIZE_TB << 40) - 1, UL))
>> #define MODULES_VADDR (__START_KERNEL_map + KERNEL_IMAGE_SIZE)
>> /* The module sections ends with the start of the fixmap */
>> -#define MODULES_END __fix_to_virt(__end_of_fixed_addresses + 1)
>> +#define MODULES_END (__fix_to_virt(__end_of_fixed_addresses + 1) & \
>> + ~((PAGE_SIZE << KASAN_SHADOW_SCALE_SHIFT) - 1))
>
> Could this be #define MODULES_END KASAN_ROUND_DOWN(__fix_to_virt(...)) instead?
>

Actually, we could simply set fixed MODULES_END, as it was before f06bdd4001c2 ("x86/mm: Adapt MODULES_END based on fixmap section size").
AFAICS, the whole point of f06bdd4001c2 was to move MODULES_END down if NR_CPUS is big.
But since 92a0f81d8957 ("x86/cpu_entry_area: Move it out of the fixmap") cpu_entry_area is not in fixmap anymore.
So it should be fine to set fixed MODULES_END.

The only concern I have is 4.14 stable, where 21506525f ("x86/kasan/64: Teach KASAN about the cpu_entry_area") was backported.
Is 92a0f81d8957 ("x86/cpu_entry_area: Move it out of the fixmap") also a candidate for stable?
If so, fixed MODULES_END seems like a better choice.

2017-12-27 18:10:01

by Thomas Gleixner

[permalink] [raw]
Subject: Re: linux/master crashes on boot with KASAN=y

On Tue, 26 Dec 2017, Andrey Ryabinin wrote:
> On 12/24/2017 04:48 AM, Andy Lutomirski wrote:
> > Could this be #define MODULES_END KASAN_ROUND_DOWN(__fix_to_virt(...)) instead?
> >
> Actually, we could simply set fixed MODULES_END, as it was before
> f06bdd4001c2 ("x86/mm: Adapt MODULES_END based on fixmap section size").
> AFAICS, the whole point of f06bdd4001c2 was to move MODULES_END down if
> NR_CPUS is big. But since 92a0f81d8957 ("x86/cpu_entry_area: Move it out
> of the fixmap") cpu_entry_area is not in fixmap anymore. So it should be
> fine to set fixed MODULES_END.
>
> The only concern I have is 4.14 stable, where 21506525f ("x86/kasan/64:
> Teach KASAN about the cpu_entry_area") was backported. Is 92a0f81d8957
> ("x86/cpu_entry_area: Move it out of the fixmap") also a candidate for
> stable?
>
> If so, fixed MODULES_END seems like a better choice.

Yes, it's on the way there.

Thanks,

tglx

2017-12-28 16:06:34

by Andrey Ryabinin

[permalink] [raw]
Subject: [PATCH] x86/mm: Set MODULES_END to 0xffffffffff000000

Since f06bdd4001c2 ("x86/mm: Adapt MODULES_END based on fixmap section size")
kasan_mem_to_shadow(MODULES_END) could be not aligned to a page boundary.

So passing page unaligned address to kasan_populate_zero_shadow() have two
possible effects:

1) It may leave one page hole in supposed to be populated area. After commit
21506525fb8d ("x86/kasan/64: Teach KASAN about the cpu_entry_area") that
hole happens to be in the shadow covering fixmap area and leads to crash:

BUG: unable to handle kernel paging request at fffffbffffe8ee04
RIP: 0010:check_memory_region+0x5c/0x190

Call Trace:
<NMI>
memcpy+0x1f/0x50
ghes_copy_tofrom_phys+0xab/0x180
ghes_read_estatus+0xfb/0x280
ghes_notify_nmi+0x2b2/0x410
nmi_handle+0x115/0x2c0
default_do_nmi+0x57/0x110
do_nmi+0xf8/0x150
end_repeat_nmi+0x1a/0x1e

Note, the crash likely disappeared after commit 92a0f81d8957, which
changed kasan_populate_zero_shadow() call the way it was before
commit 21506525fb8d.

2) Attempt to load module near MODULES_END will fail, because
__vmalloc_node_range() called from kasan_module_alloc() will hit the
WARN_ON(!pte_none(*pte)) in the vmap_pte_range() and bail out with error.

To fix this we need to make kasan_mem_to_shadow(MODULES_END) page aligned
which means that MODULES_END should be 8*PAGE_SIZE aligned.

The whole point of commit f06bdd4001c2 was to move MODULES_END down if
NR_CPUS is big, so the cpu_entry_area takes a lot of space.
But since 92a0f81d8957 ("x86/cpu_entry_area: Move it out of the fixmap")
the cpu_entry_area is no longer in fixmap, so we could just set
MODULES_END to a fixed 8*PAGE_SIZE aligned address.

Reported-by: Jakub Kicinski <[email protected]>
Signed-off-by: Andrey Ryabinin <[email protected]>
Cc: <[email protected]> # 4.14
---
Documentation/x86/x86_64/mm.txt | 5 +----
arch/x86/include/asm/pgtable_64_types.h | 2 +-
2 files changed, 2 insertions(+), 5 deletions(-)

diff --git a/Documentation/x86/x86_64/mm.txt b/Documentation/x86/x86_64/mm.txt
index 51101708a03a..60a0fa2bc01f 100644
--- a/Documentation/x86/x86_64/mm.txt
+++ b/Documentation/x86/x86_64/mm.txt
@@ -42,7 +42,7 @@ ffffff0000000000 - ffffff7fffffffff (=39 bits) %esp fixup stacks
ffffffef00000000 - fffffffeffffffff (=64 GB) EFI region mapping space
... unused hole ...
ffffffff80000000 - ffffffff9fffffff (=512 MB) kernel text mapping, from phys 0
-ffffffffa0000000 - [fixmap start] (~1526 MB) module mapping space
+ffffffffa0000000 - fffffffffeffffff (1520 MB) module mapping space
[fixmap start] - ffffffffff5fffff kernel-internal fixmap range
ffffffffff600000 - ffffffffff600fff (=4 kB) legacy vsyscall ABI
ffffffffffe00000 - ffffffffffffffff (=2 MB) unused hole
@@ -66,9 +66,6 @@ memory window (this size is arbitrary, it can be raised later if needed).
The mappings are not part of any other kernel PGD and are only available
during EFI runtime calls.

-The module mapping space size changes based on the CONFIG requirements for the
-following fixmap section.
-
Note that if CONFIG_RANDOMIZE_MEMORY is enabled, the direct mapping of all
physical memory, vmalloc/ioremap space and virtual memory map are randomized.
Their order is preserved but their base will be offset early at boot time.
diff --git a/arch/x86/include/asm/pgtable_64_types.h b/arch/x86/include/asm/pgtable_64_types.h
index 3d27831bc58d..ed2da4e7f259 100644
--- a/arch/x86/include/asm/pgtable_64_types.h
+++ b/arch/x86/include/asm/pgtable_64_types.h
@@ -100,7 +100,7 @@ typedef struct { pteval_t pte; } pte_t;

#define MODULES_VADDR (__START_KERNEL_map + KERNEL_IMAGE_SIZE)
/* The module sections ends with the start of the fixmap */
-#define MODULES_END __fix_to_virt(__end_of_fixed_addresses + 1)
+#define MODULES_END _AC(0xffffffffff000000, UL)
#define MODULES_LEN (MODULES_END - MODULES_VADDR)

#define ESPFIX_PGD_ENTRY _AC(-2, UL)
--
2.13.6

Subject: [tip:x86/pti] x86/mm: Set MODULES_END to 0xffffffffff000000

Commit-ID: f5a40711fa58f1c109165a4fec6078bf2dfd2bdc
Gitweb: https://git.kernel.org/tip/f5a40711fa58f1c109165a4fec6078bf2dfd2bdc
Author: Andrey Ryabinin <[email protected]>
AuthorDate: Thu, 28 Dec 2017 19:06:20 +0300
Committer: Thomas Gleixner <[email protected]>
CommitDate: Thu, 4 Jan 2018 23:04:57 +0100

x86/mm: Set MODULES_END to 0xffffffffff000000

Since f06bdd4001c2 ("x86/mm: Adapt MODULES_END based on fixmap section size")
kasan_mem_to_shadow(MODULES_END) could be not aligned to a page boundary.

So passing page unaligned address to kasan_populate_zero_shadow() have two
possible effects:

1) It may leave one page hole in supposed to be populated area. After commit
21506525fb8d ("x86/kasan/64: Teach KASAN about the cpu_entry_area") that
hole happens to be in the shadow covering fixmap area and leads to crash:

BUG: unable to handle kernel paging request at fffffbffffe8ee04
RIP: 0010:check_memory_region+0x5c/0x190

Call Trace:
<NMI>
memcpy+0x1f/0x50
ghes_copy_tofrom_phys+0xab/0x180
ghes_read_estatus+0xfb/0x280
ghes_notify_nmi+0x2b2/0x410
nmi_handle+0x115/0x2c0
default_do_nmi+0x57/0x110
do_nmi+0xf8/0x150
end_repeat_nmi+0x1a/0x1e

Note, the crash likely disappeared after commit 92a0f81d8957, which
changed kasan_populate_zero_shadow() call the way it was before
commit 21506525fb8d.

2) Attempt to load module near MODULES_END will fail, because
__vmalloc_node_range() called from kasan_module_alloc() will hit the
WARN_ON(!pte_none(*pte)) in the vmap_pte_range() and bail out with error.

To fix this we need to make kasan_mem_to_shadow(MODULES_END) page aligned
which means that MODULES_END should be 8*PAGE_SIZE aligned.

The whole point of commit f06bdd4001c2 was to move MODULES_END down if
NR_CPUS is big, so the cpu_entry_area takes a lot of space.
But since 92a0f81d8957 ("x86/cpu_entry_area: Move it out of the fixmap")
the cpu_entry_area is no longer in fixmap, so we could just set
MODULES_END to a fixed 8*PAGE_SIZE aligned address.

Fixes: f06bdd4001c2 ("x86/mm: Adapt MODULES_END based on fixmap section size")
Reported-by: Jakub Kicinski <[email protected]>
Signed-off-by: Andrey Ryabinin <[email protected]>
Signed-off-by: Thomas Gleixner <[email protected]>
Cc: [email protected]
Cc: Andy Lutomirski <[email protected]>
Cc: Thomas Garnier <[email protected]>
Link: https://lkml.kernel.org/r/[email protected]

---
Documentation/x86/x86_64/mm.txt | 5 +----
arch/x86/include/asm/pgtable_64_types.h | 2 +-
2 files changed, 2 insertions(+), 5 deletions(-)

diff --git a/Documentation/x86/x86_64/mm.txt b/Documentation/x86/x86_64/mm.txt
index ad41b38..ddd5ffd 100644
--- a/Documentation/x86/x86_64/mm.txt
+++ b/Documentation/x86/x86_64/mm.txt
@@ -43,7 +43,7 @@ ffffff0000000000 - ffffff7fffffffff (=39 bits) %esp fixup stacks
ffffffef00000000 - fffffffeffffffff (=64 GB) EFI region mapping space
... unused hole ...
ffffffff80000000 - ffffffff9fffffff (=512 MB) kernel text mapping, from phys 0
-ffffffffa0000000 - [fixmap start] (~1526 MB) module mapping space
+ffffffffa0000000 - fffffffffeffffff (1520 MB) module mapping space
[fixmap start] - ffffffffff5fffff kernel-internal fixmap range
ffffffffff600000 - ffffffffff600fff (=4 kB) legacy vsyscall ABI
ffffffffffe00000 - ffffffffffffffff (=2 MB) unused hole
@@ -67,9 +67,6 @@ memory window (this size is arbitrary, it can be raised later if needed).
The mappings are not part of any other kernel PGD and are only available
during EFI runtime calls.

-The module mapping space size changes based on the CONFIG requirements for the
-following fixmap section.
-
Note that if CONFIG_RANDOMIZE_MEMORY is enabled, the direct mapping of all
physical memory, vmalloc/ioremap space and virtual memory map are randomized.
Their order is preserved but their base will be offset early at boot time.
diff --git a/arch/x86/include/asm/pgtable_64_types.h b/arch/x86/include/asm/pgtable_64_types.h
index b97a539..6233e55 100644
--- a/arch/x86/include/asm/pgtable_64_types.h
+++ b/arch/x86/include/asm/pgtable_64_types.h
@@ -104,7 +104,7 @@ typedef struct { pteval_t pte; } pte_t;

#define MODULES_VADDR (__START_KERNEL_map + KERNEL_IMAGE_SIZE)
/* The module sections ends with the start of the fixmap */
-#define MODULES_END __fix_to_virt(__end_of_fixed_addresses + 1)
+#define MODULES_END _AC(0xffffffffff000000, UL)
#define MODULES_LEN (MODULES_END - MODULES_VADDR)

#define ESPFIX_PGD_ENTRY _AC(-2, UL)