Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1753627AbbGBU4E (ORCPT ); Thu, 2 Jul 2015 16:56:04 -0400 Received: from mail-ig0-f171.google.com ([209.85.213.171]:36157 "EHLO mail-ig0-f171.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1754164AbbGBUzy (ORCPT ); Thu, 2 Jul 2015 16:55:54 -0400 From: Vince Weaver X-Google-Original-From: Vince Weaver Date: Thu, 2 Jul 2015 17:02:08 -0400 (EDT) To: linux-kernel@vger.kernel.org cc: Peter Zijlstra , Ingo Molnar , Arnaldo Carvalho de Melo , Stephane Eranian Subject: perf: fuzzer triggered CPU lockup Message-ID: User-Agent: Alpine 2.20 (DEB 67 2015-01-07) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 8361 Lines: 121 The fuzzer just turned this up. This is the first part; a huge amount of CPU lockup messages, rcu stalls, and spinlock lockup suspected messages followed beyond what I've posted here but eventually the machine recovered (?) [20601.976374] WARNING: CPU: 1 PID: 28966 at kernel/watchdog.c:311 watchdog_overflow_callback+0x84/0xa0() [20601.986660] Watchdog detected hard LOCKUP on cpu 1 [20601.991597] Modules linked in: [20601.995219] fuse x86_pkg_temp_thermal intel_powerclamp intel_rapl iosf_mbi coretemp kvm_intel kvm snd_hda_codec_hdmi crct10dif_pclmul crc32_pclmul ghash_clmulni_intel hmac drbg i915 ansi_cprng snd_hda_codec_realtek snd_hda_codec_generic iTCO_wdt ppdev snd_hda_intel snd_hda_codec aesni_intel aes_x86_64 snd_hda_core lrw evdev snd_hwdep drm_kms_helper drm psmouse iTCO_vendor_support snd_pcm gf128mul glue_helper ablk_helper serio_raw pcspkr cryptd snd_timer i2c_i801 processor battery video snd mei_me parport_pc i2c_algo_bit button soundcore lpc_ich mfd_core tpm_tis mei parport tpm wmi sg sr_mod sd_mod cdrom ehci_pci ehci_hcd ahci libahci libata xhci_pci xhci_hcd e1000e ptp usbcore crc32c_intel fan scsi_mod pps_core usb_common thermal thermal_sys [20602.068491] CPU: 1 PID: 28966 Comm: perf_fuzzer Tainted: G W 4.1.0+ #160 [20602.077305] Hardware name: LENOVO 10AM000AUS/SHARKBAY, BIOS FBKT72AUS 01/26/2014 [20602.085645] ffffffff81a27b82 ffff88011ea45af0 ffffffff8169e763 0000000000000000 [20602.094061] ffff88011ea45b40 ffff88011ea45b30 ffffffff8106ecba ffff88011ea45c40 [20602.102496] ffff8801197c7800 0000000000000000 ffff88011ea45c40 ffff88011ea45ef8 [20602.110909] Call Trace: [20602.113982] [] dump_stack+0x45/0x57 [20602.120616] [] warn_slowpath_common+0x8a/0xc0 [20602.127520] [] warn_slowpath_fmt+0x46/0x50 [20602.134103] [] ? intel_pmu_drain_pebs_nhm+0x176/0x2e0 [20602.141753] [] watchdog_overflow_callback+0x84/0xa0 [20602.149189] [] __perf_event_overflow+0x8c/0x1b0 [20602.156300] [] perf_event_overflow+0x14/0x20 [20602.163092] [] intel_pmu_handle_irq+0x1d4/0x440 [20602.170206] [] ? copy_page_range+0x515/0x960 [20602.177014] [] ? native_apic_msr_write+0x2b/0x30 [20602.184197] [] ? x2apic_send_IPI_self+0x1d/0x20 [20602.191284] [] ? arch_irq_work_raise+0x35/0x40 [20602.198282] [] ? irq_work_queue+0x66/0x80 [20602.204830] [] perf_event_nmi_handler+0x26/0x40 [20602.211928] [] nmi_handle+0x9d/0x140 [20602.217999] [] ? nmi_handle+0x5/0x140 [20602.224206] [] default_do_nmi+0x4a/0x120 [20602.230651] [] do_nmi+0x8d/0xc0 [20602.236280] [] end_repeat_nmi+0x1e/0x2e [20602.242650] [] ? native_read_tsc+0x6/0x20 [20602.249194] [] ? native_read_tsc+0x6/0x20 [20602.255733] [] ? native_read_tsc+0x6/0x20 [20602.262282] <> [] delay_tsc+0x2d/0x70 [20602.269008] [] __delay+0xf/0x20 [20602.274617] [] do_raw_spin_lock+0x8c/0x120 [20602.281273] [] _raw_spin_lock_irqsave+0x4c/0x60 [20602.288346] [] ? perf_event_read+0x6a/0x130 [20602.295064] [] perf_event_read+0x6a/0x130 [20602.301605] [] perf_event_read_value+0x88/0xd0 [20602.308563] [] ? perf_event_ctx_lock_nested+0x15/0xf0 [20602.316160] [] perf_read+0x1cf/0x300 [20602.322203] [] ? handle_mm_fault+0xdbf/0x1750 [20602.329079] [] __vfs_read+0x28/0xd0 [20602.335008] [] ? security_file_permission+0xa3/0xc0 [20602.342452] [] ? rw_verify_area+0x53/0xf0 [20602.348934] [] vfs_read+0x8a/0x130 [20602.354769] [] SyS_read+0x49/0xa0 [20602.360484] [] entry_SYSCALL_64_fastpath+0x16/0x7a [20602.367734] ---[ end trace e3d880444bf5705f ]--- [20609.247053] ------------[ cut here ]------------ [20609.252343] WARNING: CPU: 2 PID: 29626 at kernel/watchdog.c:311 watchdog_overflow_callback+0x84/0xa0() [20609.262667] Watchdog detected hard LOCKUP on cpu 2 [20609.387068] Call Trace: [20609.390155] [] dump_stack+0x45/0x57 [20609.396774] [] warn_slowpath_common+0x8a/0xc0 [20609.403676] [] warn_slowpath_fmt+0x46/0x50 [20609.410245] [] ? intel_pmu_drain_pebs_nhm+0x176/0x2e0 [20609.417849] [] watchdog_overflow_callback+0x84/0xa0 [20609.425247] [] __perf_event_overflow+0x8c/0x1b0 [20609.432324] [] perf_event_overflow+0x14/0x20 [20609.439100] [] intel_pmu_handle_irq+0x1d4/0x440 [20609.446153] [] ? __atomic_notifier_call_chain+0x77/0x90 [20609.453984] [] ? __atomic_notifier_call_chain+0x5/0x90 [20609.461717] [] ? lock_acquire+0xbd/0x120 [20609.468152] [] ? native_apic_msr_write+0x2b/0x30 [20609.475296] [] ? x2apic_send_IPI_self+0x1d/0x20 [20609.482383] [] ? arch_irq_work_raise+0x35/0x40 [20609.489362] [] ? irq_work_queue+0x66/0x80 [20609.495880] [] perf_event_nmi_handler+0x26/0x40 [20609.502970] [] nmi_handle+0x9d/0x140 [20609.509066] [] ? nmi_handle+0x5/0x140 [20609.515184] [] default_do_nmi+0xc9/0x120 [20609.521617] [] do_nmi+0x8d/0xc0 [20609.527217] [] end_repeat_nmi+0x1e/0x2e [20609.533566] [] ? native_write_msr_safe+0xd/0x10 [20609.540658] [] ? native_write_msr_safe+0xd/0x10 [20609.547728] [] ? native_write_msr_safe+0xd/0x10 [20609.554770] <> [] ? __intel_pmu_enable_all+0x5a/0xc0 [20609.562888] [] intel_pmu_enable_all+0x10/0x20 [20609.569768] [] x86_pmu_enable+0x25c/0x2e0 [20609.576271] [] perf_pmu_enable+0x22/0x30 [20609.582693] [] perf_event_context_sched_in+0x94/0x150 [20609.590305] [] __perf_event_task_sched_in+0x97/0xa0 [20609.597710] [] finish_task_switch+0x197/0x1f0 [20609.604580] [] ? __schedule+0x280/0xa50 [20609.610866] [] __schedule+0x2e8/0xa50 [20609.616966] [] ? put_event+0x92/0x150 [20609.623071] [] schedule+0x37/0x80 [20609.628788] [] schedule_preempt_disabled+0xe/0x10 [20609.636002] [] mutex_lock_nested+0x120/0x320 [20609.642717] [] ? put_event+0x92/0x150 [20609.648789] [] put_event+0x92/0x150 [20609.654651] [] ? put_event+0x2b/0x150 [20609.660680] [] perf_release+0x10/0x20 [20609.666685] [] __fput+0xdc/0x1e0 [20609.672243] [] ____fput+0xe/0x10 [20609.677768] [] task_work_run+0x85/0xb0 [20609.683882] [] do_exit+0x3a5/0xa90 [20609.689605] [] ? get_signal+0xe2/0x720 [20609.695712] [] do_group_exit+0x54/0xe0 [20609.701802] [] get_signal+0x280/0x720 [20609.707790] [] do_signal+0x28/0xb50 [20609.713579] [] ? __lock_acquire.isra.31+0x3a6/0xf90 [20609.720874] [] ? __schedule+0x73/0xa50 [20609.726927] [] ? __schedule+0x5ec/0xa50 [20609.733093] [] ? __schedule+0x5ec/0xa50 [20609.739262] [] ? sys_getppid+0x5/0x80 [20609.745244] [] do_notify_resume+0x62/0x70 [20609.751546] [] retint_signal+0x44/0x86 [20609.757629] ---[ end trace e3d880444bf57060 ]--- -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/