Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1752670Ab3F1WTP (ORCPT ); Fri, 28 Jun 2013 18:19:15 -0400 Received: from mx1.redhat.com ([209.132.183.28]:13949 "EHLO mx1.redhat.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751812Ab3F1WTN (ORCPT ); Fri, 28 Jun 2013 18:19:13 -0400 Date: Fri, 28 Jun 2013 16:45:06 -0400 From: Dave Jones To: Steven Rostedt Cc: Linux Kernel Subject: Re: WARNING: at kernel/trace/ftrace.c:1605 __ftrace_hash_rec_update.part.37+0x20a/0x240() Message-ID: <20130628204506.GA9767@redhat.com> Mail-Followup-To: Dave Jones , Steven Rostedt , Linux Kernel References: <20130610234806.GA7069@redhat.com> <1370910794.9844.150.camel@gandalf.local.home> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1370910794.9844.150.camel@gandalf.local.home> User-Agent: Mutt/1.5.21 (2010-09-15) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 3679 Lines: 61 On Mon, Jun 10, 2013 at 08:33:14PM -0400, Steven Rostedt wrote: > On Mon, 2013-06-10 at 19:48 -0400, Dave Jones wrote: > > 3.10-rc5 + the two patches referenced in the RCU thread from earlier. > > > > Dave > > > > [ 2313.381283] WARNING: at kernel/trace/ftrace.c:1605 __ftrace_hash_rec_update.part.37+0x20a/0x240() > > Grumble, > > Somehow the list of functions that perf enabled got out of sync with > what ftrace had. When perf disabled its list of functions from ftrace, > perf thought it had a function enabled that wasn't and ftrace cried > about that. > > What does 'trinity-child2' do? and is this reproducible? I'll go and > investigate how perf integrates with ftrace to see if I can find how > things got out of sync. Just hit this again on rc7. So 'reproducable' means "twice a month" apparently ;) Though now that I have a fix for the lockups I was seeing, maybe I'll start seeing this more frequently. Dave [ 393.396441] WARNING: at kernel/trace/ftrace.c:1605 __ftrace_hash_rec_update.part.37+0x20a/0x240() [ 393.400825] Modules linked in: fuse tun bnep rfcomm ipt_ULOG nfnetlink can_bcm scsi_transport_iscsi can_raw appletalk netrom bluetooth irda af_802154 phonet af_rxrpc nfc rfkill can af_key rose atm ipx p8023 psnap p8022 caif_socket caif crc_ccitt rds llc2 llc ax25 x25 pppoe pppox ppp_generic slhc snd_hda_codec_realtek coretemp hwmon kvm_intel kvm snd_hda_codec_hdmi crc32c_intel ghash_clmulni_intel microcode snd_hda_intel snd_hda_codec pcspkr snd_hwdep usb_debug snd_seq snd_seq_device snd_pcm e1000e snd_page_alloc ptp snd_timer snd pps_core soundcore xfs libcrc32c [ 393.484160] CPU: 2 PID: 19336 Comm: trinity-child0 Not tainted 3.10.0-rc7+ #37 [ 393.502497] ffffffff81a17636 ffff8801e49cdc68 ffffffff816e4662 ffff8801e49cdca0 [ 393.507648] ffffffff8104a0c1 0000000000000000 0000000000000001 ffff8801e3667000 [ 393.512670] 0000000000000000 ffff8801f1f4cb40 ffff8801e49cdcb0 ffffffff8104a19a [ 393.520041] Call Trace: [ 393.521408] [] dump_stack+0x19/0x1b [ 393.525699] [] warn_slowpath_common+0x61/0x80 [ 393.529232] [] warn_slowpath_null+0x1a/0x20 [ 393.532732] [] __ftrace_hash_rec_update.part.37+0x20a/0x240 [ 393.538897] [] ftrace_shutdown+0xb8/0x170 [ 393.542390] [] unregister_ftrace_function+0x30/0x50 [ 393.547601] [] perf_ftrace_event_register+0x87/0x130 [ 393.551518] [] perf_trace_destroy+0x2c/0x50 [ 393.556096] [] tp_perf_event_destroy+0x9/0x10 [ 393.559632] [] free_event+0xa1/0x1c0 [ 393.562751] [] perf_event_release_kernel+0x64/0x90 [ 393.568341] [] put_event+0x120/0x1b0 [ 393.571456] [] ? put_event+0x30/0x1b0 [ 393.574813] [] perf_release+0x10/0x20 [ 393.577944] [] __fput+0xf5/0x2d0 [ 393.580749] [] ____fput+0xe/0x10 [ 393.585035] [] task_work_run+0xac/0xe0 [ 393.588187] [] do_exit+0x2bb/0xcd0 [ 393.592297] [] ? ftrace_call+0x5/0x2f [ 393.598091] [] do_group_exit+0x4c/0xc0 [ 393.602355] [] SyS_exit_group+0x14/0x20 [ 393.608055] [] tracesys+0xdd/0xe2 [ 393.620867] ---[ end trace 113d10486f2930c4 ]--- -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/