Received: by 2002:a05:6a10:22f:0:0:0:0 with SMTP id 15csp904449pxk; Fri, 25 Sep 2020 00:28:46 -0700 (PDT) X-Google-Smtp-Source: ABdhPJzz57ypKcHb7g35G9tHFkZKSlvG8bXUJfTaLqZGE+p/lwHbuZ3XDxXdbLEQKwyHAxrWE6+i X-Received: by 2002:a17:906:4b18:: with SMTP id y24mr1360748eju.471.1601018926232; Fri, 25 Sep 2020 00:28:46 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1601018926; cv=none; d=google.com; s=arc-20160816; b=S7UugoyZWYTvB2JTXiJLotyTaukYj8w/Zpc60d+9y7lr0alMdpInSQhoi57B4vbifp 7aRlKAzcAVW54GU/bKYoIP8kto6DkBUQvQ4JGYmLvi0BE2Y99HLByNs0SNTYqLoY0uMO shnjyAr5mJRQdLVNtMSKg3kTSQLSq15set/SfiOrNkvBfydPorb3KcoMAT9lPVLDSF2w ZjvGlF0DMf5e5SxHQ1RX7G6Ga7Pp47VJxiW70jxeENnrvitfbxPMDZlxMvZYD5T4y3O/ P3SHz33bFrGWcIlBz7R6K5yUrrYjWSTe8r1tPCSMj4FWXjczuhN289KH6rooC+KYq42e fLlw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:cc:to:subject:message-id:date:from:in-reply-to :references:mime-version:dkim-signature; bh=9+u6pjC7pRB1K9gjeMWKj3lZ/9RhhBMJjz0Kr1AOtzs=; b=XRO8haZkSZevRI1kdHKhMdMMNU6DtTUUIbTqLrME35jalUWo92Hf4Zun3Np8OzJSkh MPwYdXdcpmsaIexrufgXTJ9Qw44KBFWANuX1gTOxySM0jyMckY6IX9IvlPhYQmw5FLSr wsqUnu3RQzUTfQdJmziYj0JSH2AZ2CqpiPFNtn6NSR7SJxfXEsU1e6iwxtuWwq/V11kk +cz7PRTva32T93nLWaijrnZ/b/fMLGkmFwFb7YzeDnpdcTjdQh+9+xO7AKa711rB/Ypg Er7lt3vFIrsFmny8kc9GtpL7rCKK0z5XCvRiyDe8kwN31PAVTFw1M6TYZ6QiIn9uk1PA CBKA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=znz84rc2; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id n6si1244804ejx.165.2020.09.25.00.28.23; Fri, 25 Sep 2020 00:28:46 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=znz84rc2; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727290AbgIYHZ0 (ORCPT + 99 others); Fri, 25 Sep 2020 03:25:26 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:44710 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727183AbgIYHZZ (ORCPT ); Fri, 25 Sep 2020 03:25:25 -0400 Received: from mail-vs1-xe44.google.com (mail-vs1-xe44.google.com [IPv6:2607:f8b0:4864:20::e44]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 7F8A9C0613CE for ; Fri, 25 Sep 2020 00:25:25 -0700 (PDT) Received: by mail-vs1-xe44.google.com with SMTP id q13so805994vsj.13 for ; Fri, 25 Sep 2020 00:25:25 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=9+u6pjC7pRB1K9gjeMWKj3lZ/9RhhBMJjz0Kr1AOtzs=; b=znz84rc2KTxMeuZHBWoFa4B0qNPH/4nMwsP+S61V9IatDeRCRbBjXCWmOV7byKF1Ky bGXKIXbQQctoF47LltBYdfHbE2uiREyLYy9UhpNNnvid+BRkL1sIaQG8L1wpb4Beips4 bLArDC1gja85x2EyHWr9tAj/QhRNmk13a/gDQ7c1or9dEfw7Ms2f5/4JE4m2MXFR4cOl xHJI2gMFnqOnTaF3B/e5JtCFSAscq63Be9G3eEXpIhND/l4UGyYCyuxDfyK2k0O+1uiK tWRVcCmbOJ7AqOmtNYTudR+d3/AF9bXMQgfRUZDbctTyziK/+wBrDxrsEBAFbgXgKu8M G7nw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=9+u6pjC7pRB1K9gjeMWKj3lZ/9RhhBMJjz0Kr1AOtzs=; b=B0bJulaxQrsqotilItpGbeHI/CVUtWO/rpOGKvEVxIkpUD/PQueaR9Gizla0zwpddF woT6R6FvV0sH6N2hoQJUJVzuF6jUxKs6NPiL+yfj3OlgKP6+6bbtRluAmdFu11Xr9g73 DP9nOdS+bK/xWi4Pf0BT4e9y8GTny8E0MpQEIHGxGO8PCtnPcL6f0LWLKeZmTWJA/4s7 bqGTiya8bsMWB5jMc3J+37YE+d0wMBUQmj2FS5KjZJQtSXhG2jk/dLjabEt8MWVEA44S Lw92tnq3xX+eLgWjRQwRDJefJ9I3u4P7duXKKE3Dqg27nm/sE+HrXzKCjffPTIp0Bgzi cGZA== X-Gm-Message-State: AOAM531waL4CwDtYCflsaImQh7Soe41geBeLWf3T9MXNg4SSoDmT3s3s C1wm5Xu2uL4+uefz33XKLGxzvC8l2jvCp5v7/CQHbuYUXFkh8XVz X-Received: by 2002:a05:6102:310f:: with SMTP id e15mr1937206vsh.39.1601018724645; Fri, 25 Sep 2020 00:25:24 -0700 (PDT) MIME-Version: 1.0 References: <20180823023839.GA13343@shao2-debian> <20180828195347.GA228832@joelaf.mtv.corp.google.com> <20200925051518.GA605188@kroah.com> In-Reply-To: <20200925051518.GA605188@kroah.com> From: Naresh Kamboju Date: Fri, 25 Sep 2020 12:55:13 +0530 Message-ID: Subject: Re: [stable 4.19] [PANIC]: tracing: Centralize preemptirq tracepoints and unify their usage To: Greg Kroah-Hartman Cc: Joel Fernandes , Steven Rostedt , Peter Zijlstra , Namhyung Kim , LKML , linux- stable , Sasha Levin , Masami Hiramatsu , LTP List , lkft-triage@lists.linaro.org Content-Type: text/plain; charset="UTF-8" Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Fri, 25 Sep 2020 at 10:45, Greg Kroah-Hartman wrote: > > On Fri, Sep 25, 2020 at 10:13:05AM +0530, Naresh Kamboju wrote: > > >From stable rc 4.18.1 onwards to today's stable rc 4.19.147 > > > > There are two problems while running LTP tracing tests > > 1) kernel panic on i386, qemu_i386, x86_64 and qemu_x86_64 [1] > > 2) " segfault at 0 ip " and "Code: Bad RIP value" on x86_64 and qemu_x86_64 [2] > > Please refer to the full test logs from below links. > > > > The first bad commit found by git bisect. > > commit: c3bc8fd637a9623f5c507bd18f9677effbddf584 > > tracing: Centralize preemptirq tracepoints and unify their usage > > > > Reported-by: Naresh Kamboju > > So this also is reproducable in 5.4 and Linus's tree right now? No. The reported issues are not reproducible on 5.4, 5.8 and Linus's tree. > > Or are newer kernels working fine? No. There are different issues while testing LTP tracing on 5.4, 5.8 and Linus 's 5.9. NETDEV WATCHDOG: eth0 (igb): transmit queue 2 timed out WARNING: CPU: 1 PID: 331 at net/sched/sch_generic.c:442 dev_watchdog+0x4c7/0x4d0 https://lore.kernel.org/stable/CA+G9fYtS_nAX=sPV8zTTs-nOdpJ4uxk9sqeHOZNuS4WLvBcPGg@mail.gmail.com/ I see this on 5.4, 5.8 and Linus 's 5.9. rcu: INFO: rcu_sched self-detected stall on CPU ? ftrace_graph_caller+0xc0/0xc0 https://lore.kernel.org/stable/CA+G9fYsdTLRj55_bvod8Sf+0zvK0RRMp5+FeJcOx5oAcAKOGXA@mail.gmail.com/T/#u > > thanks, > > greg k-h - Naresh