Received: by 2002:a25:c205:0:0:0:0:0 with SMTP id s5csp4278748ybf; Wed, 4 Mar 2020 00:34:29 -0800 (PST) X-Google-Smtp-Source: ADFU+vv3SXfPx36efRA4rPqlfw69iE42YA99n+JRgr7likj8Qd1LVRzZVdK7CbldFEssH66q6kHu X-Received: by 2002:aca:a94a:: with SMTP id s71mr1027861oie.132.1583310869255; Wed, 04 Mar 2020 00:34:29 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1583310869; cv=none; d=google.com; s=arc-20160816; b=tEx5R6AkQf/G7kbvgi1fYr6mSUxajT7Ljv8CsJf3+qGv4NBobOwvu9CLxsWaAN87Yb gHH2l6GsSbWQY+vui34TlDN3XVFe/zVA1fK7I19yMFER90OmKiWcaMbOR+3bRPKee+Is rI/HXPnDV7Jo3YFRc/TlclctkVDTx8iQ5tALNbiM4daGToHUGD9OCeJer6+poSwYuITB 5wBWczgdxM2HWW7nqjiIBsXNhiV08NWqbvoIV+G5F5Kb8eLBLUVTF8AFg/mLd34l5We4 f0h+8M8hSTX3RLDS0FRHpCo6E3s/bUIjF96zBA3Xf3bUdX589JFV5exyVNgFttLqESxX H2wQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:dkim-signature; bh=MGkxEVuNmSpsbMjbs4y3ZqP9ci0NOJ4QjgZ1q4n/Bvw=; b=YrDvCcS8+zm+7he1MqadXcYAOJzYe/TvpBj3LsF32ypMw8wYdv2xHHIXCQgZGdMQ+I 6A7owvRmMxfc1EyOAt8DFgfj8RLvS/TWHcJUyGiPD5QQkGWE0DwIh5nZOMphKN4n7fRW kYZWMpfwEgAf23/ZR3cwlZvk3jIYNHSN+7oImcrYt3e4P/IX1/HKPPtgRk3VwFXNzzyX e5tJn5KWUdXu2Vo5LUMROXsuClFw5wWwaZl+CYLZfld3WmfP7N4uAhzCzzG/w6xy8DYb K9PyDWHH0Dt+794m3fe2PxTY7CUCQR6SeXQ/6HCGoOssqeU7GvIwq1DEybJv4BERE+bY rM+Q== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@google.com header.s=20161025 header.b=Vd1akRsv; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id 88si871912otv.12.2020.03.04.00.34.15; Wed, 04 Mar 2020 00:34:29 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@google.com header.s=20161025 header.b=Vd1akRsv; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728659AbgCDIeF (ORCPT + 99 others); Wed, 4 Mar 2020 03:34:05 -0500 Received: from mail-qv1-f65.google.com ([209.85.219.65]:36609 "EHLO mail-qv1-f65.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1728319AbgCDIeE (ORCPT ); Wed, 4 Mar 2020 03:34:04 -0500 Received: by mail-qv1-f65.google.com with SMTP id r15so427340qve.3 for ; Wed, 04 Mar 2020 00:34:02 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=MGkxEVuNmSpsbMjbs4y3ZqP9ci0NOJ4QjgZ1q4n/Bvw=; b=Vd1akRsv09v+hvji2/nchiQdEo0xQsLZ8q88rQU7ex+/UraV53POStpzqHkK+bKTBy MwIh+WhO2pXt7FC0xQema4LRUdAsMpIxdguBysHFyVX8o+CLLMpKtPoa0c6gBqHscTyM TPEAkhpsZ5FJPB5NHE1SeRunP29S4Dijaz2kYxxolpJLvIzcoyy9gg+/T7UlTdWWHzCs Sn+mY3sEGXQksFTp5C78RqTWr2WvF7a81HSvzr+YMOWaxgDc7EvcsKXWil9kzkOJV/Jp PtgAIZFbiIa5DUn+6ciE+FEHhN5Cr2RhNyM1d6UGfofP9i+huwEiDCOS1fhZbyCihmvr 1erw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=MGkxEVuNmSpsbMjbs4y3ZqP9ci0NOJ4QjgZ1q4n/Bvw=; b=PUPIKZbEI+Wg/7WEmEi6Sz7hnQ1m0h5+cyax5Ax+DIJfNcLRL5zQGliiq+vftaD+hE W82bUb1pkCE+lPqQzcJ8GgfeZvp6umG/bQbPYG2HPoChCB05utYA9n+AWMI3nrfqI2Ol q98n1eY+J2yfUCEBHM9Y/A5AA35fyoVX9IIqOR8Az5VqS9nhpKjf3D8kDn/uBwOM0l8K R76NaTO0RTXxYUHN8iZl0h9QLdzFgFmomecOjiEMCOvbbT/tS4ZlVESt49g4eyM6MUFd fDoGs/FgUjR/c553rGre6ONGIAyauzejW2dzZFxqiHm0H9Ie21jtAOllXxvwalbm1hMs oBNA== X-Gm-Message-State: ANhLgQ2rvcpW/lWgps0DLhGiDP+8iNsWl2FGbiqCWRNJ9+6RJO1V3xCp nHGJdyU4Zn7X5MgCBUcPrYNIXLDPrPkmF6AGa9Cfpfrw4po= X-Received: by 2002:a05:6214:1467:: with SMTP id c7mr1246909qvy.122.1583310841976; Wed, 04 Mar 2020 00:34:01 -0800 (PST) MIME-Version: 1.0 References: <000000000000dd909105a002ebe6@google.com> <01d56a46-2ed1-9953-9824-f32e778beea4@moonlit-rail.com> <60c24894-f0ab-fb41-b0f3-e6c9f940a955@moonlit-rail.com> In-Reply-To: <60c24894-f0ab-fb41-b0f3-e6c9f940a955@moonlit-rail.com> From: Dmitry Vyukov Date: Wed, 4 Mar 2020 09:33:50 +0100 Message-ID: Subject: Re: INFO: rcu detected stall in sys_keyctl To: Kris Karas Cc: LKML Content-Type: text/plain; charset="UTF-8" Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Wed, Mar 4, 2020 at 9:32 AM Kris Karas wrote: > > Dmitry Vyukov wrote: > > syzbot wrote: > >> Call Trace: > >> > >> __dump_stack lib/dump_stack.c:77 [inline] > >> dump_stack+0x197/0x210 lib/dump_stack.c:118 > >> nmi_cpu_backtrace.cold+0x70/0xb2 lib/nmi_backtrace.c:101 > >> nmi_trigger_cpumask_backtrace+0x23b/0x28b lib/nmi_backtrace.c:62 > >> arch_trigger_cpumask_backtrace+0x14/0x20 arch/x86/kernel/apic/hw_nmi.c:38 > >> trigger_single_cpu_backtrace include/linux/nmi.h:164 [inline] > >> rcu_dump_cpu_stacks+0x183/0x1cf kernel/rcu/tree_stall.h:254 > >> print_cpu_stall kernel/rcu/tree_stall.h:475 [inline] > >> check_cpu_stall kernel/rcu/tree_stall.h:549 [inline] > >> rcu_pending kernel/rcu/tree.c:3030 [inline] > >> rcu_sched_clock_irq.cold+0x51a/0xc37 kernel/rcu/tree.c:2276 > >> update_process_times+0x2d/0x70 kernel/time/timer.c:1726 > >> tick_sched_handle+0xa2/0x190 kernel/time/tick-sched.c:171 > >> tick_sched_timer+0x53/0x140 kernel/time/tick-sched.c:1314 > >> __run_hrtimer kernel/time/hrtimer.c:1517 [inline] > >> __hrtimer_run_queues+0x364/0xe40 kernel/time/hrtimer.c:1579 > >> hrtimer_interrupt+0x314/0x770 kernel/time/hrtimer.c:1641 > >> local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1119 [inline] > >> smp_apic_timer_interrupt+0x160/0x610 arch/x86/kernel/apic/apic.c:1144 > >> apic_timer_interrupt+0xf/0x20 arch/x86/entry/entry_64.S:829 > >> > >> > > +lib/mpi maintainers > > > > I wonder if this can also be triggered by remote actors (tls, wifi, usb, etc). > > > > This looks somewhat similar to an OOPS + rcu stall I reported earlier in > reply to Greg KH's announcement of 5.5.7: > > rcu: INFO: rcu_sched self-detected stall on CPU > rcu: 14-....: (20999 ticks this GP) idle=216/1/0x4000000000000002 softirq=454/454 fqs=5250 > (t=21004 jiffies g=-755 q=1327) > NMI backtrace for cpu 14 > CPU: 14 PID: 520 Comm: pidof Tainted: G D 5.5.7 #1 > Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./X470 Taichi, BIOS P3.50 07/18/2019 > Call Trace: > > dump_stack+0x50/0x70 > nmi_cpu_backtrace.cold+0x14/0x53 > ? lapic_can_unplug_cpu.cold+0x44/0x44 > nmi_trigger_cpumask_backtrace+0x7b/0x88 > rcu_dump_cpu_stacks+0x7b/0xa9 > rcu_sched_clock_irq.cold+0x152/0x39b > update_process_times+0x1f/0x50 > tick_sched_timer+0x40/0x90 > ? tick_sched_do_timer+0x50/0x50 > __hrtimer_run_queues+0xdd/0x180 > hrtimer_interrupt+0x108/0x230 > smp_apic_timer_interrupt+0x53/0xa0 > apic_timer_interrupt+0xf/0x20 > > > I don't have a reproducer for it, either. It showed up in 5.5.7 (but > might be from earlier as it reproduces so infrequently). > > Kris Hi Kris, Please re-send this to full To/Cc list. Nobody reads LKML/syzbot per se.