Received: by 2002:a05:6358:1087:b0:cb:c9d3:cd90 with SMTP id j7csp492800rwi; Thu, 13 Oct 2022 00:38:30 -0700 (PDT) X-Google-Smtp-Source: AMsMyM6AnbsYbzYXxjlwkxZAYaegCstN7stLK2RvTSnt63vTdxgncIAz3bwqQVR+Ls9uvfWr7D3a X-Received: by 2002:a63:581e:0:b0:43c:29a0:6390 with SMTP id m30-20020a63581e000000b0043c29a06390mr29420384pgb.552.1665646709767; Thu, 13 Oct 2022 00:38:29 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1665646709; cv=none; d=google.com; s=arc-20160816; b=m6/SuuEfj80xzB1pvTEs9yAth5Xz+D0JGRTTAWV6ch0FXTnW5tl0W0kILDUB1TQr9U EsRP7n7DSqsBZJ/Mf4SQ4RUcB6HUr7owTj5y6uCRqfeIy83DMXf0NdXgL5xlYcJMW/I6 Ha9UoiXpaU0X0471L/BFZqkIkByQ1LAkx/U6xZpgPx3G0ceV0C//pYxuQ0ECOfoph+Yx 7cOEKBsv3m86hXVyLOHAXNOq9CNwiNs/6+a3Op8N0oORUDjAA5Y8eXKvqh6+PGt4Ld3w g9fPe3cdi7Vr6cnAgjkCUkPLJeYNTg2o6FIV80zad6tECiKQY2piF4smxxrKMh7nHqDe snSg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:in-reply-to:content-disposition:mime-version :references:message-id:subject:cc:to:from:date:dkim-signature; bh=NW8B2A4IOWuKOdLEgcuPTswvtWIBJW4ugM3qn1pYU6g=; b=SxbOQejgurZN/bkqQEkVlYTaX7HOCPqvmQ3wmIQFx3afJ8K8WUoS9PUXqcfRWHYt2n ICz1BMtenvfZE2C4xjxbPbF3e1lNkd207/Pna6jVx0C0LxAdHAjFar/THO0O9JENbGDU i54kUvnc74qZm7kgEI2gcoacHfuWugVCrsz8XO80bgge/E3p+BMO+qkCbuqzopGyOpgV jfOd97TXfTRL74uhyZ7yN6qcR9WgLTjec7/7Bodk6axVuc8UB3r9qd9KsxdqgEQTiouH BMgm6ufq9QJsi8EwBqP8mljdDkLHZojhDw2okdO1uyUbdYDQrh/xnSqTid8hvAVMBdBd 6Qog== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@resnulli-us.20210112.gappssmtp.com header.s=20210112 header.b=WVlWFONP; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id bf16-20020a656d10000000b0045d1aa2a586si14242567pgb.197.2022.10.13.00.38.17; Thu, 13 Oct 2022 00:38:29 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@resnulli-us.20210112.gappssmtp.com header.s=20210112 header.b=WVlWFONP; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229591AbiJMHLf (ORCPT + 99 others); Thu, 13 Oct 2022 03:11:35 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:35422 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229635AbiJMHLO (ORCPT ); Thu, 13 Oct 2022 03:11:14 -0400 Received: from mail-ej1-x629.google.com (mail-ej1-x629.google.com [IPv6:2a00:1450:4864:20::629]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 8B5D21142C2 for ; Thu, 13 Oct 2022 00:11:09 -0700 (PDT) Received: by mail-ej1-x629.google.com with SMTP id k2so1962050ejr.2 for ; Thu, 13 Oct 2022 00:11:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=resnulli-us.20210112.gappssmtp.com; s=20210112; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=NW8B2A4IOWuKOdLEgcuPTswvtWIBJW4ugM3qn1pYU6g=; b=WVlWFONPAmcJz+b5FrHbw1XDPOcSGVqpYQEWv5efU6Aw2pUAWNyRgY08rPVd2F/UuS cu+JCwwJrB8OiPe8p+3JZ9KT6/uvOxOOtYvE+xn6Tji2xaNhKtCJcOrYg+pYh2Ipa8JZ ghTRipGho321op6CiyHmEG8RHLGr228q32tZFmRhyl+3AWiWo+jjoBJqb+heO7eQUkhX MzuHdf76XFuS8BTwHeb9RapS+8Zwf7F+nLS6u6NyReodp2qqUO2ZvNm2CqiUiDnpDvQB mJUDUpEP4Iuh6/xI5w7ebLXkyHaDc+LE8XLiKNSdLCvScJ44k4zMJvo2XhX4lNa35t2Q RagQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=NW8B2A4IOWuKOdLEgcuPTswvtWIBJW4ugM3qn1pYU6g=; b=4Vk3ZjyrxHVknZ5hvAmJ6iuaL3ifY4TApLb5efXRT3gb79exVeBckykBHLGLtwTZDk GW3gVnhgXeujpa7V/fP10O9xZgZVuGiXZGbD7MdHnE3ws0OsEKpnkfg2kxf33z1wx6/k 1rtqlCmQRVKggW927jEpLvta9R77fmxodqOlYesPY5F1F7+y9R/mEkoxhJP8+uzc27II 4pik6qS39E3jIFPdNe+xl6FprkdsO/idGlA2dJAT/NStks6GMleboM9NYdYpGcRVWIIC cQNdRwsmhsdYR6mf3jlI2coHrOGNTxRGw8naaDOgRRKogMpfOVAyNWTVAjy/xE0SOWoG xhFw== X-Gm-Message-State: ACrzQf2LL7s4RyQ5EKv0kppkZ/688Ek2ID0LIRg0nKoFnhOw9aQaxehs lWHFAMY/l93RfnibCivGKWzTcA== X-Received: by 2002:a17:906:da85:b0:741:40a7:d08d with SMTP id xh5-20020a170906da8500b0074140a7d08dmr26757892ejb.263.1665645067965; Thu, 13 Oct 2022 00:11:07 -0700 (PDT) Received: from localhost ([86.61.181.4]) by smtp.gmail.com with ESMTPSA id t21-20020a170906609500b007402796f065sm2471592ejj.132.2022.10.13.00.11.07 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 13 Oct 2022 00:11:07 -0700 (PDT) Date: Thu, 13 Oct 2022 09:11:06 +0200 From: Jiri Pirko To: Eric Dumazet Cc: Dmitry Vyukov , syzbot , davem@davemloft.net, kuba@kernel.org, linux-kernel@vger.kernel.org, netdev@vger.kernel.org, pabeni@redhat.com, syzkaller-bugs@googlegroups.com Subject: Re: [syzbot] kernel panic: kernel stack overflow Message-ID: References: <000000000000c8900705ead19e41@google.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,RCVD_IN_DNSWL_NONE,SPF_HELO_NONE,SPF_NONE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Wed, Oct 12, 2022 at 06:42:39PM CEST, edumazet@google.com wrote: >On Wed, Oct 12, 2022 at 8:08 AM Jiri Pirko wrote: >> >> Wed, Oct 12, 2022 at 03:54:59PM CEST, dvyukov@google.com wrote: >> >On Wed, 12 Oct 2022 at 15:11, Jiri Pirko wrote: >> >> >> >> Wed, Oct 12, 2022 at 09:53:27AM CEST, dvyukov@google.com wrote: >> >> >On Wed, 12 Oct 2022 at 09:48, syzbot >> >> > wrote: >> >> >> >> >> >> Hello, >> >> >> >> >> >> syzbot found the following issue on: >> >> >> >> >> >> HEAD commit: bbed346d5a96 Merge branch 'for-next/core' into for-kernelci >> >> >> git tree: git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-kernelci >> >> >> console output: https://syzkaller.appspot.com/x/log.txt?x=14a03a2a880000 >> >> >> kernel config: https://syzkaller.appspot.com/x/.config?x=aae2d21e7dd80684 >> >> >> dashboard link: https://syzkaller.appspot.com/bug?extid=60748c96cf5c6df8e581 >> >> >> compiler: Debian clang version 13.0.1-++20220126092033+75e33f71c2da-1~exp1~20220126212112.63, GNU ld (GNU Binutils for Debian) 2.35.2 >> >> >> userspace arch: arm64 >> >> >> >> >> >> Unfortunately, I don't have any reproducer for this issue yet. >> >> >> >> >> >> Downloadable assets: >> >> >> disk image: https://storage.googleapis.com/syzbot-assets/11078f50b80b/disk-bbed346d.raw.xz >> >> >> vmlinux: https://storage.googleapis.com/syzbot-assets/398e5f1e6c84/vmlinux-bbed346d.xz >> >> >> >> >> >> IMPORTANT: if you fix the issue, please add the following tag to the commit: >> >> >> Reported-by: syzbot+60748c96cf5c6df8e581@syzkaller.appspotmail.com >> >> > >> >> >+Jiri >> >> > >> >> >It looks like the issue is with the team device. It seems to call >> >> >itself infinitely. >> >> >team_device_event was mentioned in stack overflow bugs in the past: >> >> >https://groups.google.com/g/syzkaller-bugs/search?q=%22team_device_event%22 >> >> >> >> Hi, do you have dmesg output available by any chance? >> > >> >Hi Jiri, >> > >> >syzbot attaches dmesg output to every report under the "console output" link. >> >> I see. I guess the debug messages are not printed out, I don't see them >> there. Would it be possible to turn them on? > >What debug messages do you need ? > >There is a nice stack trace [1] with file:number available Sure, but there are no debug printks that are printed out during feature processing. That could shed some light on if this is caused by lack of nest level enforce or perhaps for some reason repetitive processing of the same team-port netdevice couple in loop. > > >My guess was that for some reason the team driver does not enforce a >max nest level of 8 ? > >https://git.kernel.org/pub/scm/linux/kernel/git/netdev/net.git/commit/?id=65921376425fc9c8b7ce647e1f7989f7cdf5dd70 > > >[1] >CPU: 1 PID: 16874 Comm: syz-executor.3 Not tainted >6.0.0-rc7-syzkaller-18095-gbbed346d5a96 #0 >Hardware name: Google Google Compute Engine/Google Compute Engine, >BIOS Google 09/30/2022 >Call trace: > dump_backtrace+0x1c4/0x1f0 arch/arm64/kernel/stacktrace.c:156 > show_stack+0x2c/0x54 arch/arm64/kernel/stacktrace.c:163 > __dump_stack lib/dump_stack.c:88 [inline] > dump_stack_lvl+0x104/0x16c lib/dump_stack.c:106 > dump_stack+0x1c/0x58 lib/dump_stack.c:113 > panic+0x218/0x50c kernel/panic.c:274 > nmi_panic+0xbc/0xf0 kernel/panic.c:169 > panic_bad_stack+0x134/0x154 arch/arm64/kernel/traps.c:906 > handle_bad_stack+0x34/0x48 arch/arm64/kernel/entry-common.c:848 > __bad_stack+0x78/0x7c arch/arm64/kernel/entry.S:549 > mark_lock+0x4/0x1b4 kernel/locking/lockdep.c:4593 > lock_acquire+0x100/0x1f8 kernel/locking/lockdep.c:5666 > do_write_seqcount_begin_nested include/linux/seqlock.h:516 [inline] > do_write_seqcount_begin include/linux/seqlock.h:541 [inline] > psi_group_change+0x128/0x3d0 kernel/sched/psi.c:705 > psi_task_switch+0x9c/0x310 kernel/sched/psi.c:851 > psi_sched_switch kernel/sched/stats.h:194 [inline] > __schedule+0x554/0x5a0 kernel/sched/core.c:6489 > preempt_schedule_irq+0x64/0x110 kernel/sched/core.c:6806 > arm64_preempt_schedule_irq arch/arm64/kernel/entry-common.c:265 [inline] > __el1_irq arch/arm64/kernel/entry-common.c:473 [inline] > el1_interrupt+0x4c/0x68 arch/arm64/kernel/entry-common.c:485 > el1h_64_irq_handler+0x18/0x24 arch/arm64/kernel/entry-common.c:490 > el1h_64_irq+0x64/0x68 arch/arm64/kernel/entry.S:577 > arch_local_irq_restore+0x8/0x10 arch/arm64/include/asm/irqflags.h:122 > lock_is_held include/linux/lockdep.h:283 [inline] > __might_resched+0x7c/0x218 kernel/sched/core.c:9854 > __might_sleep+0x48/0x78 kernel/sched/core.c:9821 > might_alloc include/linux/sched/mm.h:274 [inline] > slab_pre_alloc_hook mm/slab.h:700 [inline] > slab_alloc_node mm/slub.c:3162 [inline] > kmem_cache_alloc_node+0x80/0x370 mm/slub.c:3298 > __alloc_skb+0xf8/0x378 net/core/skbuff.c:422 > alloc_skb include/linux/skbuff.h:1257 [inline] > nlmsg_new include/net/netlink.h:953 [inline] > genlmsg_new include/net/genetlink.h:410 [inline] > ethnl_default_notify+0x16c/0x320 net/ethtool/netlink.c:640 >...