Received: by 2002:a05:6a10:a852:0:0:0:0 with SMTP id d18csp253529pxy; Fri, 30 Apr 2021 04:50:50 -0700 (PDT) X-Google-Smtp-Source: ABdhPJx+l38nh1HeuDiGLFdH9b5v9Ns+1wxqs/pxWSs8b9C8yLl7wi64cN+qRGASsOHEJvfRW3Xr X-Received: by 2002:aa7:d90d:: with SMTP id a13mr5376783edr.76.1619783450649; Fri, 30 Apr 2021 04:50:50 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1619783450; cv=none; d=google.com; s=arc-20160816; b=UgnrO1KJtSw8ByGptOUJS/xt9NJhomVUUKEh868wQAhiWvkdeqUtpwLLpcQdsCRHF+ W5OMh3VvqRIDD103O7TAREVd7zfxYZqBDCLQ5z648+3a3B+oUL0U4aqqcljY5VIzP0hM jxYZSgzyvnMiiRCuWYAVDpT1Z80qrunzeNojPPt/iyZha08X8y0w3gOR6vRWFmz4QoC6 4siT6IH90InfxLug8Z3bnvwDgIIi9Erv7G41MZHmrIbTBs+/a9+2+Dscqo018PnPJ+jM qVFdHcC0VINK8OUlyAUQq5k1TDmYAqIIsIhDaeELo35oXZrLLP2jCcDwFbKdFE5ndGPy DDqg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:content-language :in-reply-to:mime-version:user-agent:date:message-id:from:references :cc:to:subject; bh=K17ppss6gpFt8IiSPwStuHxXIpBpLWkqmci0gjnTm2g=; b=t/x2H9L+PBYWHM4BTRYsqlc8OgvnPuGj7zbx5pCRXpioO3+19EY7zA2WkQWxpNH4yI xrkb5vyl6eIFGbmuDf61k2XTuUm9di66uRZI1U8VLD7hrCOYzvuEti1/1w6s2kim/ekW S1B3U7WReLhoNiIX5pvKwfBfRqH1Dnq23FgEFNRFeJSHswehJqgBed/FPPAUvzH0f1UJ vhVp1NKPp00p1ZjFGzvFL8UIsGUBY6rsrc0tuPdD/Tg9ZZUHOjBei2bffxC7u5IeJ517 7U/E7SnihEJUXDMNFeSZIG6rZGteogiB/k69XGDBAdOlwbsEFGvUemS/D89oS1WbiZFy 2Dhw== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id os28si3573002ejb.641.2021.04.30.04.50.26; Fri, 30 Apr 2021 04:50:50 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230394AbhD3LuW (ORCPT + 99 others); Fri, 30 Apr 2021 07:50:22 -0400 Received: from www262.sakura.ne.jp ([202.181.97.72]:51276 "EHLO www262.sakura.ne.jp" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229875AbhD3LuS (ORCPT ); Fri, 30 Apr 2021 07:50:18 -0400 Received: from fsav303.sakura.ne.jp (fsav303.sakura.ne.jp [153.120.85.134]) by www262.sakura.ne.jp (8.15.2/8.15.2) with ESMTP id 13UBm58U016239; Fri, 30 Apr 2021 20:48:05 +0900 (JST) (envelope-from penguin-kernel@i-love.sakura.ne.jp) Received: from www262.sakura.ne.jp (202.181.97.72) by fsav303.sakura.ne.jp (F-Secure/fsigk_smtp/550/fsav303.sakura.ne.jp); Fri, 30 Apr 2021 20:48:05 +0900 (JST) X-Virus-Status: clean(F-Secure/fsigk_smtp/550/fsav303.sakura.ne.jp) Received: from [192.168.1.9] (M106072142033.v4.enabler.ne.jp [106.72.142.33]) (authenticated bits=0) by www262.sakura.ne.jp (8.15.2/8.15.2) with ESMTPSA id 13UBm4Lq016232 (version=TLSv1.2 cipher=AES256-GCM-SHA384 bits=256 verify=NO); Fri, 30 Apr 2021 20:48:05 +0900 (JST) (envelope-from penguin-kernel@i-love.sakura.ne.jp) Subject: Re: [PATCH] rtnetlink: add rtnl_lock debug log To: Rocco Yue Cc: Peter Enderborg , Thomas Gleixner , Anshuman Khandual , Vitor Massaru Iha , Sedat Dilek , Wei Yang , Cong Wang , Di Zhu , Stephen Hemminger , Francis Laniel , Roopa Prabhu , Andrii Nakryiko , linux-kernel@vger.kernel.org, netdev@vger.kernel.org, linux-arm-kernel@lists.infradead.org, linux-mediatek@lists.infradead.org, wsd_upsream@mediatek.com, "David S . Miller" , Jakub Kicinski , Masahiro Yamada , Matthias Brugger , Andrew Morton , Nick Desaulniers , Andy Shevchenko , peterz@infradead.org References: <20210429070237.3012-1-rocco.yue@mediatek.com> From: Tetsuo Handa Message-ID: <27fa19c9-81b2-3604-033c-b7fe5d14b620@i-love.sakura.ne.jp> Date: Fri, 30 Apr 2021 20:48:02 +0900 User-Agent: Mozilla/5.0 (Windows NT 6.3; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.10.0 MIME-Version: 1.0 In-Reply-To: <20210429070237.3012-1-rocco.yue@mediatek.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 2021/04/29 16:02, Rocco Yue wrote: > +static void rtnl_print_btrace(struct timer_list *unused) > +{ > + pr_info("----------- %s start -----------\n", __func__); > + pr_info("%s[%d][%c] hold rtnl_lock more than 2 sec, start time: %llu\n", > + rtnl_instance.task->comm, > + rtnl_instance.pid, > + task_state_to_char(rtnl_instance.task), > + rtnl_instance.start_time); > + stack_trace_print(rtnl_instance.addrs, rtnl_instance.nr_entries, 0); Do we want to print same traces every 2 seconds? Since it is possible to stall for e.g. 30 seconds, printing either only upon first call to rtnl_print_btrace() for each stalling duration or only upon end of stalling duration (i.e. from rtnl_relase_btrace()) is better? > + show_stack(rtnl_instance.task, NULL, KERN_DEBUG); Why KERN_DEBUG ? If you retrieve the output via dmesg, KERN_DEBUG would be fine. But for syzkaller (which counts on printk() messages being printed to consoles), KERN_INFO (or default) is expected. > + pr_info("------------ %s end -----------\n", __func__); > +} > + > +static void rtnl_relase_btrace(void) > +{ > + rtnl_instance.end_time = sched_clock(); > + You should del_timer_sync() here than > + if (rtnl_instance.end_time - rtnl_instance.start_time > 2000000000ULL) { > + pr_info("rtnl_lock is held by [%d] from [%llu] to [%llu]\n", > + rtnl_instance.pid, > + rtnl_instance.start_time, > + rtnl_instance.end_time); > + } > + > + del_timer(&rtnl_chk_timer); here in order to make sure that end message is printed only after rtnl_print_btrace() messages are printed. > +} > +#endif > +