Received: by 2002:a25:ad19:0:0:0:0:0 with SMTP id y25csp2127798ybi; Sat, 13 Jul 2019 07:22:36 -0700 (PDT) X-Google-Smtp-Source: APXvYqzb3s1itcOAQbQvVK8JKS9iSDI30qawoX5Zki0k4o9pG2uF30G5dX4VuwA4005qa9miN2YV X-Received: by 2002:a17:902:aa83:: with SMTP id d3mr17501601plr.74.1563027756620; Sat, 13 Jul 2019 07:22:36 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1563027756; cv=none; d=google.com; s=arc-20160816; b=Amix4t0GFyEgLntmwL3HBWne1i6pFrNvIjfiMUfPy6WLka86zgjc57FYNVSEoxqwUN Ryzi8iMKlj6uDelZgP/IltkTbGOM/VUPkzTVnf63VshysnnrevhUy4J0DvBzJclbx6YX zFrKXPtFTS5V4/GiL/AA0Uz+GLIz3AW+96+/Ec5IpXaadOO4jDdYEukf1yfrg6vLJxCx HpmBlBMVGEsBsDncl3w8Xsj7K53e+7Wqg0OKoV/F0GblL0JpmIObyHW2E86RVrO813yy F2eBl448Y0hppN0eSfX3e3u8WDDk1md4Kt+jPNbQdncWAMHVIzhVwOoMCnKt8fJpj+oH wSuw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:dkim-signature; bh=Eoo4TggbXqVeMTReA94Ufd750gwnU1fKyL4kS8L/PyY=; b=lKO2+V6UDZ0nVJWHyuunevcIKdVz6r4GKTw8R8Et0Eitq8+7STka/iApfitnWMMv4d rWOzV/u2hXxgjDJwmNWiWRUtNKL19D5/npIz/xQLsOGV2r6RmF+ImVet8FJEXHAQSD6m +lozxqhFRvtHmcztb2QRasEcJ/3ETn+E0nR99G+R52GjEV5GSgoth69BmNmV0m1Gc/vj VM0er/9VGhifgZtPyu7nKNB2fMFcoQZKnzP2Fp073cvyL5HLv5weN4CPH+AN1rUiua66 +f2NowY9pSj/1mXq15t/zmd3QOFKNJufz9oNDAGazzx8HHAVD1hfTBYs41v0pq57a5QO cZVQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@joelfernandes.org header.s=google header.b=UCOs5FL8; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id k23si649545pgb.228.2019.07.13.07.22.21; Sat, 13 Jul 2019 07:22:36 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@joelfernandes.org header.s=google header.b=UCOs5FL8; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727837AbfGMOUP (ORCPT + 99 others); Sat, 13 Jul 2019 10:20:15 -0400 Received: from mail-lf1-f66.google.com ([209.85.167.66]:33481 "EHLO mail-lf1-f66.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727504AbfGMOUP (ORCPT ); Sat, 13 Jul 2019 10:20:15 -0400 Received: by mail-lf1-f66.google.com with SMTP id x3so8309642lfc.0 for ; Sat, 13 Jul 2019 07:20:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=joelfernandes.org; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=Eoo4TggbXqVeMTReA94Ufd750gwnU1fKyL4kS8L/PyY=; b=UCOs5FL8fHXmegSsSGaSv3eE8QOcjtDyOHU8x4M4O/v/X7byzi/hEZl5y719AbZjpB QxtWKIyxb118isP7mkPt/viq+2zaHqo4qXIcfjDGFlbso54ehvIxnv6ylEwR9AC7yLLf OuC6yjmGzH9u/i6zrKIphMp2GwStuLYsEfPKA= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=Eoo4TggbXqVeMTReA94Ufd750gwnU1fKyL4kS8L/PyY=; b=VbBJ+I+ILHfq2ok7UTP6iJPP/Jqn/Ipg+gX/CgBQpQOGc/D1rsHwpZZ6/PkcFAGTvP McS+uNDADxh2sI6kNO9WKAAopz7FE9JGl+ca3Zc3PB/mcKdIn8K/MInkwD+WUCV1pYhB +zaSn2U/+JUV4BEUyY+qnLXY7jiJ0kGLLIVOopbIoEZR6rCCR0jy5NkPy9YLjU7zFi+o NSoSTgN+rCttXMSJGwM066cspBTlW1/geWnybTXGSJ3wR3WBBDKZpYTwHiyomFNNfkL+ Mb8VOhOxM/75L7gkTjZ9YVTOTnljvKshBVtRsilA8QDIv2n98f6o6tNwbBIa7CBVP6Xo Se/A== X-Gm-Message-State: APjAAAXw67bySnplDDp7NV5SgXnbrpNEJCq6QOZes/lXZzmuNm4EBbWU N250de1QU4K/4ZmBU/ep+p5RS8b9kI50FtNfJZA= X-Received: by 2002:a19:c80b:: with SMTP id y11mr7118647lff.81.1563027612870; Sat, 13 Jul 2019 07:20:12 -0700 (PDT) MIME-Version: 1.0 References: <20190708130359.GA42888@google.com> <20190709055815.GA19459@X58A-UD3R> <20190709124102.GR26519@linux.ibm.com> <20190710012025.GA20711@X58A-UD3R> <20190711123052.GI26519@linux.ibm.com> <20190711130849.GA212044@google.com> <20190711150215.GK26519@linux.ibm.com> <20190711164818.GA260447@google.com> <20190711195839.GA163275@google.com> <20190712063240.GD7702@X58A-UD3R> <20190712125116.GB92297@google.com> In-Reply-To: From: Joel Fernandes Date: Sat, 13 Jul 2019 10:20:02 -0400 Message-ID: Subject: Re: [PATCH] rcu: Make jiffies_till_sched_qs writable To: Byungchul Park Cc: Byungchul Park , "Paul E. McKenney" , Josh Triplett , Steven Rostedt , Mathieu Desnoyers , Lai Jiangshan , rcu , LKML , kernel-team@lge.com Content-Type: text/plain; charset="UTF-8" Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Sat, Jul 13, 2019 at 4:47 AM Byungchul Park wrote: > > On Fri, Jul 12, 2019 at 9:51 PM Joel Fernandes wrote: > > > > On Fri, Jul 12, 2019 at 03:32:40PM +0900, Byungchul Park wrote: > > > On Thu, Jul 11, 2019 at 03:58:39PM -0400, Joel Fernandes wrote: > > > > Hmm, speaking of grace period durations, it seems to me the maximum grace > > > > period ever is recorded in rcu_state.gp_max. However it is not read from > > > > anywhere. > > > > > > > > Any idea why it was added but not used? > > > > > > > > I am interested in dumping this value just for fun, and seeing what I get. > > > > > > > > I wonder also it is useful to dump it in rcutorture/rcuperf to find any > > > > issues, or even expose it in sys/proc fs to see what worst case grace periods > > > > look like. > > > > > > Hi, > > > > > > commit ae91aa0adb14dc33114d566feca2f7cb7a96b8b7 > > > rcu: Remove debugfs tracing > > > > > > removed all debugfs tracing, gp_max also included. > > > > > > And you sounds great. And even looks not that hard to add it like, > > > > > > :) > > > > > > diff --git a/kernel/rcu/tree.c b/kernel/rcu/tree.c > > > index ad9dc86..86095ff 100644 > > > --- a/kernel/rcu/tree.c > > > +++ b/kernel/rcu/tree.c > > > @@ -1658,8 +1658,10 @@ static void rcu_gp_cleanup(void) > > > raw_spin_lock_irq_rcu_node(rnp); > > > rcu_state.gp_end = jiffies; > > > gp_duration = rcu_state.gp_end - rcu_state.gp_start; > > > - if (gp_duration > rcu_state.gp_max) > > > + if (gp_duration > rcu_state.gp_max) { > > > rcu_state.gp_max = gp_duration; > > > + trace_rcu_grace_period(something something); > > > + } > > > > Yes, that makes sense. But I think it is much better off as a readable value > > from a virtual fs. The drawback of tracing for this sort of thing are: > > - Tracing will only catch it if tracing is on > > - Tracing data can be lost if too many events, then no one has a clue what > > the max gp time is. > > - The data is already available in rcu_state::gp_max so copying it into the > > trace buffer seems a bit pointless IMHO > > - It is a lot easier on ones eyes to process a single counter than process > > heaps of traces. > > > > I think a minimal set of RCU counters exposed to /proc or /sys should not > > hurt and could do more good than not. The scheduler already does this for > > scheduler statistics. I have seen Peter complain a lot about new tracepoints > > but not much (or never) about new statistics. > > > > Tracing has its strengths but may not apply well here IMO. I think a counter > > like this could be useful for tuning of things like the jiffies_*_sched_qs, > > the stall timeouts and also any other RCU knobs. What do you think? > > I prefer proc/sys knob for it to tracepoint. Why I've considered it is just it > looks like undoing what Paul did at ae91aa0ad. > > I think you're rational enough. I just wondered how Paul think of it. I believe at least initially, a set of statistics can be made available only when rcutorture or rcuperf module is loaded. That way they are purely only for debugging and nothing needs to be exposed to normal kernels distributed thus reducing testability concerns. rcu_state::gp_max would be trivial to expose through this, but for other statistics that are more complicated - perhaps tracepoint_probe_register can be used to add hooks on to the tracepoints and generate statistics from them. Again the registration of the probe and the probe handler itself would all be in rcutorture/rcuperf test code and not a part of the kernel proper. Thoughts? - Joel