Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67;
Date:   Mon, 5 Aug 2019 07:47:55 -0700
From:   "Paul E. McKenney" <paulmck@linux.ibm.com>
To:     Peter Zijlstra <peterz@infradead.org>
Cc:     rcu@vger.kernel.org, linux-kernel@vger.kernel.org,
        mingo@kernel.org, jiangshanlai@gmail.com, dipankar@in.ibm.com,
        akpm@linux-foundation.org, mathieu.desnoyers@efficios.com,
        josh@joshtriplett.org, tglx@linutronix.de, rostedt@goodmis.org,
        dhowells@redhat.com, edumazet@google.com, fweisbec@gmail.com,
        oleg@redhat.com, joel@joelfernandes.org
Subject: Re: [PATCH RFC tip/core/rcu 14/14] rcu/nohz: Make multi_cpu_stop()
 enable tick on all online CPUs
Message-ID: <20190805144755.GH28441@linux.ibm.com>
Reply-To: paulmck@linux.ibm.com
References: <20190802151435.GA1081@linux.ibm.com>
 <20190802151501.13069-14-paulmck@linux.ibm.com>
 <20190804144317.GF2349@hirez.programming.kicks-ass.net>
 <20190804144835.GB2386@hirez.programming.kicks-ass.net>
 <20190804184159.GC28441@linux.ibm.com>
 <20190804202446.GA25634@linux.ibm.com>
 <20190805041901.GA17621@linux.ibm.com>
 <20190805080736.GI2349@hirez.programming.kicks-ass.net>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <20190805080736.GI2349@hirez.programming.kicks-ass.net>
User-Agent: Mutt/1.5.21 (2010-09-15)
Sender: linux-kernel-owner@vger.kernel.org
Precedence: bulk

On Mon, Aug 05, 2019 at 10:07:36AM +0200, Peter Zijlstra wrote:
> On Sun, Aug 04, 2019 at 09:19:01PM -0700, Paul E. McKenney wrote:
> > On Sun, Aug 04, 2019 at 01:24:46PM -0700, Paul E. McKenney wrote:
> 
> > > For whatever it is worth, the things on my list include using 25 rounds
> > > of resched_cpu() on each CPU with ten-jiffy wait between each (instead of
> > > merely 10 rounds), using waitqueues or some such to actually force a
> > > meaningful context switch on the other CPUs, etc.
> 
> That really should not be needed. What are those other CPUs doing?

Excellent question.  It would be really nice to have a CPU-stopper stall
warning, wouldn't it?  But who knows?  Maybe I am the only one to have
run into this.  However, the comment in multi_cpu_stop() just before
the call to touch_nmi_watchdog() leads me to believe otherwise.  ;-)

> > Which appears to have reduced the bug rate by about a factor of two.
> > (But statistics and all that.)
> 
> Which is just weird..

Indeed.  Your point being?

> > I am now trying the same test, but with CONFIG_PREEMPT=y and without
> > quite so much hammering on the scheduler.  This is keying off Peter's
> > earlier mention of preemption.  If this turns out to be solid, perhaps
> > we outlaw CONFIG_PREEMPT=n && CONFIG_NO_HZ_FULL=y?
> 
> CONFIG_PREEMPT=n should work just fine, _something_ is off.

Thank you, that is what I needed to know.

							Thanx, Paul