Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18;
Date:   Fri, 24 Sep 2021 15:43:37 -0700
From:   "Paul E. McKenney" <paulmck@kernel.org>
To:     Waiman Long <llong@redhat.com>
Cc:     peterz@infradead.org, mingo@redhat.com, will@kernel.org,
        boqun.feng@gmail.com, linux-kernel@vger.kernel.org, richard@nod.at
Subject: Re: Confusing lockdep splat
Message-ID: <20210924224337.GL880162@paulmck-ThinkPad-P17-Gen-1>
Reply-To: paulmck@kernel.org
References: <20210924210247.GA3877322@paulmck-ThinkPad-P17-Gen-1>
 <d8cb4445-cb01-4405-8800-a3eefa253af1@redhat.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <d8cb4445-cb01-4405-8800-a3eefa253af1@redhat.com>
Precedence: bulk

On Fri, Sep 24, 2021 at 05:41:17PM -0400, Waiman Long wrote:
> On 9/24/21 5:02 PM, Paul E. McKenney wrote:
> > Hello!
> > 
> > I got the lockdep splat below from an SRCU-T rcutorture run, which uses
> > a !SMP !PREEMPT kernel.  This is a random event, and about half the time
> > it happens within an hour or two.  My reproducer (on current -rcu "dev"
> > branch for a 16-CPU system) is:
> > 
> > 	tools/testing/selftests/rcutorture/bin/kvm.sh --cpus 16 --configs "16*SRCU-T" --duration 7200
> > 
> > My points of confusion are as follows:
> > 
> > 1.	The locks involved in this deadlock cycle are irq-disabled
> > 	raw spinlocks.	The claimed deadlock cycle uses two CPUs.
> > 	There is only one CPU.	There is no possibility of preemption
> > 	or interrupts.	So how can this deadlock actually happen?
> > 
> > 2.	If there was more than one CPU, then yes, there would be
> > 	a deadlock.  The PI lock is acquired by the wakeup code after
> > 	acquiring the workqueue lock, and rcutorture tests the new ability
> > 	of the scheduler to hold the PI lock across rcu_read_unlock(),
> > 	and while it is at it, across the rest of the unlock primitives.
> > 
> > 	But if there was more than one CPU, Tree SRCU would be used
> > 	instead of Tiny SRCU, and there would be no wakeup invoked from
> > 	srcu_read_unlock().
> > 
> > 	Given only one CPU, there is no way to complete the deadlock
> > 	cycle.
> > 
> > For now, I am working around this by preventing rcutorture from holding
> > the PI lock across Tiny srcu_read_unlock().
> > 
> > Am I missing something subtle here?
> 
> I would say that the lockdep code just doesn't have enough intelligence to
> identify that deadlock is not possible in this special case. There are
> certainly false positives, and it can be hard to get rid of them.

Would it make sense for lockdep to filter out reports involving more
than one CPU unless there is at least one sleeplock in the cycle?

Of course, it gets more complicated when interrupts are involved...

							Thanx, Paul