Received: by 2002:a25:683:0:0:0:0:0 with SMTP id 125csp558287ybg; Fri, 12 Jun 2020 08:35:06 -0700 (PDT) X-Google-Smtp-Source: ABdhPJx4v+jPCVJMzJSi83oCz9OgIAitm5LUx3ZXaELUHVDUBGBYSkaDPKZBmxFMgUa24c8NHvgi X-Received: by 2002:a17:906:695a:: with SMTP id c26mr14197196ejs.214.1591976106564; Fri, 12 Jun 2020 08:35:06 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1591976106; cv=none; d=google.com; s=arc-20160816; b=TEV9VpRxq/vrftWSgY5ufD3JXRUCaWCboExOTl8sxDEHxzoqE/InjRpHEh1qbONnpA tO+nBu6xrjW6AMp87+B9Sf6Rk65sy+XvLaN8KzxeNUkEDVUGs6ROMLJmqeEa1URO8d3v 4tUP7L9gpPw0ceLViblkPrsjk3RkgAeCNujqH1Fagbv3AMZHrQvz1RRO0PQ1hqnyzjF7 8DYxwJmLjuaCwwTFIX/XBEHe8uah+OiwWNb3gBBMIDBA8IKeIX++8E/7iyN8Q6q+PXdr ywU9J9/NAjeUDdd/T2DYs6pgvcLkGMKrE1XhGCgFRsfDjzAvr/GGoi6nzredJSbvksIu O7VQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:dkim-signature; bh=1bzFs/3D9de07O+VVT9Y1Exb8KtBe+TWOs5uYgeoTAs=; b=FIAgLVCjO1YXy0N8Pc/64Bu3NSXWEQ3FW/6yWIS60/pVrY0UH/XDTV+e8vBgi6ObdD CFTHrek6+qBYWCJsb1w28kdMZIIbOVNMF1x1wSuAkL+3GukYgPj58UvE5uBeA246WVB6 6K3TS76AS9UUD9UGC4vbvLUB/jEcAZbfNMmTib22YXu23TfAfx5s4XvMK8Xs/eVU3tjN kuufvy3MXaHAlBqiOr1ZnBU9lCdp69M/+s1jmRZGqGkxnGGkvrW2BDAd9MGflVdH5PjO uuIHyyLyQUU7FKO8ZY2u5eqENyFYicTB4mONs5TW6XdbHdQ9hJjHd2VXjH248+5aqtoW x6PQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@kernel.org header.s=default header.b="t/BJGapH"; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id dm17si3516262edb.312.2020.06.12.08.34.43; Fri, 12 Jun 2020 08:35:06 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=default header.b="t/BJGapH"; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726463AbgFLPc1 (ORCPT + 99 others); Fri, 12 Jun 2020 11:32:27 -0400 Received: from mail.kernel.org ([198.145.29.99]:50606 "EHLO mail.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726341AbgFLPc1 (ORCPT ); Fri, 12 Jun 2020 11:32:27 -0400 Received: from mail-wr1-f46.google.com (mail-wr1-f46.google.com [209.85.221.46]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id 2DCDB20897 for ; Fri, 12 Jun 2020 15:32:26 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1591975946; bh=1bzFs/3D9de07O+VVT9Y1Exb8KtBe+TWOs5uYgeoTAs=; h=References:In-Reply-To:From:Date:Subject:To:Cc:From; b=t/BJGapHgyyVp0rAEapRuPoZCWwU9+VAHlCvOKkUD1WLOOAqzV1TofaFn4eixuiTb wW3NXMUj+GKBzxbCdX4YvJLIsvoeSS+QqOnELPRBiSDsEFKZYoNTiIMDVR4Lb7YbEc HnFDylLPtVaKl7IFOYeDkFzvbeacoITpPU0JARPQ= Received: by mail-wr1-f46.google.com with SMTP id l10so10149265wrr.10 for ; Fri, 12 Jun 2020 08:32:26 -0700 (PDT) X-Gm-Message-State: AOAM533dv1If+7XXGud5apYRVyZwcnS1O2RemzHejlFH3D7sNZaj5z/a aSyBIlBzBgjUg5SlvJRa4nYLX2nNtTzDClwLRq8WSA== X-Received: by 2002:a5d:49c5:: with SMTP id t5mr15864784wrs.18.1591975944724; Fri, 12 Jun 2020 08:32:24 -0700 (PDT) MIME-Version: 1.0 References: <20200611235305.GA32342@paulmck-ThinkPad-P72> <871rmkzcc8.fsf@nanos.tec.linutronix.de> <87wo4cxubv.fsf@nanos.tec.linutronix.de> In-Reply-To: <87wo4cxubv.fsf@nanos.tec.linutronix.de> From: Andy Lutomirski Date: Fri, 12 Jun 2020 08:32:13 -0700 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: [PATCH x86/entry: Force rcu_irq_enter() when in idle task To: Thomas Gleixner Cc: "Paul E. McKenney" , LKML , rcu@vger.kernel.org, Andrew Lutomirski , X86 ML , Frederic Weisbecker , Steven Rostedt , Joel Fernandes , Mathieu Desnoyers , Will Deacon , Peter Zijlstra Content-Type: text/plain; charset="UTF-8" Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Fri, Jun 12, 2020 at 6:55 AM Thomas Gleixner wrote: > > The idea of conditionally calling into rcu_irq_enter() only when RCU is > not watching turned out to be not completely thought through. > > Paul noticed occasional premature end of grace periods in RCU torture > testing. Bisection led to the commit which made the invocation of > rcu_irq_enter() conditional on !rcu_is_watching(). > > It turned out that this conditional breaks RCU assumptions about the idle > task when the scheduler tick happens to be a nested interrupt. Nested > interrupts can happen when the first interrupt invokes softirq processing > on return which enables interrupts. If that nested tick interrupt does not > invoke rcu_irq_enter() then the nest accounting in RCU claims that this is > the first interrupt which might mark a quiescient state and end grace > periods prematurely. > > Change the condition from !rcu_is_watching() to is_idle_task(current) which > enforces that interrupts in the idle task unconditionally invoke > rcu_irq_enter() independent of the RCU state. > > This is also correct vs. user mode entries in NOHZ full scenarios because > user mode entries bring RCU out of EQS and force the RCU irq nesting state > accounting to nested. As only the first interrupt can enter from user mode > a nested tick interrupt will enter from kernel mode and as the nesting > state accounting is forced to nesting it will not do anything stupid even > if rcu_irq_enter() has not been invoked. Acked-by: Andy Lutomirski