Received: by 2002:a25:e74b:0:0:0:0:0 with SMTP id e72csp5629ybh; Fri, 17 Jul 2020 16:39:10 -0700 (PDT) X-Google-Smtp-Source: ABdhPJy5rqyqs+rbWwtn3E5bV9R2CUKkGmu3p699vBOCHqlrBV9UTZGwF3L58i42zC/eU8TOAYnL X-Received: by 2002:a17:906:2681:: with SMTP id t1mr10639083ejc.350.1595029150772; Fri, 17 Jul 2020 16:39:10 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1595029150; cv=none; d=google.com; s=arc-20160816; b=PxQa7pYdd+9lU4ZPwA5gMKvFwOxvCy1Oo+h+P1DSlPzR1XElosJ1CruiBHkLHqB4F8 Wh3wQmAyFb3JIdyqrgbZYbPdqR9riXAYPokjFascSeayH2P37KDoftNF3273Y4G0cw3l IImWb0/YIZxTToO0Lrt86sZPFLXiTo+o8UaFuM3RPvpEGOx19ktOKS+5u0CU9JBUPbSj vI1A7yFHDkxCBSC0je9uxN5A9yuXsL9w8pYhAUwUPBSLJTNQazgAoEi5Cb0AeJ/YkH20 VJ80d0uQyErf7lJiIWxKhpc3lxVOcCu/Pz94sit2ysS1tpNtGA2POS9jclgfS6p+18rS O2Cw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:mime-version:message-id:date:references :in-reply-to:subject:cc:to:dkim-signature:dkim-signature:from; bh=qhBCp5oifLUN19We7Kb5IeTk7cj/ecbete5sSwz5VUs=; b=B4FzvxZTsAZnTZM1Aj7S2oGssykAX561zHoRiy61Ppf37RqLBDq8GyfjrCxphebRB0 ff3IXUB51sanynSzbKYUsfwwzCIpgUY4JryrPJFNv+VjYOdhVJtmGmlrE13pJJLT0NWq fncaBf+3Q3E94/2Rd1osr4/iVEa51WVzwrIi54+7X2YCV8TOM/Jf801IZCfLv2pGHqh/ K7Cat+0G/CIi+ixPSdlsNs5wXaDzDYe/E4CqmTjR132BDynCrPB13M7ioJNA7Kx4OfFm fXJ5sTulMlHYDLbt7/LKalUdHGU5iAh9BG9gKkpszOT9gr8XcF6FUb/m7Ka9Qd6fVk8N t8og== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linutronix.de header.s=2020 header.b=k4JrsQqU; dkim=neutral (no key) header.i=@linutronix.de header.b=TJos7CsR; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=linutronix.de Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id i3si5788009edr.555.2020.07.17.16.38.48; Fri, 17 Jul 2020 16:39:10 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@linutronix.de header.s=2020 header.b=k4JrsQqU; dkim=neutral (no key) header.i=@linutronix.de header.b=TJos7CsR; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=linutronix.de Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728672AbgGQXhx (ORCPT + 99 others); Fri, 17 Jul 2020 19:37:53 -0400 Received: from Galois.linutronix.de ([193.142.43.55]:43984 "EHLO galois.linutronix.de" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726851AbgGQXhw (ORCPT ); Fri, 17 Jul 2020 19:37:52 -0400 From: Thomas Gleixner DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linutronix.de; s=2020; t=1595029070; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=qhBCp5oifLUN19We7Kb5IeTk7cj/ecbete5sSwz5VUs=; b=k4JrsQqUWJpSxIsq5XesfpB5sTIc3ogCGGn2Wha9vRngRdl29bapWaYJevS+XojBS8rcve vr/CvkEhBh/aFeW/o3pEVjD5I50v3l/vcY90xuMpiQpCUv9WiAI1Y8rvnL4+nMr30VIltX juVhJjUfB8tu2FCcH/TDvmKMdQ2gP9teqx7ihqhA86AVwSO92BqZArcO8CtqlU8EppwFev yR49SmBHFxfNsTXdV6d7evVc1ZxYa51kaeKRa6KnOrun1RzUPctSF3XlMCTGFkPj69vVHr scH1W4bAfZhIc+hkCzEyOG3QxGJQuh0WYzjHj5YVx0gC7WY5SHTWpfB4uvtXUw== DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=linutronix.de; s=2020e; t=1595029070; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=qhBCp5oifLUN19We7Kb5IeTk7cj/ecbete5sSwz5VUs=; b=TJos7CsRZijD2Iwi2ej/8iISuuowFHmWTVTXGJPlQ3VwsO8FqV5x1ZS8DHNkj3GdyxA9DR DlO+A7bXhhXa9WAQ== To: "Li\, Aubrey" , Vineeth Remanan Pillai , Nishanth Aravamudan , Julien Desfossez , Peter Zijlstra , Tim Chen , mingo@kernel.org, pjt@google.com, torvalds@linux-foundation.org Cc: "Joel Fernandes \(Google\)" , linux-kernel@vger.kernel.org, subhra.mazumdar@oracle.com, fweisbec@gmail.com, keescook@chromium.org, kerrnel@google.com, Phil Auld , Aaron Lu , Aubrey Li , Valentin Schneider , Mel Gorman , Pawan Gupta , Paolo Bonzini , Joel Fernandes , vineethrp@gmail.com, Chen Yu , Christian Brauner , Tim Chen , "Paul E . McKenney" Subject: Re: [RFC PATCH 14/16] irq: Add support for core-wide protection of IRQ and softirq In-Reply-To: References: Date: Sat, 18 Jul 2020 01:37:50 +0200 Message-ID: <87y2nhpvap.fsf@nanos.tec.linutronix.de> MIME-Version: 1.0 Content-Type: text/plain Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org "Li, Aubrey" writes: > On 2020/7/1 5:32, Vineeth Remanan Pillai wrote: > > We saw a lot of soft lockups on the screen when we tested v6. > > [ 186.527883] watchdog: BUG: soft lockup - CPU#86 stuck for 22s! [uperf:5551] > [ 186.535884] watchdog: BUG: soft lockup - CPU#87 stuck for 22s! [uperf:5444] > [ 186.555883] watchdog: BUG: soft lockup - CPU#89 stuck for 22s! [uperf:5547] > [ 187.547884] rcu: INFO: rcu_sched self-detected stall on CPU > [ 187.553760] rcu: 40-....: (14997 ticks this GP) idle=49a/1/0x4000000000000002 softirq=1711/1711 fqs=7279 > [ 187.564685] NMI watchdog: Watchdog detected hard LOCKUP on cpu 14 > [ 187.564723] NMI watchdog: Watchdog detected hard LOCKUP on cpu 38 > > The problem is gone when we reverted this patch. We are running multiple > uperf threads(equal to cpu number) in a cgroup with coresched enabled. > This is 100% reproducible on our side. ROTFL. I just predicted that from staring at the patch ....