Received: by 2002:ac0:a582:0:0:0:0:0 with SMTP id m2-v6csp2301407imm; Wed, 3 Oct 2018 01:29:33 -0700 (PDT) X-Google-Smtp-Source: ACcGV60+zYulcwvKgUpT/zZWRybASmfJX+l5MS0QfXSmX4VqGb3hZ0TnorvoF3D3sEjbeIXp9Dj+ X-Received: by 2002:a63:9304:: with SMTP id b4-v6mr366133pge.143.1538555373504; Wed, 03 Oct 2018 01:29:33 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1538555373; cv=none; d=google.com; s=arc-20160816; b=BN+95Vw/RRNtDPmAKzUsDTfpgHl4QRqMgzCDt5wEW/XNrcIAb3U+H/1A5JhsgQQ7yd PU2BWL09uZzAJcc9mHL8uEES7LgqYXpKB/XYybj+4LZgiSSPM0nl/v2eF4mE1T470dJO owYj5apE3ZoyNIa8ht7l+n/QhK4/HazbGMPwQW0gRkPd0GDvADcqv8aVVBWy1uIPzmKY YM4jWhNyeqOFZug+4VLKswtFLIUyDolC6A2po6VaaDsxigr3Yc8p49XoanLLC5KQkMa2 35DFr0xD+3JJKk5Z79e/Eji06ZGFUv3lfPZSK1ftsMv0GaOhST4yUD/WCKPMU5MEB6GR 3LXg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-disposition:mime-version:references:message-id:subject:cc :to:from:date:dkim-signature; bh=Arb13BCu4zbBM0jaVVYdVsl7FbIlqiVlm3Jtq4sWiCM=; b=RMlE6noX7a11EdmkdZsDhYr4POJR6wtP/4LhUWgaOctDu97T9Sw7ATJgBkJaDSqLgX ypVHpp6HXM05C94XqVGDppwcqSwygvOIaSSxhWFqAAI4wdTGdrhfdczju7OqP+GrCdrO GumpTshz981oOcL0pM4K8gkRU8w0B/V9juHOa8fBIot9/B2UW7SdMX/KuhqGEtEXErut F1Sm3IIxO4R5PjFfk2S5T0WebU5HpWyTy1yqXM6bOna8CuKX1HrgQ6m5aDC+nn1sPPR0 q7GBkr5jWW6Yyrnw2ocF0Nj3nNs2/uf5cjWX/gXcYE1RMJ8VxsI+em9iyvogX/RlAYDP qv1Q== ARC-Authentication-Results: i=1; mx.google.com; dkim=fail header.i=@infradead.org header.s=merlin.20170209 header.b=bshuiK0y; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id r13-v6si860190pfb.43.2018.10.03.01.29.18; Wed, 03 Oct 2018 01:29:33 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=fail header.i=@infradead.org header.s=merlin.20170209 header.b=bshuiK0y; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727506AbeJCPQM (ORCPT + 99 others); Wed, 3 Oct 2018 11:16:12 -0400 Received: from merlin.infradead.org ([205.233.59.134]:35478 "EHLO merlin.infradead.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727001AbeJCPQM (ORCPT ); Wed, 3 Oct 2018 11:16:12 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=merlin.20170209; h=In-Reply-To:Content-Type:MIME-Version: References:Message-ID:Subject:Cc:To:From:Date:Sender:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id: List-Help:List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive; bh=Arb13BCu4zbBM0jaVVYdVsl7FbIlqiVlm3Jtq4sWiCM=; b=bshuiK0ysySobW380CeCMr1ER +6T7ppljlnbjb99adAGqJFGhZMcP5PTqoM9v/YlMGM9CPutUGLS0cOt3yiPkB7kPf6Ihj7O6Fmbiy RR05WF4Bo9XMRuVF235I/5qdvpFz/jxmIhQ7ALRXVDrY/Pi0rtk5edkXkZxnJPIDmYbLqbH58Hq9y qdT3coMCEQp64yvdUKJElEwvCx7FN8CBXShDD1ymAlVZiven+BgltUxhwMq3gipLqC+cr1Tk95Hru na8k1XGX3EAqoJlLYX/P5eyMrxneEwkN82ZUjX6tljuHzuKx/eMUyFMM3jkphpZBknbhNjzEbfvjG j5OsIfPHw==; Received: from j217100.upc-j.chello.nl ([24.132.217.100] helo=hirez.programming.kicks-ass.net) by merlin.infradead.org with esmtpsa (Exim 4.90_1 #2 (Red Hat Linux)) id 1g7cWS-0003br-6u; Wed, 03 Oct 2018 08:28:44 +0000 Received: by hirez.programming.kicks-ass.net (Postfix, from userid 1000) id 4EB54202C1A1E; Wed, 3 Oct 2018 10:28:42 +0200 (CEST) Date: Wed, 3 Oct 2018 10:28:42 +0200 From: Peter Zijlstra To: Thomas Gleixner Cc: Catalin Marinas , bigeasy@linutronix.de, Linux Kernel Mailing List , daniel.wagner@siemens.com, Will Deacon , x86@kernel.org, Linus Torvalds , "H. Peter Anvin" , boqun.feng@gmail.com, Paul McKenney Subject: Re: [Problem] Cache line starvation Message-ID: <20181003082842.GN26858@hirez.programming.kicks-ass.net> References: <20180921120226.6xjgr4oiho22ex75@linutronix.de> <20180921122058.GB24124@hirez.programming.kicks-ass.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.10.1 (2018-07-13) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Wed, Oct 03, 2018 at 10:07:05AM +0200, Thomas Gleixner wrote: > On Wed, 3 Oct 2018, Catalin Marinas wrote: > > > On Fri, 21 Sep 2018 at 13:22, Peter Zijlstra wrote: > > > On Fri, Sep 21, 2018 at 02:02:26PM +0200, Sebastian Andrzej Siewior wrote: > > > > We reproducibly observe cache line starvation on a Core2Duo E6850 (2 > > > > cores), a i5-6400 SKL (4 cores) and on a NXP LS2044A ARM Cortex-A72 (4 > > > > cores). > Except that the ARM64 ticket locks are not preventing the starvation > issue. Neither do the qrlocks on ARM64 on later kernels. That A72 is ARMv8-A afaict, that doesn't have the fancy LSE bits (which are new in ARMv8.1) on and thus ends up using LL/SC. And LL/SC has similar issues as cmpxchg loops. AFAICT Cortex-A75 is the first that has LSE on (that's an ARMv8.2-A).