Received: by 2002:ac0:a5a6:0:0:0:0:0 with SMTP id m35-v6csp599350imm; Fri, 21 Sep 2018 05:23:32 -0700 (PDT) X-Google-Smtp-Source: ANB0VdYuPd2AfhFXl1hIOs1OazFIrkoCiRdJBZk3N71kYrw6oI74NEQl6jPfR9QNatG2AioMsg/L X-Received: by 2002:a62:4f1b:: with SMTP id d27-v6mr6605545pfb.132.1537532612587; Fri, 21 Sep 2018 05:23:32 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1537532612; cv=none; d=google.com; s=arc-20160816; b=n+jrZL/77v6CHmj6bzQ/k1xX/qFlPRFA4nGjNJAC00+ZsNyiY9NDorezNGGURe7wiF sVz/xD0l3qjww+F+FmT7dT3necyRZoce4MqqTfp3pYStIY63qpa1VuuvkCkdtFugL19/ oYMvnunX7HBJiXZMLqHva9O0n2X4h0Iftjd/Wt3paH2rLCuv4gKhJawKPnvlPGSxnHM9 15R7D6owzLhv03e6NdTvqrWyJtAKaRwl2N3rKiW88xFb7r3z3JDSuvHpXnzQFNuWmobL BcGbgehuYTys3Hn2rlkz/QQsUhzNhwBuRh3uDS9tELupCIR7AQflFpdx923fFLJ9wRNw KOmw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-disposition:mime-version:references:message-id:subject:cc :to:from:date:dkim-signature; bh=9UjvAUTQUgqFx8GwnwHC8ESLZjSakdChu/DzRxkh1N4=; b=rNNWqqR2Lbf1jckzV3TkF/1dCdgNNBJVMfbcoQ5WIPrGbnkRlONY+qr4cDkBu4J0zQ dDb7YFlMPpOdWGWDH0iTHzcYVehJTnCKerNcZbvfuqNpB/mLHcyDOdzTHNF0/ZRcoU4N TvlmpUs/+UDhDaBjoOI126KmUuhRfxaPFtkycAU5Kfv0pP7spK9ky8JBPy0Czvbxm8Xb kwHMoSmUYGz2RTFEI8RQS76NfNknC5+6rhPPO7I9vpmbLYURuDQLjzZ0LInX/CyvZufu NioBmkzXuwOZ5w88o7MbsrbEGxprTQQ8yw/4E3dvsQbkXKYTICKzSFcys1pIw48rhy7K MAcQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=fail header.i=@infradead.org header.s=merlin.20170209 header.b=gzK5pDHL; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id 3-v6si27769076plv.314.2018.09.21.05.23.12; Fri, 21 Sep 2018 05:23:32 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=fail header.i=@infradead.org header.s=merlin.20170209 header.b=gzK5pDHL; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S2389684AbeIUSJy (ORCPT + 99 others); Fri, 21 Sep 2018 14:09:54 -0400 Received: from merlin.infradead.org ([205.233.59.134]:33890 "EHLO merlin.infradead.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727697AbeIUSJy (ORCPT ); Fri, 21 Sep 2018 14:09:54 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=merlin.20170209; h=In-Reply-To:Content-Type:MIME-Version: References:Message-ID:Subject:Cc:To:From:Date:Sender:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id: List-Help:List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive; bh=9UjvAUTQUgqFx8GwnwHC8ESLZjSakdChu/DzRxkh1N4=; b=gzK5pDHLa8Lr2WTzOPjEay0gY ixcgoezxLIfGj3VtbeJb00vN/yqVqP58SFbKwd9UQjinvzdKiqQBwFGNoSZrvrt1PUi5dViJVSY5n gtk+ni6ZTk4Dlohz4M1ngzSZHyXVgtdrgz+r2Sw/xIKKBGo+LNu0TeijirOZR3XXqtNnSP5/jUM0R cU634pSCAveZZc0SzkOCDuuYFET29OrByQ9PLqJYlWiJGnqnuNs5FMmVIT860PrXWIkN0G3e28p4E 2EzOUnJ5jZPGbZykju0E0A5pYA+vbFB63TpFiuPOu7OEYMnOAqqeKEgdTzkSDqXKLZtS3zhEwUKD2 +AVPkZaNg==; Received: from j217100.upc-j.chello.nl ([24.132.217.100] helo=hirez.programming.kicks-ass.net) by merlin.infradead.org with esmtpsa (Exim 4.90_1 #2 (Red Hat Linux)) id 1g3KQh-0005ZC-IT; Fri, 21 Sep 2018 12:21:03 +0000 Received: by hirez.programming.kicks-ass.net (Postfix, from userid 1000) id C14E22024E449; Fri, 21 Sep 2018 14:20:58 +0200 (CEST) Date: Fri, 21 Sep 2018 14:20:58 +0200 From: Peter Zijlstra To: Sebastian Andrzej Siewior Cc: linux-kernel@vger.kernel.org, Daniel Wagner , Will Deacon , x86@kernel.org, Linus Torvalds , "H. Peter Anvin" , Boqun Feng , "Paul E. McKenney" Subject: Re: [Problem] Cache line starvation Message-ID: <20180921122058.GB24124@hirez.programming.kicks-ass.net> References: <20180921120226.6xjgr4oiho22ex75@linutronix.de> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20180921120226.6xjgr4oiho22ex75@linutronix.de> User-Agent: Mutt/1.10.0 (2018-05-17) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Fri, Sep 21, 2018 at 02:02:26PM +0200, Sebastian Andrzej Siewior wrote: > We reproducibly observe cache line starvation on a Core2Duo E6850 (2 > cores), a i5-6400 SKL (4 cores) and on a NXP LS2044A ARM Cortex-A72 (4 > cores). > > The problem can be triggered with a v4.9-RT kernel by starting > Daniel reported that disabling ticket locks on 4.4 makes the problem go > away, but he hasn't run a long time test yet and as we saw with 4.14 it can > take quite a while. On 4.4 and 4.9 ARM64 still uses ticket locks. So I'm very interested to know if the ticket locks on x86 really fix or just make it harder. I've been looking at qspinlock in the light of this and there is indeed room for improvement. The ticket lock certainly is much simpler.