Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1755743Ab3IAWfh (ORCPT ); Sun, 1 Sep 2013 18:35:37 -0400 Received: from zeniv.linux.org.uk ([195.92.253.2]:50215 "EHLO ZenIV.linux.org.uk" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1754500Ab3IAWfe (ORCPT ); Sun, 1 Sep 2013 18:35:34 -0400 Date: Sun, 1 Sep 2013 23:35:21 +0100 From: Al Viro To: Linus Torvalds Cc: Sedat Dilek , Waiman Long , Ingo Molnar , Benjamin Herrenschmidt , Jeff Layton , Miklos Szeredi , Ingo Molnar , Thomas Gleixner , linux-fsdevel , Linux Kernel Mailing List , Peter Zijlstra , Steven Rostedt , Andi Kleen , "Chandramouleeswaran, Aswin" , "Norton, Scott J" Subject: Re: [PATCH v7 1/4] spinlock: A new lockref structure for lockless update of refcount Message-ID: <20130901223521.GV13318@ZenIV.linux.org.uk> References: <20130901212355.GU13318@ZenIV.linux.org.uk> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 1851 Lines: 40 On Sun, Sep 01, 2013 at 03:16:24PM -0700, Linus Torvalds wrote: > Does not seem to matter. Still 66% mntput_no_expire, 31% path_init. > And that lg_local_lock() takes 5-6% of CPU, pretty much all of which > is that single xadd instruction that implements the spinlock. > > This is on /tmp, which is tmpfs. But I don't see how any of that could > matter. "mntput()" does an unconditional call to mntput_no_expire(), > and mntput_no_expire() does that br_read_lock() unconditionally too. > > Note that I'm talking about that "cheap" *read* lock being expensive. > It's the local one, not the global one. So it's not what Waiman saw > with the global lock. This is a local per-cpu thing. > > That read-lock is supposed to be very cheap - it's just a per-cpu > spinlock. But it ends up being very expensive for some reason. I'm not > quite sure why - I don't see any lg_global_lock() calls at all, so... > > I wonder if there is some false sharing going on. But I don't see that > either, this is the percpu offset map afaik: > > 000000000000f560 d files_lglock_lock > 000000000000f564 d nr_dentry > 000000000000f568 d last_ino > 000000000000f56c d nr_unused > 000000000000f570 d nr_inodes > 000000000000f574 d vfsmount_lock_lock > 000000000000f580 d bh_accounting > > and I don't see anything there that would get cross-cpu accesses, so > there shouldn't be any cacheline bouncing. That's the whole point of > percpu variables, after all. Hell knows... Are you sure you don't see br_write_lock() at all? I don't see anything else that would cause cross-cpu traffic with that layout... -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/