Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S261322AbVDIJeh (ORCPT ); Sat, 9 Apr 2005 05:34:37 -0400 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S261320AbVDIJef (ORCPT ); Sat, 9 Apr 2005 05:34:35 -0400 Received: from tone.orchestra.cse.unsw.EDU.AU ([129.94.242.59]:65226 "EHLO tone.orchestra.cse.unsw.EDU.AU") by vger.kernel.org with ESMTP id S261324AbVDIJeb (ORCPT ); Sat, 9 Apr 2005 05:34:31 -0400 From: Neil Brown To: Willy Tarreau Date: Sat, 9 Apr 2005 19:34:10 +1000 MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-ID: <16983.41362.375073.942173@cse.unsw.edu.au> Cc: Chris Wedgwood , Linus Torvalds , Jeff Garzik , Matthias-Christian Ott , Andrea Arcangeli , Kernel Mailing List Subject: Re: Kernel SCM saga.. In-Reply-To: message from Willy Tarreau on Saturday April 9 References: <20050408071428.GB3957@opteron.random> <4256AE0D.201@tiscali.de> <4256C0F8.6030008@pobox.com> <20050408185608.GA5638@taniwha.stupidest.org> <20050409073726.GC7858@alpha.home.local> <16983.34940.197017.568255@cse.unsw.edu.au> <20050409080056.GA8551@alpha.home.local> X-Mailer: VM 7.19 under Emacs 21.4.1 X-face: [Gw_3E*Gng}4rRrKRYotwlE?.2|**#s9D On Sat, Apr 09, 2005 at 05:47:08PM +1000, Neil Brown wrote: > > On Saturday April 9, willy@w.ods.org wrote: > > > > > > I've just checked, it takes 5.7s to compare 2.4.29{,-hf3} over NFS (13300 > > > files each) and 1.3s once the trees are cached locally. This is without > > > comparing file contents, just meta-data. And it takes 19.33s to compare > > > the file's md5 sums once the trees are cached. I don't know if there are > > > ways to avoid some NFS operations when everything is cached. > > > > > > Anyway, the system does not seem much efficient on hard links, it caches > > > the files twice :-( > > > > I suspect you'll be wanting to add a "no_subtree_check" export option > > on your NFS server... > > Thanks a lot, Neil ! This is very valuable information. I didn't > understand such implications from the exports(5) man page, but it > makes a great difference. And the diff sped up from 5.7 to 3.9s > and from 19.3 to 15.3s. No, that implication had never really occurred to me before either. But when you said "caches the file twice" it suddenly made sense. With subtree_check, the NFS file handle contains information about the directory, and NFS uses the filehandle as the primary key to tell if two things are the same or not. Trond keeps prodding me to make no_subtree_check the default. Maybe it is time that I actually did.... NeilBrown - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/