Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S261258AbVDNAQ3 (ORCPT ); Wed, 13 Apr 2005 20:16:29 -0400 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S261255AbVDNAPW (ORCPT ); Wed, 13 Apr 2005 20:15:22 -0400 Received: from waste.org ([216.27.176.166]:31136 "EHLO waste.org") by vger.kernel.org with ESMTP id S261236AbVDNANZ (ORCPT ); Wed, 13 Apr 2005 20:13:25 -0400 Date: Wed, 13 Apr 2005 17:13:06 -0700 From: Matt Mackall To: Krzysztof Halasa Cc: Linus Torvalds , Andrea Arcangeli , David Eger , Petr Baudis , "Randy.Dunlap" , Ross Vandegrift , Kernel Mailing List Subject: Re: more git updates.. Message-ID: <20050414001306.GI3174@waste.org> References: <20050412040519.GA17917@havoc.gtf.org> <20050412081613.GA18545@pasky.ji.cz> <20050412204429.GA24910@havoc.gtf.org> <20050412234005.GJ1521@opteron.random> <20050413001408.GL1521@opteron.random> <20050413204451.GP25554@waste.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.6+20040907i Sender: linux-kernel-owner@vger.kernel.org X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 916 Lines: 22 On Thu, Apr 14, 2005 at 01:42:11AM +0200, Krzysztof Halasa wrote: > Matt Mackall writes: > > > Now if you can assume that blobs never change and are never deleted, > > you can simply append them all onto a log, and then index them with a > > separate file containing an htree of (sha1, offset, length) or the > > like. > > That mean a problem with rsync, though. I believe 200k inodes is a problem for rsync too. But we can simply grab the remote htree, do a tree compare, find the ranges of the remote file we need, sort and merge the ranges, and then pull them. That will surely trounce rsync. -- Mathematics is the supreme nostalgia of our time. - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/