Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1752535Ab0HZGiJ (ORCPT ); Thu, 26 Aug 2010 02:38:09 -0400 Received: from bld-mail17.adl2.internode.on.net ([150.101.137.102]:47648 "EHLO mail.internode.on.net" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1751642Ab0HZGiG (ORCPT ); Thu, 26 Aug 2010 02:38:06 -0400 Date: Thu, 26 Aug 2010 16:38:00 +1000 From: Dave Chinner To: "Ted Ts'o" , David Rientjes , Peter Zijlstra , Jens Axboe , Andrew Morton , Neil Brown , Alasdair G Kergon , Chris Mason , Steven Whitehouse , Jan Kara , Frederic Weisbecker , "linux-raid@vger.kernel.org" , "linux-btrfs@vger.kernel.org" , "cluster-devel@redhat.com" , "linux-ext4@vger.kernel.org" , "reiserfs-devel@vger.kernel.org" , "linux-kernel@vger.kernel.org" Subject: Re: [patch 1/5] mm: add nofail variants of kmalloc kcalloc and kzalloc Message-ID: <20100826063759.GB705@dastard> References: <1282743090.2605.3696.camel@laptop> <1282769729.1975.96.camel@laptop> <1282771677.1975.138.camel@laptop> <20100826001901.GL4453@thunk.org> <20100826014847.GQ4453@thunk.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20100826014847.GQ4453@thunk.org> User-Agent: Mutt/1.5.20 (2009-06-14) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 1915 Lines: 47 On Wed, Aug 25, 2010 at 09:48:47PM -0400, Ted Ts'o wrote: > On Wed, Aug 25, 2010 at 05:30:42PM -0700, David Rientjes wrote: > > > > We certainly hope that nobody will reimplement the same function without > > the __deprecated warning, especially for order < PAGE_ALLOC_COSTLY_ORDER > > where there's no looping at a higher level. So perhaps the best > > alternative is to implement the same _nofail() functions but do a > > WARN_ON(get_order(size) > PAGE_ALLOC_COSTLY_ORDER) instead? > > Yeah, that sounds better. > > > I think it's really sad that the caller can't know what the upper bounds > > of its memory requirement are ahead of time or at least be able to > > implement a memory freeing function when kmalloc() returns NULL. > > Oh, we can determine an upper bound. You might just not like it. > Actually ext3/ext4 shouldn't be as bad as XFS, which Dave estimated to > be around 400k for a transaction. For a 4k block size filesystem. If I use 64k block size directories (which XFS can even on 4k page size machines), the maximum transaction reservation goes up to at around 3MB, and that's just for blocks being _modified_. It's not the limit on the amount of memory that may need to be allocated during a transaction.... > My guess is that the worst case for > ext3/ext4 is probably around 256k or so; like XFS, most of the time, > it would be a lot less. Right, it usually is a lot less, but one of the big problems is that during low memory situations memory reclaim of the metadata page cache actually causes _more_ memory allocation during tranactions than otherwise would occur....... Cheers, Dave. -- Dave Chinner david@fromorbit.com -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/