From: Eric Sandeen Subject: Re: Files full of zeros with coreutils-8.11 and xfs (FIEMAP related?) Date: Tue, 19 Apr 2011 09:05:24 -0500 Message-ID: <4DAD96A4.40008@sandeen.net> References: <20110415000940.GL21395@dastard> <76FFF648-CA02-494B-A862-566C66A8CB82@dilger.ca> <20110416005040.GP21395@dastard> <4EEEA16E-1FDB-4430-A372-8F8701196E4C@mit.edu> <20110418004040.GS21395@dastard> <6C89E159-A5F6-4A06-A3D2-273BE4CFB9B5@dilger.ca> <20110419034455.GB23985@dastard> <20110419074538.GG23985@dastard> Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Cc: Dave Chinner , Andreas Dilger , Theodore Tso , xfs-oss , "coreutils@gnu.org" , "linux-ext4@vger.kernel.org" , =?UTF-8?B?UMOhZHJhaWcgQnJhZHk=?= , Markus Trippelsdorf To: Yongqiang Yang Return-path: Received: from sandeen.net ([63.231.237.45]:52629 "EHLO mail.sandeen.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751573Ab1DSOFL (ORCPT ); Tue, 19 Apr 2011 10:05:11 -0400 In-Reply-To: Sender: linux-ext4-owner@vger.kernel.org List-ID: On 4/19/11 3:11 AM, Yongqiang Yang wrote: > On Tue, Apr 19, 2011 at 3:45 PM, Dave Chinner wrote: >> On Tue, Apr 19, 2011 at 02:53:20PM +0800, Yongqiang Yang wrote: ... >>> I think there are 2 ways to provide a definite definition for FIEMAP >>> for all filesystems: >>> >>> 1. FIEMAP returns extent state on disk. >>> 2. FIEMAP returns extent both in memory and on disk. >> >> You are *not listening*. There is no #2. FIEMAP returns the extent >> state _on disk_ at the time of the call. If you want it to reflect >> the in-memory state at the time of the call (for data or metadata), >> you *must* use the the SYNC flag to convert that in-memory state to >> on-disk state, which FIEMAP then reports just fine. > > Sorry for being dense. > > I think delayed extent is an exception. because it is not on the disk. > > Yongqiang. I don't think you're being dense, I think that the interface specification is just messed up. By including flags for both unwritten and delalloc in the interface, we have hopelessly intertwined on-disk and in-memory state. If you preallocate 1M and then do a buffered IO to that same range without a sync, and then a fiemap, what on earth should the interface return? Writing the first part of that testcase is simple but I have no idea what the correct behavior is. (FIEMAP_EXTENT_UNWRITTEN|FIEMAP_EXTENT_DELALLOC) ? that makes no sense. But no other combination of flags makes sense to me either, unless we get into tortured redefinitions of what "delalloc" means. And if we can't say what it -should- return.... well, too bad for coreutils. :( -Eric