Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1754065AbYFTJWJ (ORCPT ); Fri, 20 Jun 2008 05:22:09 -0400 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1751971AbYFTJVy (ORCPT ); Fri, 20 Jun 2008 05:21:54 -0400 Received: from dwdmx4.dwd.de ([141.38.3.230]:46686 "EHLO dwdmx4.dwd.de" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751674AbYFTJVx (ORCPT ); Fri, 20 Jun 2008 05:21:53 -0400 Date: Fri, 20 Jun 2008 09:21:48 +0000 (GMT) From: Holger Kiehl X-X-Sender: kiehl@diagnostix.dwd.de To: Theodore Tso Cc: Eric Sandeen , "Aneesh Kumar K.V" , Jan Kara , Solofo.Ramangalahy@bull.net, Nick Dokos , linux-ext4@vger.kernel.org, linux-kernel Subject: Re: Performance of ext4 In-Reply-To: <20080620085922.GH9119@mit.edu> Message-ID: References: <20080612180605.GD22481@skywalker> <20080616175408.GF3279@atrey.karlin.mff.cuni.cz> <20080616181353.GA20686@skywalker> <20080619155645.GA8582@mit.edu> <485A8C2D.1090806@redhat.com> <20080619174211.GB9119@mit.edu> <20080620085922.GH9119@mit.edu> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 1922 Lines: 43 On Fri, 20 Jun 2008, Theodore Tso wrote: > On Fri, Jun 20, 2008 at 08:32:52AM +0000, Holger Kiehl wrote: >>> It sounds like i_size is actually dropping in >>> size at some pointer long after the file was written. If I had to > > sorry, "at some point"... > >>> guess the value in the inode cache is correct; and perhaps so is the >>> value on the journal. But somehow, the wrong value is getting written >>> to disk > > Or, "the right value is never getting written to disk". (Which as I > think about it is more likely; it's likely that an update to i_size is > getting *lost*, perhaps because the delalloc code is possibly > modifying i_size without starting a transaction first. Again this is > just a guess.) > >> What I find strange is that the missing parts of the file are not for >> example exactly 512 or 1024 or 4096 bytes it is mostly some odd number >> of bytes. > > Is there any chance the truncation point is related to how the program > is writing its output file? i.e., if it is a text file, is the > truncation happening after a new-line or when the stdio library might > have done an explicit or implicit fflush()? > When the benchmark runs it writes to stdout and with tee to the result file. It first writes some information about the system, prepares the test files (creates lots of small files), calls sync and then starts the test. Then every minute one line gets written to the result file. Often I have seen that everything after the sync was missing. But sometimes it happened that some parts at the end are missing. But it was always a clean cut, that is there where no lines that where cut partially. The lines where always complete. Holger -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/