From: "Aneesh Kumar K.V" Subject: Re: fsync on ext[34] working only by an accident Date: Thu, 10 Sep 2009 14:45:51 +0530 Message-ID: <20090910091551.GB11418@skywalker.linux.vnet.ibm.com> References: <20090908132601.GA17778@duck.suse.cz> <20090910064605.GA8690@skywalker.linux.vnet.ibm.com> <20090910085056.GA607@duck.suse.cz> <20090910090449.GA11418@skywalker.linux.vnet.ibm.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Cc: linux-ext4@vger.kernel.org To: Jan Kara Return-path: Received: from e23smtp01.au.ibm.com ([202.81.31.143]:34634 "EHLO e23smtp01.au.ibm.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1754154AbZIJJPy (ORCPT ); Thu, 10 Sep 2009 05:15:54 -0400 Received: from d23relay05.au.ibm.com (d23relay05.au.ibm.com [202.81.31.247]) by e23smtp01.au.ibm.com (8.14.3/8.13.1) with ESMTP id n8A9EfUX000950 for ; Thu, 10 Sep 2009 19:14:41 +1000 Received: from d23av02.au.ibm.com (d23av02.au.ibm.com [9.190.235.138]) by d23relay05.au.ibm.com (8.13.8/8.13.8/NCO v10.0) with ESMTP id n8A9E3uc1343626 for ; Thu, 10 Sep 2009 19:14:03 +1000 Received: from d23av02.au.ibm.com (loopback [127.0.0.1]) by d23av02.au.ibm.com (8.14.3/8.13.1/NCO v10.0 AVout) with ESMTP id n8A9Ft2X016211 for ; Thu, 10 Sep 2009 19:15:55 +1000 Content-Disposition: inline In-Reply-To: <20090910090449.GA11418@skywalker.linux.vnet.ibm.com> Sender: linux-ext4-owner@vger.kernel.org List-ID: On Thu, Sep 10, 2009 at 02:34:49PM +0530, Aneesh Kumar K.V wrote: > On Thu, Sep 10, 2009 at 10:50:56AM +0200, Jan Kara wrote: > > Hi, > > > > On Thu 10-09-09 12:16:05, Aneesh Kumar K.V wrote: > > > On Tue, Sep 08, 2009 at 03:26:01PM +0200, Jan Kara wrote: > > > > When looking at how ext3/4 handles fsync, I've realized I don't > > > > understand how writing out inode on fsync can work. The problem is that > > > > ext3/4 mostly calls ext?_mark_inode_dirty() which actually does *not* dirty > > > > the inode. It just copies the in-memory inode content to disk buffer. > > > > So in particular the inode looks clean to VFS and our check in > > > > ext?_sync_file() shouldn't trigger. > > > > The only obvious case when we call mark_inode_dirty() is from write_end > > > > functions when we update i_size but that's clearly not enough. Now I did > > > > some research why things seem to be actually working. The trick is that > > > > when allocating block, we call vfs_dq_alloc_block() which calls > > > > mark_inode_dirty(). But that's all what's keeping our fsync / writeout > > > > logic from breaking! > > > > > > ext4_handle_dirty_metadata should do mark_inode_dirty right ? > > > __ext4_handle_dirty_metadata -> mark_buffer_dirty ->__set_page_dirty > > > -> __mark_inode_dirty -> list_move(&inode->i_list, &sb->s_dirty); > > ext4_handle_dirty_metadata() marks the buffer dirty only when we do not > > have a journal (BTW, the inode that gets dirtied in the nojournal case > > is the block-device one, not the one whose metadata we mark as dirty, so > > it won't work there either - but Google guys are working on this I think). > > With a journal the function just calls jbd2_journal_dirty_metadata which > > does nothing with the inode. > > When we don't have a journal handle we do that as a part of journal commit > right ? __jbd2_journal_temp_unlink_buffer -> mark_buffer_dirty > > I guess fsync only requires the meta data update to be in journal ? > Adding the file inode to the sb->s_dirty is done through block_write_end ? Why do you mention above that it is not "clearly not enough" ? -aneesh