Received: by 2002:a25:8b12:0:0:0:0:0 with SMTP id i18csp1950444ybl; Thu, 29 Aug 2019 01:05:38 -0700 (PDT) X-Google-Smtp-Source: APXvYqyxfKKO2Bl2PAz7Hz6M1ErAWherPabwHCbfk8fD8NA8AawTlvFeBqoupZEsuVuG1YYbH/Cg X-Received: by 2002:a63:161c:: with SMTP id w28mr5019008pgl.442.1567065938202; Thu, 29 Aug 2019 01:05:38 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1567065938; cv=none; d=google.com; s=arc-20160816; b=bT8WBWj7casgiYw31tYr66apxun7tiFhJoSEjXBVj8iIcQsWg4k76FHeAAWFFdhxqq 5xn7MZ6cPGjC9O6MrL82KKyQnaXxooCnkRji68a6S4AjBkYP+han7VlydiOiDSIFvFbA 47rSq99U0tZBsUqyPrmJMNqdWgF/e79nDRMDaNqWcTBC22q09DvEpdyKpi9WUa2OjzNB RPe4ugl0Far3Xb7mFRhfV/7q+KTtwC1rLN/Lzv0w+376fjESJ9PkpK6E4LFT9aWp/io2 Y8CeztGhcBdFDir3+xbhG875Z76Mqx1pl2xRU2xlH1JuStWXWMG2lLa36+bgGIw5by1d IWGQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-disposition:mime-version:references:message-id:subject:cc :to:from:date; bh=1tWU6k8+sz7MG+qoNQOxMUXxVLYYkNy36pX9DrtwneA=; b=k+SdDSnuLPdbtXFm1eNGB4PfrcjaMmNmJeaSjtZv8jd/pgQ5HfbPwvf2HnzBryjJkM MO5cFTAevKTdYs+ki2kFv9cznyOZehFrxsXZFl8+Fm71WaIDJ2mGv0OnNf6A49E0Ee/0 f2CoAwlRfDYzVrH56mapYX3pxoPWteD4GvgE/4SVZZejN6R9UmzMHh6mRzWzE2gc/rWi eevQSXrPxFGFfWPFUZqi5mB7pJ1e0YKClEY0AKNojpAomHyYa5jM0XFJYY9nGvcSQZpg oecxTIul2Mfk+nYW629fjTWMQ5Vc1Gkrc0uyIPdgxT1Y2lO4ck43GTlkwF3/4UDUzIxk 8Nkw== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-ext4-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-ext4-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id r7si1253108pli.94.2019.08.29.01.05.13; Thu, 29 Aug 2019 01:05:38 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-ext4-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-ext4-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-ext4-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726330AbfH2IDL (ORCPT + 99 others); Thu, 29 Aug 2019 04:03:11 -0400 Received: from mx2.suse.de ([195.135.220.15]:52818 "EHLO mx1.suse.de" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1725807AbfH2IDL (ORCPT ); Thu, 29 Aug 2019 04:03:11 -0400 X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay2.suse.de (unknown [195.135.220.254]) by mx1.suse.de (Postfix) with ESMTP id 4BED4AC8E; Thu, 29 Aug 2019 08:03:09 +0000 (UTC) Received: by quack2.suse.cz (Postfix, from userid 1000) id B65901E4362; Thu, 29 Aug 2019 10:03:08 +0200 (CEST) Date: Thu, 29 Aug 2019 10:03:08 +0200 From: Jan Kara To: Dave Chinner Cc: Jan Kara , Matthew Bobrowski , linux-ext4@vger.kernel.org, linux-fsdevel@vger.kernel.org, tytso@mit.edu, riteshh@linux.ibm.com Subject: Re: [PATCH 4/5] ext4: introduce direct IO write code path using iomap infrastructure Message-ID: <20190829080308.GA19156@quack2.suse.cz> References: <581c3a2da89991e7ce5862d93dcfb23e1dc8ddc8.1565609891.git.mbobrowski@mbobrowski.org> <20190828202619.GG22343@quack2.suse.cz> <20190828223218.GZ7777@dread.disaster.area> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20190828223218.GZ7777@dread.disaster.area> User-Agent: Mutt/1.10.1 (2018-07-13) Sender: linux-ext4-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-ext4@vger.kernel.org On Thu 29-08-19 08:32:18, Dave Chinner wrote: > On Wed, Aug 28, 2019 at 10:26:19PM +0200, Jan Kara wrote: > > On Mon 12-08-19 22:53:26, Matthew Bobrowski wrote: > > > This patch introduces a new direct IO write code path implementation > > > that makes use of the iomap infrastructure. > > > > > > All direct IO write operations are now passed from the ->write_iter() callback > > > to the new function ext4_dio_write_iter(). This function is responsible for > > > calling into iomap infrastructure via iomap_dio_rw(). Snippets of the direct > > > IO code from within ext4_file_write_iter(), such as checking whether the IO > > > request is unaligned asynchronous IO, or whether it will ber overwriting > > > allocated and initialized blocks has been moved out and into > > > ext4_dio_write_iter(). > > > > > > The block mapping flags that are passed to ext4_map_blocks() from within > > > ext4_dio_get_block() and friends have effectively been taken out and > > > introduced within the ext4_iomap_begin(). If ext4_map_blocks() happens to have > > > instantiated blocks beyond the i_size, then we attempt to place the inode onto > > > the orphan list. Despite being able to perform i_size extension checking > > > earlier on in the direct IO code path, it makes most sense to perform this bit > > > post successful block allocation. > > > > > > The ->end_io() callback ext4_dio_write_end_io() is responsible for removing > > > the inode from the orphan list and determining if we should truncate a failed > > > write in the case of an error. We also convert a range of unwritten extents to > > > written if IOMAP_DIO_UNWRITTEN is set and perform the necessary > > > i_size/i_disksize extension if the iocb->ki_pos + dio->size > i_size_read(inode). > > > > > > In the instance of a short write, we fallback to buffered IO and complete > > > whatever is left the 'iter'. Any blocks that may have been allocated in > > > preparation for direct IO will be reused by buffered IO, so there's no issue > > > with leaving allocated blocks beyond EOF. > > > > > > Signed-off-by: Matthew Bobrowski > > > --- > > > fs/ext4/file.c | 227 ++++++++++++++++++++++++++++++++++++++++---------------- > > > fs/ext4/inode.c | 42 +++++++++-- > > > 2 files changed, 199 insertions(+), 70 deletions(-) > > > > Overall this is very nice. Some smaller comments below. > > > > > @@ -235,6 +244,34 @@ static ssize_t ext4_write_checks(struct kiocb *iocb, struct iov_iter *from) > > > return iov_iter_count(from); > > > } > > > > > > +static ssize_t ext4_buffered_write_iter(struct kiocb *iocb, > > > + struct iov_iter *from) > > > +{ > > > + ssize_t ret; > > > + struct inode *inode = file_inode(iocb->ki_filp); > > > + > > > + if (!inode_trylock(inode)) { > > > + if (iocb->ki_flags & IOCB_NOWAIT) > > > + return -EOPNOTSUPP; > > > + inode_lock(inode); > > > + } > > > > Currently there's no support for IOCB_NOWAIT for buffered IO so you can > > replace this with "inode_lock(inode)". > > IOCB_NOWAIT is supported for buffered reads. It is not supported on > buffered writes (as yet), so this should return EOPNOTSUPP if > IOCB_NOWAIT is set, regardless of whether the lock can be grabbed or > not. Yeah, right. Thanks for correcting me. Honza -- Jan Kara SUSE Labs, CR