Received: by 2002:a05:6902:102b:0:0:0:0 with SMTP id x11csp74567ybt; Tue, 30 Jun 2020 15:08:12 -0700 (PDT) X-Google-Smtp-Source: ABdhPJykbTON1JVUGfFNE3xZytfmxzD/8FxvZMJYDqAOZ10lXvhIaCpuF06clCR8rrc7vKytYVXn X-Received: by 2002:a17:906:f2c1:: with SMTP id gz1mr20864222ejb.88.1593554412897; Tue, 30 Jun 2020 15:00:12 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1593554412; cv=none; d=google.com; s=arc-20160816; b=gtud1nzNkc4T61uuzEewYuEBcyYa2vLkqbJzA+TrvaclxNiAHd4tifvK8xHK3MlLNg HBjRgyEJ7QW9xka9kbE6gfvmzclQbDgc3xnWEO/uN5u0Lo7hsVvR7XidmgFCBoA+I0iF LxCAwUfT6negfItpLeT/egiIg5rL7iCcp1q6P6EpHzrrvKteW4GA0EmLUrnAuubb8p8b F7P+pjpfdWyiPL/6AcYpaT4wtqohSB+tAR4Ng4XRAVOlDRwnKYxAgJgt7XpS9kTuRETS BkEAdEOU0FLjOnn1PZa4KWsHe9W5oFsrU6fGJnCwEgUgKGIs/fLIPNkmw6vnoxeyIlYo Ho6Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:in-reply-to:content-transfer-encoding :content-disposition:mime-version:references:message-id:subject:cc :to:from:date:dkim-signature; bh=1U7qDe81bxeS8KAHawbIOFO9Fggjwj9LA0IzCK/CCEU=; b=jKGvq75vUyHQiehngCtL2wNqVqxoHw3zuL439/lc+e51tOqD4QUbo9npMMedOdAdr6 VgBxjnxznrG9SBihELfHWco3j36w+uIOYmjs4DJhSIKqL/C9jqH1CUXHA3dRwum7avUZ w3GFn+676Q5SjetxTMNalJqVaBaaaZMK0Ct8K56H+IKa1ebR089Y08PYUtJUqlFnCGRK 0O0HqgsiGFG5BifVvrmAD/UdYaq8jkIO7g6ff1AuxvquzcahqL/1WLm1Q7eAqVzRcgiL MqINinCuhAEl4mjp/R6uu6jGAv2mUZPVLo6170678UVySUwyJNZK9lV8bjkKlPtmUFC3 wn9w== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@kernel.org header.s=default header.b=poiy4WZ9; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id l17si2707386ejc.174.2020.06.30.14.59.49; Tue, 30 Jun 2020 15:00:12 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=default header.b=poiy4WZ9; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727093AbgF3U4g (ORCPT + 99 others); Tue, 30 Jun 2020 16:56:36 -0400 Received: from mail.kernel.org ([198.145.29.99]:34910 "EHLO mail.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727045AbgF3U4g (ORCPT ); Tue, 30 Jun 2020 16:56:36 -0400 Received: from localhost (unknown [104.132.1.66]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id F32E22074D; Tue, 30 Jun 2020 20:56:35 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1593550596; bh=SyHZ0Wo0kdMmXhB3HauNfjbw3rcUtpXH44TVKsmAjGU=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=poiy4WZ9FK2/3ySDGGwENxJRuNeC9b7nRe7aM8hJoJXADIW3NillTF248reYglom8 0+ZuFTxbRjkkQjnv+ejTW5FXps36eGS/0zvgIlkiu8CDtqvPzWWSp08v4sfnRsVBJk InH2N6wr38soyV1bleIvfSlOAcFHCPDb6YcWj1aA= Date: Tue, 30 Jun 2020 13:56:35 -0700 From: Jaegeuk Kim To: Nathan Chancellor Cc: kernel-team@android.com, linux-kernel@vger.kernel.org, linux-f2fs-devel@lists.sourceforge.net Subject: Re: [f2fs-dev] [PATCH v3] f2fs: avoid readahead race condition Message-ID: <20200630205635.GB1396584@google.com> References: <20200624012148.180050-1-jaegeuk@kernel.org> <20200629150323.GA3293033@google.com> <20200629202720.GA230664@google.com> <20200630204348.GA2504307@ubuntu-s3-xlarge-x86> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20200630204348.GA2504307@ubuntu-s3-xlarge-x86> Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 06/30, Nathan Chancellor wrote: > On Mon, Jun 29, 2020 at 01:27:20PM -0700, Jaegeuk Kim wrote: > > If two readahead threads having same offset enter in readpages, every read > > IOs are split and issued to the disk which giving lower bandwidth. > > > > This patch tries to avoid redundant readahead calls. > > > > Signed-off-by: Jaegeuk Kim > > --- > > v3: > > - use READ|WRITE_ONCE > > v2: > > - add missing code to bypass read > > > > fs/f2fs/data.c | 18 ++++++++++++++++++ > > fs/f2fs/f2fs.h | 1 + > > fs/f2fs/super.c | 2 ++ > > 3 files changed, 21 insertions(+) > > > > diff --git a/fs/f2fs/data.c b/fs/f2fs/data.c > > index 995cf78b23c5e..360b4c9080d97 100644 > > --- a/fs/f2fs/data.c > > +++ b/fs/f2fs/data.c > > @@ -2296,6 +2296,7 @@ static int f2fs_mpage_readpages(struct inode *inode, > > unsigned nr_pages = rac ? readahead_count(rac) : 1; > > unsigned max_nr_pages = nr_pages; > > int ret = 0; > > + bool drop_ra = false; > > > > map.m_pblk = 0; > > map.m_lblk = 0; > > @@ -2306,10 +2307,24 @@ static int f2fs_mpage_readpages(struct inode *inode, > > map.m_seg_type = NO_CHECK_TYPE; > > map.m_may_create = false; > > > > + /* > > + * Two readahead threads for same address range can cause race condition > > + * which fragments sequential read IOs. So let's avoid each other. > > + */ > > + if (rac && readahead_count(rac)) { > > + if (READ_ONCE(F2FS_I(inode)->ra_offset) == readahead_index(rac)) > > + drop_ra = true; > > + else > > + WRITE_ONCE(F2FS_I(inode)->ra_offset, > > + readahead_index(rac)); > > + } > > + > > for (; nr_pages; nr_pages--) { > > if (rac) { > > page = readahead_page(rac); > > prefetchw(&page->flags); > > + if (drop_ra) > > + goto next_page; > > When CONFIG_F2FS_FS_COMPRESSION is not set (i.e. x86_64 defconfig + > CONFIG_F2FS_FS=y): > > $ make -skj"$(nproc)" O=out distclean defconfig fs/f2fs/data.o > ../fs/f2fs/data.c: In function ‘f2fs_mpage_readpages’: > ../fs/f2fs/data.c:2327:5: error: label ‘next_page’ used but not defined > 2327 | goto next_page; > | ^~~~ > ... Thanks. I pushed the fix for -next. https://lore.kernel.org/linux-f2fs-devel/1be18397-7fc6-703e-121b-e210e101357f@infradead.org/T/#t Thanks, > > Cheers, > Nathan > > > _______________________________________________ > Linux-f2fs-devel mailing list > Linux-f2fs-devel@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/linux-f2fs-devel