Received: by 2002:a05:6902:102b:0:0:0:0 with SMTP id x11csp217296ybt; Tue, 30 Jun 2020 19:00:34 -0700 (PDT) X-Google-Smtp-Source: ABdhPJyjuDxPrjYga20AiizZeIMrnEwLkgL11xxaAu3zWaFMYtTLqo9aYLO6uRoTXlzXu5oNJvcl X-Received: by 2002:a17:906:dbe5:: with SMTP id yd5mr21079687ejb.328.1593568834218; Tue, 30 Jun 2020 19:00:34 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1593568834; cv=none; d=google.com; s=arc-20160816; b=yNiOs7tJArzUqmTTynCZECF8OoUwJKLSHi1ttnwWD1MX7CZA7ws8DYKO8DunN3Luzs D42FEZYmSGNDJycX5gabklIj0SvSLFOq62FlgQmNABXSWap89Mt60xjw8BNmaore3wKt w/sUSXbtrDz+Toihm69eqJyVWKp+d8IRsTedG1gOrUxMCW1X8zinYyg4ztWYXIO7usXd W0YhIYLzYJmlVpNL6zIm3wt2FxnaHHY4P/wkragV4LW1766KNnMHq4dY0+nCt2Oy+DgD HCVNJDbOZWOaMHmQMKWd/uknWO59mOSeeDhqe3uUABJuZ2wUO5YNwkJeNXb3qyQ249P/ 4M9A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:from:references:cc:to:subject; bh=A2WMAPdO5Lf1fbJYedJY0uGV8RoMcyyS/7PY5yJUZZw=; b=uP4CD5JD3dQU7QAb8nmhvzsIT09Rvwn8mXHhjK0hCE/VTp5UWhMM7tQVzwx7ehoCrt q7d9AFP7V0G87D7MNQkf9MLd2JO2HHkVAeTJUwOKL1fe4xks3L//mtod2V9RSpwJdaWp Df/TODulnypn9OiSYh+yOEtM7sNpS2BbfThqAm8a+/CVY5NQB3fcAPBdUzGYQtnxnD/r /w44QStdm+w+vtTNFjta5g5uHfTleMjkLil2WRjSpR3cKpZTQYAqcwCrrlVDWzVguoLS xJe4GUFhgtWlN+3m52v9HZJhNec6GTxV5+UV2Nc6EjSkfyi9crFwKONN4CC649H2FC+l YZJw== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id b11si2803418ejg.42.2020.06.30.19.00.10; Tue, 30 Jun 2020 19:00:34 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1725937AbgGACAF (ORCPT + 99 others); Tue, 30 Jun 2020 22:00:05 -0400 Received: from szxga06-in.huawei.com ([45.249.212.32]:57734 "EHLO huawei.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1725805AbgGACAF (ORCPT ); Tue, 30 Jun 2020 22:00:05 -0400 Received: from DGGEMS412-HUB.china.huawei.com (unknown [172.30.72.59]) by Forcepoint Email with ESMTP id 4681418191EF47DAEB71; Wed, 1 Jul 2020 10:00:01 +0800 (CST) Received: from [10.134.22.195] (10.134.22.195) by smtp.huawei.com (10.3.19.212) with Microsoft SMTP Server (TLS) id 14.3.487.0; Wed, 1 Jul 2020 09:59:55 +0800 Subject: Re: [f2fs-dev] [PATCH v3] f2fs: avoid readahead race condition To: Jaegeuk Kim , Nathan Chancellor CC: , , References: <20200624012148.180050-1-jaegeuk@kernel.org> <20200629150323.GA3293033@google.com> <20200629202720.GA230664@google.com> <20200630204348.GA2504307@ubuntu-s3-xlarge-x86> <20200630205635.GB1396584@google.com> From: Chao Yu Message-ID: <285a4e16-2cbc-d1e9-8464-8a06bacbaaa0@huawei.com> Date: Wed, 1 Jul 2020 09:59:54 +0800 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.9.1 MIME-Version: 1.0 In-Reply-To: <20200630205635.GB1396584@google.com> Content-Type: text/plain; charset="utf-8" Content-Language: en-US Content-Transfer-Encoding: 8bit X-Originating-IP: [10.134.22.195] X-CFilter-Loop: Reflected Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 2020/7/1 4:56, Jaegeuk Kim wrote: > On 06/30, Nathan Chancellor wrote: >> On Mon, Jun 29, 2020 at 01:27:20PM -0700, Jaegeuk Kim wrote: >>> If two readahead threads having same offset enter in readpages, every read >>> IOs are split and issued to the disk which giving lower bandwidth. >>> >>> This patch tries to avoid redundant readahead calls. >>> >>> Signed-off-by: Jaegeuk Kim >>> --- >>> v3: >>> - use READ|WRITE_ONCE >>> v2: >>> - add missing code to bypass read >>> >>> fs/f2fs/data.c | 18 ++++++++++++++++++ >>> fs/f2fs/f2fs.h | 1 + >>> fs/f2fs/super.c | 2 ++ >>> 3 files changed, 21 insertions(+) >>> >>> diff --git a/fs/f2fs/data.c b/fs/f2fs/data.c >>> index 995cf78b23c5e..360b4c9080d97 100644 >>> --- a/fs/f2fs/data.c >>> +++ b/fs/f2fs/data.c >>> @@ -2296,6 +2296,7 @@ static int f2fs_mpage_readpages(struct inode *inode, >>> unsigned nr_pages = rac ? readahead_count(rac) : 1; >>> unsigned max_nr_pages = nr_pages; >>> int ret = 0; >>> + bool drop_ra = false; >>> >>> map.m_pblk = 0; >>> map.m_lblk = 0; >>> @@ -2306,10 +2307,24 @@ static int f2fs_mpage_readpages(struct inode *inode, >>> map.m_seg_type = NO_CHECK_TYPE; >>> map.m_may_create = false; >>> >>> + /* >>> + * Two readahead threads for same address range can cause race condition >>> + * which fragments sequential read IOs. So let's avoid each other. >>> + */ >>> + if (rac && readahead_count(rac)) { >>> + if (READ_ONCE(F2FS_I(inode)->ra_offset) == readahead_index(rac)) >>> + drop_ra = true; >>> + else >>> + WRITE_ONCE(F2FS_I(inode)->ra_offset, >>> + readahead_index(rac)); >>> + } >>> + >>> for (; nr_pages; nr_pages--) { >>> if (rac) { >>> page = readahead_page(rac); >>> prefetchw(&page->flags); >>> + if (drop_ra) >>> + goto next_page; >> >> When CONFIG_F2FS_FS_COMPRESSION is not set (i.e. x86_64 defconfig + >> CONFIG_F2FS_FS=y): >> >> $ make -skj"$(nproc)" O=out distclean defconfig fs/f2fs/data.o >> ../fs/f2fs/data.c: In function ‘f2fs_mpage_readpages’: >> ../fs/f2fs/data.c:2327:5: error: label ‘next_page’ used but not defined >> 2327 | goto next_page; >> | ^~~~ >> ... > > Thanks. I pushed the fix for -next. > https://lore.kernel.org/linux-f2fs-devel/1be18397-7fc6-703e-121b-e210e101357f@infradead.org/T/#t Reviewed-by: Chao Yu Thanks, > > Thanks, > >> >> Cheers, >> Nathan >> >> >> _______________________________________________ >> Linux-f2fs-devel mailing list >> Linux-f2fs-devel@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/linux-f2fs-devel > > > _______________________________________________ > Linux-f2fs-devel mailing list > Linux-f2fs-devel@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/linux-f2fs-devel >