Received: by 2002:a25:683:0:0:0:0:0 with SMTP id 125csp4051473ybg; Sun, 7 Jun 2020 20:01:02 -0700 (PDT) X-Google-Smtp-Source: ABdhPJxGZ8ZmrSJXUGYGdP8fEZ0J8OUOZynrWEtEFsVEKGYVeG+M8le0NkAgg4Gh5r9fCraLwmtP X-Received: by 2002:a05:6402:1d82:: with SMTP id dk2mr19593922edb.75.1591585262085; Sun, 07 Jun 2020 20:01:02 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1591585262; cv=none; d=google.com; s=arc-20160816; b=cLYiEKkzQs7W+zKsF6pQrJZzClbFg1i0t0MyjzHUVWidq9aBqfQ9PvBfPpyLOTrIxJ MkUUaV4JYWJwNaHiyxL6wQdueOQa8FbNMPmmPD6kXxKHBbd2QEWLTiIU3rSjrnax07sc lODbPUAzvTrqCmlEDAdQh8a39HmkB88iEjTsall7OGfMswsoQWXNc6n4zW3ukbdTUP1N 3IBx+5t6qwZYqWZPLyrsCT2nnzmzXh/PExLwLDszZHMv4zUoado0XSkjVMm3D5ZPVg5v /IVD95QN7/eO+nBNLM0H4kJ/i/4gIQWNxxPbX0Jj3augF9+Ot0ajgj7T1tAgUI1mFJOZ rBvQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:from:references:cc:to:subject; bh=wSrNSjI1nVPcPhQx6yOMcy56IvJQhPtET4c3+Fpt4Ok=; b=jIFbrzxuGA9EOwa9BSEHFMo13A6Sv8XHcdcjrMyZMR6CVu+3SnWYioDgCeRfbVBEKl cG7NVvGJYgXkUEpmxVTcRqArjw8JOkeO61yAqqdskU1dYS68HaH8FlSGX9xx54QtWnwU 62FS7Rqboqz8GD/FiVmDNUPwAWDZQ3/nEf1xbofBtsWHev3nEupobAiGeJL5Xz5G9kCF I3672LstPNQ1fvXy3MpdBa3Cg3G0BYK8RTVrh0U1gMHHFxUWTf8H3FPfk7F1ZRySlgvz +RiREpsOddZ2qtnXkOhpgwuPu1ot1xWgcdZmYhoFpJuxdrP85qNzLl+FQ3p5gr0ttmwP 63PQ== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id z20si7988556eja.58.2020.06.07.20.00.39; Sun, 07 Jun 2020 20:01:02 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728670AbgFHC6z (ORCPT + 99 others); Sun, 7 Jun 2020 22:58:55 -0400 Received: from szxga04-in.huawei.com ([45.249.212.190]:5862 "EHLO huawei.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1728065AbgFHC6z (ORCPT ); Sun, 7 Jun 2020 22:58:55 -0400 Received: from DGGEMS413-HUB.china.huawei.com (unknown [172.30.72.58]) by Forcepoint Email with ESMTP id D4266A8D4C9B446D8409; Mon, 8 Jun 2020 10:58:51 +0800 (CST) Received: from [10.134.22.195] (10.134.22.195) by smtp.huawei.com (10.3.19.213) with Microsoft SMTP Server (TLS) id 14.3.487.0; Mon, 8 Jun 2020 10:58:49 +0800 Subject: Re: [PATCH] f2fs: allow writeback on error status filesystem To: Jaegeuk Kim CC: , , References: <20200605085453.45717-1-yuchao0@huawei.com> <20200607211748.GA26785@google.com> From: Chao Yu Message-ID: <025cde14-3b4e-b9db-d359-513a44e9c1a1@huawei.com> Date: Mon, 8 Jun 2020 10:58:50 +0800 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.9.1 MIME-Version: 1.0 In-Reply-To: <20200607211748.GA26785@google.com> Content-Type: text/plain; charset="windows-1252" Content-Language: en-US Content-Transfer-Encoding: 7bit X-Originating-IP: [10.134.22.195] X-CFilter-Loop: Reflected Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 2020/6/8 5:17, Jaegeuk Kim wrote: > On 06/05, Chao Yu wrote: >> 71.07% 0.01% kworker/u256:1+ [kernel.kallsyms] [k] wb_writeback >> | >> --71.06%--wb_writeback >> | >> |--68.96%--__writeback_inodes_wb >> | | >> | --68.95%--writeback_sb_inodes >> | | >> | |--65.08%--__writeback_single_inode >> | | | >> | | --64.35%--do_writepages >> | | | >> | | |--59.83%--f2fs_write_node_pages >> | | | | >> | | | --59.74%--f2fs_sync_node_pages >> | | | | >> | | | |--27.91%--pagevec_lookup_range_tag >> | | | | | >> | | | | --27.90%--find_get_pages_range_tag >> >> If filesystem was injected w/ checkpoint errror, before umount, kworker >> will always hold one core in order to writeback a large number of node >> pages, that looks not reasonable, to avoid that, we can allow data/node >> write in such case, since we can force all data/node writes with OPU mode, >> and clear recovery flag on node, and checkpoint is not allowed as well, >> so we don't need to worry about writeback's effect on data/node in >> previous checkpoint, then with this way, it can decrease memory footprint >> cost by node/data pages and avoid looping into data/node writeback >> process. > > This patch breaks fault injection test with filesystem corruption. Please check. My bad, will check soon. Thanks, > >> >> Signed-off-by: Chao Yu >> --- >> fs/f2fs/data.c | 19 ++++++++++++------- >> fs/f2fs/node.c | 7 +++++-- >> 2 files changed, 17 insertions(+), 9 deletions(-) >> >> diff --git a/fs/f2fs/data.c b/fs/f2fs/data.c >> index 9d40db50cd65..2b3c846181bb 100644 >> --- a/fs/f2fs/data.c >> +++ b/fs/f2fs/data.c >> @@ -2519,6 +2519,8 @@ bool f2fs_should_update_outplace(struct inode *inode, struct f2fs_io_info *fio) >> { >> struct f2fs_sb_info *sbi = F2FS_I_SB(inode); >> >> + if (unlikely(f2fs_cp_error(sbi))) >> + return true; >> if (f2fs_lfs_mode(sbi)) >> return true; >> if (S_ISDIR(inode->i_mode)) >> @@ -2702,13 +2704,16 @@ int f2fs_write_single_data_page(struct page *page, int *submitted, >> /* we should bypass data pages to proceed the kworkder jobs */ >> if (unlikely(f2fs_cp_error(sbi))) { >> mapping_set_error(page->mapping, -EIO); >> - /* >> - * don't drop any dirty dentry pages for keeping lastest >> - * directory structure. >> - */ >> - if (S_ISDIR(inode->i_mode)) >> - goto redirty_out; >> - goto out; >> + >> + if (has_not_enough_free_secs(sbi, 0, 0)) { >> + /* >> + * don't drop any dirty dentry pages for keeping lastest >> + * directory structure. >> + */ >> + if (S_ISDIR(inode->i_mode)) >> + goto redirty_out; >> + goto out; >> + } >> } >> >> if (unlikely(is_sbi_flag_set(sbi, SBI_POR_DOING))) >> diff --git a/fs/f2fs/node.c b/fs/f2fs/node.c >> index 03e24df1c84f..372c04efad38 100644 >> --- a/fs/f2fs/node.c >> +++ b/fs/f2fs/node.c >> @@ -1527,7 +1527,10 @@ static int __write_node_page(struct page *page, bool atomic, bool *submitted, >> unlock_page(page); >> return 0; >> } >> - goto redirty_out; >> + if (has_not_enough_free_secs(sbi, 0, 0)) >> + goto redirty_out; >> + set_fsync_mark(page, 0); >> + set_dentry_mark(page, 0); >> } >> >> if (unlikely(is_sbi_flag_set(sbi, SBI_POR_DOING))) >> @@ -1568,7 +1571,7 @@ static int __write_node_page(struct page *page, bool atomic, bool *submitted, >> goto redirty_out; >> } >> >> - if (atomic && !test_opt(sbi, NOBARRIER)) >> + if (atomic && !test_opt(sbi, NOBARRIER) && !f2fs_cp_error(sbi)) >> fio.op_flags |= REQ_PREFLUSH | REQ_FUA; >> >> /* should add to global list before clearing PAGECACHE status */ >> -- >> 2.18.0.rc1 > . >