Received: by 2002:a05:6a10:a841:0:0:0:0 with SMTP id d1csp113031pxy; Wed, 21 Apr 2021 20:25:30 -0700 (PDT) X-Google-Smtp-Source: ABdhPJwNjndYHuujOYfA5nAGoGXWkPP44EOpEEaUkW2EDgOgmhNZJs12LRuNDAz5uFsnhvIGWA8Z X-Received: by 2002:a17:90a:f2ca:: with SMTP id gt10mr1593368pjb.231.1619061929990; Wed, 21 Apr 2021 20:25:29 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1619061929; cv=none; d=google.com; s=arc-20160816; b=m/naEW03a6FPe0eUpSPWtxZ3LmXGjj827uj2NG7q9IzSA/gwadkeaNld7eE5boqvB7 io6OBZb5cKBugQIjiClpmCK/eb5SCbO/u09tK21BEPHVBH3qb4hrYLXEAJD29E8IEu6h gAYTBKP1mqwyqD5kdyrjFsUQ3Jbk8NO/JMCE1ewBeADbA5xkU88STC+cUOD8XWO6AEZ/ s5to2oCz4USAg5lO8wxh+IP3p7YL67luPsz0uF5pSEbbr6nGDgs+3bdR5QofD7Qqu95d soPP3XiXVtsNA8/uKx9iHaM2s8IuNVUx9pmzBMDhg2DwqZeezMUFU5cJuCqnNco7Si8i ywew== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:in-reply-to :mime-version:user-agent:date:message-id:from:references:cc:to :subject; bh=MJm72DXgLcdaTCQB8rarf72Su+WGeur4rHtHWB5npQw=; b=Kr6TkXQxxZtrfT1B96+oTh5RIgOeWNhjeDW5A1TegPuRivg9QpAeF98wgdWCJ/lTX9 ld+dHyTWBXNEVBSE8HyGdRvV13aYraIPE8mQ/qDbLDrvK1PRBFCp0Duw8NLpp/NVPGSk L4aDUfqaw281Mjjs42enoWJuu9JqrMHONoyJ9v3ETOMj3yyeBWKm8ogyKdI1kxLVvosZ s29Va5nV7OA4YQ5r1+1p66tWSA+W21q6HfeGDpzNMwgjJHa+AY8zGUSBI0nQsX6hrOX7 sP9F72YenwjfBl2mFfClfkdEzw5lA+P01TDIU0dsAYYb7x/CApYyNFTfxnxZf16LtzmW AN1Q== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id b9si1627649pfl.171.2021.04.21.20.25.17; Wed, 21 Apr 2021 20:25:29 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S234258AbhDVDZF (ORCPT + 99 others); Wed, 21 Apr 2021 23:25:05 -0400 Received: from zg8tmty1ljiyny4xntqumjca.icoremail.net ([165.227.154.27]:34836 "HELO zg8tmty1ljiyny4xntqumjca.icoremail.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with SMTP id S230319AbhDVDZE (ORCPT ); Wed, 21 Apr 2021 23:25:04 -0400 Received: from [10.115.17.59] (unknown [198.19.131.31]) by front-2 (Coremail) with SMTP id DAGowABnJt1m7IBgTEkTAA--.26630S3; Thu, 22 Apr 2021 11:24:23 +0800 (CST) Subject: Re: [f2fs-dev] [RFC PATCH] f2fs: reduce expensive checkpoint trigger frequency To: Chao Yu , jaegeuk@kernel.org Cc: linux-kernel@vger.kernel.org, linux-f2fs-devel@lists.sourceforge.net, feng.han@hihonor.com, bintian.wang@hihonor.com References: <20210416095838.29568-1-yuchao0@huawei.com> From: heyunlei 00015531 Message-ID: <17bd61a2-114a-e17b-6de2-e1de22963000@hihonor.com> Date: Thu, 22 Apr 2021 11:24:22 +0800 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.6.0 MIME-Version: 1.0 In-Reply-To: <20210416095838.29568-1-yuchao0@huawei.com> Content-Type: text/plain; charset=gbk; format=flowed Content-Transfer-Encoding: 8bit X-CM-TRANSID: DAGowABnJt1m7IBgTEkTAA--.26630S3 X-Coremail-Antispam: 1UD129KBjvJXoWxWr4ftw4kAFyUJw1fGrW5GFg_yoWrGw1Upr n5GF18Krs5C3y2gFn2vF18Zw1Fq34UW3yUCrZ8uw1vy3W2qryrKF1xta9rXF1rAFWvgw1a qF1j9FyrXwsIqaDanT9S1TB71UUUUUUqnTZGkaVYY2UrUUUUjbIjqfuFe4nvWSU5nxnvy2 9KBjDU0xBIdaVrnRJUUUmlb7Iv0xC_Zr1lb4IE77IF4wAFc2x0x2IEx4CE42xK8VAvwI8I cIk0rVWrJVCq3wAFIxvE14AKwVWUJVWUGwA2ocxC64kIII0Yj41l84x0c7CEw4AK67xGY2 AK021l84ACjcxK6xIIjxv20xvE14v26w1j6s0DM28EF7xvwVC0I7IYx2IY6xkF7I0E14v2 6rxl6s0DM28EF7xvwVC2z280aVAFwI0_GcCE3s1l84ACjcxK6I8E87Iv6xkF7I0E14v26r xl6s0DM2AIxVAIcxkEcVAq07x20xvEncxIr21l5I8CrVACY4xI64kE6c02F40Ex7xfMcIj 6xIIjxv20xvE14v26r1q6rW5McIj6xkF7I0En7xvr7AKxVWUJVW8JwAv7VC2z280aVAFwI 0_Cr1j6rxdMcvjeVCFs4IE7xkEbVWUJVW8JwACjcxG0xvEwIxGrwACjcxG6xCI17CEII8v rVW3JVW8Jr1lF7I21c0EjII2zVCS5cI20VAGYxC7Mxk0xIA0c2IEe2xFo4CEbIxvr21lc2 xSY4AK6svPMxAIw28IcxkI7VAKI48JMxAIw28IcVCjz48v1sIEY20_XFWUJr1UMxC20s02 6xCaFVCjc4AY6r1j6r4UMI8I3I0E5I8CrVAFwI0_Jr0_Jr4lx2IqxVCjr7xvwVAFwI0_Jr I_JrWlx4CE17CEb7AF67AKxVWUAVWUtwCIc40Y0x0EwIxGrwCI42IY6xIIjxv20xvE14v2 6r1j6r1xMIIF0xvE2Ix0cI8IcVCY1x0267AKxVWUJVW8JwCI42IY6xAIw20EY4v20xvaj4 0_Jr0_JF4lIxAIcVC2z280aVAFwI0_Jr0_Gr1lIxAIcVC2z280aVCY1x0267AKxVWUJVW8 JbIYCTnIWIevJa73UjIFyTuYvj4RLSdDUUUUU X-CM-SenderInfo: pkh130hohlqxxlkr003uof0z/1tbiAQMBEV3ki9C7zAABsG Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org ?? 2021/4/16 17:58, Chao Yu ะด??: > We may trigger high frequent checkpoint for below case: > 1. mkdir /mnt/dir1; set dir1 encrypted > 2. touch /mnt/file1; fsync /mnt/file1 > 3. mkdir /mnt/dir2; set dir2 encrypted > 4. touch /mnt/file2; fsync /mnt/file2 > ... > > Although, newly created dir and file are not related, due to > commit bbf156f7afa7 ("f2fs: fix lost xattrs of directories"), we will > trigger checkpoint whenever fsync() comes after a new encrypted dir > created. > > In order to avoid such condition, let's record an entry including > directory's ino into global cache when we initialize encryption policy > in a checkpointed directory, and then only trigger checkpoint() when > target file's parent has non-persisted encryption policy, for the case > its parent is not checkpointed, need_do_checkpoint() has cover that > by verifying it with f2fs_is_checkpointed_node(). Ping! > > Signed-off-by: Chao Yu > --- > fs/f2fs/f2fs.h | 2 ++ > fs/f2fs/file.c | 3 +++ > fs/f2fs/xattr.c | 6 ++++-- > include/trace/events/f2fs.h | 3 ++- > 4 files changed, 11 insertions(+), 3 deletions(-) > > diff --git a/fs/f2fs/f2fs.h b/fs/f2fs/f2fs.h > index 87d734f5589d..34487e527d12 100644 > --- a/fs/f2fs/f2fs.h > +++ b/fs/f2fs/f2fs.h > @@ -246,6 +246,7 @@ enum { > APPEND_INO, /* for append ino list */ > UPDATE_INO, /* for update ino list */ > TRANS_DIR_INO, /* for trasactions dir ino list */ > + ENC_DIR_INO, /* for encrypted dir ino list */ > FLUSH_INO, /* for multiple device flushing */ > MAX_INO_ENTRY, /* max. list */ > }; > @@ -1090,6 +1091,7 @@ enum cp_reason_type { > CP_FASTBOOT_MODE, > CP_SPEC_LOG_NUM, > CP_RECOVER_DIR, > + CP_ENC_DIR, > }; > > enum iostat_type { > diff --git a/fs/f2fs/file.c b/fs/f2fs/file.c > index 6284b2f4a60b..a6c38d8b1ec3 100644 > --- a/fs/f2fs/file.c > +++ b/fs/f2fs/file.c > @@ -218,6 +218,9 @@ static inline enum cp_reason_type need_do_checkpoint(struct inode *inode) > f2fs_exist_written_data(sbi, F2FS_I(inode)->i_pino, > TRANS_DIR_INO)) > cp_reason = CP_RECOVER_DIR; > + else if (f2fs_exist_written_data(sbi, F2FS_I(inode)->i_pino, > + ENC_DIR_INO)) > + cp_reason = CP_ENC_DIR; > > return cp_reason; > } > diff --git a/fs/f2fs/xattr.c b/fs/f2fs/xattr.c > index c8f34decbf8e..38796d488d15 100644 > --- a/fs/f2fs/xattr.c > +++ b/fs/f2fs/xattr.c > @@ -630,6 +630,7 @@ static int __f2fs_setxattr(struct inode *inode, int index, > const char *name, const void *value, size_t size, > struct page *ipage, int flags) > { > + struct f2fs_sb_info *sbi = F2FS_I_SB(inode); > struct f2fs_xattr_entry *here, *last; > void *base_addr, *last_base_addr; > int found, newsize; > @@ -745,8 +746,9 @@ static int __f2fs_setxattr(struct inode *inode, int index, > !strcmp(name, F2FS_XATTR_NAME_ENCRYPTION_CONTEXT)) > f2fs_set_encrypted_inode(inode); > f2fs_mark_inode_dirty_sync(inode, true); > - if (!error && S_ISDIR(inode->i_mode)) > - set_sbi_flag(F2FS_I_SB(inode), SBI_NEED_CP); > + if (!error && S_ISDIR(inode->i_mode) && > + f2fs_is_checkpointed_node(sbi, inode->i_ino)) > + f2fs_add_ino_entry(sbi, inode->i_ino, ENC_DIR_INO); > > same: > if (is_inode_flag_set(inode, FI_ACL_MODE)) { > diff --git a/include/trace/events/f2fs.h b/include/trace/events/f2fs.h > index 56b113e3cd6a..ca0cf12226e9 100644 > --- a/include/trace/events/f2fs.h > +++ b/include/trace/events/f2fs.h > @@ -145,7 +145,8 @@ TRACE_DEFINE_ENUM(CP_RESIZE); > { CP_NODE_NEED_CP, "node needs cp" }, \ > { CP_FASTBOOT_MODE, "fastboot mode" }, \ > { CP_SPEC_LOG_NUM, "log type is 2" }, \ > - { CP_RECOVER_DIR, "dir needs recovery" }) > + { CP_RECOVER_DIR, "dir needs recovery" }, \ > + { CP_ENC_DIR, "persist encryption policy" }) > > #define show_shutdown_mode(type) \ > __print_symbolic(type, \