Received: by 2002:a05:6a10:2726:0:0:0:0 with SMTP id ib38csp5348533pxb; Mon, 28 Mar 2022 11:15:42 -0700 (PDT) X-Google-Smtp-Source: ABdhPJwbfLs3erQoYpwV/HhP5v2fuln4VQ6o2keeEsTKWpeCrGTHdLPfjOxTq+sGRdr0owiIHaGT X-Received: by 2002:a9d:6292:0:b0:5b2:4693:de5a with SMTP id x18-20020a9d6292000000b005b24693de5amr10503766otk.163.1648491342623; Mon, 28 Mar 2022 11:15:42 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1648491342; cv=none; d=google.com; s=arc-20160816; b=Uku06+BH7O1eHmRTbmxzf/PHK/37Ju8Mc9voFYaI59uRUBwTIjvIhdUe9x/wkGzC9j HNlH1blahNpjUGuC7fCaoPaNgi5SwBInzTweELKOxM7SCO1NAB6PaSRitqBsqxfwbV0H TvhMO7P/S9BonREYfMv11vi0ucqzF2w7cN2DzWaP9q4XCyVKDzRgC9kSUk3KrlteIv5r toYain3yzzTXSVGoMaaFLfYkaNdbtKQpBehedaqa5u8qbO+NMIiHet056JkuOn2MWM5y mYW2mIxUfR7wOlMLrC3aluIVM1IbWxOyS/lt4RPXO2mD57yxyc8D/mFdZdIoAtOM+dg8 Bufg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:in-reply-to:content-disposition:mime-version :references:mail-followup-to:message-id:subject:cc:to:from:date; bh=QE50daSjBaH5MEfRPPDOTdsOSvS4Bmt6HaEQPeay3fY=; b=GwPuUP/j0Iaxc11B6dPInto3lSaxjKbk9kV/FgCd6VNrd7Tm65PzxTGvdAadOOn+Il PV+Jy+esWy0K2d/SVHgAI9FKYWeg8VR3qW56IL1TnKQ9xfh+BZ6qF8PAQRwS3HaVKiGm tNJ7MHMJWtonHXercr//+Eppkfog/25KP1HJhbO+PWAJAjguc0CNT08p1W7OCz30kkrl Ixe1K+l5/DirPJ2dmQsWepkEVgJJSE6WXARaBQcsaMn9lNaLP70PCXwXtzDeskJSpqF3 Ph3v2AJK/zNWVuEAUbS0CdAEUJhoeNLUP5pBoJU1uKbNE6C7/I5RhGMVNCUzoGCM5aSp Acqw== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=alibaba.com Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id s30-20020a056870611e00b000de1c8f0746si12421393oae.72.2022.03.28.11.15.15; Mon, 28 Mar 2022 11:15:42 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=alibaba.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S240398AbiC1K51 (ORCPT + 99 others); Mon, 28 Mar 2022 06:57:27 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:55332 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S240386AbiC1K50 (ORCPT ); Mon, 28 Mar 2022 06:57:26 -0400 Received: from out30-57.freemail.mail.aliyun.com (out30-57.freemail.mail.aliyun.com [115.124.30.57]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id CF01C24F1C; Mon, 28 Mar 2022 03:55:44 -0700 (PDT) X-Alimail-AntiSpam: AC=PASS;BC=-1|-1;BR=01201311R151e4;CH=green;DM=||false|;DS=||;FP=0|-1|-1|-1|0|-1|-1|-1;HT=e01e04426;MF=hsiangkao@linux.alibaba.com;NM=1;PH=DS;RN=19;SR=0;TI=SMTPD_---0V8R4iF-_1648464938; Received: from B-P7TQMD6M-0146.local(mailfrom:hsiangkao@linux.alibaba.com fp:SMTPD_---0V8R4iF-_1648464938) by smtp.aliyun-inc.com(127.0.0.1); Mon, 28 Mar 2022 18:55:40 +0800 Date: Mon, 28 Mar 2022 18:55:38 +0800 From: Gao Xiang To: Jeffle Xu Cc: dhowells@redhat.com, linux-cachefs@redhat.com, xiang@kernel.org, chao@kernel.org, linux-erofs@lists.ozlabs.org, torvalds@linux-foundation.org, gregkh@linuxfoundation.org, willy@infradead.org, linux-fsdevel@vger.kernel.org, joseph.qi@linux.alibaba.com, bo.liu@linux.alibaba.com, tao.peng@linux.alibaba.com, gerry@linux.alibaba.com, eguan@linux.alibaba.com, linux-kernel@vger.kernel.org, luodaowen.backend@bytedance.com, tianzichen@kuaishou.com, fannaihao@baidu.com Subject: Re: [PATCH v6 21/22] erofs: implement fscache-based data readahead Message-ID: Mail-Followup-To: Jeffle Xu , dhowells@redhat.com, linux-cachefs@redhat.com, xiang@kernel.org, chao@kernel.org, linux-erofs@lists.ozlabs.org, torvalds@linux-foundation.org, gregkh@linuxfoundation.org, willy@infradead.org, linux-fsdevel@vger.kernel.org, joseph.qi@linux.alibaba.com, bo.liu@linux.alibaba.com, tao.peng@linux.alibaba.com, gerry@linux.alibaba.com, eguan@linux.alibaba.com, linux-kernel@vger.kernel.org, luodaowen.backend@bytedance.com, tianzichen@kuaishou.com, fannaihao@baidu.com References: <20220325122223.102958-1-jefflexu@linux.alibaba.com> <20220325122223.102958-22-jefflexu@linux.alibaba.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline In-Reply-To: <20220325122223.102958-22-jefflexu@linux.alibaba.com> X-Spam-Status: No, score=-9.9 required=5.0 tests=BAYES_00, ENV_AND_HDR_SPF_MATCH,RCVD_IN_DNSWL_NONE,RCVD_IN_MSPIKE_H4, RCVD_IN_MSPIKE_WL,SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE, UNPARSEABLE_RELAY,USER_IN_DEF_SPF_WL autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Fri, Mar 25, 2022 at 08:22:22PM +0800, Jeffle Xu wrote: > Implements fscache-based data readahead. Also registers an individual > bdi for each erofs instance to enable readahead. > > Signed-off-by: Jeffle Xu > --- > fs/erofs/fscache.c | 114 +++++++++++++++++++++++++++++++++++++++++++++ > fs/erofs/super.c | 4 ++ > 2 files changed, 118 insertions(+) > > diff --git a/fs/erofs/fscache.c b/fs/erofs/fscache.c > index cbb39657615e..589d1e7c2b1b 100644 > --- a/fs/erofs/fscache.c > +++ b/fs/erofs/fscache.c > @@ -191,12 +191,126 @@ static int erofs_fscache_readpage(struct file *file, struct page *page) > return ret; > } > > +static inline size_t erofs_fscache_calc_len(struct erofs_map_blocks *map, > + size_t len, size_t done) > +{ > + /* > + * 1) For CHUNK_BASED layout, the output m_la is rounded down to the > + * nearest chunk boundary, and the output m_llen actually starts from > + * the start of the containing chunk. > + * 2) For other cases, the output m_la is equal to o_la. > + */ > + size_t length = map->m_llen - (map->o_la - map->m_la); > + > + return min_t(size_t, length, len - done); This helper can be folded too. > +} > + > +static inline void erofs_fscache_unlock_folios(struct readahead_control *rac, > + size_t len) > +{ > + while (len) { > + struct folio *folio = readahead_folio(rac); > + > + len -= folio_size(folio); > + folio_mark_uptodate(folio); > + folio_unlock(folio); > + } > +} > + > +static void erofs_fscache_readahead(struct readahead_control *rac) > +{ > + struct inode *inode = rac->mapping->host; > + struct erofs_inode *vi = EROFS_I(inode); > + struct super_block *sb = inode->i_sb; > + size_t len, done = 0; > + loff_t start; > + int ret; > + > + if (erofs_inode_is_data_compressed(vi->datalayout)) { > + erofs_info(sb, "compressed layout not supported yet"); > + return; > + } Redundant check. > + > + if (!readahead_count(rac)) > + return; > + > + start = readahead_pos(rac); > + len = readahead_length(rac); > + > + do { > + struct erofs_map_blocks map; > + > + map.m_la = map.o_la = start + done; > + > + ret = erofs_map_blocks(inode, &map, EROFS_GET_BLOCKS_RAW); > + if (ret) > + return; > + > + /* Read-ahead Hole > + * Two cases will hit this: > + * 1) EOF. Imposibble in readahead routine; > + * 2) hole. Only CHUNK_BASED layout supports hole. > + */ /* * */ and typo `Imposibble'. Also I think this comment may not be useful though. > + if (!(map.m_flags & EROFS_MAP_MAPPED)) { > + struct iov_iter iter; > + loff_t offset = start + done; > + size_t count = erofs_fscache_calc_len(&map, len, done); > + > + iov_iter_xarray(&iter, READ, &rac->mapping->i_pages, offset, count); > + iov_iter_zero(count, &iter); > + > + erofs_fscache_unlock_folios(rac, count); > + ret = count; > + continue; > + } > + > + ret = erofs_fscache_get_map(&map, sb); > + if (ret) > + return; > + > + /* Read-ahead Inline */ > + if (map.m_flags & EROFS_MAP_META) { > + struct folio *folio = readahead_folio(rac); > + > + ret = erofs_fscache_readpage_inline(folio, &map); > + if (!ret) { > + folio_mark_uptodate(folio); > + ret = folio_size(folio); > + } > + > + folio_unlock(folio); > + continue; > + } > + > + /* Read-ahead No-inline */ > + if (vi->datalayout == EROFS_INODE_FLAT_PLAIN || > + vi->datalayout == EROFS_INODE_FLAT_INLINE || > + vi->datalayout == EROFS_INODE_CHUNK_BASED) { > + struct fscache_cookie *cookie = map.m_fscache->cookie; > + loff_t offset = start + done; > + size_t count = erofs_fscache_calc_len(&map, len, done); You could promote `offset' and `count' to the outer block. So another `offset' and `count' in !EROFS_MAP_MAPPED can be dropped then. Thanks, Gao Xiang