Received: by 2002:a05:6a10:413:0:0:0:0 with SMTP id 19csp950363pxp; Wed, 16 Mar 2022 22:22:44 -0700 (PDT) X-Google-Smtp-Source: ABdhPJyjtPV4PggTtNNKv7aq1TJYnpV/zW9atWGIQJTYXlwUDzl7FiXXUk1cAFER9LU2vI0YmPlp X-Received: by 2002:a65:4789:0:b0:374:8b11:fb47 with SMTP id e9-20020a654789000000b003748b11fb47mr2290256pgs.325.1647494563850; Wed, 16 Mar 2022 22:22:43 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1647494563; cv=none; d=google.com; s=arc-20160816; b=HOaq6KG9VsiwtXZpHH3cxR8qkdS2PFHRUtSdoOpvUSNrpZE/jgsv823RbnffiMAM3i j7pGscNAxhCAhLYT4aakVJVAcB4T+72hc+hn9pTp7hwNELC5VHA4qzG2Hb5jm62a7hY9 I6ZF00Awm2NfkHZdtOw0/eQ+211RiBKwaT8Zz/BiWgEL2KkmkRp0s1pK6lfazt6Hg0Cz 5vo1/ax3y7sXCfSsKfj8AeqqIMQFroDO5XuOUnJqXN5ueXmxdmPZzkKRpBl4aZA2en/C AR60ueMAYRAdBtxK+EyN/ep3AUF2rHjCQAQBbYdlK7mcjRi+Lr3Fq+Vgmxma+KPJ+ruy EsxA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from; bh=A+QVwVs042OQN1g73iK4x+s6dv/ZvPICSRGKyFnAFgU=; b=QWgB9psK223jNpIr6upDFzS0f6VKuUlb2Rb2FYZHygFB3TRVeDvdj3CVLCO9N8nNWf D9injX92ITGjq3/4EiNJgNEorKF4nv2+VvWu6cgN5ptquB2rQiaKsEKm7zN6NNQ/zKBS SYXlOWP3knqtb9lZbpMxYwLOBhvlGeKKbF+4JSeRIJdq1qKz1CneZPHwUi1SAvIdxjVe Q85FR15y51CfDU1G3C+c1G1MuvqUYSYFN1wGytR295jtPylVidf3f4uAZ+4i8mMdbBhE EsnaIFUkmKroj4maTVcvmy/lDG2mhPnzf1xY1lHst8gB+5N4nuk2WH6Hmbm/MwT/Velj JnZw== ARC-Authentication-Results: i=1; mx.google.com; spf=softfail (google.com: domain of transitioning linux-kernel-owner@vger.kernel.org does not designate 23.128.96.19 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=alibaba.com Return-Path: Received: from lindbergh.monkeyblade.net (lindbergh.monkeyblade.net. [23.128.96.19]) by mx.google.com with ESMTPS id r31-20020a635d1f000000b003816043efabsi992223pgb.416.2022.03.16.22.22.43 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 16 Mar 2022 22:22:43 -0700 (PDT) Received-SPF: softfail (google.com: domain of transitioning linux-kernel-owner@vger.kernel.org does not designate 23.128.96.19 as permitted sender) client-ip=23.128.96.19; Authentication-Results: mx.google.com; spf=softfail (google.com: domain of transitioning linux-kernel-owner@vger.kernel.org does not designate 23.128.96.19 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=alibaba.com Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by lindbergh.monkeyblade.net (Postfix) with ESMTP id 4DAAA216FA9; Wed, 16 Mar 2022 21:28:37 -0700 (PDT) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1356388AbiCPNUN (ORCPT + 99 others); Wed, 16 Mar 2022 09:20:13 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:55676 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1356314AbiCPNTm (ORCPT ); Wed, 16 Mar 2022 09:19:42 -0400 Received: from out199-13.us.a.mail.aliyun.com (out199-13.us.a.mail.aliyun.com [47.90.199.13]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 246DA7653; Wed, 16 Mar 2022 06:17:52 -0700 (PDT) X-Alimail-AntiSpam: AC=PASS;BC=-1|-1;BR=01201311R171e4;CH=green;DM=||false|;DS=||;FP=0|-1|-1|-1|0|-1|-1|-1;HT=e01e04423;MF=jefflexu@linux.alibaba.com;NM=1;PH=DS;RN=16;SR=0;TI=SMTPD_---0V7NEPrI_1647436667; Received: from localhost(mailfrom:jefflexu@linux.alibaba.com fp:SMTPD_---0V7NEPrI_1647436667) by smtp.aliyun-inc.com(127.0.0.1); Wed, 16 Mar 2022 21:17:48 +0800 From: Jeffle Xu To: dhowells@redhat.com, linux-cachefs@redhat.com, xiang@kernel.org, chao@kernel.org, linux-erofs@lists.ozlabs.org Cc: torvalds@linux-foundation.org, gregkh@linuxfoundation.org, willy@infradead.org, linux-fsdevel@vger.kernel.org, joseph.qi@linux.alibaba.com, bo.liu@linux.alibaba.com, tao.peng@linux.alibaba.com, gerry@linux.alibaba.com, eguan@linux.alibaba.com, linux-kernel@vger.kernel.org, luodaowen.backend@bytedance.com Subject: [PATCH v5 16/22] erofs: implement fscache-based metadata read Date: Wed, 16 Mar 2022 21:17:17 +0800 Message-Id: <20220316131723.111553-17-jefflexu@linux.alibaba.com> X-Mailer: git-send-email 2.27.0 In-Reply-To: <20220316131723.111553-1-jefflexu@linux.alibaba.com> References: <20220316131723.111553-1-jefflexu@linux.alibaba.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,RDNS_NONE, SPF_HELO_NONE,T_SCC_BODY_TEXT_LINE,UNPARSEABLE_RELAY autolearn=no autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org This patch implements the data plane of reading metadata from bootstrap blob file over fscache. Be noted that currently it only supports the scenario where the backing file has no hole. Once it hits a hole of the backing file, erofs will fail the IO with -EOPNOTSUPP for now. The following patch will fix this issue, i.e. implementing the demand reading mode. Signed-off-by: Jeffle Xu --- fs/erofs/data.c | 11 +++++++++-- fs/erofs/fscache.c | 24 ++++++++++++++++++++++++ fs/erofs/internal.h | 3 +++ 3 files changed, 36 insertions(+), 2 deletions(-) diff --git a/fs/erofs/data.c b/fs/erofs/data.c index 6e2a28242453..1bff99576883 100644 --- a/fs/erofs/data.c +++ b/fs/erofs/data.c @@ -31,15 +31,22 @@ void erofs_put_metabuf(struct erofs_buf *buf) void *erofs_read_metabuf(struct erofs_buf *buf, struct super_block *sb, erofs_blk_t blkaddr, enum erofs_kmap_type type) { - struct address_space *const mapping = sb->s_bdev->bd_inode->i_mapping; + struct address_space *mapping; + struct erofs_sb_info *sbi = EROFS_SB(sb); erofs_off_t offset = blknr_to_addr(blkaddr); pgoff_t index = offset >> PAGE_SHIFT; struct page *page = buf->page; if (!page || page->index != index) { erofs_put_metabuf(buf); - page = read_cache_page_gfp(mapping, index, + if (erofs_bdev_mode(sb)) { + mapping = sb->s_bdev->bd_inode->i_mapping; + page = read_cache_page_gfp(mapping, index, mapping_gfp_constraint(mapping, ~__GFP_FS)); + } else { + page = erofs_fscache_read_cache_page(sbi->bootstrap, + index); + } if (IS_ERR(page)) return page; /* should already be PageUptodate, no need to lock page */ diff --git a/fs/erofs/fscache.c b/fs/erofs/fscache.c index 38b5a9380092..654414aa87ad 100644 --- a/fs/erofs/fscache.c +++ b/fs/erofs/fscache.c @@ -44,9 +44,33 @@ static inline int erofs_fscache_read_page(struct fscache_cookie *cookie, page_offset(page), PAGE_SIZE, pstart); } +static int erofs_fscache_readpage_blob(struct file *data, struct page *page) +{ + int ret; + struct erofs_fscache_context *ctx = + (struct erofs_fscache_context *)data; + + ret = erofs_fscache_read_page(ctx->cookie, page, page_offset(page)); + if (!ret) + SetPageUptodate(page); + else + SetPageError(page); + + unlock_page(page); + return ret; +} + static const struct address_space_operations erofs_fscache_blob_aops = { + .readpage = erofs_fscache_readpage_blob, }; +struct page *erofs_fscache_read_cache_page(struct erofs_fscache_context *ctx, + pgoff_t index) +{ + DBG_BUGON(!ctx->inode); + return read_mapping_page(ctx->inode->i_mapping, index, ctx); +} + static int erofs_fscache_init_cookie(struct erofs_fscache_context *ctx, char *path) { diff --git a/fs/erofs/internal.h b/fs/erofs/internal.h index cce39339c08e..35e7c330e59e 100644 --- a/fs/erofs/internal.h +++ b/fs/erofs/internal.h @@ -633,6 +633,9 @@ struct erofs_fscache_context *erofs_fscache_get_ctx(struct super_block *sb, char *path, bool need_inode); void erofs_fscache_put_ctx(struct erofs_fscache_context *ctx); +struct page *erofs_fscache_read_cache_page(struct erofs_fscache_context *ctx, + pgoff_t index); + #define EFSCORRUPTED EUCLEAN /* Filesystem is corrupted */ #endif /* __EROFS_INTERNAL_H */ -- 2.27.0