Received: by 2002:a05:6358:45e:b0:b5:b6eb:e1f9 with SMTP id 30csp1127062rwe; Sat, 27 Aug 2022 01:03:24 -0700 (PDT) X-Google-Smtp-Source: AA6agR4zJJKt50aLQpJ8373hWrUBT5JEpOzZUIqdC5zvMU9ZKNAHmPLJaxhJS4wWomIAWLfsH9YD X-Received: by 2002:a05:6402:524a:b0:43d:aa71:33d8 with SMTP id t10-20020a056402524a00b0043daa7133d8mr9633857edd.33.1661587404478; Sat, 27 Aug 2022 01:03:24 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1661587404; cv=none; d=google.com; s=arc-20160816; b=mA8XaUQdPn/T/ORlY1DZSolm3WKKkcfXOc9sNkfT3EdtO08o93BBP0h7g71cmcVBC5 tekd8VwxysCEfvqYQ1VjyFNH4JABSMZf63qfD7zUBwfqCyw05/JQfGOh2vmeANwYwsZo JvO/CFnHAI0ibisyszCP6OS+t3rArJgS0Bsh1H4xzinvViQPf59eemlY3wANeBR+ZKXs 7R9ZeoGPJVUIau29JEae8FwwjOyW85yuX3gcJ1KqvM/Jcl2MIPEVRmMWm6rh5j4Nf4tf gRcnkZwsGKmYEgcGa0FwYaTn2/EEPNI6UDkSU7Iw8D/0qE0adv2XHSrNuhBbjrMHm+2y MKSQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:references:in-reply-to:references:in-reply-to :message-id:date:subject:cc:to:from:dkim-signature; bh=k4xOaCJXR13lMOpKa8KBEBvxrHZTljSJsyP8ZiT7jOE=; b=ZeievuamaOXgmaJLU8LzqQAwzmUKvksxvpRLFh77VbCjo9LHcdB38BXBsec/LHG8cN N7EXFstSqcZPDh30pyQhFQGTP6xhkhxmy8pkYV4OTl04MQ+cZwRHhXohMCilalqBs3PV TMa3M1z0x9G8+SjNG3uOB3PwmVhtbNfUfvOga8VK2BwgFRSjdCQobWLDiEUVuhYWj+op y12ZbAMu6DCAkbthX/0h+i70ogqR8zrAO0HUUuvmeacMDzGcaZG8d3fQyugaG3Z1xwer XXvcmRO2JtTcA0D5hp+nR3eoufnFiAC+mV2Y3iib6ATTlQE1f9Efyip79rjjFIXSeLi4 2NdQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20210112 header.b=R0ELpqCj; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id r5-20020a50c005000000b004477532706bsi2694767edb.517.2022.08.27.01.02.58; Sat, 27 Aug 2022 01:03:24 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20210112 header.b=R0ELpqCj; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1345063AbiH0Hsl (ORCPT + 99 others); Sat, 27 Aug 2022 03:48:41 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:55044 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S233119AbiH0Hsg (ORCPT ); Sat, 27 Aug 2022 03:48:36 -0400 Received: from mail-pl1-x633.google.com (mail-pl1-x633.google.com [IPv6:2607:f8b0:4864:20::633]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 73DD15070D for ; Sat, 27 Aug 2022 00:48:35 -0700 (PDT) Received: by mail-pl1-x633.google.com with SMTP id u22so3442257plq.12 for ; Sat, 27 Aug 2022 00:48:35 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=references:in-reply-to:references:in-reply-to:message-id:date :subject:cc:to:from:from:to:cc; bh=k4xOaCJXR13lMOpKa8KBEBvxrHZTljSJsyP8ZiT7jOE=; b=R0ELpqCjrsYaqO/7g3nQd5LYZgbXeKZI2ZSbQ5bovwxqA8ASQ4fGIe23pOappKXsW4 BBje2Q+FRxY/u3bOF6mxm+kQrdn8bwCU0UMvYtxW5Fx/ibcRMFeqQGhiSsIyv5uuhuUn objrh6OJ7Pk4s2YfUWc2J4Xt79l+pMTQPiTiJeag8RnGtlX7sMFGs9L7ugHq/RczAtON A9YIuofw7xZKuYmXJ6Y2qnUJxFxr0VXSP73EPlp5q/huahkV5zuSn8P9uD15vCnw2Vci 42H62nMnzl2EPd/HJGUQnI7yLpzJXXFpDL3WXR3L11vQLZ/m1kSpYaDaDoW/jRdRdRSZ 6oqA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=references:in-reply-to:references:in-reply-to:message-id:date :subject:cc:to:from:x-gm-message-state:from:to:cc; bh=k4xOaCJXR13lMOpKa8KBEBvxrHZTljSJsyP8ZiT7jOE=; b=clrs09uG+fk2Qtz3ndCmTWrt1q7h91cAnG3m3v3BNb3w/xYyHjCnh8imHyIzRVYLZk FDlmAq5g8y/kTp89XNdPLk3gf7oDK1HoCoDh/6CtatXasrZtT5DUpkyeM23+urGotJPd pHiubuuDDMJAiTPaXUWeOVa+ChsuXLTNr2NdgQJ7dJzVl1KnjReCpKDye4zo8RW8hSsk Du6E1XFahWIpCREvMyHYgyxdRrBxMTxynuEzIHsvdNc4wfBFVPGPcFtkymS43GSrWjrL xJRyBuAqDQCnGosKI42ro2FjkINUV0NOcAibAh8Ge+W3OHJW+wY6QXlzFyjEQslNr8+J aT5g== X-Gm-Message-State: ACgBeo2s32bFZWd06jHlfbMwaeRvx3/KaXtb8q5TJ0SmGqNlzFJjY+45 SiINGrYYcjsnYCCnHyo3MhE= X-Received: by 2002:a17:902:e80e:b0:173:23e:d5a6 with SMTP id u14-20020a170902e80e00b00173023ed5a6mr6996841plg.85.1661586514951; Sat, 27 Aug 2022 00:48:34 -0700 (PDT) Received: from localhost.localdomain ([156.236.96.165]) by smtp.gmail.com with ESMTPSA id q4-20020a656844000000b0042aaaf6e2d9sm2632006pgt.49.2022.08.27.00.48.31 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 27 Aug 2022 00:48:34 -0700 (PDT) From: Yue Hu To: xiang@kernel.org, chao@kernel.org Cc: linux-erofs@lists.ozlabs.org, linux-kernel@vger.kernel.org, zhangwen@coolpad.com, shaojunjun@coolpad.com, Yue Hu Subject: [RFC PATCH v2 1/2] erofs: support interlaced uncompressed data for compressed files Date: Sat, 27 Aug 2022 15:47:56 +0800 Message-Id: <014ae4b2548bb318a4f187c7dad59867721bf418.1661584151.git.huyue2@coolpad.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: References: In-Reply-To: References: X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FROM, RCVD_IN_DNSWL_NONE,SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org From: Yue Hu Currently, there is no start offset when writing uncompressed data to disk blocks for compressed files. However, we are using in-place I/O which will decrease the number of memory copies a lot if we write it just from an offset of 'pageofs_out'. So, let's support it. Signed-off-by: Yue Hu --- fs/erofs/compress.h | 3 +++ fs/erofs/decompressor.c | 12 +++++++----- fs/erofs/erofs_fs.h | 2 ++ fs/erofs/zdata.c | 11 ++++++++++- fs/erofs/zdata.h | 3 +++ 5 files changed, 25 insertions(+), 6 deletions(-) diff --git a/fs/erofs/compress.h b/fs/erofs/compress.h index 26fa170090b8..cef26c63d6b1 100644 --- a/fs/erofs/compress.h +++ b/fs/erofs/compress.h @@ -15,6 +15,9 @@ struct z_erofs_decompress_req { unsigned short pageofs_in, pageofs_out; unsigned int inputsize, outputsize; + /* cut point of interlaced uncompressed data */ + unsigned int interlaced_offset; + /* indicate the algorithm will be used for decompression */ unsigned int alg; bool inplace_io, partial_decoding, fillgaps; diff --git a/fs/erofs/decompressor.c b/fs/erofs/decompressor.c index 2d55569f96ac..e5dc8eb992b1 100644 --- a/fs/erofs/decompressor.c +++ b/fs/erofs/decompressor.c @@ -340,18 +340,20 @@ static int z_erofs_shifted_transform(struct z_erofs_decompress_req *rq, src = kmap_atomic(*rq->in) + rq->pageofs_in; if (rq->out[0]) { dst = kmap_atomic(rq->out[0]); - memcpy(dst + rq->pageofs_out, src, righthalf); + memcpy(dst + rq->pageofs_out, src + rq->interlaced_offset, + righthalf); kunmap_atomic(dst); } if (nrpages_out == 2) { DBG_BUGON(!rq->out[1]); - if (rq->out[1] == *rq->in) { - memmove(src, src + righthalf, lefthalf); - } else { + if (rq->out[1] != *rq->in) { dst = kmap_atomic(rq->out[1]); - memcpy(dst, src + righthalf, lefthalf); + memcpy(dst, rq->interlaced_offset ? src : + (src + righthalf), lefthalf); kunmap_atomic(dst); + } else if (!rq->interlaced_offset) { + memmove(src, src + righthalf, lefthalf); } } kunmap_atomic(src); diff --git a/fs/erofs/erofs_fs.h b/fs/erofs/erofs_fs.h index 2b48373f690b..5c1de6d7ad71 100644 --- a/fs/erofs/erofs_fs.h +++ b/fs/erofs/erofs_fs.h @@ -295,11 +295,13 @@ struct z_erofs_lzma_cfgs { * bit 1 : HEAD1 big pcluster (0 - off; 1 - on) * bit 2 : HEAD2 big pcluster (0 - off; 1 - on) * bit 3 : tailpacking inline pcluster (0 - off; 1 - on) + * bit 4 : interlaced plain pcluster (0 - off; 1 - on) */ #define Z_EROFS_ADVISE_COMPACTED_2B 0x0001 #define Z_EROFS_ADVISE_BIG_PCLUSTER_1 0x0002 #define Z_EROFS_ADVISE_BIG_PCLUSTER_2 0x0004 #define Z_EROFS_ADVISE_INLINE_PCLUSTER 0x0008 +#define Z_EROFS_ADVISE_INTERLACED_PCLUSTER 0x0010 struct z_erofs_map_header { __le16 h_reserved1; diff --git a/fs/erofs/zdata.c b/fs/erofs/zdata.c index 5792ca9e0d5e..4863d9d960d5 100644 --- a/fs/erofs/zdata.c +++ b/fs/erofs/zdata.c @@ -481,6 +481,7 @@ static void z_erofs_try_to_claim_pcluster(struct z_erofs_decompress_frontend *f) static int z_erofs_register_pcluster(struct z_erofs_decompress_frontend *fe) { + struct erofs_inode *const vi = EROFS_I(fe->inode); struct erofs_map_blocks *map = &fe->map; bool ztailpacking = map->m_flags & EROFS_MAP_META; struct z_erofs_pcluster *pcl; @@ -508,6 +509,11 @@ static int z_erofs_register_pcluster(struct z_erofs_decompress_frontend *fe) pcl->pageofs_out = map->m_la & ~PAGE_MASK; fe->mode = Z_EROFS_PCLUSTER_FOLLOWED; + pcl->interlaced = false; + if ((vi->z_advise & Z_EROFS_ADVISE_INTERLACED_PCLUSTER) && + pcl->algorithmformat == Z_EROFS_COMPRESSION_SHIFTED) + pcl->interlaced = true; + /* * lock all primary followed works before visible to others * and mutex_trylock *never* fails for a new pcluster. @@ -972,7 +978,7 @@ static int z_erofs_decompress_pcluster(struct z_erofs_decompress_backend *be, struct erofs_sb_info *const sbi = EROFS_SB(be->sb); struct z_erofs_pcluster *pcl = be->pcl; unsigned int pclusterpages = z_erofs_pclusterpages(pcl); - unsigned int i, inputsize; + unsigned int i, inputsize, interlaced_offset; int err2; struct page *page; bool overlapped; @@ -1015,6 +1021,8 @@ static int z_erofs_decompress_pcluster(struct z_erofs_decompress_backend *be, else inputsize = pclusterpages * PAGE_SIZE; + interlaced_offset = pcl->interlaced ? pcl->pageofs_out : 0; + err = z_erofs_decompress(&(struct z_erofs_decompress_req) { .sb = be->sb, .in = be->compressed_pages, @@ -1023,6 +1031,7 @@ static int z_erofs_decompress_pcluster(struct z_erofs_decompress_backend *be, .pageofs_out = pcl->pageofs_out, .inputsize = inputsize, .outputsize = pcl->length, + .interlaced_offset = interlaced_offset, .alg = pcl->algorithmformat, .inplace_io = overlapped, .partial_decoding = pcl->partial, diff --git a/fs/erofs/zdata.h b/fs/erofs/zdata.h index e7f04c4fbb81..75f3a52fc66f 100644 --- a/fs/erofs/zdata.h +++ b/fs/erofs/zdata.h @@ -87,6 +87,9 @@ struct z_erofs_pcluster { /* L: indicate several pageofs_outs or not */ bool multibases; + /* I: whether interlaced uncompressed data or not */ + bool interlaced; + /* A: compressed bvecs (can be cached or inplaced pages) */ struct z_erofs_bvec compressed_bvecs[]; }; -- 2.17.1