Received: by 2002:a05:7412:8d10:b0:f3:1519:9f41 with SMTP id bj16csp843714rdb; Wed, 6 Dec 2023 01:12:06 -0800 (PST) X-Google-Smtp-Source: AGHT+IG3/1oEl1FG8ilSB5A+h5z+TXK4ii/J7/6KrlVPyoSFpu4u4esSlAeB2CrdZXwYocx4i0yg X-Received: by 2002:a17:903:22cd:b0:1d0:7165:3faf with SMTP id y13-20020a17090322cd00b001d071653fafmr343695plg.63.1701853926264; Wed, 06 Dec 2023 01:12:06 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1701853926; cv=none; d=google.com; s=arc-20160816; b=c5/SxhpCw41R5upoz0hn0QLIOtTwEJDpCZBcYPWvLAfTD4xFa5m8A+Iuf12X9ozGR5 X6riZ+xwRwjBtfvQZabiukL3wPn0I9jRyB3y9aswUNjRnejeh9t1U4eVkUHDIS1GKGoz xbiHEplcC3Bw+Bas/UiS8lnDKmLC+nLi1v3cxmZhnFznJEs9oV8AI71zN9f+/x6eWRSD BtSlPWrekvuL3LcCcr9bey/pSCEpkKQg16lkZpk2+BgHYFVyWpX2n2r8J7TSpaqBRcus W593St8+aciRtSYh+mxZ8D+FSVXSaENcoeEXrRHFxWjKHJHhVSXHWPwDrbuEaIvnSdo2 0YGg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from; bh=8S1tYjCboCWoFfVq2KJHgTFdY3UlnnBEOwVBXcGNJ/Q=; fh=Z0R8B0AmUMsLcNxAwFR/TDJEQ3RBfXHfZWEZwiqrD84=; b=qIfjfM00Tzun4zQVgjTc4fntWX44dqn9sr2+SILONy+Kr65WRhq6b18vy1IRuOnCXd 1eVsSrqLouFeHLAN6HdzoGw70ntXnWh5wzGcOyq98KSFMAuC2jhCdzZ1pS7Mj6fv/eaS gDRm/uAnaCLWXAj8lF9oi1mC9G2BNjSSVZPVtKjDaIFUL9boJ8pBk/lJOZT0gdMkJK0i yaPVysM4JzhOyHdyzL7tMMfPK0XkKCBAgBceHWbD/rmleUj5EVf7AdrY8F2MmJtFXEBI frR+h2o6WsY5LUxEIpfNtnGtY21uNH7pNfaf+HmReAG4VgV0a6BkB3YDx5MS42xa+5d1 er7Q== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:8 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=alibaba.com Return-Path: Received: from fry.vger.email (fry.vger.email. [2620:137:e000::3:8]) by mx.google.com with ESMTPS id y9-20020a170902b48900b001cc59201d1esi11119773plr.172.2023.12.06.01.12.05 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 06 Dec 2023 01:12:06 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:8 as permitted sender) client-ip=2620:137:e000::3:8; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:8 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=alibaba.com Received: from out1.vger.email (depot.vger.email [IPv6:2620:137:e000::3:0]) by fry.vger.email (Postfix) with ESMTP id 5EB5B80569B0; Wed, 6 Dec 2023 01:12:02 -0800 (PST) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.11 at fry.vger.email Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1346727AbjLFJLK (ORCPT + 99 others); Wed, 6 Dec 2023 04:11:10 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:34734 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1346881AbjLFJLI (ORCPT ); Wed, 6 Dec 2023 04:11:08 -0500 Received: from out30-130.freemail.mail.aliyun.com (out30-130.freemail.mail.aliyun.com [115.124.30.130]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id A2B6711F for ; Wed, 6 Dec 2023 01:11:13 -0800 (PST) X-Alimail-AntiSpam: AC=PASS;BC=-1|-1;BR=01201311R511e4;CH=green;DM=||false|;DS=||;FP=0|-1|-1|-1|0|-1|-1|-1;HT=ay29a033018046056;MF=hsiangkao@linux.alibaba.com;NM=1;PH=DS;RN=4;SR=0;TI=SMTPD_---0VxxSRMO_1701853861; Received: from e69b19392.et15sqa.tbsite.net(mailfrom:hsiangkao@linux.alibaba.com fp:SMTPD_---0VxxSRMO_1701853861) by smtp.aliyun-inc.com; Wed, 06 Dec 2023 17:11:11 +0800 From: Gao Xiang To: linux-erofs@lists.ozlabs.org Cc: LKML , dhavale@google.com, Gao Xiang Subject: [PATCH 0/5] erofs: basic sub-page compressed data support Date: Wed, 6 Dec 2023 17:10:52 +0800 Message-Id: <20231206091057.87027-1-hsiangkao@linux.alibaba.com> X-Mailer: git-send-email 2.39.3 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-0.8 required=5.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE, UNPARSEABLE_RELAY autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on fry.vger.email Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (fry.vger.email [0.0.0.0]); Wed, 06 Dec 2023 01:12:02 -0800 (PST) Hi folks, Recently, there are two new cases so that we need to add a preliminary sub-page block support for compressed files; - As Android folks requested, Android ecosystem itself is now switching to 16k page size for their arm64 devices. They needs an option of 4k-block image compatibility on their new 16k devices; - Some arm64 cloud servers use 64k page size for their optimized workloads, but 4k-block EROFS container images need to be parsed too. So this patchset mainly addresses the requirements above with a very very simple approach as a start: just allocate short-lived temporary buffers all the time to keep compressed data if sub-page blocks are identified. In other words, no inplace/cache decompression for the preliminary support. This patchset survives EROFS stress test on my own testfarms. Thanks, Gao Xiang Gao Xiang (5): erofs: support I/O submission for sub-page compressed blocks erofs: record `pclustersize` in bytes instead of pages erofs: fix up compacted indexes for block size < 4096 erofs: refine z_erofs_transform_plain() for sub-page block support erofs: enable sub-page compressed block support fs/erofs/decompressor.c | 81 +++++++++------ fs/erofs/inode.c | 6 +- fs/erofs/zdata.c | 224 ++++++++++++++++++---------------------- fs/erofs/zmap.c | 32 +++--- 4 files changed, 169 insertions(+), 174 deletions(-) -- 2.39.3