Received: by 2002:a05:7412:8d10:b0:f3:1519:9f41 with SMTP id bj16csp3791045rdb; Sun, 10 Dec 2023 22:51:27 -0800 (PST) X-Google-Smtp-Source: AGHT+IG+tf7LqQCk2hLQAnuFyisfVQiywo3CCbxbo3Wymat16qtKlkoPAq0du6z1oPrAsN7x73g1 X-Received: by 2002:a17:90a:6f03:b0:286:6cc0:8869 with SMTP id d3-20020a17090a6f0300b002866cc08869mr1382322pjk.86.1702277486928; Sun, 10 Dec 2023 22:51:26 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1702277486; cv=none; d=google.com; s=arc-20160816; b=rm0lqsCO85Srbxjktlrl2uNZKWXbUZoGfGoJX70X5nB3Ex5BolTXOueDsxoFL8wSd+ zSqbuST7fOgI4R0Ambyg9kunCiAdky0/KURILqBEE4UYvzPT0o/6MImpLeuYXg1PJsvO J1+2z0v/tYcWtAkKHwaDEGwemsSWtzrJToJrgtos6Mrhch6jVBHZe9sA7ds93idg45OS jpvlWDtm1/+8L4506y2O05emOru4p23AllFyYn+FrV6ykLPhb/qI7QK1XDHuw6NpJfcR dH6+ufDtGMe4xPmHnCD5rGX50DmNtQtsW5qIqAUMuFyFE9UX03nN3+es0qWN3+JSfj7M 3OHA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :references:in-reply-to:message-id:subject:cc:to:from:date :dkim-signature; bh=YctzTYntyd51jqXxmWwWW3nRDYDfU3b8oocrWrVlruk=; fh=1KgpB6FK0/myJtkvr5uk2Fujl3QwCrKXOd254kQqr0Y=; b=UtD0fUCWKL3iDlDvo9bBdmIrnLhtbvqX8M5B5vyLe1DHFzXlyz/av0hmy//Nv8ugb4 wiltl+oyxWLcHKv3+7hVPxJUheGUAnZ6bHx2+QHgLwB7zoOmYtmgXycwmsdIwiOBqjj8 PrY3A79kKambPKZfDkRpn0HXQ47AEUagHilw8hgfzUigWnXQcmlhXQRd2htlXLlUBmpI WJ7ow9d3aZ96DuT3UzKodAb/RTjC0hq3v/qp70hvYyQYEmxNnvAdnKUysCVKKfvWn4rO tKrrXqB4WdnLUlbkVRr3t0G9/HRVdexFK/prggK42/6xiFjsgSplCaQ5G+PajIWSeLC0 X1OA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20230601 header.b=PbmooSSi; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:8 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from fry.vger.email (fry.vger.email. [2620:137:e000::3:8]) by mx.google.com with ESMTPS id w9-20020a17090aad4900b00285f918f395si5566141pjv.190.2023.12.10.22.51.25 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 10 Dec 2023 22:51:26 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:8 as permitted sender) client-ip=2620:137:e000::3:8; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20230601 header.b=PbmooSSi; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:8 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: from out1.vger.email (depot.vger.email [IPv6:2620:137:e000::3:0]) by fry.vger.email (Postfix) with ESMTP id 472FC808A35B; Sun, 10 Dec 2023 22:51:21 -0800 (PST) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.11 at fry.vger.email Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S233104AbjLKGu6 (ORCPT + 99 others); Mon, 11 Dec 2023 01:50:58 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:59636 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S231721AbjLKGu5 (ORCPT ); Mon, 11 Dec 2023 01:50:57 -0500 Received: from mail-oi1-x232.google.com (mail-oi1-x232.google.com [IPv6:2607:f8b0:4864:20::232]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id BEECED7 for ; Sun, 10 Dec 2023 22:51:03 -0800 (PST) Received: by mail-oi1-x232.google.com with SMTP id 5614622812f47-3b88f2a37deso3295116b6e.0 for ; Sun, 10 Dec 2023 22:51:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1702277463; x=1702882263; darn=vger.kernel.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:subject:cc:to:from:date:from:to:cc:subject:date :message-id:reply-to; bh=YctzTYntyd51jqXxmWwWW3nRDYDfU3b8oocrWrVlruk=; b=PbmooSSiw9uJ4wc+pUMLVMJ+tzGzc27nYJ6LbWqBlcYDkBuvMvj+9xItsnmqrY9n7L /E6O7XMaASy4EWQT6CgjHt/1XZ0MJyP3dv41v2IGdGkHiUbR2cidGgVgiD/Dk2opEgb+ VdONGiDy5Xhii9oOF44DW2jNY9voV4VAGJR5+GsjZICyy6YFb8ix+RYWh/DeqoeDFUUs StyPig433YmVHsvpH4ghxeGQXhVx0PvImf90XEKy+KHsc9Ts5V+lL0mbAC0vpfyLzt3w 6WQ/ilF31Sp6I8zIMP1/fICUEus6WeYh72wqhLG+Fq2fMR3f6isMOwmck7n8qP0Lcl13 ufMg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1702277463; x=1702882263; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:subject:cc:to:from:date:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=YctzTYntyd51jqXxmWwWW3nRDYDfU3b8oocrWrVlruk=; b=MYUhceb6XGX2QsNCOl7Gx/+PZGyNLv9MwdrQVOppuhw7EcaXaaADJcOrBkGyWRk0iI rnYVFHSJDhKid1lpAEZi7nEeBZdFy0cMjC3pXEG2YDqHT9tFUfsnJZ1rypb4kolEJCLy 2AKuD6h4iUtArZSV8ZnlTMEiJl1akpe1456eIwJdiPguTOmv7mHjtlYni6SbWtZlDdCz YnS0IJlAkuukGgdHxpYKbDIRBhurXjOK3Ct+6GPC9yCMHYSGbnBZ+WYi3iauCApuXiwd yJHg6mDl4k5nS44csy0XKzdwBOM9eMJYRu74qmO6/mK/H0EnltrNGDbsiKRGERugc/+v U7GA== X-Gm-Message-State: AOJu0YzoIn5k3MwN1WkHyHOHRvYXmBD2dFpL51Inspf7P0ssRWMZBkTH j/rcSA1Hl1AbYCTl8rcm7Bs= X-Received: by 2002:a05:6808:208a:b0:3b9:f08f:6846 with SMTP id s10-20020a056808208a00b003b9f08f6846mr5059593oiw.18.1702277462917; Sun, 10 Dec 2023 22:51:02 -0800 (PST) Received: from localhost ([156.236.96.164]) by smtp.gmail.com with ESMTPSA id 64-20020a630043000000b005c65d432119sm5533968pga.67.2023.12.10.22.51.01 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 10 Dec 2023 22:51:02 -0800 (PST) Date: Mon, 11 Dec 2023 14:50:57 +0800 From: Yue Hu To: Gao Xiang Cc: linux-erofs@lists.ozlabs.org, LKML , huyue2@coolpad.com Subject: Re: [PATCH 0/5] erofs: basic sub-page compressed data support Message-ID: <20231211145057.000067eb.zbestahu@gmail.com> In-Reply-To: <20231206091057.87027-1-hsiangkao@linux.alibaba.com> References: <20231206091057.87027-1-hsiangkao@linux.alibaba.com> X-Mailer: Claws Mail 4.1.1 (GTK 3.24.34; x86_64-w64-mingw32) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-0.6 required=5.0 tests=DKIM_SIGNED,DKIM_VALID, DKIM_VALID_AU,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE, SPF_PASS,T_SCC_BODY_TEXT_LINE autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on fry.vger.email Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (fry.vger.email [0.0.0.0]); Sun, 10 Dec 2023 22:51:21 -0800 (PST) On Wed, 6 Dec 2023 17:10:52 +0800 Gao Xiang wrote: > Hi folks, > > Recently, there are two new cases so that we need to add a preliminary > sub-page block support for compressed files; > > - As Android folks requested, Android ecosystem itself is now switching > to 16k page size for their arm64 devices. They needs an option of > 4k-block image compatibility on their new 16k devices; > > - Some arm64 cloud servers use 64k page size for their optimized > workloads, but 4k-block EROFS container images need to be parsed too. > > So this patchset mainly addresses the requirements above with a very > very simple approach as a start: just allocate short-lived temporary > buffers all the time to keep compressed data if sub-page blocks are > identified. In other words, no inplace/cache decompression for > the preliminary support. > > This patchset survives EROFS stress test on my own testfarms. > > Thanks, > Gao Xiang > > Gao Xiang (5): > erofs: support I/O submission for sub-page compressed blocks > erofs: record `pclustersize` in bytes instead of pages > erofs: fix up compacted indexes for block size < 4096 > erofs: refine z_erofs_transform_plain() for sub-page block support > erofs: enable sub-page compressed block support > > fs/erofs/decompressor.c | 81 +++++++++------ > fs/erofs/inode.c | 6 +- > fs/erofs/zdata.c | 224 ++++++++++++++++++---------------------- > fs/erofs/zmap.c | 32 +++--- > 4 files changed, 169 insertions(+), 174 deletions(-) > Reviewed-by: Yue Hu