Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18;
From:   Huang Jianan <huangjianan@oppo.com>
To:     linux-erofs@lists.ozlabs.org
Cc:     huangjianan@oppo.com, guoweichao@oppo.com, zhangshiming@oppo.com,
        linux-kernel@vger.kernel.org
Subject: [PATCH v2 2/2] erofs: decompress in endio if possible
Date:   Fri,  5 Mar 2021 16:08:03 +0800
Message-Id: <20210305080803.789634-2-huangjianan@oppo.com>
In-Reply-To: <20210305080803.789634-1-huangjianan@oppo.com>
References: <20210305080803.789634-1-huangjianan@oppo.com>
Content-Transfer-Encoding: 8bit
Content-Type: text/plain
MIME-Version: 1.0
X-MS-Exchange-MessageSentRepresentingType: 1
Received: from localhost.localdomain (58.252.5.72) by HK2PR02CA0187.apcprd02.prod.outlook.com (2603:1096:201:21::23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3912.17 via Frontend Transport; Fri, 5 Mar 2021 08:08:18 +0000
X-MS-PublicTrafficType: Email
X-MS-Office365-Filtering-Correlation-Id: ea830309-113d-404a-f869-08d8dfadd670
X-MS-TrafficTypeDiagnostic: SG2PR02MB3020:
X-MS-Exchange-Transport-Forked: True
X-Microsoft-Antispam-PRVS: <SG2PR02MB30203EFC44A144B2F9D5B2CEC3969@SG2PR02MB3020.apcprd02.prod.outlook.com>
X-MS-Oob-TLC-OOBClassifiers: OLM:3276;
X-MS-Exchange-SenderADCheck: 1
X-Microsoft-Antispam: BCL:0;
X-Microsoft-Antispam-Message-Info: oWUWj2Ixz17eRDK23lAB2Dt3u99EEnxCpBVm2nXq1JQeukGdpO49weV2i5MwUUNsKY8D+Fyu7Ex4053TwgfRkTypJN6w4DU2Qdy5yIIy/SIMi/2P5Cle6MUMMsWjriHUVryKPW1NmRi4mRh/D2b7NoXKzzqjkjtu69L5hvXIKTRd8MsBPhD00sauaFR/bFlzyjJezyxpcJ8j7xN56bX9xrRuD9buMakdLUjq4H+bqyGe7OWoa6fZ8dRIOAkIzHvCzz4imtmV6sJpdu/z83NGgjiVP7sPLwyJEGr3AewwBLTn39YrwaXclHNdvC0AiCq3PTaOwq5qxVOJ+6ecc4jjY3GfHZ8FVOzIDl6hM49Cbsu7lpF5ZfPn3Cl+v0Tx17WFBN/mOveL1fa73Bz9T+rWev0A5tkkQYJFPOioCdWO/gEj1SXauI51D9dElT2U3WSCsD/a4SiqPF8wH+nN8GLzRVjdzy18jzyk1dZ/hftgu8VPhECFAlx1vGREZS0FIpU1NqOX/Vh50FUdPDH+7vjvsuSvxfqsiEK+4Iz5v5PPgI9gJCncaY1DkPFstLRnP5hDeX6o6nCdMoE2jx+hygckrR+xzqmej+Qt2Xy+nGStcZk=
X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:SG2PR02MB4108.apcprd02.prod.outlook.com;PTR:;CAT:NONE;SFS:(4636009)(366004)(346002)(136003)(39860400002)(376002)(396003)(6486002)(316002)(83380400001)(478600001)(16526019)(6916009)(6666004)(66946007)(1076003)(66476007)(6506007)(6512007)(5660300002)(52116002)(66556008)(36756003)(8676002)(186003)(4326008)(956004)(2616005)(26005)(8936002)(86362001)(69590400012)(2906002)(11606007);DIR:OUT;SFP:1101;
X-MS-Exchange-AntiSpam-MessageData: =?us-ascii?Q?B1PdBis4Y5JKtFR0IJXYPBQftVAlM/vTshDidsTnazrWLdd0IarT9v+ZOJNJ?=
 =?us-ascii?Q?Fb3H3gTr6XyON4oG3BrNq8kLz3lRCX2umTulUlj8Nsu1DCPjEA6F6IqUFXmP?=
 =?us-ascii?Q?7a0QLzDX9T2MWSRcRyDVW8cznhcxDrVipRZ11NyQUZyT3f5kYgz5D3XOoACE?=
 =?us-ascii?Q?qfeXTAJ8QmrUCvG9KPEyl5eQ9YoUh3VaPNu2aor6ahj+eWpCOQmTcalzJsSU?=
 =?us-ascii?Q?EUFtmKVZ9yjvEc4K2EaY2iMiSHWb7r51G6IoHpibyIKMfPEg5VD2bACkyU1y?=
 =?us-ascii?Q?h6wNaSYJOxzc5WKWSQ6qBmGGOqEAZZWo8tUIcuJK2jQep3f4MH+ZiPF8XRo0?=
 =?us-ascii?Q?JKKF+gTqhKVt8MQzTMWS4PetXsWh1d9BxQX5b3IN9fur4o4Zq00jt3vX3QWa?=
 =?us-ascii?Q?yFVfmgIzwUvril4wrZuEGwhp4UAUnBMRJWTPdZceNxusYVihKbFc/UNK0eqU?=
 =?us-ascii?Q?jp2EYOXROVQmVaLWyFQyBVIYMyQR0YlyTCNgLEPrYocbYH594pixSt2BNjKA?=
 =?us-ascii?Q?5gnw2gmx0b1qJMcJgPo0raLaREHK/Lb7OmzV3NbRFTRfg17lfiwJR9K6ONmE?=
 =?us-ascii?Q?ouzJC3TY+ulb6kfXt3qq1DaZfEoqDnOJj1ue7Hd457IJM+F9ahH9hoPbCtcq?=
 =?us-ascii?Q?Ik06xIref9xGq+CauEaXvMJeToQW14YkHpg71+GRQGy2q9c4NmQ0Smbv/2Ny?=
 =?us-ascii?Q?u1CSYiFIy2TRbzXm70LtqYRKvSdlxZK0u1/H+HNZebZf68HysPRwuP3SxVl5?=
 =?us-ascii?Q?24jEOVo0/0lc4mGPXC5T4spQgjSof0gyW5pOvcwZ3Pd8ICEc1hQ8Td8ISchs?=
 =?us-ascii?Q?wjcXv3A0ZA1ITYzKOQaAyYgw35oCOQmRdm6cPUhjPcyBvXo0fwsLc2T/CDpP?=
 =?us-ascii?Q?Qbxq/pzcdUg2L1jKeQQFOnKGdoQRBeAKDKiHkBJ3wu0/bgQkp6vHvLrNZNMr?=
 =?us-ascii?Q?bDR2DVg3AFUjC9M5+4RDMQXZUcR1VZLPzCHivZFbQI+uTaWyMc3s9lTtYHw4?=
 =?us-ascii?Q?lZ9OtnE24R9FuLtof+GPePT52NlwKqGI3rgSnjJzDSKSnuRlLKdgsY2qWZ00?=
 =?us-ascii?Q?xAR69ykOFfjLtHd/YTBptmHXa+2ATd7Bj4M4HLvpF56ATRKKU+B470bqFk8P?=
 =?us-ascii?Q?9VDcIEjPJcS9YmsgCWVy6nP+RW96ZufvfMfLEy3oP00EThcvifE8dj6Hc97m?=
 =?us-ascii?Q?O3RMWqBTJvgCYwWbMye9NRCPmQ6ToFguhZCkyD8OfUq1gy5new32hRLKWSOl?=
 =?us-ascii?Q?J3NSsFwXF99LNYl7l7eOLUyxRQCeS7Dheeq2XfBM2lf9hUYfTq/4MYRScklK?=
 =?us-ascii?Q?cKwerdezP8csIminuQecTbTp?=
X-OriginatorOrg: oppo.com
X-MS-Exchange-CrossTenant-Network-Message-Id: ea830309-113d-404a-f869-08d8dfadd670
X-MS-Exchange-CrossTenant-AuthSource: SG2PR02MB4108.apcprd02.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 05 Mar 2021 08:08:19.7346
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: f1905eb1-c353-41c5-9516-62b4a54b5ee6
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: ywVYyM4dCMYAvXuoTm/A38ou3BPGmt3V2+biOzvwxKjbdklMB1EXzcFBbyzZbRQSiq5MRzW9gklbk43okTUSMw==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SG2PR02MB3020
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

z_erofs_decompressqueue_endio may not be executed in the atomic
context, for example, when dm-verity is turned on. In this scenario,
data can be decompressed directly to get rid of additional kworker
scheduling overhead. Also, it makes no sense to apply synchronous
decompression for such case.

Signed-off-by: Huang Jianan <huangjianan@oppo.com>
Signed-off-by: Guo Weichao <guoweichao@oppo.com>
---
 fs/erofs/internal.h |  3 +++
 fs/erofs/super.c    |  4 ++++
 fs/erofs/zdata.c    | 13 +++++++++++--
 3 files changed, 18 insertions(+), 2 deletions(-)

diff --git a/fs/erofs/internal.h b/fs/erofs/internal.h
index 67a7ec945686..b817cb85d67b 100644
--- a/fs/erofs/internal.h
+++ b/fs/erofs/internal.h
@@ -70,6 +70,9 @@ struct erofs_sb_info {
 
 	/* pseudo inode to manage cached pages */
 	struct inode *managed_cache;
+
+	/* decide whether to decompress synchronously */
+	bool readahead_sync_decompress;
 #endif	/* CONFIG_EROFS_FS_ZIP */
 	u32 blocks;
 	u32 meta_blkaddr;
diff --git a/fs/erofs/super.c b/fs/erofs/super.c
index d5a6b9b888a5..77819efe9b15 100644
--- a/fs/erofs/super.c
+++ b/fs/erofs/super.c
@@ -175,6 +175,10 @@ static int erofs_read_superblock(struct super_block *sb)
 	sbi->root_nid = le16_to_cpu(dsb->root_nid);
 	sbi->inos = le64_to_cpu(dsb->inos);
 
+#ifdef CONFIG_EROFS_FS_ZIP
+	sbi->readahead_sync_decompress = false;
+#endif
+
 	sbi->build_time = le64_to_cpu(dsb->build_time);
 	sbi->build_time_nsec = le32_to_cpu(dsb->build_time_nsec);
 
diff --git a/fs/erofs/zdata.c b/fs/erofs/zdata.c
index 6cb356c4217b..49ffc817dd9e 100644
--- a/fs/erofs/zdata.c
+++ b/fs/erofs/zdata.c
@@ -706,6 +706,7 @@ static int z_erofs_do_read_page(struct z_erofs_decompress_frontend *fe,
 	goto out;
 }
 
+static void z_erofs_decompressqueue_work(struct work_struct *work);
 static void z_erofs_decompress_kickoff(struct z_erofs_decompressqueue *io,
 				       bool sync, int bios)
 {
@@ -720,8 +721,14 @@ static void z_erofs_decompress_kickoff(struct z_erofs_decompressqueue *io,
 		return;
 	}
 
-	if (!atomic_add_return(bios, &io->pending_bios))
-		queue_work(z_erofs_workqueue, &io->u.work);
+	if (!atomic_add_return(bios, &io->pending_bios)) {
+		if (in_atomic() || irqs_disabled()) {
+			queue_work(z_erofs_workqueue, &io->u.work);
+			sbi->readahead_sync_decompress = true;
+		} else {
+			z_erofs_decompressqueue_work(&io->u.work);
+		}
+	}
 }
 
 static bool z_erofs_page_is_invalidated(struct page *page)
@@ -1333,6 +1340,8 @@ static void z_erofs_readahead(struct readahead_control *rac)
 	struct erofs_sb_info *const sbi = EROFS_I_SB(inode);
 
 	unsigned int nr_pages = readahead_count(rac);
+	bool sync = (sbi->readahead_sync_decompress &&
+			nr_pages <= sbi->ctx.max_sync_decompress_pages);
 	bool sync = (nr_pages <= sbi->ctx.max_sync_decompress_pages);
 	struct z_erofs_decompress_frontend f = DECOMPRESS_FRONTEND_INIT(inode);
 	struct page *page, *head = NULL;
-- 
2.25.1