Received: by 2002:a05:6a10:6d10:0:0:0:0 with SMTP id gq16csp4439713pxb; Wed, 20 Apr 2022 03:21:48 -0700 (PDT) X-Google-Smtp-Source: ABdhPJxyxDnUFOtBZq6wukS+RCjAX5MoG12WcftFADMNOTtjCja0cxb9dJn/pgVOtI/zgCZRbW5C X-Received: by 2002:a17:906:66d5:b0:6e0:5ba8:8e0f with SMTP id k21-20020a17090666d500b006e05ba88e0fmr17010125ejp.581.1650450107865; Wed, 20 Apr 2022 03:21:47 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1650450107; cv=none; d=google.com; s=arc-20160816; b=oQAYF9YtIOMDi3vQthW8RL5dT6ddpioQJnIGdsdL87pS71y+NWNDSQNqc/BlgCcj+9 AfhPQ3ZrVbO0yX0jyc9oFFoCx6t5dRDfJpYFDs4JgoIHvuAipwBY2my29GGiI+wRBxJE kGsR0MQBinrpGVRS8JOG4+vgy2gHltInz96jBNoW2z+NqsJQas9NEqBMGjncZFhFcC7j M8ItznqnRS7QXqPVuhVkMYy7LlF/HKJcmPpitmKatRPMqVJtoUeZl3EG4156uuLAH6dY Qr4EICyBQefVe3bO9TEhtCF6iaZCrlP3mrbPAtDXAuNCY6qskFd2sekmNyE2Iimneecj IUBw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:ironport-hdrordr:ironport-data; bh=BGxMqGzUDokyn76memHGqWjnq9ucQEeA4uow3rFLLNw=; b=vwFT55mLdbRw5fJrTPp4vlJ+QyUgUJ6kocHZPcV7QQAKzah+2wX1XQLbrnM424qUxs deZIhZ7EBK7DPLua0MSUFMVOGxa+gKuQ1WgThuSBnsFHdS06HFt9YnVax/9lUZMfeDJp OUN3htG95JLR4EzMzxNWulBxCNRN2NLkjrfuZMsE5qfZ/V9wia03dG7uYu4z/BtzMxOj QL+tveR/txMrPftMdGNvYhQZ+QCqefJjmQMEL1cqAjuFipZ6YHjWD1MWuWqNvzjnMCm+ xphEc/HDtdjfSOzoodTmzl364DLWrPXYpv2TrL+jpB3LDl3h/LYxCy8H51O1sFE6H/Qk xr8w== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=fujitsu.com Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id i18-20020a05640242d200b004213bb4b214si1309184edc.541.2022.04.20.03.21.24; Wed, 20 Apr 2022 03:21:47 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=fujitsu.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1348560AbiDSEzt (ORCPT + 99 others); Tue, 19 Apr 2022 00:55:49 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:48754 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1348466AbiDSEzT (ORCPT ); Tue, 19 Apr 2022 00:55:19 -0400 Received: from heian.cn.fujitsu.com (mail.cn.fujitsu.com [183.91.158.132]) by lindbergh.monkeyblade.net (Postfix) with ESMTP id 0C81032ECC; Mon, 18 Apr 2022 21:50:49 -0700 (PDT) IronPort-Data: =?us-ascii?q?A9a23=3Au2RBvKjQPIjEua4iyUkhZ8J3X161CxEKZh0ujC4?= =?us-ascii?q?5NGQNrF6WrkUEyWUXXWCBOPmLYjbwfYx3aIXg/BkC78WDxoAwTFFqpXw8FHgiR?= =?us-ascii?q?ejtX4rAdhiqV8+xwmwvdGo+toNGLICowPkcFhcwnT/wdOixxZVA/fvQHOCkUra?= =?us-ascii?q?dYnkZqTJME0/NtzoywobVvaY42bBVMyvV0T/Di5W31G2NglaYAUpIg063ky6Di?= =?us-ascii?q?dyp0N8uUvPSUtgQ1LPWvyF94JvyvshdJVOgKmVfNrbSq+ouUNiEEm3lExcFUrt?= =?us-ascii?q?Jk57wdAsEX7zTIROTzHFRXsBOgDAb/mprjPl9b6FaNC+7iB3Q9zx14M9QvJqrW?= =?us-ascii?q?EEnOLbQsOoAURhECDw4NqpDkFPCCSHl6pLMlhKaLRMAxN0rVinaJ7Yw9u9pAG1?= =?us-ascii?q?m++YfLTcXZBGfwemxxdqTSuJsrsUlItPiMI4Wtjdn1z6xJfovR9bBBbrL4dtZ1?= =?us-ascii?q?TIrrsFIAfvaIcEebFJHYBbfZBtAElQaEpQzmKGvnHaXWzlZrk+F4K8yy2vNxQd?= =?us-ascii?q?ylr/3P7L9fMKGRMBQtkKZvX7duWD4BAwKctCS11Kt8Huqi6nEnT7TX5gbH7m1s?= =?us-ascii?q?PVthTW7wm0VFQ1TW0C3rOe0jmagVN9FbU8Z4Cwjqe417kPDZt38WQCo5X2JpBg?= =?us-ascii?q?RX/JOHOAgrgKA0KzZ50CeHGdsZjpAbsE28d84XhQ02VKT2dDkHzpitPuSU331y?= =?us-ascii?q?1s+hVteIgBMdSlbO3BCFlBDvrHeTEgIpkqnZr5e/GSd0rUZwQ3N/g0=3D?= IronPort-HdrOrdr: =?us-ascii?q?A9a23=3AOx2m76hS8LA8xk4fM2ePciqv63BQXjAji2hC?= =?us-ascii?q?6mlwRA09TySZ//rOoB19726StN9xYgBHpTnuAtjifZqxz/FICOoqTNOftWvdyQ?= =?us-ascii?q?mVxehZhOOIqVCNJ8SUzI5gPMlbHZSWcOeAaGSSk/yKmjWQIpIxxsWd6qC0iaP7?= =?us-ascii?q?x3dpdwtjbKZt9G5Ce36mO3wzVA9bHoA4CZbZwsJGogCrcXMRYt/+KWICW4H41q?= =?us-ascii?q?b2vaOjcRgbHAQm9QXLqTup7YTxGx+e0gxbcx4n+8ZazVT4?= X-IronPort-AV: E=Sophos;i="5.88,333,1635177600"; d="scan'208";a="123671746" Received: from unknown (HELO cn.fujitsu.com) ([10.167.33.5]) by heian.cn.fujitsu.com with ESMTP; 19 Apr 2022 12:50:48 +0800 Received: from G08CNEXMBPEKD05.g08.fujitsu.local (unknown [10.167.33.204]) by cn.fujitsu.com (Postfix) with ESMTP id D439E4D17171; Tue, 19 Apr 2022 12:50:47 +0800 (CST) Received: from G08CNEXJMPEKD02.g08.fujitsu.local (10.167.33.202) by G08CNEXMBPEKD05.g08.fujitsu.local (10.167.33.204) with Microsoft SMTP Server (TLS) id 15.0.1497.23; Tue, 19 Apr 2022 12:50:47 +0800 Received: from G08CNEXCHPEKD09.g08.fujitsu.local (10.167.33.85) by G08CNEXJMPEKD02.g08.fujitsu.local (10.167.33.202) with Microsoft SMTP Server (TLS) id 15.0.1497.23; Tue, 19 Apr 2022 12:50:49 +0800 Received: from irides.mr.mr (10.167.225.141) by G08CNEXCHPEKD09.g08.fujitsu.local (10.167.33.209) with Microsoft SMTP Server id 15.0.1497.23 via Frontend Transport; Tue, 19 Apr 2022 12:50:45 +0800 From: Shiyang Ruan To: , , , , CC: , , , , Subject: [PATCH v13 0/7] fsdax: introduce fs query to support reflink Date: Tue, 19 Apr 2022 12:50:38 +0800 Message-ID: <20220419045045.1664996-1-ruansy.fnst@fujitsu.com> X-Mailer: git-send-email 2.35.1 MIME-Version: 1.0 Content-Transfer-Encoding: 7BIT Content-Type: text/plain; charset=US-ASCII X-yoursite-MailScanner-ID: D439E4D17171.A07DF X-yoursite-MailScanner: Found to be clean X-yoursite-MailScanner-From: ruansy.fnst@fujitsu.com X-Spam-Status: No, score=-4.2 required=5.0 tests=BAYES_00,RCVD_IN_DNSWL_MED, SPF_HELO_NONE,SPF_NONE,T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org This patchset is aimed to support shared pages tracking for fsdax. Changes since V12: - Rebased onto next-20220414 - Do not continue ->notify_failure() if filesystem is not ready yet - Simplify the logic of setting CoW flag - Fix build warning/error and typo This patchset moves owner tracking from dax_assocaite_entry() to pmem device driver, by introducing an interface ->memory_failure() for struct pagemap. This interface is called by memory_failure() in mm, and implemented by pmem device. Then call holder operations to find the filesystem which the corrupted data located in, and call filesystem handler to track files or metadata associated with this page. Finally we are able to try to fix the corrupted data in filesystem and do other necessary processing, such as killing processes who are using the files affected. The call trace is like this: memory_failure() |* fsdax case |------------ |pgmap->ops->memory_failure() => pmem_pgmap_memory_failure() | dax_holder_notify_failure() => | dax_device->holder_ops->notify_failure() => | - xfs_dax_notify_failure() | |* xfs_dax_notify_failure() | |-------------------------- | | xfs_rmap_query_range() | | xfs_dax_failure_fn() | | * corrupted on metadata | | try to recover data, call xfs_force_shutdown() | | * corrupted on file data | | try to recover data, call mf_dax_kill_procs() |* normal case |------------- |mf_generic_kill_procs() == Shiyang Ruan (7): dax: Introduce holder for dax_device mm: factor helpers for memory_failure_dev_pagemap pagemap,pmem: Introduce ->memory_failure() fsdax: Introduce dax_lock_mapping_entry() mm: Introduce mf_dax_kill_procs() for fsdax case xfs: Implement ->notify_failure() for XFS fsdax: set a CoW flag when associate reflink mappings drivers/dax/super.c | 67 +++++++++- drivers/md/dm.c | 2 +- drivers/nvdimm/pmem.c | 17 +++ fs/dax.c | 113 ++++++++++++++-- fs/erofs/super.c | 10 +- fs/ext2/super.c | 7 +- fs/ext4/super.c | 9 +- fs/xfs/Makefile | 5 + fs/xfs/xfs_buf.c | 10 +- fs/xfs/xfs_fsops.c | 3 + fs/xfs/xfs_mount.h | 1 + fs/xfs/xfs_notify_failure.c | 220 +++++++++++++++++++++++++++++++ fs/xfs/xfs_super.h | 1 + include/linux/dax.h | 48 +++++-- include/linux/memremap.h | 12 ++ include/linux/mm.h | 2 + include/linux/page-flags.h | 6 + mm/memory-failure.c | 255 +++++++++++++++++++++++++----------- 18 files changed, 682 insertions(+), 106 deletions(-) create mode 100644 fs/xfs/xfs_notify_failure.c -- 2.35.1