Received: by 2002:a05:6a10:8c0a:0:0:0:0 with SMTP id go10csp1575527pxb; Thu, 28 Jan 2021 22:32:18 -0800 (PST) X-Google-Smtp-Source: ABdhPJy3MBpvjqsJO4LB1Xhylp+4qdrFCAZluCMzQ1a6lItdK/z1kAW1wwa/TmpnfkUvW6bPQtLG X-Received: by 2002:a17:906:a115:: with SMTP id t21mr3018124ejy.549.1611901938437; Thu, 28 Jan 2021 22:32:18 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1611901938; cv=none; d=google.com; s=arc-20160816; b=oPn1uAznRzt9AfUUBVn8vIsJ9e2nWXu9GMzDM9MDhhLdM7n+oI3QTNL4ddAa3qCYra Y1+ZJq463djaKQxczEzk4iqlyWBAMUe+P91N4Gfp6lhDy/EZwRr1Py6cVHHS5dLasecC wQgehwIHWvhK80ex63lLiyCQxmIaSm5iO/7Uv++VMxAFQlJ5sSKQbSwK49/r7BtsSVm5 i4hX//VlXatOXSOaNYfGcrsSa7CnB0oBKfGwp7prq9EDyOEKLDp0FuuwO/L/cznA9q2p 7O65XL6ZcM5alyw7DelxD7WoaHvfOvsPyZ28shm3ZSX4NrANhKtkjGn5DFrYPn5oJ5sB +17A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from; bh=eHXjuOR38KOi5T3rf5+TNbSK6Fcrg4l9o8Y5MM+5j08=; b=JiMW2K8fnTQmNPbPM+5tnUJFGNce2RlMeJ/YHF9TDPOcWfIQMcFH4Ip75ypBc3eH7X cvr0KXS1yxD7Eoz/cKxn/3dkc8cVbTKz6+19b4PMPwHj/nCRtMTMCQ4FMXG0YbDrnvWp /Mbm9EV0mc7YEfUWzchD3Q/IDuRJRS4NDv8QRWgXmv8XKcWvPLd9aThtK2UBuJ21kTNO oQ2UJGm42TpDEKAoZdYA/IMrmp5+RqQJQMigdU5kJW9rqiFmO5zscluitmq0Bu1xW+DI hT2fYE+LeBT+5a7DMvHsBYChLiFIVNYxnxCNRliKNy7GbesIp1AYayYSGG+eKiqiqj49 C44w== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id dp16si4128123ejc.564.2021.01.28.22.31.54; Thu, 28 Jan 2021 22:32:18 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232176AbhA2G30 (ORCPT + 99 others); Fri, 29 Jan 2021 01:29:26 -0500 Received: from mail.cn.fujitsu.com ([183.91.158.132]:4889 "EHLO heian.cn.fujitsu.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S232155AbhA2G3S (ORCPT ); Fri, 29 Jan 2021 01:29:18 -0500 X-IronPort-AV: E=Sophos;i="5.79,384,1602518400"; d="scan'208";a="103973619" Received: from unknown (HELO cn.fujitsu.com) ([10.167.33.5]) by heian.cn.fujitsu.com with ESMTP; 29 Jan 2021 14:28:05 +0800 Received: from G08CNEXMBPEKD04.g08.fujitsu.local (unknown [10.167.33.201]) by cn.fujitsu.com (Postfix) with ESMTP id 304B448990D2; Fri, 29 Jan 2021 14:28:01 +0800 (CST) Received: from G08CNEXCHPEKD04.g08.fujitsu.local (10.167.33.200) by G08CNEXMBPEKD04.g08.fujitsu.local (10.167.33.201) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Fri, 29 Jan 2021 14:28:01 +0800 Received: from irides.mr.mr.mr (10.167.225.141) by G08CNEXCHPEKD04.g08.fujitsu.local (10.167.33.209) with Microsoft SMTP Server id 15.0.1497.2 via Frontend Transport; Fri, 29 Jan 2021 14:28:01 +0800 From: Shiyang Ruan To: , , , , , CC: , , , , , , , , Subject: [PATCH RESEND v2 00/10] fsdax: introduce fs query to support reflink Date: Fri, 29 Jan 2021 14:27:47 +0800 Message-ID: <20210129062757.1594130-1-ruansy.fnst@cn.fujitsu.com> X-Mailer: git-send-email 2.30.0 MIME-Version: 1.0 Content-Transfer-Encoding: 7BIT Content-Type: text/plain; charset=US-ASCII X-yoursite-MailScanner-ID: 304B448990D2.AA014 X-yoursite-MailScanner: Found to be clean X-yoursite-MailScanner-From: ruansy.fnst@cn.fujitsu.com X-Spam-Status: No Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org This patchset is aimed to support shared pages tracking for fsdax. Resend V2: - Cc dm-devel instead of linux-raid Change from V1: - Add the old memory-failure handler back for rolling back - Add callback in MD's ->rmap() to support multiple mapping of dm device - Add judgement for CONFIG_SYSFS - Add pfn_valid() judgement in hwpoison_filter() - Rebased to v5.11-rc5 Change from RFC v3: - Do not lock dax entry in memory failure handler - Add a helper function for corrupted_range - Add restrictions in xfs code - Fix code style - remove the useless association and lock in fsdax Change from RFC v2: - Adjust the order of patches - Divide the infrastructure and the drivers that use it - Rebased to v5.10 Change from RFC v1: - Introduce ->block_lost() for block device - Support mapped device - Add 'not available' warning for realtime device in XFS - Rebased to v5.10-rc1 This patchset moves owner tracking from dax_assocaite_entry() to pmem device driver, by introducing an interface ->memory_failure() of struct pagemap. This interface is called by memory_failure() in mm, and implemented by pmem device. Then pmem device calls its ->corrupted_range() to find the filesystem which the corrupted data located in, and call filesystem handler to track files or metadata assocaited with this page. Finally we are able to try to fix the corrupted data in filesystem and do other necessary processing, such as killing processes who are using the files affected. The call trace is like this: memory_failure() pgmap->ops->memory_failure() => pmem_pgmap_memory_failure() gendisk->fops->corrupted_range() => - pmem_corrupted_range() - md_blk_corrupted_range() sb->s_ops->currupted_range() => xfs_fs_corrupted_range() xfs_rmap_query_range() xfs_currupt_helper() * corrupted on metadata try to recover data, call xfs_force_shutdown() * corrupted on file data try to recover data, call mf_dax_mapping_kill_procs() The fsdax & reflink support for XFS is not contained in this patchset. (Rebased on v5.11-rc5) Shiyang Ruan (10): pagemap: Introduce ->memory_failure() blk: Introduce ->corrupted_range() for block device fs: Introduce ->corrupted_range() for superblock mm, fsdax: Refactor memory-failure handler for dax mapping mm, pmem: Implement ->memory_failure() in pmem driver pmem: Implement ->corrupted_range() for pmem driver dm: Introduce ->rmap() to find bdev offset md: Implement ->corrupted_range() xfs: Implement ->corrupted_range() for XFS fs/dax: Remove useless functions block/genhd.c | 6 ++ drivers/md/dm-linear.c | 20 ++++ drivers/md/dm.c | 61 +++++++++++ drivers/nvdimm/pmem.c | 44 ++++++++ fs/block_dev.c | 42 +++++++- fs/dax.c | 63 ++++------- fs/xfs/xfs_fsops.c | 5 + fs/xfs/xfs_mount.h | 1 + fs/xfs/xfs_super.c | 109 +++++++++++++++++++ include/linux/blkdev.h | 2 + include/linux/dax.h | 1 + include/linux/device-mapper.h | 5 + include/linux/fs.h | 2 + include/linux/genhd.h | 3 + include/linux/memremap.h | 8 ++ include/linux/mm.h | 9 ++ mm/memory-failure.c | 190 +++++++++++++++++++++++----------- 17 files changed, 466 insertions(+), 105 deletions(-) -- 2.30.0