Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
From:   Jane Chu <jane.chu@oracle.com>
To:     dan.j.williams@intel.com, bp@alien8.de, hch@infradead.org,
        dave.hansen@intel.com, peterz@infradead.org, luto@kernel.org,
        david@fromorbit.com, djwong@kernel.org,
        linux-fsdevel@vger.kernel.org, nvdimm@lists.linux.dev,
        linux-kernel@vger.kernel.org, x86@kernel.org
Cc:     vishal.l.verma@intel.com, dave.jiang@intel.com, agk@redhat.com,
        snitzer@redhat.com, dm-devel@redhat.com, ira.weiny@intel.com,
        willy@infradead.org, vgoyal@redhat.com
Subject: [PATCH v9 0/7] DAX poison recovery
Date:   Fri, 22 Apr 2022 16:45:01 -0600
Message-Id: <20220422224508.440670-1-jane.chu@oracle.com>
Content-Type: text/plain
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?dZs/qAOqS83+Y1Fq9hlRjFOD+smVlDQEK+uGoqvZW++rG6xaPuw+I8hjciI/?=
 =?us-ascii?Q?dloDo3HucxhTUfOTxL5q3U5OItd7pfOQ7kFww6Te02BCnIFArvJedBqoFjEW?=
 =?us-ascii?Q?ZfxKq5io/PoJaYXrdyZF22kAaJVlDAdl8l97fY43hn41zplDiToQUz6v+fu8?=
 =?us-ascii?Q?16ilQXZtVyCgIeSZqXe7d3usVza16U28y1LPM+/H9bG/vZTL4IH58IarGZlc?=
 =?us-ascii?Q?fRl4a5GGayfTMvnKaWyZcIQdtozjbWldoia3Oz5vOoNa0P0kB/VxuDUhAlbF?=
 =?us-ascii?Q?jMgtlL0CHtaRy4SDCySqH6Fy/w2biqcAgEkVYDgOkzE3W0yw+gtDhS7AUd8d?=
 =?us-ascii?Q?6CI2LYjmFZSaMLmBhBsUB0zyUDuzkU03iww1n7Y08lDswVQI4OyTqhtLg9B5?=
 =?us-ascii?Q?h1vfrDl2jyzLCUAD9AmUxZiP2kcAgyCzsQeAgRgqPBIyAH4qIGPoDJ6qwrQN?=
 =?us-ascii?Q?9ZuEGdkGZWaFdNYs65U66HH1K2M3EPVkqrkw6NKX1t9kjz55tdVyXjyvZP0V?=
 =?us-ascii?Q?KcqLLOqduQlcUeEKtBaqzHSJxV9g7x7Af8OLcoTKkOzbIi6IhHknWyE37gIu?=
 =?us-ascii?Q?JmVcgyNaWmrUoR+sN3VQD7N5blRri8FbtkPyxwsSuO0hOmLZYO+kdDvW/9VE?=
 =?us-ascii?Q?LApbwDKoDqwbfKgEx1hTc1+p3kMy7zaG8cnnCkWtOa03y8D/VFxaPpo1mpZJ?=
 =?us-ascii?Q?J+sNdl/pVG9mGNhZCSPACDvkgQaOeUBWYK2bfPBVExx/adq0yU8eWJdZQmlU?=
 =?us-ascii?Q?fk/GfaymN2yFBf0AvM+H5kfTbrHOBzkN8+f75mVJmWOJKMdV9qikxQ3r2oZ5?=
 =?us-ascii?Q?MWsFz+p1yziCGdQwd4uScBJvmKRJboaC0IFuM0oHIl7RbOecVehwLmkasrnc?=
 =?us-ascii?Q?t1fHeZ8UNwR/4pXMEiUipDnbYyWPIuBQfe65jzbEfxj5QwWfasYI5MDitIGe?=
 =?us-ascii?Q?4rm1iF3d0+BdyzT1AeARTgiF0YsSp63qAmGVwAyApxW+Hm6ejT6acsSxuTTr?=
 =?us-ascii?Q?SXHneAxN7wHl2nfy/NOsUc55nkq3Ff9x8Zw7WMifvwEDh4YOdSk3Pjw/qGNA?=
 =?us-ascii?Q?rInRB5qecD6bRdT+YS5vQ5Lvuhx1aSjdW1T8Uqp6zvkwtIcUTn9ZEoSc6nLc?=
 =?us-ascii?Q?3Q4I7HbqkFqwaXLC4gCOW3WBH3RwgQTpGRtbVvB5jQPoeeOAjZwRIyh8m08J?=
 =?us-ascii?Q?7Pt7Np2q+K7QDoQaYWXl/nK+OveuEMYGBju1qK+VgoHvelUDTsam0G6QRA0a?=
 =?us-ascii?Q?x4krJMkHRWKV3omRT5SRjKNWptpeqZxcNMGc2x5ryJv1fn0djCyiTr41EQpU?=
 =?us-ascii?Q?OyEyvQLZorZQNU5TyE2XfeDHTHJnzpKp7suAW7zPh2FwYzpSbY10zu5Fnyxl?=
 =?us-ascii?Q?AC3K61TJYv8xx0d8J35g/FDkhZgn+cyDTFBAKd+DFdirU4Ocj0OWNe1A/Upk?=
 =?us-ascii?Q?iVNXKYSplEiwbAMNzJre+f4jpQosqDfVkARfELsXPs7kHORKRbppg/A2Mgd+?=
 =?us-ascii?Q?aWPTxv6rYfwuRd6wkMStmwkSZqzelVBs+aa4eusk4r+I6XPhzh4s3fHA9qdy?=
 =?us-ascii?Q?1WKxOmxoF307ErgjGvuKLwUZQNaSZe+GretSoOb2gG2SJzBgVBgQ6b19HPed?=
 =?us-ascii?Q?77JQ80OsBWSAZxhq5ZF9h+0tovQbil7b+RsJ47+oeq7BFRNx6uXE7kWc6Si2?=
 =?us-ascii?Q?KsjuEUChlvBxNOHT3VC3EsHQ1A35XfiIFPjwK6BZ3Y9kfR4h9Qgw+x3ng2Cm?=
 =?us-ascii?Q?pwtxq27dBVGcKTOVy9I2/CqIA7QyrOU=3D?=
X-OriginatorOrg: oracle.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 27e4aa33-ae59-453b-dace-08da24b1d3c1
X-MS-Exchange-CrossTenant-AuthSource: SJ0PR10MB4429.namprd10.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 22 Apr 2022 22:45:40.8729
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: YHA4t/aIpYQv6+9fISCZfKVv0GsYVagM8zb0W3VMo63F9Qdw4k0almiMY4YzepBQhKdmDC13NrqNDrlFXFRnMg==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BYAPR10MB2550
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.486,18.0.858
 definitions=2022-04-22_07:2022-04-22,2022-04-22 signatures=0
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 malwarescore=0 bulkscore=0
 suspectscore=0 mlxscore=0 spamscore=0 mlxlogscore=999 phishscore=0
 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1
 engine=8.12.0-2202240000 definitions=main-2204220095
X-Proofpoint-GUID: 6pfItZVj7vlRtlTTV5h4Vn-bZJdgb_0c
X-Proofpoint-ORIG-GUID: 6pfItZVj7vlRtlTTV5h4Vn-bZJdgb_0c
X-Spam-Status: No, score=-2.8 required=5.0 tests=BAYES_00,DKIM_SIGNED,
        DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_LOW,SPF_HELO_NONE,
        SPF_NONE autolearn=ham autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

In this series, dax recovery code path is independent of that of
normal write. Competing dax recovery threads are serialized,
racing read threads are guaranteed not overlapping with the
recovery process.

In this phase, the recovery granularity is page, future patch
will explore recovery in finer granularity.

Changelog:
v8 -> v9:
- collect R-Bs from Christoph and Dan
- move the actual DAX_RECOVERY_WRITE part of the work out of the
  dax access mode plumbing patch and into the next patch that
  introduces .recovery_write

v7 -> v8:
  - add a patch to teach the nfit driver to rely on mce->misc for poison
    granularity, suggested by Dan
  - add set_memory_present() helper to be invoked by set_mce_nospec() for
    better readibility, suggested by Dan
  - folded a trivial fix to comments in patch 2/NN, suggested by Boris,
    and more commit message comments from Boris
  - mode .recovery_write to dax_operation as dev_pagemap_ops is meant for
    device agnostic operations, suggested by Christoph
  - replace DAX_RECOVERY flag with enum dax_access_mode suggested by Dan
  - re-organized __pmem_direct_access as provided by Christoph
  - split [PATCH v7 4/6] into two patches: one introduces
    DAX_RECOVERY_WRITE, and the other introduces .recovery_write operation

v6 -> v7:
 . incorporated comments from Christoph, and picked up a reviewed-by
 . add x86@kernel.org per Boris
 . discovered pmem firmware doesn't reliably handle a request to clear
   poison over a large range (such as 2M), hence worked around the
   the feature by limiting the size of the requested range to kernel
   page size.

v5->v6:
  . per Christoph, move set{clear}_mce_nospec() inline functions out
    of include/linux/set_memory.h and into arch/x86/mm/pat/set_memory.c
    file, so that no need to export _set_memory_present().
  . per Christoph, ratelimit warning message in pmem_do_write()
  . per both Christoph and Dan, switch back to adding a flag to
    dax_direct_access() instead of embedding the flag in kvaddr
  . suggestions from Christoph for improving code structure and
    readability
  . per Dan, add .recovery_write to dev_pagemap.ops instead of adding
    it to dax_operations, such that, the DM layer doesn't need to be
    involved explicitly in dax recoovery write
  . per Dan, is_bad_pmem() takes a seqlock, so no need to place it
    under recovery_lock.
  Many thanks for both reviewers!

v4->v5:
  Fixed build errors reported by kernel test robot

v3->v4:
  Rebased to v5.17-rc1-81-g0280e3c58f92

References:
v4 https://lore.kernel.org/lkml/20220126211116.860012-1-jane.chu@oracle.com/T/
v3 https://lkml.org/lkml/2022/1/11/900
v2 https://lore.kernel.org/all/20211106011638.2613039-1-jane.chu@oracle.com/
Disussions about marking poisoned page as 'np'
https://lore.kernel.org/all/CAPcyv4hrXPb1tASBZUg-GgdVs0OOFKXMXLiHmktg_kFi7YBMyQ@mail.gmail.com/

Jane Chu (7):
  acpi/nfit: rely on mce->misc to determine poison granularity
  x86/mce: relocate set{clear}_mce_nospec() functions
  mce: fix set_mce_nospec to always unmap the whole page
  dax: introduce DAX_RECOVERY_WRITE dax access mode
  dax: add .recovery_write dax_operation
  pmem: refactor pmem_clear_poison()
  pmem: implement pmem_recovery_write()

 arch/x86/include/asm/set_memory.h |  52 --------
 arch/x86/kernel/cpu/mce/core.c    |   6 +-
 arch/x86/mm/pat/set_memory.c      |  48 ++++++-
 drivers/acpi/nfit/mce.c           |   4 +-
 drivers/dax/super.c               |  14 ++-
 drivers/md/dm-linear.c            |  15 ++-
 drivers/md/dm-log-writes.c        |  15 ++-
 drivers/md/dm-stripe.c            |  15 ++-
 drivers/md/dm-target.c            |   4 +-
 drivers/md/dm-writecache.c        |   7 +-
 drivers/md/dm.c                   |  25 +++-
 drivers/nvdimm/pmem.c             | 203 +++++++++++++++++++++---------
 drivers/nvdimm/pmem.h             |   5 +-
 drivers/s390/block/dcssblk.c      |   9 +-
 fs/dax.c                          |  22 +++-
 fs/fuse/dax.c                     |   4 +-
 include/linux/dax.h               |  22 +++-
 include/linux/device-mapper.h     |  13 +-
 include/linux/set_memory.h        |  10 +-
 tools/testing/nvdimm/pmem-dax.c   |   3 +-
 20 files changed, 346 insertions(+), 150 deletions(-)


base-commit: 028192fea1de083f4f12bfb1eb7c4d7beb5c8ecd
-- 
2.18.4