Received-SPF: pass (google.com: domain of linux-kernel+bounces-37153-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:40f1:3f00::1 as permitted sender) client-ip=2604:1380:40f1:3f00::1;
From: John Garry <john.g.garry@oracle.com>
To: hch@lst.de, djwong@kernel.org, viro@zeniv.linux.org.uk, brauner@kernel.org,
        dchinner@redhat.com, jack@suse.cz, chandan.babu@oracle.com
Cc: martin.petersen@oracle.com, linux-kernel@vger.kernel.org,
        linux-xfs@vger.kernel.org, linux-fsdevel@vger.kernel.org,
        tytso@mit.edu, jbongio@google.com, ojaswin@linux.ibm.com,
        John Garry <john.g.garry@oracle.com>
Subject: [PATCH 0/6] block atomic writes for XFS
Date: Wed, 24 Jan 2024 14:26:39 +0000
Message-Id: <20240124142645.9334-1-john.g.garry@oracle.com>
Content-Transfer-Encoding: 8bit
Content-Type: text/plain
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: 
	=?us-ascii?Q?AvfSb+L89kRi0ErTNYfCtsLshpb3tbMFLdm90/tQ8y6vANQrn6F/iytJxLND?=
 =?us-ascii?Q?GWzA/hlXfsZF0sluHIQkliJn/E2kgnZ0m7KzZ8qPaFz7pyNMxqeKKtzJERSu?=
 =?us-ascii?Q?p9hi53QGl9jhCTbWYM8GFu5IsD8TtfKqJq31IlQoEvKmd3g5Hyayigc/Ob7Q?=
 =?us-ascii?Q?2IKciP6UC4lqEJuMBn9cVnfuixr4qP5l++JCbIofbKJUG5fWd6d47sspMvos?=
 =?us-ascii?Q?ZMCAEz/JbULSvQS8/+bG6DgKYV1GH+k/FIvmOW4ZmQ308Z5B61K2F2NkOwSB?=
 =?us-ascii?Q?Pbn9kvFG+jDO1rVgWGlaf0iuXXgt/qv6ZWe/n2pAO93nnH3WUdYffjVyCher?=
 =?us-ascii?Q?dz+jwMUQ6kdGT8/XOStsXt3tS6lJyOixphAVk5+tTXLeGgRpID8dX+zFg/mi?=
 =?us-ascii?Q?t9SI1P9RmXI/pbmUGGdFBzhxqvozmkgIvUwBAcNi3jgIOimKLuq+d+PBXb6B?=
 =?us-ascii?Q?rO6/y9W0MKCiFQRBubH89bNeJmy7aIpohmIkG8rI+/hUbyacYj/WOK63GB/I?=
 =?us-ascii?Q?71mz1e5bfcmepywgPI4v7Xmb4wA8fkenBLydrBkQGr1ShDvi/83+BtjTpjuc?=
 =?us-ascii?Q?6iBN4l78HuHnCry862UPB+nDxCPn1xJ/j7RnoF6ePr1dtc4jFCNFi5WuJYsh?=
 =?us-ascii?Q?osyriHTPeBpcPZFoXMEA0HMQFDQf+YChqkcyn/u+HtxTFNyABKB04JP27NMO?=
 =?us-ascii?Q?e3qy+0y0+yXgdbYXMOmvuRX/whMejajB8IN4PdeuyO4d4KvNfyKTIwhJm256?=
 =?us-ascii?Q?YaO7QUkt/o74lZ1iAynFAI4dFyLEqg1sf96Kle73ya0xdewUcf3YZHoi3eoY?=
 =?us-ascii?Q?dKNzt+cLD03ct7MKRdp5drI6RpamUB0kXKD+GaPKl8gHBm2eSkWcIQOnSTPF?=
 =?us-ascii?Q?F30JC3v6uxAZ+Bi/CvovSk9fn6g6j5qXI91pkqkH/tWA7tpeeT2Uxle0jnwN?=
 =?us-ascii?Q?QZRM8dZuH5EcXh5HxJI+kOJJDPrszoCuzPosGPOnCmviP0L5y9rZ8WjU+BDZ?=
 =?us-ascii?Q?m59ZNX+PeGeyKpoedM5rTSb6Zh1InYNhAvn0ILldIpKlEcWJBnbs1FcemuJ7?=
 =?us-ascii?Q?M/g03oAw9jc8ABc0Dya7r2N8q5f6diG0XISDzROhvU/PT9G1SKFE81n5lMhj?=
 =?us-ascii?Q?t2mG7ZBqagXslGTojodzCd/MwnGXhNdScyuXCZ7j6j4tYsBhdR80CBWkttwl?=
 =?us-ascii?Q?UiH39IBb4+Vgsd1x3QyKrTxdX3kSuz6efijVxs9GMl7tmkp0YDBzfjPJ0k9L?=
 =?us-ascii?Q?dtyts641ctd/Y1Ex8upM2/6PaUoF19LEGVutTaOov2Zdiv1HlFxGVd4ZgmH3?=
 =?us-ascii?Q?XJwCIIeo1TgfS4pGmN+dL6C41x3EN44JMT9wigKrgabg/tBDOYIe/OeS8J6c?=
 =?us-ascii?Q?MwHjCohlLgkfmJz3O4CcGnVAexidoHalqVCIDAM8epYm+x/dSVO63naEDHJA?=
 =?us-ascii?Q?XaM2+ftkXEcnkaAA6fkK/1Vqr4SYNie4M7JQt4HIW8tAv9sgFKTTC2eoSygw?=
 =?us-ascii?Q?yMx+Q9pKM2yxQC2zV0KdbstRuj1E4AMfgbce243CEEnCPm+JJzmVoXDuNztM?=
 =?us-ascii?Q?79wATr2gzgErYYHnqKiPNY6J5UqVyAmq1LC6B0izLEy3UGMEqCls6ZGvuPfx?=
 =?us-ascii?Q?WA=3D=3D?=
X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: 
	3fJaMtZl0qWhtpWDbRYHNQLhtGL8TZNvclr7Kk37cTwBsEJ8B5GONHvNXaRGykPfL53k44lyR+FuKMOVaihVsqHD+/SK4f5G9iGIHgXioILQc3BBQCX0zFbNxCwIztCh1ixNZ2QRJ62VZLuMr4/1j0D8T2xJrcHG4nVNQ6SqHmSNGLxj94MxC42avTlL2j6401ssvYsOObYH6cYoSmHeE5TPBSKBa3JIR3gh/yi1B77eAwlp7ArT6bVURK1kBCCGFXJCPzitH/w9oyuuVtmSqPfiYk8404g0H5tN671ZTXH3fU1bPJ1rLkxSaONoW4urXGtvVnbuSfGzB+NZJCIizzRuSlNxEFYNOKzRQj8zX1kZKozh6zd/UppisfBwocXP5NE5bTwm+5E0JDrweJ+7Lb4O5ixqqLLit76TmYnSSAuFdE/XZ1nGItz8JcxHHRHBPur8x1+wjcDx83UOoth9Dar7GYL2cGZCipL/7AtQRq8tc8gkbP8MtCBtjx8U1XTUQRucbX2+rjPWColnf+NjJfR6hSWJJBSqpyVMHIQSkkVniA1xClSqCn7AE1Mq94dclY/k7AFTpUT+huolaVP5/RhM9YccuUX3WPkG+I3vxlw=
X-OriginatorOrg: oracle.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 6d5312cc-d1ed-4354-2472-08dc1ce883ae
X-MS-Exchange-CrossTenant-AuthSource: DM6PR10MB4313.namprd10.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 24 Jan 2024 14:26:54.8810
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: WotJWPaHyVa6oDJJAwr+v8bxN5FKT5EhDop3+ht9y7ZTnh3NuGk3hrLJ58ytVEEu0LN64a+L9AbbMlSUKFVDDg==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CH0PR10MB5212
X-Proofpoint-Virus-Version: vendor=baseguard
 engine=ICAP:2.0.272,Aquarius:18.0.1011,Hydra:6.0.619,FMLib:17.11.176.26
 definitions=2024-01-24_06,2024-01-24_01,2023-05-22_02
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 malwarescore=0 bulkscore=0
 mlxlogscore=999 mlxscore=0 phishscore=0 adultscore=0 spamscore=0
 suspectscore=0 classifier=spam adjust=0 reason=mlx scancount=1
 engine=8.12.0-2311290000 definitions=main-2401240104
X-Proofpoint-GUID: M0NIBwgqVvBzRrWqtxVNYwtEXVCcUB-a
X-Proofpoint-ORIG-GUID: M0NIBwgqVvBzRrWqtxVNYwtEXVCcUB-a

This series expands atomic write support to filesystems, specifically
XFS. Since XFS rtvol supports extent alignment already, support will
initially be added there. When XFS forcealign feature is merged, then we
can similarly support atomic writes for a non-rtvol filesystem.

Flag FS_XFLAG_ATOMICWRITES is added as an enabling flag for atomic writes.

For XFS rtvol, support can be enabled through xfs_io command:
$xfs_io -c "chattr +W" filename
$xfs_io -c "lsattr -v" filename
[realtime, atomic-writes] filename

The FS needs to be formatted with a specific extent alignment size, like:
mkf.xfs -r rtdev=/dev/sdb,extsize=16K -d rtinherit=1 /dev/sda

This enables 16K atomic write support. There are no checks whether the
underlying HW actually supports that for enabling atomic writes with
xfs_io, though, so statx needs to be issued for a file to know atomic
write limits.

For supporting non-rtvol, we will require forcealign enabled. As such, a
dedicated xfs_io command to enable atomic writes for a regular FS may
be useful, which would enable FS_XFLAG_ATOMICWRITES, enable forcealign,
and set an extent alignment hint.

Baseline is following series (which is based on v6.8-rc1):
https://urldefense.com/v3/__https://lore.kernel.org/linux-nvme/20240124113841.31824-1-john.g.garry@oracle.com/T/*m4ad28b480a8e12eb51467e17208d98ca50041ff2__;Iw!!ACWV5N9M2RV99hQ!PKOcFzPtVYZ9uATl1BrTJmYanWxEtCKJPV-tTPDYqeTjuWmChXn08ZcmP_H07A9mxPyQ8wwjdSzgH0eYU_45MaIOJyEW$ 

Basic xfsprogs support at:
https://urldefense.com/v3/__https://github.com/johnpgarry/xfsprogs-dev/tree/atomicwrites__;!!ACWV5N9M2RV99hQ!PKOcFzPtVYZ9uATl1BrTJmYanWxEtCKJPV-tTPDYqeTjuWmChXn08ZcmP_H07A9mxPyQ8wwjdSzgH0eYU_45MTapy6qp$ 

John Garry (6):
  fs: iomap: Atomic write support
  fs: Add FS_XFLAG_ATOMICWRITES flag
  fs: xfs: Support FS_XFLAG_ATOMICWRITES for rtvol
  fs: xfs: Support atomic write for statx
  fs: xfs: iomap atomic write support
  fs: xfs: Set FMODE_CAN_ATOMIC_WRITE for FS_XFLAG_ATOMICWRITES set

 fs/iomap/direct-io.c       | 21 +++++++++++++++++-
 fs/iomap/trace.h           |  3 ++-
 fs/xfs/libxfs/xfs_format.h |  8 +++++--
 fs/xfs/libxfs/xfs_sb.c     |  2 ++
 fs/xfs/xfs_file.c          |  2 ++
 fs/xfs/xfs_inode.c         | 22 +++++++++++++++++++
 fs/xfs/xfs_inode.h         |  7 ++++++
 fs/xfs/xfs_ioctl.c         | 19 ++++++++++++++--
 fs/xfs/xfs_iomap.c         | 41 ++++++++++++++++++++++++++++++++++
 fs/xfs/xfs_iops.c          | 45 ++++++++++++++++++++++++++++++++++++++
 fs/xfs/xfs_iops.h          |  4 ++++
 fs/xfs/xfs_mount.h         |  2 ++
 fs/xfs/xfs_super.c         |  4 ++++
 include/linux/iomap.h      |  1 +
 include/uapi/linux/fs.h    |  1 +
 15 files changed, 176 insertions(+), 6 deletions(-)

-- 
2.31.1