Received-SPF: pass (google.com: domain of linux-kernel+bounces-21136-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45d1:ec00::1 as permitted sender) client-ip=2604:1380:45d1:ec00::1;
Message-ID: <d2324bad-f0f8-43ba-9f72-870e2e276fd3@oracle.com>
Date: Tue, 9 Jan 2024 16:52:28 +0000
User-Agent: Mozilla Thunderbird
Subject: Re: [PATCH v2 00/16] block atomic writes
To: Christoph Hellwig <hch@lst.de>
Cc: "Darrick J. Wong" <djwong@kernel.org>, axboe@kernel.dk, kbusch@kernel.org,
        sagi@grimberg.me, jejb@linux.ibm.com, martin.petersen@oracle.com,
        viro@zeniv.linux.org.uk, brauner@kernel.org, dchinner@redhat.com,
        jack@suse.cz, linux-block@vger.kernel.org,
        linux-kernel@vger.kernel.org, linux-nvme@lists.infradead.org,
        linux-xfs@vger.kernel.org, linux-fsdevel@vger.kernel.org,
        tytso@mit.edu, jbongio@google.com, linux-scsi@vger.kernel.org,
        ming.lei@redhat.com, bvanassche@acm.org, ojaswin@linux.ibm.com
References: <b8b0a9d7-88d2-45a9-877a-ecc5e0f1e645@oracle.com>
 <20231213154409.GA7724@lst.de>
 <c729b03c-b1d1-4458-9983-113f8cd752cd@oracle.com>
 <20231219051456.GB3964019@frogsfrogsfrogs> <20231219052121.GA338@lst.de>
 <76c85021-dd9e-49e3-80e3-25a17c7ca455@oracle.com>
 <20231219151759.GA4468@lst.de>
 <fff50006-ccd2-4944-ba32-84cbb2dbd1f4@oracle.com>
 <20231221065031.GA25778@lst.de>
 <73d03703-6c57-424a-80ea-965e636c34d6@oracle.com>
 <20240109160223.GA7737@lst.de>
Content-Language: en-US
From: John Garry <john.g.garry@oracle.com>
Organization: Oracle Corporation
In-Reply-To: <20240109160223.GA7737@lst.de>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: 
	=?utf-8?B?N1hYQ1NVODlwVU1hWkFxc2ZZSHlNamg3YlVsb1lyZWhEWE1sOUozKzJEUDBp?=
 =?utf-8?B?cEQ1SWF4dkRaTWN0QjhOZmtGd2lKVC9ncWx4RHJVY3FoTWlXNDkwUWJHUUNX?=
 =?utf-8?B?QWxSdzltZVF5MVBTQlV5dWNsWFNHUFRoN1lxaXFvcUtmYnVpcjJBSGdpZW9D?=
 =?utf-8?B?dTF3QytpM3JONFlpRVVlN1l2aVdoZFhvaXVVQVI4NkdqR2o4YW9PNjlKQU5r?=
 =?utf-8?B?Nm5KYXpKTmdQZzBmTmNVMUxXK0xBcERSTk5TKzJlODZSQ3BFQ0FSNGVzeXNs?=
 =?utf-8?B?YzNoWXNObnpvMjVGMXVGc3NaSWM3S0ZDZ2Fvb1UzWm1UWEJZUFAza1pLZWVZ?=
 =?utf-8?B?Mzd2NTFHUnZ6aW1FVjNwR2lFWVBBMWxVc2FJaURMZXFIRkpwc2ZXMnJZUkJN?=
 =?utf-8?B?cEhNcXpWMUUzc284eW84RnVwN2pxem95RW41VUFMVW5uVlFGeWRGcmJBU3dM?=
 =?utf-8?B?V1IrYllTR0RCTzlJbU52TDRoVW16dGlqZ2pCUE1xaDFUSnVSYmpxdG5XdHNt?=
 =?utf-8?B?cllYTU5VRXFnMEduTDFFcXNwa1dremhjNGZBTG5ZMDAvS2ZiSlhkWlRXZ3Ro?=
 =?utf-8?B?bzN5WHlHSmNwNW5sT1dLSjVreisxSVBkemw3WS85cEFCd3hubHNJaFZ2SzZ3?=
 =?utf-8?B?UEZCWHUwZ0VTcDNZcndWanllMlE0UHpuenhZSDZoblVhdWhzSkk0UXQ4YlpG?=
 =?utf-8?B?REZPNDJIK0ZJWktQb0hmcWIyMEkyT2tvejdYU0pXczBxaWV4dzBZN3RnRUk1?=
 =?utf-8?B?aTI5Wk15OGMwczVwZnlXM1UrOHZXSHFhV1hudWU3ejFJbDJJMVhyQTFHU3ov?=
 =?utf-8?B?SWdDT2hUWVBsSHZrVUhDRVV3Q25WVzFxS29qQWVMenNEVDA0UUN1alNncXF0?=
 =?utf-8?B?UXpEQ2ZzVm1TNVdhdzcraldnb0xxTHArenYybk5UcllpSHV1SXNNdVVYT0Zu?=
 =?utf-8?B?MEVnVTEzandPbjBIelJzMG1QU3FjOGZ6d2U3RUpxQW14TE1pYkRtOFlyZlR5?=
 =?utf-8?B?OVA0b3Z2YXVQL3BzSGhNNk1EOXd1dENlUFF2a2FFZnd0QUZpNFdTQVpBMjF2?=
 =?utf-8?B?V3lGVzdiNWJjUTFxcnFCTnhiL1BkZVhkam9PNlRVNVBBRWVYZmJYR0haZVM0?=
 =?utf-8?B?YWZCVUMzbjRPaTBFRmZmWE1UeXp5M1pXOTZEd2N5bjZIN0JzQmNmT281anFs?=
 =?utf-8?B?SVlJZWRLMUpodVVBaHpiaHR1eFJKYVczTy9oZ1R1b3FZVCtMbWZ1MitmamhU?=
 =?utf-8?B?RzdyaTNxRTl5cUExZUNjMDNMS2E2cHlKeGNtbW1yWTZEeHNQM3hwc1BiaElk?=
 =?utf-8?B?SGtiajJqbC9vZW03NVpiQzh6U1JGd3RSQk0vc3YxV3pxcEI3THdHOUhVYkZr?=
 =?utf-8?B?Si9zMTVhamh6cEpZVEJEYmNSeHF4bmhNcHZJNDhDbDJqVy9WUFhwaDZDRzlp?=
 =?utf-8?B?VFk0TERvK01uWDlFNXlKdHN2bEZyQlFGOWdFcHA4a21IckNkTUJTVTVFYWNU?=
 =?utf-8?B?OTJvZU1ZZ0ZzRlJDcmZORWMvV21yOUUyUnpwOTI1N1FaNVFVMDUxTUVONW9j?=
 =?utf-8?B?bUFHbjdPVzRDdytVVjdLSVZmTU5sVTh0eU9Tc21ENFlDMko4K25aWkhacnZH?=
 =?utf-8?B?emZQMzFvYkVIeUlaaDgrUGFaanZsRENFVkNZMnI1dEFwdVVMN2RwSFNKQXl3?=
 =?utf-8?B?WHFyVUd3bEZPbjJQK1JEYlNPNDRGWWhkd3ptS0VoM2oweFJGc3dBQjI4UFY2?=
 =?utf-8?B?S1poNVVRbVFjdHhmOGxkdGI1ekxyOUt4eVhKSHhnc29nY0hLbEFYS0F3MFFD?=
 =?utf-8?B?T2Fidk05ZktkcU5FeGtPemRvczcrWHgvYk5oSFYvbGw0VlJNbTYxZ3RPdnNj?=
 =?utf-8?B?N0RRRHY2UGxvT2dzb09WQnVrT3JxcTdRQUpoWDdEdUMrZmsyelZKNXlabmRx?=
 =?utf-8?B?dktGZlQvWU5wV3lJMFZqN2x0VzFPYVE0dnZTL3c2S1NheUJZclpDOHdHenhN?=
 =?utf-8?B?QXN6OWYzaFRLN1BMdHJIWHA2KzVYQ1hnZE5sMzdvNHNVbVRDU0o5REh6bnlU?=
 =?utf-8?B?K1VGTHJhTHFLMzhwaWc4RGYwUGM5Z1NJZEhqV0x4MjRCZzN1REkva29yR1BM?=
 =?utf-8?B?c1NuTXdoOEMzK1FzRVhkMGJXNWdNRGNLZUxKNlF0dDNSTWY1OElLQS9HSE95?=
 =?utf-8?B?UHc9PQ==?=
X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: 
	zzzVALVMAYrpdVgbC6CoSC/miACLmIuIfJuP9Cm6mJtUzDNtGlPFirnf4NAdKwURfNm0Y5WwaRpkt764ZJ1eTJ6S66Lq8F+DV3nk6aDKX0HxsN4eUs9bnSbgv4b3FofkwfBSWQFehVLwpBT8EkwEeUl3/saS2BLd5UrXNIYLoTjzLfFkLS0a+ulVxYAl+wHgk+xgU4+xdwazf8qNC2XH32766Z6amLvlpiEDyxDU/e3U/HrxWEMrO9IdxIiRciRUwdCntCFZP5sOr3T/3/Ti5ZtULU/fWHYeTD8UQV1XycRKxWiqk2hzbY9xzZ4STURDEfhwzPPq84OfeI3vswmaM5lVXifAcweUqfFOu1oyHQR/DOviLRfnTwSs9EcePQYk+izY0WldSfFC0cIBKP62ParnLN7SbnciLK5nhQRYG5xjffXCVRFjJGgJym+TVg4XVNHBEJuqfhwmHdd+0SIV5tC9vmcSDOZd4Pb0gSIqo6/ajc9/A+WvUh8D2ZFEkY41AoKNEWsizKMup+f6/lhcSVV+rxQCkxYzz/PcdQfQ5JCRhxMrC5JFitouHn4rm8XRXCpnk2V9oh5Nqcmfe9EvqU1k3uiD1wIExnJ71upRJwQ=
X-OriginatorOrg: oracle.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 49b37859-908c-4c04-02d3-08dc1133608d
X-MS-Exchange-CrossTenant-AuthSource: DM6PR10MB4313.namprd10.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 09 Jan 2024 16:52:34.3079
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: gx3T4XwrLoXYVVDJpkglJeBkMENIie2MEsX4/ZSkNr4oXRVPlIhwCnml08gjWzPvf0dgFRSFA+ipVmSbf+/GGA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH7PR10MB5853
X-Proofpoint-Virus-Version: vendor=baseguard
 engine=ICAP:2.0.272,Aquarius:18.0.997,Hydra:6.0.619,FMLib:17.11.176.26
 definitions=2024-01-09_08,2024-01-09_02,2023-05-22_02
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 spamscore=0 phishscore=0 bulkscore=0
 mlxscore=0 mlxlogscore=999 adultscore=0 malwarescore=0 suspectscore=0
 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2311290000
 definitions=main-2401090137
X-Proofpoint-ORIG-GUID: -xYDjIPMCokqDYasswAVH6HvrDT3nXV8
X-Proofpoint-GUID: -xYDjIPMCokqDYasswAVH6HvrDT3nXV8

On 09/01/2024 16:02, Christoph Hellwig wrote:
> On Tue, Jan 09, 2024 at 09:55:24AM +0000, John Garry wrote:
>> So a user can issue:
>>
>>> xfs_io -c "atomic-writes 64K" mnt/file
>>> xfs_io -c "atomic-writes" mnt/file
>> [65536] mnt/file
> Let me try to decipher that:
> 
>   - the first call sets a 64k fsx_atomicwrites_size size

It should also set FS_XFLAG_ATOMICWRITES for the file. So this step does 
everything to enable atomic writes for that file.

>   - the secon call queries fsx_atomicwrites_size?

Right, I'm just demo'ing how it would look

> 
>> The user will still have to issue statx to get the actual atomic write
>> limit for a file, as 'xfs_io -c "atomic-writes"' does not take into account
>> any HW/linux block layer atomic write limits.
> So will the set side never fail?

It could fail.

Examples of when it could fail could include:

a. If user gave a bad size value. So the size should be a power-of-2 and 
also divisible into the AG size and compatible with any stripe alignment.

b. If the file already had flags set which are incompatible with or not 
supported for atomic writes.

c. the file already has data written. I guess that's obvious.

> 
>> Is this the sort of userspace API which you would like to see?
> What I had in mind (and that's doesn't mean it's right..) was that
> the user just sets a binary flag, and the fs reports the best it
> could.  But there might be reasons to do it differently.

That is what I am trying to do, but I also want to specify a size for 
the atomic write unit max which the user could want. I'd rather not use 
the atomic write unit max from the device for that, as that could be 
huge. However, re-reading a., above, makes me think that the kernel 
should have more input on this, but we still need some input on the max 
from the user...

Thanks,
John