Received-SPF: pass (google.com: domain of linux-kernel+bounces-65178-linux.lists.archive=gmail.com@vger.kernel.org designates 139.178.88.99 as permitted sender) client-ip=139.178.88.99;
Message-ID: <a1876205-5473-4f44-9439-a7b3c534be4d@oracle.com>
Date: Wed, 14 Feb 2024 12:13:25 +0000
User-Agent: Mozilla Thunderbird
Subject: Re: [PATCH RFC 5/6] fs: xfs: iomap atomic write support
To: "Darrick J. Wong" <djwong@kernel.org>
Cc: hch@lst.de, viro@zeniv.linux.org.uk, brauner@kernel.org,
        dchinner@redhat.com, jack@suse.cz, chandan.babu@oracle.com,
        martin.petersen@oracle.com, linux-kernel@vger.kernel.org,
        linux-xfs@vger.kernel.org, linux-fsdevel@vger.kernel.org,
        tytso@mit.edu, jbongio@google.com, ojaswin@linux.ibm.com
References: <20240124142645.9334-1-john.g.garry@oracle.com>
 <20240124142645.9334-6-john.g.garry@oracle.com>
 <20240202184758.GA6226@frogsfrogsfrogs>
 <e61cf382-66bd-4091-b49c-afbb5ce67d8f@oracle.com>
 <20240213175030.GC6184@frogsfrogsfrogs>
Content-Language: en-US
From: John Garry <john.g.garry@oracle.com>
Organization: Oracle Corporation
In-Reply-To: <20240213175030.GC6184@frogsfrogsfrogs>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: 
	=?utf-8?B?Ujc0NE8zT0UrZ1FqQW5zVWUyZEhkWHhPanRyZStuSkowSUg2R044Vjg2Z3Rq?=
 =?utf-8?B?aE9XZ3pGMGZjUXJVcnNZVmFFWUdXeVl2eUNPQzc3UlAxRVd3NUNzNnBtMExL?=
 =?utf-8?B?SnJuSExremNSd2RQSFJGdVp3TFJDWVRUQXV0U2Z5N0wwbytZUGtiZXlhM1J1?=
 =?utf-8?B?bjh0S0FKSXNGaytMYWkvMHU2RGJUTFQ5QjJDdmJodmk1dzVYNUFyZmpNUDJs?=
 =?utf-8?B?K0FtTTJmVzUva2wvRHFkZUVxSTZUZ0tXVmNNaG9temg3RGtFT0Y3VlhieFY5?=
 =?utf-8?B?WmpqeU44NTRVeG5tajdEazlPbjdwUDZ0N3laRHN4N0p6STlEejNsR3J2Y2kz?=
 =?utf-8?B?Ukc5ejEwQjhHeG13aTBoQVg4V21DaXkvdWx5VFN0NklYaG1RVTNqZE80RjRx?=
 =?utf-8?B?cVRaS2V2eFJLbnRyaGc0QUhwTWE1YzhuTlJxQTk0MWh1TDlkZHBobkpGb1ZO?=
 =?utf-8?B?K3ZLZlpQalN1Y3hzZVBLRmZTNG9jWlg5SkgxMzB5YkZDMktJZG9qVWVHbzUz?=
 =?utf-8?B?cmIzY0M5UTNlTkNlenJMTmZNNFlXNXg5RXZLVmdBelFRS25oUUZtcndoSWZr?=
 =?utf-8?B?OW9ZdWdlOUFCeU5VcGhPRXJzeFJOakV3UzgyQ0hKSDNiS3FsTmd0L1pvRGFF?=
 =?utf-8?B?NXBkWklnM09qRkYzbHlia0lTcGFvN1hmNXBkNnc1TmZoaXBzRU11NnRYaGI5?=
 =?utf-8?B?WHN0RG1JM0RjVExLcnJnak5CNVNzVTAvTGlDNXY1SzFPZlNYMjJjTTNtVytE?=
 =?utf-8?B?NzdPR0ZvdEZ4dWc5T2RJRHlQOVUybENqMnV4dHA1Sks3bGJMQjV3WmRTVzVv?=
 =?utf-8?B?bWxqbEJOd2xDQU1IYVo2ZHNVdmFybnJBRGl4aFpmazlybTlQYUdXaDZCTGlx?=
 =?utf-8?B?NFlEeTkzUkNENEEvYk1Qb3NsNjdTSG51RVNybFZyZTZlZ1IremRJU0F5VmJZ?=
 =?utf-8?B?bzFVU1d2YWN5TGpUUHBNcVJnaVM0UG5xN21WL2RKU1AyNHBtY0pGWW5uVG1Y?=
 =?utf-8?B?ZXJFM216RWhSbHFSRnM0YXdGcVd5Skd6ZlJEdzUzSDRLbUhYQ1laZVo0NzRZ?=
 =?utf-8?B?ZjZLenZ2aUcxZWxJZnJsRm5UajRrWkhPUmQxRjZiYWtBeHJMN25ZOElnait4?=
 =?utf-8?B?U1FLUGEveC9BV3hrSjBSK21oK08xOXJyOVBSbzBPQlgwQ1MwUHdHZkZIQWQ1?=
 =?utf-8?B?Y2t5K2VvQ0VJWWRqTTI3Q1BsT3BpRm8vQ3Q2NTN0QmkrblpxVlRBcGYxeDBL?=
 =?utf-8?B?TGluYllOVFBlaDN4cG1BVjVPelBFM0VWZkp0Nys4blN1Z1lVVmQ3UlZraDBv?=
 =?utf-8?B?aVBIRjl4TjRScGw4aHV2dk82TlMwenBYZFFoT3ArRkUzT3JrYnRienR6OWVS?=
 =?utf-8?B?YWN5TzdsVHRNdkNQN1QwQTlwNmdJTk44aVVvYnZLaGtXV0JnYnNOajBpVElI?=
 =?utf-8?B?SmZRYmpsZUxkYzJwMHpuMit2VkFsME9jeWVFZTFXUmFVeGNBRTN2TnJXTXBK?=
 =?utf-8?B?RXNpdy9GSlc4d255M3I0MkdNZUFkenJ1RTZIVDF0bmFDai9aU09SVWtTL1Zj?=
 =?utf-8?B?V1ErbWR5SmJWZ0FDbW9vRi9PbHU2dDJzSzhTaUFRclZLQ1lFNE0vK01HdVFD?=
 =?utf-8?B?aS9JeVZUemxoTnF5cGdnZXFZaGZyWXBqbExrNU5pUGJiY0RUaDgzNjVrdWcz?=
 =?utf-8?B?T2NGNjlIOUV0ZTUwMjVwZHBNQU5uTFpMV3NqazFhOGc1emlKYWlDMGlxMnpE?=
 =?utf-8?B?b1pHVnU2ZGdVMlN5bGlIOEVPS1VPNjRGa2dRQzgyUFVtL3lkeGJ1WFVNU3NG?=
 =?utf-8?B?OVhTMFN5TStROTJEMkVHN3p3bGZOb1ArR05EUi94elRBZDBxUVhST1o5akIx?=
 =?utf-8?B?djRpcGtpWDQwdEduRFdXKzVQUG8vdEpSY21XNk5SV2lXdkluNVN4VlRDNVZp?=
 =?utf-8?B?RzBLZGt6eUVCOWxJdXRXQjFrb0paV25vdkFIUzJjSlJ2a1dmaDJWS1liNmVt?=
 =?utf-8?B?U2VxWWRSeStzWUFpdHJRejF0cUxWYXIweThZVVg4VHFock9oM0lueXlnZUpT?=
 =?utf-8?B?Z05YdmMrVUVuVFdYR3pwT3IvbmovS05rdDVpNnRYSHlucDBoMEdnd3dmMGhx?=
 =?utf-8?B?Sm1pWjcyaERkUU5HUjRoUmVyLzhKRjJyWE92dzN0YnVtWTUyeGt2RkJNdmln?=
 =?utf-8?B?NUE9PQ==?=
X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: 
	/Fm6WI1A/lkesP0MuK3z63NgXl1BKsqn6K4dK3mG6Vub2PAApRxWgJthoJmS//I3YNPFV+0aIQMUAJMq3osu9c7diUYxPjH+3ss/MhIpV5q6GPiQY1iHTIJrLdt9x9DoyCEI21tSq5MUOT7a3R0Ppp5qoKCUb9JzDoFGNnfQE33a6B8SEmhBwVQuurQ+pOupQfU0IUh3MMosUIkzwzoUw94L8MKLofYZJgWuG593GqC65Rs+X6WScBeNS8JajOywP23BkQmB7a4boWAlgl0DjVpZGgOhB01KMQMvTT1jMVxWGJvm9Nt+hLGLDewBvNpWiJzYQ+7YPooicHXSfekUVkSYIzNsOk8lpJ7uQLK9fREp4HO7j3PI1RE6v41TGRq7QMpLdgi8B6wJ1oarASw6zwL9NabkRSP/oULTXahvOArz/F8E/NDqi9RUz0pegILksYUUYaqEMmLj+cC370XVPXV9JFoii8HOf2BcKAw9Dv2CwCAXzPsSpipIuOLInt/QhlWihMR8gktaI97XiNbYZ6aFkmYKbRrqpq71qwWO/mr51Gu1V1xeC4MQy57WD8MHdeLRff6OO5vE/mpt8D29c+2iJLkD/TNjS3HvBJ6sl18=
X-OriginatorOrg: oracle.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 3489631e-d6ea-41b8-91c6-08dc2d565bf4
X-MS-Exchange-CrossTenant-AuthSource: DM6PR10MB4313.namprd10.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 14 Feb 2024 12:13:31.4924
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: 2lSyFrx3k3JQPPqR+HTRDa4cFHjFO886cXpRQKHioqQslURoTTrTKyZqPtYlz1AkPcrXfoYA4npXD52IdCxAlA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6PR10MB4393
X-Proofpoint-Virus-Version: vendor=baseguard
 engine=ICAP:2.0.272,Aquarius:18.0.1011,Hydra:6.0.619,FMLib:17.11.176.26
 definitions=2024-02-14_04,2024-02-14_01,2023-05-22_02
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 adultscore=0 bulkscore=0
 mlxlogscore=999 malwarescore=0 mlxscore=0 spamscore=0 suspectscore=0
 phishscore=0 classifier=spam adjust=0 reason=mlx scancount=1
 engine=8.12.0-2311290000 definitions=main-2402140096
X-Proofpoint-ORIG-GUID: 7WlmiLv0XSc_W2pl7N3znUSx_YaViRem
X-Proofpoint-GUID: 7WlmiLv0XSc_W2pl7N3znUSx_YaViRem


>>>
>>> Not sure why we care about the file position, it's br_startblock that
>>> gets passed into the bio, not br_startoff.
>>
>> We just want to ensure that the length of the write is valid w.r.t. to the
>> offset within the extent, and br_startoff would be the offset within the
>> aligned extent.
> 
> Yes, I understand what br_startoff is, but this doesn't help me
> understand why this code is necessary.  Let's say you have a device that
> supports untorn writes of 16k in length provided the LBA of the write
> command is also aligned to 16k, and the fs has 4k blocks.
> 
> Userspace issues an 16k untorn write at offset 13k in the file, and gets
> this mapping:
> 
> [startoff: 13k, startblock: 16k, blockcount: 16k]
> 
> Why should this IO be rejected? 

It's rejected as it does not follow the rules.

> The physical space extent satisfies the
> alignment requirements of the underlying device, and the logical file
> space extent does not need aligning at all.

Sure. In this case, we can produce a single BIO and the underlying HW 
may be able to handle this atomically.

The point really is that we want a consistent userspace experience. We 
say that the write 'must' be naturally aligned, not 'should' be.

It's not really useful to the user if sometimes a write passes and 
sometimes it fails by chance of how the extents happen to be laid out.

Furthermore, in this case, what should the user do if this write at 13K 
offset fails as the 16K of data straddles 2x extents? They asked for 16K 
written at offset 13K and they want it done atomically - there is 
nothing which the FS can do to help. If they don't really need 16K 
written atomically, then better just do a regular write, or write 
individual chunks atomically.

Thanks,
John