Received-SPF: pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
From:   Trond Myklebust <trondmy@hammerspace.com>
To:     "chuck.lever@oracle.com" <chuck.lever@oracle.com>
CC:     "linux-nfs@vger.kernel.org" <linux-nfs@vger.kernel.org>
Subject: Re: write_space and software kTLS
Thread-Topic: write_space and software kTLS
Thread-Index: AQHYN+t1B+vqcaPqcEao3l2OCHLB2ay/kR2A
Date:   Tue, 15 Mar 2022 00:06:12 +0000
Message-ID: <378c5635b97c237f869234e24030ac0018b684b3.camel@hammerspace.com>
References: <B7F08FCD-0EC1-4D7E-A560-6ADA281605AE@oracle.com>
In-Reply-To: <B7F08FCD-0EC1-4D7E-A560-6ADA281605AE@oracle.com>
Accept-Language: en-US, en-GB
Content-Language: en-US
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: =?utf-8?B?YVlKZlF3aG5tVTRxeFhsNHZOaG1PeUdtaGppL1VSSjFlQ1liU080bSt1enhp?=
 =?utf-8?B?anF4dlpKQzV5LzhEQjJ0WitjbzlNQzFsVGhLMVZpZ3J0L3FHQ0hVdU14a0xS?=
 =?utf-8?B?ODNyYzRlTk1qYi9PZTU4dkFnNEd5NEEzbVNhVWpoNUUzMElPZGRhbUgzOEdq?=
 =?utf-8?B?UlJ0eVI1RHJIUG1SYUVjSFlnWmE5R3FMdk1GSGpVWWlYcUQyajA5V0Q1b2VT?=
 =?utf-8?B?TW8zNU9XTjdLSVR0Qy9mNkEzRnNMSjdnZ2s0NnlCTGd0MHNTWUEyWXlDc1Vv?=
 =?utf-8?B?MlZuT0VmN3RISG1RYzBPdkdablZZbmdIY0U3TXdnYjh3eWtpK3M0ZHQ3K1lE?=
 =?utf-8?B?ekI2SDVkV2lOMkxMbkJwVW1SWGFQb1dzcXRudzBtRHFQWW9PVjZ6MmdqbDh5?=
 =?utf-8?B?OEVKQnBjcm5Rb3Y3S1FNdnlpMUFVbU91OWRob3hneDNzaVBFZDRobkY5dTI0?=
 =?utf-8?B?U2JZeEVLT21Yakl2Nlg5Y1JpOU1tWFdSTDY4Slc2dWJIZWdMbVUrTU5Xa0cx?=
 =?utf-8?B?Tkg2djVuWXo0L001VlN4V0Z6blFSczhPNkxmKzljcG1WQXRHNzlmMlg1Y0lC?=
 =?utf-8?B?bmNUYXZIaUkyZ21nQ0ltZTJOOUc1WkE4M3QxT296aTY1YndLREpCdHBSUk5H?=
 =?utf-8?B?bjZmS0hzTmpUMEc3bWdzWlVpaUJ1Q3dhemFFRTZOTE9nT2RKUFQwVUNpOXE4?=
 =?utf-8?B?U3M5REo4RG9Dd3NBNnJHVzN5SzRIUjFQRHdPSDJXbm96Zm5MUFR4ZDJwUlBU?=
 =?utf-8?B?bUJZVXM5OC8xU0Urayt1RWZ5TCt3UnB1S0ZMaFUvUVBhdW5nU204c2lOVWZB?=
 =?utf-8?B?R2JhdzVRVmRPK0tVWDl3ZzczVVB1MFZmNzNhV0JrYVVkZzZSOUphdG5OdlNn?=
 =?utf-8?B?cUhlSFRBakJKNVkzc2ZOTzEwenVGRklrSHVBWWQ2cEljR1pDUWs3a2F1T1E3?=
 =?utf-8?B?VUhCcWI0MzVWYXdJVThiUWFKTGdiUkhEejNuLzRRbXdJT1JobzhITkRkcWdp?=
 =?utf-8?B?amNYMHM0QnE3YllWM2diRDhIMVYyeE1LTjhLUStLS2JONXNIMEF6VTlGaEtJ?=
 =?utf-8?B?R0dadFptaW1IN25UOW5PeGR2d0QwRm1XMVIreWw4N1hoaXg3b0pVTzZYRk5x?=
 =?utf-8?B?dnBuYk1rYWtFUFhBdUxVekMyYTBaZER6ajhLUGRZeWc1VGljUFFOdXo2Y3lj?=
 =?utf-8?B?Z2pMN1lGc0FEZVhrOHJBZU84Z0M5czZ4VzZhVGZQR2lRNDcvcFNxZE1wb1E5?=
 =?utf-8?B?TktOK0FHWXhPWWRJUEFTVE1yYlVidGVGMXNuZlhSRmtXY0pDVWV3S2h5a3FD?=
 =?utf-8?B?U0dWK3ZpS2ZDWXNTa3NsQVZaWEY5TWgrZjg4bVdhZ3BNRFBiWW4rNktRdDYw?=
 =?utf-8?B?YzREWEdpdGMvWUFuOGRpM0RvdUU4ME5UcWN6TUt5R0RHTVc2TnNzQTdZd3V3?=
 =?utf-8?B?cloreERNZi9pQUFuUW1MUjNsN0hGWEJZbm1JYVM2UlhnSE5mamVYTFhKZUJO?=
 =?utf-8?B?OFhFcU41NFE3d0RHekNzTnpWTlFvTXNVaG1XTi84ZkRTQ3Fybmw3V1dGVjlX?=
 =?utf-8?B?K3h4bWRaSFpzSUdBbURGMzM3ZE5PZzVDOTJkOGNoVzNTRm1HQTg0TjFoMUNt?=
 =?utf-8?B?SGNhQktIRG03eWcyRFV4dkRUZ2ZVSVNoWHJIN2thRjRaWnZPbDJCSVRwaENV?=
 =?utf-8?B?MWhBRVRUd0N5Uk5YNXlQZlFZVE1zWkRjRlBPOGN2TzhHWmxTUVo3c3VoR0lK?=
 =?utf-8?B?alR6Uy9SMTArV2lBSGhnRzh5UzNDbjMzU2lLM1VoeXJIOHRWWlBLc1dUT2U4?=
 =?utf-8?B?YXpmRE1zT3kyQWZZTzlZd2tMTEpkcHRybjJmUGJ5UTl5cGJza0VXQnZETTdK?=
 =?utf-8?B?MSswWXBDQmxyV0lacld5eHppWkhGMllvUXA0djBidnpRcW95dUtGNGpJS2ZE?=
 =?utf-8?B?dGlMN0EzK1JyT3o2eXlza2R4MFJYN1NndkovRW1yNUs2K3lCYURMVTRKYlB2?=
 =?utf-8?B?dkNUR0JneGpnPT0=?=
Content-Type: text/plain; charset="utf-8"
Content-ID: <9EC39BCA280E294698D578DDD76A1B14@namprd13.prod.outlook.com>
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-OriginatorOrg: hammerspace.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: CH0PR13MB5084.namprd13.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 79293564-c8ef-4b28-6cd3-08da06179de7
X-MS-Exchange-CrossTenant-originalarrivaltime: 15 Mar 2022 00:06:12.8456
 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 0d4fed5c-3a70-46fe-9430-ece41741f59e
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: eK3QNn89FBdGbGq1NiALPmx+cd4Um2v4xeS6Av2x85Q6T/bXZ6tbBYuedTwKYide2pF8fADjl1VQjnn5HFtIfw==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM5PR13MB1500
X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIM_SIGNED,
        DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_NONE,
        RCVD_IN_MSPIKE_H2,SPF_HELO_PASS,SPF_PASS,T_SCC_BODY_TEXT_LINE
        autolearn=ham autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-nfs.vger.kernel.org>
X-Mailing-List: linux-nfs@vger.kernel.org

T24gTW9uLCAyMDIyLTAzLTE0IGF0IDIxOjM1ICswMDAwLCBDaHVjayBMZXZlciBJSUkgd3JvdGU6
DQo+IEhleSBUcm9uZC0NCj4gDQo+IEkndmUgbWFkZSBzb21lIHByb2dyZXNzIGdldHRpbmcgUlBD
LXdpdGgtVExTIHdvcmtpbmcgaW4NCj4gdGhlIExpbnV4IE5GUyBjbGllbnQsIGJ1dCBJIHJlY2Vu
dGx5IGhpdCBhbiBpbnRlcmVzdGluZw0KPiBzbmFnIGFuZCBjb3VsZCB1c2UgYSBsaXR0bGUgYWR2
aWNlLg0KPiANCj4gVGhlIHNvZnR3YXJlIGtUTFMgaW5mcmFzdHJ1Y3R1cmUgdXNlcyBkb190Y3Bf
c2VuZHBhZ2VzKCkNCj4gdW5kZXIgdGhlIGNvdmVycywgYW5kIHRoYXQgZnVuY3Rpb24gaXMgY2xl
YXJpbmcNCj4gU09DS1dRX0FTWU5DX05PU1BBQ0UgZnJvbSB1bmRlciB4c19ub3NwYWNlKCkuIFRo
YXQNCj4gcHJldmVudHMgeHNfcnVuX2Vycm9yX3dvcmtlcigpIGZyb20gd2FraW5nIHVwIHhwcnQt
PnNlbmRpbmcsDQo+IHN0YWxsaW5nIGFuIFJQQyB0cmFuc3BvcnQgd2FpdGluZyBmb3IgbW9yZSBz
b2NrZXQgd3JpdGUNCj4gc3BhY2UuIEknbSBub3Qgc3VyZSBob3cgdG8gYWRkcmVzcyB0aGlzLCBh
bmQgSSdtIGludGVyZXN0ZWQNCj4gaW4geW91ciBvcGluaW9uLg0KPiANCg0KSG93IGlzIGl0IGFj
aGlldmluZyB0aGlzPyBXZSBvbmx5IHNldCBTT0NLV1FfQVNZTkNfTk9TUEFDRSBhZnRlciB0aGUN
CmNhbGwgdG8geHBydF9zb2NrX3NlbmRtc2coKS4NCg0KPiBGb3IgZXhhbXBsZSwgd2h5IGNoZWNr
IHRoYXQgZmxhZyByYXRoZXIgdGhhbiBqdXN0IHdha2luZw0KPiB1cCB4cHJ0LT5zZW5kaW5nIHVu
Y29uZGl0aW9uYWxseT8NCg0KVGhlIHNvY2tldCBjb2RlIGNhbGxzIC0+d3JpdGVfc3BhY2UoKSBp
biBhbGwgc29ydHMgb2Ygc2l0dWF0aW9ucywgc28gd2UNCm5lZWQgdG8gZGlzdGluZ3Vpc2ggYmV0
d2VlbiB0aGUgY2FzZXMgd2hlcmUgd2UgYXJlIGFjdHVhbGx5IHdhaXRpbmcgZm9yDQpidWZmZXIg
bWVtb3J5LCBhbmQgdGhlIHNpdHVhdGlvbnMgd2hlcmUgd2UgYXJlIG5vdC4gT3RoZXJ3aXNlLCB3
ZSdkIGJlDQpjYWxsaW5nIHhzX3J1bl9lcnJvcl93b3JrZXIoKSBhbGwgdGhlIHRpbWUuDQoNCj4g
DQo+IEFsc28ganVzdCBmb3IgbXkgb3duIHVuZGVyc3RhbmRpbmcgb2YgaG93IHRoZSB3cml0ZV9z
cGFjZQ0KPiBtZWNoYW5pc20gaXMgc3VwcG9zZWQgdG8gd29yayBmb3IgUlBDLCBJIGluc3RydW1l
bnRlZCB0aGUNCj4gY29kZSB0aGF0IGJ1bXBzIGFuZCBkZWNyZW1lbnRzIHNrX3dyaXRlX3BlbmRp
bmcsIGFuZCBmb3VuZA0KPiB0aGF0IHVuZGVyIG5vcm1hbCB3b3JrbG9hZHMsIHRoZSB2YWx1ZSBv
ZiB0aGF0IGZpZWxkIGdvZXMNCj4gbmVnYXRpdmUgYW5kIHN0YXlzIHRoZXJlLiBJJ20gbm90IHN1
cmUgdGhhdCdzIGludGVuZGVkLi4uPw0KPiANCg0KSXQgaXMgbm90IGludGVuZGVkLCBuby4gTG9v
a3MgbGlrZSB0aGVyZSBoYXZlIGJlZW4gdmFyaW91cyByZWZhY3RvcmluZ3MNCnRoYXQgaGF2ZSBt
YW5nbGVkIHRoYXQgY29kZS4gRnJvbSB3aGF0IEkgY2FuIHNlZSwgdGhlIHNvY2tldCBjb2RlDQph
c3N1bWVzIHRoYXQgc2tfd3JpdGVfcGVuZGluZyBzaG91bGQgYWx3YXlzIGJlIGJ1bXBlZCB3aXRo
IHRoZQ0Kc29ja19sb2NrKCkgaGVsZC4NCg0KTGV0IG1lIHdyaXRlIGEgZml4IGZvciB0aGF0Li4u
DQoNCg0KLS0gDQpUcm9uZCBNeWtsZWJ1c3QNCkxpbnV4IE5GUyBjbGllbnQgbWFpbnRhaW5lciwg
SGFtbWVyc3BhY2UNCnRyb25kLm15a2xlYnVzdEBoYW1tZXJzcGFjZS5jb20NCg0KDQo=