From: Trond Myklebust <trondmy@primarydata.com>
To: "jlayton@poochiereds.net" <jlayton@poochiereds.net>,
        "neilb@suse.com" <neilb@suse.com>,
        "linux-nfs@vger.kernel.org" <linux-nfs@vger.kernel.org>
CC: "hch@infradead.org" <hch@infradead.org>
Subject: Re: Confused by pnfs LAYOUTRETURN - seeking clarity.
Date: Tue, 7 Mar 2017 00:48:22 +0000
Message-ID: <1488847700.2913.1.camel@primarydata.com>
References: <87shmvnzh7.fsf@notabene.neil.brown.name>
         <1488569105.2997.1.camel@poochiereds.net>
         <87r32bjbzq.fsf@notabene.neil.brown.name>
In-Reply-To: <87r32bjbzq.fsf@notabene.neil.brown.name>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Sender: linux-nfs-owner@vger.kernel.org

SGkgTmVpbCwNCg0KT24gTW9uLCAyMDE3LTAzLTA2IGF0IDE0OjU0ICsxMTAwLCBOZWlsQnJvd24g
d3JvdGU6DQo+IE9uIEZyaSwgTWFyIDAzIDIwMTcsIEplZmYgTGF5dG9uIHdyb3RlOg0KPiANCj4g
PiANCj4gPiBUaGVyZSBpcyBvbmUgc3BlY2lhbCBjYXNlLi4uDQo+ID4gDQo+ID4gV2hlbiB0aGUg
c2VydmVyIGRvZXMgYSBDQl9MQVlPVVRSRUNBTEwsIHRoZSBjbGllbnQgY2FuIHJlcGx5IHdpdGgN
Cj4gPiBORlM0RVJSX05PTUFUQ0hJTkdfTEFZT1VUIGlmIGl0J3Mgbm90IGFjdGl2ZWx5IHVzaW5n
IHRoZSBsYXlvdXQgYXQNCj4gPiB0aGUNCj4gPiB0aW1lLiBXaXRoIHRoYXQsIHRoZSBjbGllbnQg
aXNuJ3QgZXhwZWN0ZWQgdG8gZG8gYSBMQVlPVVRSRVRVUk4uDQo+ID4gDQo+ID4gQW55IG90aGVy
IHN0YXR1cyBvbiB0aGUgQ0JfTEFZT1VUUkVDQUxMIGhvd2V2ZXIgZG9lcyByZXF1aXJlIGENCj4g
PiBMQVlPVVRSRVRVUk4uDQo+IA0KPiBUaGFua3MsIGJvdGggdG8geW91IGFuZCBDaHJpc3RvcGgs
IGZvciB0aGlzIHBvaW50ZXIuDQo+IFRoaW5ncyBhcmUgc3RhcnRpbmcgdG8gbWFrZSBzZW5zZS4N
Cj4gDQo+IEhvd2V2ZXIgUkZDNTY2MSBzYXlzIHVuZGVyDQo+IMKgwqDCoE9wZXJhdGlvbiA1OiBD
Ql9MQVlPVVRSRUNBTEwgLSBSZWNhbGwgTGF5b3V0IGZyb20gQ2xpZW50DQo+IA0KPiDCoMKgwqBX
aGlsZSB0aGUgY2xpZW50IHJlc3BvbmRzIHRvIHRoZSBDQl9MQVlPVVRSRUNBTEwgaW1tZWRpYXRl
bHksIHRoZQ0KPiDCoMKgwqBvcGVyYXRpb24gaXMgbm90IGNvbnNpZGVyZWQgY29tcGxldGUgKGku
ZS4sIGNvbnNpZGVyZWQgcGVuZGluZykNCj4gdW50aWwNCj4gwqDCoMKgYWxsIGFmZmVjdGVkIGxh
eW91dHMgYXJlIHJldHVybmVkIHRvIHRoZSBzZXJ2ZXIgdmlhIHRoZQ0KPiBMQVlPVVRSRVRVUk4N
Cj4gwqDCoMKgb3BlcmF0aW9uLg0KPiANCj4gd2hpY2ggc2VlbXMgdG8gc3Ryb25nbHkgaW1wbHkg
dGhhdCBhIExBWU9VVFJFVFVSTiBpcyBleHBlY3RlZC7CoMKgTm8NCj4gYWx0ZXJuYXRpdmUgaXMg
bGlzdGVkLg0KPiANCj4gRnVydGhlcjoNCj4gDQo+IMKgwqDCoMKgVGhlIE5GUzRFUlJfTk9NQVRD
SElOR19MQVlPVVQgZXJyb3IgaXMgb25seSByZXR1cm5lZCB3aGVuIHRoZQ0KPiBjbGllbnQNCj4g
wqDCoMKgwqBkb2VzIG5vdCBob2xkIGxheW91dHMgZm9yIHRoZSBmaWxlIG9yIGlmIHRoZSBjbGll
bnQgZG9lcyBub3QgaGF2ZQ0KPiDCoMKgwqDCoGFueSBvdmVybGFwcGluZyBsYXlvdXRzIGZvciB0
aGUgc3BlY2lmaWNhdGlvbiBpbiB0aGUgbGF5b3V0DQo+IHJlY2FsbC4NCj4gDQo+IFRoaXMgaXMg
YW4gKmVycm9yKiBjb25kaXRpb24uwqDCoMKgVGhlIGNsaWVudCByZWFsbHkgZG9lcyBzdGlsbCBo
b2xkDQo+IHRoZSBsYXlvdXRzIGlmIGl0IGhhc24ndCBzZW50ICJMQVlPVVRSRVRVUk4iLsKgwqBU
aGUgZmFjdCB0aGF0IHRoZQ0KPiBsaW51eA0KPiBjbGllbnQgY2hvb3NlcyB0byBmb3JnZXQgdGhl
bSBhbmQgd29uJ3QgZXZlciB1c2UgdGhlbSBhZ2FpbiBpc24ndA0KPiByZWFsbHkNCj4gdGhlIHNh
bWUgdGhpbmcgYXMgIm5vdCBob2xkW2luZ10gbGF5b3V0cyIuDQo+IA0KPiBJZiBJIHdlcmUgYSBz
ZXJ2ZXIgYXV0aG9yIGFuZCBJIGdvdCBORlM0RVJSX05PTUFUQ0hJTkdfTEFZT1VUIGZvciBhDQo+
IENCX0xBWU9VVFJFQ0FMTCB3aGVyZSBhIEkga25ldyBmb3IgY2VydGFpbiB0aGF0IHRoZSBjbGll
bnQgcmVhbGx5IGRpZA0KPiBoYXZlIHRoZSBsYXlvdXQsIHRoZW4gSSB3b3VsZCBwcm9iYWJseSBm
ZWVsIGp1c3RpZmllZCBpbiBkaXNjYXJkaW5nDQo+IGFsbA0KPiBzdGF0ZSBoZWxkIGJ5IHRoYXQg
Y29uZnVzZWQgY2xpZW50LCBhbmQgcmVxdWlyaW5nIHRvIHJlLWVzdGFibGlzaA0KPiBldmVyeXRo
aW5nIChiZWNhdXNlIEkgY2Fubm90IHRydXN0IGFueXRoaW5nIGFueSBtb3JlKS4NCj4gDQo+IFNv
IHRoZSBOZXRhcHAgZmlsZXIgaXMgY2xlYXJseSBkb2luZyB0aGUgd3JvbmcgdGhpbmcsIGFzIHdl
IGRvZXNuJ3QNCj4gc2VuZA0KPiBDQl9MQVlPVVRSRUNBTEwuwqDCoEJ1dCBJJ20gZmFyIGZyb20g
Y29udmluY2VkIHRoYXQgTGludXggaXMgZG9pbmcgdGhlDQo+IHJpZ2h0IHRoaW5nIGJ5IHJlcGx5
aW5nIE5GUzRFUlJfTk9NQVRDSElOR19MQVlPVVQuDQo+IA0KPiBIb3dldmVyLCBJJ20gbm90IGdv
aW5nIHRvIHRyeSB0byAiZml4IiBhbnl0aGluZyBoZXJlLsKgwqBIb3BlZnVsbHkgd2UNCj4gY2Fu
DQo+IG1hbmFnZSB0byBzdHVtYmxlIGZvcndhcmQuDQo+IA0KDQpQbGVhc2Ugc2VlIFJGQzU2NjEs
IFNlY3Rpb24gMTIuNS41LjEgaHR0cHM6Ly90b29scy5pZXRmLm9yZy9odG1sL3JmYzU2Ng0KMSNz
ZWN0aW9uLTEyLjUuNS4xDQoNClRoYXQgc2VjdGlvbiBoYXMgYSBmdWxsIGRvY3VtZW50YXRpb24g
b2Ygd2hhdCB0aGUgc2VydmVyIHNob3VsZA0KaW50ZXJwcmV0IE5GUzRFUlJfTk9NQVRDSElOR19M
QVlPVVQgdG8gbWVhbiwgYW5kIHNob3VsZCBleHBsYWluIHdoeSB0aGUNCkxpbnV4IGNsaWVudCBi
ZWhhdmlvdXIgaXMgcXVpdGUgY29ycmVjdCB3LnIudC4gdGhlIHNwZWMuDQpUaGVyZSBhcmUgYSBj
b3VwbGUgb2YgZXJyYXRhIHRvIGNvbnNpZGVyIHRvbywgYnV0IHRoZXkgbWFpbmx5IHRyeSB0bw0K
bmFpbCBkb3duIHRoZSBleHBlY3RlZCBiZWhhdmlvdXIgZm9yIGEgY291cGxlIG9mIGNvcm5lciBj
YXNlcy4NCg0KLS0gDQpUcm9uZCBNeWtsZWJ1c3QNCkxpbnV4IE5GUyBjbGllbnQgbWFpbnRhaW5l
ciwgUHJpbWFyeURhdGENCnRyb25kLm15a2xlYnVzdEBwcmltYXJ5ZGF0YS5jb20NCg==