Return-Path: Received: from us-smtp-delivery-194.mimecast.com ([63.128.21.194]:25550 "EHLO us-smtp-delivery-194.mimecast.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1750828AbdBWD2D (ORCPT ); Wed, 22 Feb 2017 22:28:03 -0500 From: Trond Myklebust To: "chuck.lever@oracle.com" CC: "linux-nfs@vger.kernel.org" Subject: Re: supporting DEVICE_REMOVAL on RPC-over-RDMA transports Date: Thu, 23 Feb 2017 03:25:39 +0000 Message-ID: <1487820335.3577.1.camel@primarydata.com> References: <9EF7BDF7-35DF-4723-A903-54AEC9A9787A@oracle.com> In-Reply-To: <9EF7BDF7-35DF-4723-A903-54AEC9A9787A@oracle.com> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Sender: linux-nfs-owner@vger.kernel.org List-ID: T24gV2VkLCAyMDE3LTAyLTIyIGF0IDE2OjMxIC0wNTAwLCBDaHVjayBMZXZlciB3cm90ZToNCj4g SGV5IFRyb25kLQ0KPiANCj4gVG8gc3VwcG9ydCB0aGUgYWJpbGl0eSB0byB1bmxvYWQgdGhlIHVu ZGVybHlpbmcgUkRNQSBkZXZpY2UncyBrZXJuZWwNCj4gZHJpdmVyIHdoaWxlIE5GUyBtb3VudHMg YXJlIGFjdGl2ZSwgeHBydHJkbWEgbmVlZHMgdGhlIGFiaWxpdHkgdG8NCj4gc3VzcGVuZCBSUEMg c2VuZHMgdGVtcG9yYXJpbHkgd2hpbGUgdGhlIHRyYW5zcG9ydCBoYW5kcyBIVyByZXNvdXJjZXMN Cj4gYmFjayB0byB0aGUgZHJpdmVyLiBPbmNlIHRoZSBkZXZpY2UgZHJpdmVyIGlzIHVubG9hZGVk LCB0aGUgUkRNQQ0KPiB0cmFuc3BvcnQgaXMgbGVmdCBkaXNjb25uZWN0ZWQsIGFuZCBSUENzIHdp bGwgYmUgc3VzcGVuZGVkIG5vcm1hbGx5DQo+IHVudGlsIGEgY29ubmVjdGlvbiBpcyBwb3NzaWJs ZSBhZ2FpbiAoZWcsIGEgbmV3IGRldmljZSBpcyBtYWRlDQo+IGF2YWlsYWJsZSkuDQo+IA0KPiBB IERFVklDRV9SRU1PVkFMIGV2ZW50IGlzIGFuIHVwY2FsbCB0byB4cHJ0cmRtYSB0aGF0IG1heSBz bGVlcC4gVXBvbg0KPiBpdHMgcmV0dXJuLCB0aGUgZGV2aWNlIGRyaXZlciB1bmxvYWRzIGl0c2Vs Zi4gQ3VycmVudGx5IG15IHByb3RvdHlwZQ0KPiBmcmVlcyBhbGwgSFcgcmVzb3VyY2VzIGR1cmlu ZyB0aGUgdXBjYWxsLCBidXQgdGhhdCBkb2Vzbid0IGJsb2NrDQo+IG5ldyBSUENzIGZyb20gdHJ5 aW5nIHRvIHVzZSB0aG9zZSByZXNvdXJjZXMgYXQgdGhlIHNhbWUgdGltZS4NCj4gDQo+IFNlZW1z IGxpa2UgdGhlIG1vc3QgbmF0dXJhbCB3YXkgdG8gdGVtcG9yYXJpbHkgYmxvY2sgc2VuZHMgd291 bGQgYmUNCj4gdG8gZ3JhYiB0aGUgdHJhbnNwb3J0J3Mgd3JpdGUgbG9jaywganVzdCBsaWtlICJj b25uZWN0IiBkb2VzLCB3aGlsZQ0KPiB0aGUgdHJhbnNwb3J0IGlzIGRlYWxpbmcgd2l0aCBERVZJ Q0VfUkVNT1ZBTCwgdGhlbiByZWxlYXNlIGl0IG9uY2UNCj4gYWxsIEhXIHJlc291cmNlcyBoYXZl IGJlZW4gZnJlZWQuDQo+IA0KPiBVbmZvcnR1bmF0ZWx5IGFuIFJQQyB0YXNrIGlzIG5lZWRlZCB0 byBhY3F1aXJlIHRoZSB3cml0ZSBsb2NrLiBCdXQNCj4gZGlzY29ubmVjdCBpcyBqdXN0IGFuIGFz eW5jaHJvbm91cyBldmVudCwgdGhlcmUgaXMgbm8gUlBDIHRhc2sNCj4gYXNzb2NpYXRlZCB3aXRo IGl0LCBhbmQgdGh1cyBubyBjb250ZXh0IHRoYXQgdGhlIFJQQyBzY2hlZHVsZXINCj4gY2FuIHB1 dCB0byBzbGVlcCBpZiB0aGVyZSBoYXBwZW5zIHRvIGJlIGFub3RoZXIgUlBDIHNlbmRpbmcgYXQg dGhlDQo+IG1vbWVudCBhIGRldmljZSByZW1vdmFsIGV2ZW50IG9jY3Vycy4NCj4gDQo+IEkgd2Fz IGxvb2tpbmcgYXQgeHBydF9sb2NrX2Nvbm5lY3QsIGJ1dCB0aGF0IGRvZXNuJ3QgYXBwZWFyIHRv IGRvDQo+IHF1aXRlIHdoYXQgSSBuZWVkLg0KPiANCj4gQW5vdGhlciB0aG91Z2h0IHdhcyB0byBo YXZlIHRoZSBERVZJQ0VfUkVNT1ZBTCB1cGNhbGwgbWFyayB0aGUNCj4gdHJhbnNwb3J0IGRpc2Nv bm5lY3RlZCwgc2VuZCBhbiBhc3luY2hyb25vdXMgTlVMTCBSUEMsIHRoZW4gd2FpdA0KPiBvbiBh IGtlcm5lbCB3YWl0cXVldWUuDQo+IA0KPiBUaGUgTlVMTCBSUEMgd291bGQgZ3JhYiB0aGUgd3Jp dGUgbG9jayBhbmQga2ljayB0aGUgdHJhbnNwb3J0J3MNCj4gY29ubmVjdCB3b3JrZXIuIFRoZSBj b25uZWN0IHdvcmtlciB3b3VsZCBmcmVlIEhXIHJlc291cmNlcywgdGhlbg0KPiBhd2FrZW4gdGhl IHdhaXRlci4gVGhlbiB0aGUgdXBjYWxsIGNvdWxkIHJldHVybiB0byB0aGUgZHJpdmVyLg0KPiAN Cj4gVGhlIHByb2JsZW0gd2l0aCB0aGlzIHNjaGVtZSBpcyB0aGUgc2FtZSBhcyBpdCB3YXMgZm9y IHRoZQ0KPiBrZWVwYWxpdmUgd29yazogdGhlcmUncyBubyB0YXNrIG9yIHJwY19jbG50IGF2YWls YWJsZSB0byB0aGUNCj4gREVWSUNFX1JFTU9WQUwgdXBjYWxsLiBTbGVlcGluZyB1bnRpbCB0aGUg d3JpdGUgbG9jayBpcyBhdmFpbGFibGUNCj4gd291bGQgcmVxdWlyZSBhIHRhc2ssIGFuZCBzZW5k aW5nIGEgTlVMTCBSUEMgd291bGQgcmVxdWlyZSBhbg0KPiBycGNfY2xudC4NCj4gDQo+IEFueSBh ZHZpY2UvdGhvdWdodHMgYWJvdXQgdGhpcz8NCj4gDQoNCkNhbiB5b3UgcGVyaGFwcyB1c2UgWFBS VF9GT1JDRV9ESVNDT05ORUNUPyBUaGF0IGRvZXMgZW5kIHVwIGNhbGxpbmcgdGhlDQp4cHJ0LT5v cHMtPmNsb3NlKCkgY2FsbGJhY2sgYXMgc29vbiBhcyB0aGUgWFBSVF9MT0NLIHN0YXRlIGhhcyBi ZWVuDQpmcmVlZC4gWW91IHN0aWxsIHdvbid0IGhhdmUgYSBjbGllbnQsIGJ1dCB5b3Ugd2lsbCBi ZSBndWFyYW50ZWVkDQpleGNsdXNpdmUgYWNjZXNzIHRvIHRoZSB0cmFuc3BvcnQsIGFuZCB5b3Ug Y2FuIGRvIHRoaW5ncyBsaWtlIHdha2luZyB1cA0KYW55IHNsZWVwaW5nIHRhc2tzIG9uIHRoZSB0 cmFuc21pdCBhbmQgcmVjZWl2ZSBxdWV1ZSB0byBoZWxwIHlvdS4NCkhvd2V2ZXIgeW91IGFsc28g aGF2ZSB0byBkZWFsIHdpdGggdGhlIGNhc2Ugd2hlcmUgdGhlIHRyYW5zcG9ydCB3YXMNCmlkbGUg dG8gc3RhcnQgd2l0aC4NCg0KVGhlIGJpZyBwcm9ibGVtIHRoYXQgeW91IGhhdmUgaGVyZSBpcyB1 bHRpbWF0ZWx5IHRoYXQgdGhlIGxvdyBsZXZlbA0KY29udHJvbCBjaGFubmVsIGZvciB0aGUgdHJh bnNwb3J0IGFwcGVhcnMgdG8gd2FudCB0byB1c2UgdGhlIFJQQyB1cHBlcg0KbGF5ZXIgZnVuY3Rp b25hbGl0eSBmb3IgaXRzIGNvbW11bmljYXRpb24gbWVjaGFuaXNtLiBBRkFJQ1MgeW91IHdpbGwN CmtlZXAgaGl0dGluZyBpc3N1ZXMgYXMgdGhlIGNvbnRyb2wgY2hhbm5lbCBuZWVkcyB0byBjaXJj dW12ZW50IGFsbCB0aGUNCnF1ZXVlaW5nIGV0YyB0aGF0IHRoZXNlIHVwcGVyIGxheWVycyBhcmUg ZGVzaWduZWQgdG8gZW5mb3JjZS4NCkdpdmVuIHRoYXQgdGhlc2UgbWVzc2FnZXMgeW91J3JlIHNl bmRpbmcgYXJlIGp1c3QgbnVsbCBwaW5ncyB3aXRoIG5vDQpwYXlsb2FkIGFuZCBubyBzcGVjaWFs IGF1dGhlbnRpY2F0aW9uIG5lZWRzIG9yIGFueXRoaW5nIGVsc2UsIG1pZ2h0IGl0DQptYWtlIHNl bnNlIHRvIGp1c3QgZ2VuZXJhdGUgdGhlbSBpbiB0aGUgUkRNQSBsYXllciBpdHNlbGY/DQoNCi0t IA0KVHJvbmQgTXlrbGVidXN0DQpMaW51eCBORlMgY2xpZW50IG1haW50YWluZXIsIFByaW1hcnlE YXRhDQp0cm9uZC5teWtsZWJ1c3RAcHJpbWFyeWRhdGEuY29tDQo=