Hi,
It's quite some time without kernel panic reports from me ....
Observer on MDS and DS shutdown during IO.
This is with 3.5.0-2.fc17.x86_64 kernel. Line in code:
nfs4proc.c:6252 : BUG_ON(!list_empty(&lo->plh_segs));
Server : dcache
Regards,
Tigran.
T24gV2VkLCAyMDEyLTA4LTA4IGF0IDEzOjUxIC0wNDAwLCBGcmVkIElzYW1hbiB3cm90ZToNCj4g
T24gV2VkLCBBdWcgOCwgMjAxMiBhdCAxOjM0IFBNLCBNeWtsZWJ1c3QsIFRyb25kDQo+IDxUcm9u
ZC5NeWtsZWJ1c3RAbmV0YXBwLmNvbT4gd3JvdGU6DQo+ID4gT24gV2VkLCAyMDEyLTA4LTA4IGF0
IDE4OjQ4ICswMjAwLCBUaWdyYW4gTWtydGNoeWFuIHdyb3RlOg0KPiA+PiBIaSwNCj4gPj4NCj4g
Pj4gSXQncyBxdWl0ZSBzb21lIHRpbWUgd2l0aG91dCBrZXJuZWwgcGFuaWMgcmVwb3J0cyBmcm9t
IG1lIC4uLi4NCj4gPj4NCj4gPj4gT2JzZXJ2ZXIgb24gTURTIGFuZCBEUyBzaHV0ZG93biBkdXJp
bmcgSU8uDQo+ID4+DQo+ID4+IFRoaXMgaXMgd2l0aCAgMy41LjAtMi5mYzE3Lng4Nl82NCBrZXJu
ZWwuIExpbmUgaW4gY29kZToNCj4gPj4NCj4gPj4gbmZzNHByb2MuYzo2MjUyIDogICBCVUdfT04o
IWxpc3RfZW1wdHkoJmxvLT5wbGhfc2VncykpOw0KPiA+Pg0KPiA+DQo+ID4gSWYgdGhlIHNlcnZl
ciBkb2Vzbid0IHJldHVybiBhIHN0YXRlaWQsIHRoZW4gdGhhdCBpcyBzdXBwb3NlZCB0bw0KPiA+
IGluZGljYXRlIHRoYXQgaXQgdGhpbmtzIHRoYXQgaXQgZG9lc24ndCBob2xkIGFueSBtb3JlIGxh
eW91dCBzZWdtZW50cw0KPiA+IGZvciB0aGlzIGZpbGUuDQo+ID4gVG8gbWUsIHRoYXQgaW5kaWNh
dGVzIHRoYXQgd2Ugc2hvdWxkIGJlIGNhbGxpbmcNCj4gPiBtYXJrX21hdGNoaW5nX2xzZWdzX2lu
dmFsaWQoKSByYXRoZXIgdGhhbiBPb3BzaW5nLg0KPiA+DQo+ID4gQW55IGRpc3NlbnRpbmcgdm9p
Y2VzIGZyb20gdGhlIHBORlMgY3Jvd2Q/DQo+ID4NCj4gDQo+IEJ1dCB0aGlzIGltcGxpZXMgdGhh
dCB0aGUgY2xpZW50IHRoaW5rcyBpdCBoYXMgYSBsYXlvdXQgd2hpY2ggdGhlDQo+IHNlcnZlciBk
b2VzIG5vdCBiZWxpZXZlIGl0IGhhcywgd2hpY2ggc2VlbXMgdG8gbWUgdG8gaW1wbHkgYW4gZWFy
bGllcg0KPiBidWcuICBJZiB5b3UgY2hhbmdlIHRvIG1hcmtfbWF0Y2hpbmdfbHNlZ3NfaW52YWxp
ZCwgSSB3b3VsZCBzdWdnZXN0DQo+IGtlZXBpbmcgYSBXQVJOX09OLg0KDQpXZSBjb3VsZCBwb3Nz
aWJseSBhZGQgYSBwcmludGssIGJ1dCBJIGRvbid0IHNlZSB3aGF0IHZhbHVlIGEgV0FSTl9PTg0K
d291bGQgaGF2ZSBoZXJlOiBob3cgaXMgYSBzdGFjayBkdW1wIGdvaW5nIHRvIGJlIHVzZWZ1bCBp
biBkZWJ1Z2dpbmcNCnRoaXMgaXNzdWU/DQoNCkFsc28sIGRvbid0IHdlIHNvbWV0aW1lcyBleHBl
Y3QgdGhpcyBzb3J0IG9mIHRoaW5nIHRvIGhhcHBlbiBvbg0Kb2NjYXNpb24/IFdoYXQgaWYgb3Vy
IGxheW91dHJldHVybiBlbmRzIHVwIHJhY2luZyB3aXRoIHRoZSBsYXlvdXQgcmVjYWxsDQpmb2xs
b3dpbmcgYSBEUyBzaHV0ZG93bj8NCg0KLS0gDQpUcm9uZCBNeWtsZWJ1c3QNCkxpbnV4IE5GUyBj
bGllbnQgbWFpbnRhaW5lcg0KDQpOZXRBcHANClRyb25kLk15a2xlYnVzdEBuZXRhcHAuY29tDQp3
d3cubmV0YXBwLmNvbQ0KDQo=
On Wed, Aug 8, 2012 at 1:34 PM, Myklebust, Trond
<[email protected]> wrote:
> On Wed, 2012-08-08 at 18:48 +0200, Tigran Mkrtchyan wrote:
>> Hi,
>>
>> It's quite some time without kernel panic reports from me ....
>>
>> Observer on MDS and DS shutdown during IO.
>>
>> This is with 3.5.0-2.fc17.x86_64 kernel. Line in code:
>>
>> nfs4proc.c:6252 : BUG_ON(!list_empty(&lo->plh_segs));
>>
>
> If the server doesn't return a stateid, then that is supposed to
> indicate that it thinks that it doesn't hold any more layout segments
> for this file.
> To me, that indicates that we should be calling
> mark_matching_lsegs_invalid() rather than Oopsing.
>
> Any dissenting voices from the pNFS crowd?
>
But this implies that the client thinks it has a layout which the
server does not believe it has, which seems to me to imply an earlier
bug. If you change to mark_matching_lsegs_invalid, I would suggest
keeping a WARN_ON.
Fred
On Wed, Aug 8, 2012 at 2:33 PM, Myklebust, Trond
<[email protected]> wrote:
> On Wed, 2012-08-08 at 14:15 -0400, Fred Isaman wrote:
>> On Wed, Aug 8, 2012 at 2:03 PM, Myklebust, Trond
>> <[email protected]> wrote:
>> > On Wed, 2012-08-08 at 13:51 -0400, Fred Isaman wrote:
>> >> On Wed, Aug 8, 2012 at 1:34 PM, Myklebust, Trond
>> >> <[email protected]> wrote:
>> >> > On Wed, 2012-08-08 at 18:48 +0200, Tigran Mkrtchyan wrote:
>> >> >> Hi,
>> >> >>
>> >> >> It's quite some time without kernel panic reports from me ....
>> >> >>
>> >> >> Observer on MDS and DS shutdown during IO.
>> >> >>
>> >> >> This is with 3.5.0-2.fc17.x86_64 kernel. Line in code:
>> >> >>
>> >> >> nfs4proc.c:6252 : BUG_ON(!list_empty(&lo->plh_segs));
>> >> >>
>> >> >
>> >> > If the server doesn't return a stateid, then that is supposed to
>> >> > indicate that it thinks that it doesn't hold any more layout segments
>> >> > for this file.
>> >> > To me, that indicates that we should be calling
>> >> > mark_matching_lsegs_invalid() rather than Oopsing.
>> >> >
>> >> > Any dissenting voices from the pNFS crowd?
>> >> >
>> >>
>> >> But this implies that the client thinks it has a layout which the
>> >> server does not believe it has, which seems to me to imply an earlier
>> >> bug. If you change to mark_matching_lsegs_invalid, I would suggest
>> >> keeping a WARN_ON.
>> >
>> > We could possibly add a printk, but I don't see what value a WARN_ON
>> > would have here: how is a stack dump going to be useful in debugging
>> > this issue?
>> >
>> > Also, don't we sometimes expect this sort of thing to happen on
>> > occasion? What if our layoutreturn ends up racing with the layout recall
>> > following a DS shutdown?
>> >
>>
>> Actually, I forgot about the whole LAYUTRETURN as fencing possibility.
>> In that case, you can pretty easily hit the BUG_ON. Though I claim
>> that, while calling mark_matching_lsegs_invalid doesn't hurt, it
>> should be unnecessary.
>
> Right... So maybe just a dprintk() for debugging purposes?
>
> BTW: Why shouldn't we do the mark_matching_lsegs_invalid? If not, then
> we will need either to do an extra layoutreturn or fail a read/write
> attempt to the DS in order to figure out that the stateid is now
> invalid.
>
They should have already been marked as invalid, and are just waiting
on io to finish for release.
Fred
On Wed, Aug 8, 2012 at 2:03 PM, Myklebust, Trond
<[email protected]> wrote:
> On Wed, 2012-08-08 at 13:51 -0400, Fred Isaman wrote:
>> On Wed, Aug 8, 2012 at 1:34 PM, Myklebust, Trond
>> <[email protected]> wrote:
>> > On Wed, 2012-08-08 at 18:48 +0200, Tigran Mkrtchyan wrote:
>> >> Hi,
>> >>
>> >> It's quite some time without kernel panic reports from me ....
>> >>
>> >> Observer on MDS and DS shutdown during IO.
>> >>
>> >> This is with 3.5.0-2.fc17.x86_64 kernel. Line in code:
>> >>
>> >> nfs4proc.c:6252 : BUG_ON(!list_empty(&lo->plh_segs));
>> >>
>> >
>> > If the server doesn't return a stateid, then that is supposed to
>> > indicate that it thinks that it doesn't hold any more layout segments
>> > for this file.
>> > To me, that indicates that we should be calling
>> > mark_matching_lsegs_invalid() rather than Oopsing.
>> >
>> > Any dissenting voices from the pNFS crowd?
>> >
>>
>> But this implies that the client thinks it has a layout which the
>> server does not believe it has, which seems to me to imply an earlier
>> bug. If you change to mark_matching_lsegs_invalid, I would suggest
>> keeping a WARN_ON.
>
> We could possibly add a printk, but I don't see what value a WARN_ON
> would have here: how is a stack dump going to be useful in debugging
> this issue?
>
> Also, don't we sometimes expect this sort of thing to happen on
> occasion? What if our layoutreturn ends up racing with the layout recall
> following a DS shutdown?
>
Actually, I forgot about the whole LAYUTRETURN as fencing possibility.
In that case, you can pretty easily hit the BUG_ON. Though I claim
that, while calling mark_matching_lsegs_invalid doesn't hurt, it
should be unnecessary.
Fred
T24gV2VkLCAyMDEyLTA4LTA4IGF0IDE0OjE1IC0wNDAwLCBGcmVkIElzYW1hbiB3cm90ZToNCj4g
T24gV2VkLCBBdWcgOCwgMjAxMiBhdCAyOjAzIFBNLCBNeWtsZWJ1c3QsIFRyb25kDQo+IDxUcm9u
ZC5NeWtsZWJ1c3RAbmV0YXBwLmNvbT4gd3JvdGU6DQo+ID4gT24gV2VkLCAyMDEyLTA4LTA4IGF0
IDEzOjUxIC0wNDAwLCBGcmVkIElzYW1hbiB3cm90ZToNCj4gPj4gT24gV2VkLCBBdWcgOCwgMjAx
MiBhdCAxOjM0IFBNLCBNeWtsZWJ1c3QsIFRyb25kDQo+ID4+IDxUcm9uZC5NeWtsZWJ1c3RAbmV0
YXBwLmNvbT4gd3JvdGU6DQo+ID4+ID4gT24gV2VkLCAyMDEyLTA4LTA4IGF0IDE4OjQ4ICswMjAw
LCBUaWdyYW4gTWtydGNoeWFuIHdyb3RlOg0KPiA+PiA+PiBIaSwNCj4gPj4gPj4NCj4gPj4gPj4g
SXQncyBxdWl0ZSBzb21lIHRpbWUgd2l0aG91dCBrZXJuZWwgcGFuaWMgcmVwb3J0cyBmcm9tIG1l
IC4uLi4NCj4gPj4gPj4NCj4gPj4gPj4gT2JzZXJ2ZXIgb24gTURTIGFuZCBEUyBzaHV0ZG93biBk
dXJpbmcgSU8uDQo+ID4+ID4+DQo+ID4+ID4+IFRoaXMgaXMgd2l0aCAgMy41LjAtMi5mYzE3Lng4
Nl82NCBrZXJuZWwuIExpbmUgaW4gY29kZToNCj4gPj4gPj4NCj4gPj4gPj4gbmZzNHByb2MuYzo2
MjUyIDogICBCVUdfT04oIWxpc3RfZW1wdHkoJmxvLT5wbGhfc2VncykpOw0KPiA+PiA+Pg0KPiA+
PiA+DQo+ID4+ID4gSWYgdGhlIHNlcnZlciBkb2Vzbid0IHJldHVybiBhIHN0YXRlaWQsIHRoZW4g
dGhhdCBpcyBzdXBwb3NlZCB0bw0KPiA+PiA+IGluZGljYXRlIHRoYXQgaXQgdGhpbmtzIHRoYXQg
aXQgZG9lc24ndCBob2xkIGFueSBtb3JlIGxheW91dCBzZWdtZW50cw0KPiA+PiA+IGZvciB0aGlz
IGZpbGUuDQo+ID4+ID4gVG8gbWUsIHRoYXQgaW5kaWNhdGVzIHRoYXQgd2Ugc2hvdWxkIGJlIGNh
bGxpbmcNCj4gPj4gPiBtYXJrX21hdGNoaW5nX2xzZWdzX2ludmFsaWQoKSByYXRoZXIgdGhhbiBP
b3BzaW5nLg0KPiA+PiA+DQo+ID4+ID4gQW55IGRpc3NlbnRpbmcgdm9pY2VzIGZyb20gdGhlIHBO
RlMgY3Jvd2Q/DQo+ID4+ID4NCj4gPj4NCj4gPj4gQnV0IHRoaXMgaW1wbGllcyB0aGF0IHRoZSBj
bGllbnQgdGhpbmtzIGl0IGhhcyBhIGxheW91dCB3aGljaCB0aGUNCj4gPj4gc2VydmVyIGRvZXMg
bm90IGJlbGlldmUgaXQgaGFzLCB3aGljaCBzZWVtcyB0byBtZSB0byBpbXBseSBhbiBlYXJsaWVy
DQo+ID4+IGJ1Zy4gIElmIHlvdSBjaGFuZ2UgdG8gbWFya19tYXRjaGluZ19sc2Vnc19pbnZhbGlk
LCBJIHdvdWxkIHN1Z2dlc3QNCj4gPj4ga2VlcGluZyBhIFdBUk5fT04uDQo+ID4NCj4gPiBXZSBj
b3VsZCBwb3NzaWJseSBhZGQgYSBwcmludGssIGJ1dCBJIGRvbid0IHNlZSB3aGF0IHZhbHVlIGEg
V0FSTl9PTg0KPiA+IHdvdWxkIGhhdmUgaGVyZTogaG93IGlzIGEgc3RhY2sgZHVtcCBnb2luZyB0
byBiZSB1c2VmdWwgaW4gZGVidWdnaW5nDQo+ID4gdGhpcyBpc3N1ZT8NCj4gPg0KPiA+IEFsc28s
IGRvbid0IHdlIHNvbWV0aW1lcyBleHBlY3QgdGhpcyBzb3J0IG9mIHRoaW5nIHRvIGhhcHBlbiBv
bg0KPiA+IG9jY2FzaW9uPyBXaGF0IGlmIG91ciBsYXlvdXRyZXR1cm4gZW5kcyB1cCByYWNpbmcg
d2l0aCB0aGUgbGF5b3V0IHJlY2FsbA0KPiA+IGZvbGxvd2luZyBhIERTIHNodXRkb3duPw0KPiA+
DQo+IA0KPiBBY3R1YWxseSwgSSBmb3Jnb3QgYWJvdXQgdGhlIHdob2xlIExBWVVUUkVUVVJOIGFz
IGZlbmNpbmcgcG9zc2liaWxpdHkuDQo+ICBJbiB0aGF0IGNhc2UsIHlvdSBjYW4gcHJldHR5IGVh
c2lseSBoaXQgdGhlIEJVR19PTi4gIFRob3VnaCBJIGNsYWltDQo+IHRoYXQsIHdoaWxlIGNhbGxp
bmcgbWFya19tYXRjaGluZ19sc2Vnc19pbnZhbGlkIGRvZXNuJ3QgaHVydCwgaXQNCj4gc2hvdWxk
IGJlIHVubmVjZXNzYXJ5Lg0KDQpSaWdodC4uLiBTbyBtYXliZSBqdXN0IGEgZHByaW50aygpIGZv
ciBkZWJ1Z2dpbmcgcHVycG9zZXM/DQoNCkJUVzogV2h5IHNob3VsZG4ndCB3ZSBkbyB0aGUgbWFy
a19tYXRjaGluZ19sc2Vnc19pbnZhbGlkPyBJZiBub3QsIHRoZW4NCndlIHdpbGwgbmVlZCBlaXRo
ZXIgdG8gZG8gYW4gZXh0cmEgbGF5b3V0cmV0dXJuIG9yIGZhaWwgYSByZWFkL3dyaXRlDQphdHRl
bXB0IHRvIHRoZSBEUyBpbiBvcmRlciB0byBmaWd1cmUgb3V0IHRoYXQgdGhlIHN0YXRlaWQgaXMg
bm93DQppbnZhbGlkLg0KDQotLSANClRyb25kIE15a2xlYnVzdA0KTGludXggTkZTIGNsaWVudCBt
YWludGFpbmVyDQoNCk5ldEFwcA0KVHJvbmQuTXlrbGVidXN0QG5ldGFwcC5jb20NCnd3dy5uZXRh
cHAuY29tDQoNCg==
T24gV2VkLCAyMDEyLTA4LTA4IGF0IDE1OjQ1IC0wNDAwLCBGcmVkIElzYW1hbiB3cm90ZToNCj4g
T24gV2VkLCBBdWcgOCwgMjAxMiBhdCAyOjMzIFBNLCBNeWtsZWJ1c3QsIFRyb25kDQo+IDxUcm9u
ZC5NeWtsZWJ1c3RAbmV0YXBwLmNvbT4gd3JvdGU6DQo+ID4gT24gV2VkLCAyMDEyLTA4LTA4IGF0
IDE0OjE1IC0wNDAwLCBGcmVkIElzYW1hbiB3cm90ZToNCj4gPj4gT24gV2VkLCBBdWcgOCwgMjAx
MiBhdCAyOjAzIFBNLCBNeWtsZWJ1c3QsIFRyb25kDQo+ID4+IDxUcm9uZC5NeWtsZWJ1c3RAbmV0
YXBwLmNvbT4gd3JvdGU6DQo+ID4+ID4gT24gV2VkLCAyMDEyLTA4LTA4IGF0IDEzOjUxIC0wNDAw
LCBGcmVkIElzYW1hbiB3cm90ZToNCj4gPj4gPj4gT24gV2VkLCBBdWcgOCwgMjAxMiBhdCAxOjM0
IFBNLCBNeWtsZWJ1c3QsIFRyb25kDQo+ID4+ID4+IDxUcm9uZC5NeWtsZWJ1c3RAbmV0YXBwLmNv
bT4gd3JvdGU6DQo+ID4+ID4+ID4gT24gV2VkLCAyMDEyLTA4LTA4IGF0IDE4OjQ4ICswMjAwLCBU
aWdyYW4gTWtydGNoeWFuIHdyb3RlOg0KPiA+PiA+PiA+PiBIaSwNCj4gPj4gPj4gPj4NCj4gPj4g
Pj4gPj4gSXQncyBxdWl0ZSBzb21lIHRpbWUgd2l0aG91dCBrZXJuZWwgcGFuaWMgcmVwb3J0cyBm
cm9tIG1lIC4uLi4NCj4gPj4gPj4gPj4NCj4gPj4gPj4gPj4gT2JzZXJ2ZXIgb24gTURTIGFuZCBE
UyBzaHV0ZG93biBkdXJpbmcgSU8uDQo+ID4+ID4+ID4+DQo+ID4+ID4+ID4+IFRoaXMgaXMgd2l0
aCAgMy41LjAtMi5mYzE3Lng4Nl82NCBrZXJuZWwuIExpbmUgaW4gY29kZToNCj4gPj4gPj4gPj4N
Cj4gPj4gPj4gPj4gbmZzNHByb2MuYzo2MjUyIDogICBCVUdfT04oIWxpc3RfZW1wdHkoJmxvLT5w
bGhfc2VncykpOw0KPiA+PiA+PiA+Pg0KPiA+PiA+PiA+DQo+ID4+ID4+ID4gSWYgdGhlIHNlcnZl
ciBkb2Vzbid0IHJldHVybiBhIHN0YXRlaWQsIHRoZW4gdGhhdCBpcyBzdXBwb3NlZCB0bw0KPiA+
PiA+PiA+IGluZGljYXRlIHRoYXQgaXQgdGhpbmtzIHRoYXQgaXQgZG9lc24ndCBob2xkIGFueSBt
b3JlIGxheW91dCBzZWdtZW50cw0KPiA+PiA+PiA+IGZvciB0aGlzIGZpbGUuDQo+ID4+ID4+ID4g
VG8gbWUsIHRoYXQgaW5kaWNhdGVzIHRoYXQgd2Ugc2hvdWxkIGJlIGNhbGxpbmcNCj4gPj4gPj4g
PiBtYXJrX21hdGNoaW5nX2xzZWdzX2ludmFsaWQoKSByYXRoZXIgdGhhbiBPb3BzaW5nLg0KPiA+
PiA+PiA+DQo+ID4+ID4+ID4gQW55IGRpc3NlbnRpbmcgdm9pY2VzIGZyb20gdGhlIHBORlMgY3Jv
d2Q/DQo+ID4+ID4+ID4NCj4gPj4gPj4NCj4gPj4gPj4gQnV0IHRoaXMgaW1wbGllcyB0aGF0IHRo
ZSBjbGllbnQgdGhpbmtzIGl0IGhhcyBhIGxheW91dCB3aGljaCB0aGUNCj4gPj4gPj4gc2VydmVy
IGRvZXMgbm90IGJlbGlldmUgaXQgaGFzLCB3aGljaCBzZWVtcyB0byBtZSB0byBpbXBseSBhbiBl
YXJsaWVyDQo+ID4+ID4+IGJ1Zy4gIElmIHlvdSBjaGFuZ2UgdG8gbWFya19tYXRjaGluZ19sc2Vn
c19pbnZhbGlkLCBJIHdvdWxkIHN1Z2dlc3QNCj4gPj4gPj4ga2VlcGluZyBhIFdBUk5fT04uDQo+
ID4+ID4NCj4gPj4gPiBXZSBjb3VsZCBwb3NzaWJseSBhZGQgYSBwcmludGssIGJ1dCBJIGRvbid0
IHNlZSB3aGF0IHZhbHVlIGEgV0FSTl9PTg0KPiA+PiA+IHdvdWxkIGhhdmUgaGVyZTogaG93IGlz
IGEgc3RhY2sgZHVtcCBnb2luZyB0byBiZSB1c2VmdWwgaW4gZGVidWdnaW5nDQo+ID4+ID4gdGhp
cyBpc3N1ZT8NCj4gPj4gPg0KPiA+PiA+IEFsc28sIGRvbid0IHdlIHNvbWV0aW1lcyBleHBlY3Qg
dGhpcyBzb3J0IG9mIHRoaW5nIHRvIGhhcHBlbiBvbg0KPiA+PiA+IG9jY2FzaW9uPyBXaGF0IGlm
IG91ciBsYXlvdXRyZXR1cm4gZW5kcyB1cCByYWNpbmcgd2l0aCB0aGUgbGF5b3V0IHJlY2FsbA0K
PiA+PiA+IGZvbGxvd2luZyBhIERTIHNodXRkb3duPw0KPiA+PiA+DQo+ID4+DQo+ID4+IEFjdHVh
bGx5LCBJIGZvcmdvdCBhYm91dCB0aGUgd2hvbGUgTEFZVVRSRVRVUk4gYXMgZmVuY2luZyBwb3Nz
aWJpbGl0eS4NCj4gPj4gIEluIHRoYXQgY2FzZSwgeW91IGNhbiBwcmV0dHkgZWFzaWx5IGhpdCB0
aGUgQlVHX09OLiAgVGhvdWdoIEkgY2xhaW0NCj4gPj4gdGhhdCwgd2hpbGUgY2FsbGluZyBtYXJr
X21hdGNoaW5nX2xzZWdzX2ludmFsaWQgZG9lc24ndCBodXJ0LCBpdA0KPiA+PiBzaG91bGQgYmUg
dW5uZWNlc3NhcnkuDQo+ID4NCj4gPiBSaWdodC4uLiBTbyBtYXliZSBqdXN0IGEgZHByaW50aygp
IGZvciBkZWJ1Z2dpbmcgcHVycG9zZXM/DQo+ID4NCj4gPiBCVFc6IFdoeSBzaG91bGRuJ3Qgd2Ug
ZG8gdGhlIG1hcmtfbWF0Y2hpbmdfbHNlZ3NfaW52YWxpZD8gSWYgbm90LCB0aGVuDQo+ID4gd2Ug
d2lsbCBuZWVkIGVpdGhlciB0byBkbyBhbiBleHRyYSBsYXlvdXRyZXR1cm4gb3IgZmFpbCBhIHJl
YWQvd3JpdGUNCj4gPiBhdHRlbXB0IHRvIHRoZSBEUyBpbiBvcmRlciB0byBmaWd1cmUgb3V0IHRo
YXQgdGhlIHN0YXRlaWQgaXMgbm93DQo+ID4gaW52YWxpZC4NCj4gPg0KPiANCj4gDQo+IFRoZXkg
c2hvdWxkIGhhdmUgYWxyZWFkeSBiZWVuIG1hcmtlZCBhcyBpbnZhbGlkLCBhbmQgYXJlIGp1c3Qg
d2FpdGluZw0KPiBvbiBpbyB0byBmaW5pc2ggZm9yIHJlbGVhc2UuDQoNClNvIGZhbGxiYWNrIHRv
IE1EUz8gV2h5IGFyZSB3ZSBpc3N1aW5nIGEgbGF5b3V0cmV0dXJuIGluIHRoYXQgY2FzZT8NCg0K
LS0gDQpUcm9uZCBNeWtsZWJ1c3QNCkxpbnV4IE5GUyBjbGllbnQgbWFpbnRhaW5lcg0KDQpOZXRB
cHANClRyb25kLk15a2xlYnVzdEBuZXRhcHAuY29tDQp3d3cubmV0YXBwLmNvbQ0KDQo=
T24gV2VkLCAyMDEyLTA4LTA4IGF0IDE1OjQ5IC0wNDAwLCBUcm9uZCBNeWtsZWJ1c3Qgd3JvdGU6
DQo+IE9uIFdlZCwgMjAxMi0wOC0wOCBhdCAxNTo0NSAtMDQwMCwgRnJlZCBJc2FtYW4gd3JvdGU6
DQo+ID4gT24gV2VkLCBBdWcgOCwgMjAxMiBhdCAyOjMzIFBNLCBNeWtsZWJ1c3QsIFRyb25kDQo+
ID4gPFRyb25kLk15a2xlYnVzdEBuZXRhcHAuY29tPiB3cm90ZToNCj4gPiA+IE9uIFdlZCwgMjAx
Mi0wOC0wOCBhdCAxNDoxNSAtMDQwMCwgRnJlZCBJc2FtYW4gd3JvdGU6DQo+ID4gPj4gT24gV2Vk
LCBBdWcgOCwgMjAxMiBhdCAyOjAzIFBNLCBNeWtsZWJ1c3QsIFRyb25kDQo+ID4gPj4gPFRyb25k
Lk15a2xlYnVzdEBuZXRhcHAuY29tPiB3cm90ZToNCj4gPiA+PiA+IE9uIFdlZCwgMjAxMi0wOC0w
OCBhdCAxMzo1MSAtMDQwMCwgRnJlZCBJc2FtYW4gd3JvdGU6DQo+ID4gPj4gPj4gT24gV2VkLCBB
dWcgOCwgMjAxMiBhdCAxOjM0IFBNLCBNeWtsZWJ1c3QsIFRyb25kDQo+ID4gPj4gPj4gPFRyb25k
Lk15a2xlYnVzdEBuZXRhcHAuY29tPiB3cm90ZToNCj4gPiA+PiA+PiA+IE9uIFdlZCwgMjAxMi0w
OC0wOCBhdCAxODo0OCArMDIwMCwgVGlncmFuIE1rcnRjaHlhbiB3cm90ZToNCj4gPiA+PiA+PiA+
PiBIaSwNCj4gPiA+PiA+PiA+Pg0KPiA+ID4+ID4+ID4+IEl0J3MgcXVpdGUgc29tZSB0aW1lIHdp
dGhvdXQga2VybmVsIHBhbmljIHJlcG9ydHMgZnJvbSBtZSAuLi4uDQo+ID4gPj4gPj4gPj4NCj4g
PiA+PiA+PiA+PiBPYnNlcnZlciBvbiBNRFMgYW5kIERTIHNodXRkb3duIGR1cmluZyBJTy4NCj4g
PiA+PiA+PiA+Pg0KPiA+ID4+ID4+ID4+IFRoaXMgaXMgd2l0aCAgMy41LjAtMi5mYzE3Lng4Nl82
NCBrZXJuZWwuIExpbmUgaW4gY29kZToNCj4gPiA+PiA+PiA+Pg0KPiA+ID4+ID4+ID4+IG5mczRw
cm9jLmM6NjI1MiA6ICAgQlVHX09OKCFsaXN0X2VtcHR5KCZsby0+cGxoX3NlZ3MpKTsNCj4gPiA+
PiA+PiA+Pg0KPiA+ID4+ID4+ID4NCj4gPiA+PiA+PiA+IElmIHRoZSBzZXJ2ZXIgZG9lc24ndCBy
ZXR1cm4gYSBzdGF0ZWlkLCB0aGVuIHRoYXQgaXMgc3VwcG9zZWQgdG8NCj4gPiA+PiA+PiA+IGlu
ZGljYXRlIHRoYXQgaXQgdGhpbmtzIHRoYXQgaXQgZG9lc24ndCBob2xkIGFueSBtb3JlIGxheW91
dCBzZWdtZW50cw0KPiA+ID4+ID4+ID4gZm9yIHRoaXMgZmlsZS4NCj4gPiA+PiA+PiA+IFRvIG1l
LCB0aGF0IGluZGljYXRlcyB0aGF0IHdlIHNob3VsZCBiZSBjYWxsaW5nDQo+ID4gPj4gPj4gPiBt
YXJrX21hdGNoaW5nX2xzZWdzX2ludmFsaWQoKSByYXRoZXIgdGhhbiBPb3BzaW5nLg0KPiA+ID4+
ID4+ID4NCj4gPiA+PiA+PiA+IEFueSBkaXNzZW50aW5nIHZvaWNlcyBmcm9tIHRoZSBwTkZTIGNy
b3dkPw0KPiA+ID4+ID4+ID4NCj4gPiA+PiA+Pg0KPiA+ID4+ID4+IEJ1dCB0aGlzIGltcGxpZXMg
dGhhdCB0aGUgY2xpZW50IHRoaW5rcyBpdCBoYXMgYSBsYXlvdXQgd2hpY2ggdGhlDQo+ID4gPj4g
Pj4gc2VydmVyIGRvZXMgbm90IGJlbGlldmUgaXQgaGFzLCB3aGljaCBzZWVtcyB0byBtZSB0byBp
bXBseSBhbiBlYXJsaWVyDQo+ID4gPj4gPj4gYnVnLiAgSWYgeW91IGNoYW5nZSB0byBtYXJrX21h
dGNoaW5nX2xzZWdzX2ludmFsaWQsIEkgd291bGQgc3VnZ2VzdA0KPiA+ID4+ID4+IGtlZXBpbmcg
YSBXQVJOX09OLg0KPiA+ID4+ID4NCj4gPiA+PiA+IFdlIGNvdWxkIHBvc3NpYmx5IGFkZCBhIHBy
aW50aywgYnV0IEkgZG9uJ3Qgc2VlIHdoYXQgdmFsdWUgYSBXQVJOX09ODQo+ID4gPj4gPiB3b3Vs
ZCBoYXZlIGhlcmU6IGhvdyBpcyBhIHN0YWNrIGR1bXAgZ29pbmcgdG8gYmUgdXNlZnVsIGluIGRl
YnVnZ2luZw0KPiA+ID4+ID4gdGhpcyBpc3N1ZT8NCj4gPiA+PiA+DQo+ID4gPj4gPiBBbHNvLCBk
b24ndCB3ZSBzb21ldGltZXMgZXhwZWN0IHRoaXMgc29ydCBvZiB0aGluZyB0byBoYXBwZW4gb24N
Cj4gPiA+PiA+IG9jY2FzaW9uPyBXaGF0IGlmIG91ciBsYXlvdXRyZXR1cm4gZW5kcyB1cCByYWNp
bmcgd2l0aCB0aGUgbGF5b3V0IHJlY2FsbA0KPiA+ID4+ID4gZm9sbG93aW5nIGEgRFMgc2h1dGRv
d24/DQo+ID4gPj4gPg0KPiA+ID4+DQo+ID4gPj4gQWN0dWFsbHksIEkgZm9yZ290IGFib3V0IHRo
ZSB3aG9sZSBMQVlVVFJFVFVSTiBhcyBmZW5jaW5nIHBvc3NpYmlsaXR5Lg0KPiA+ID4+ICBJbiB0
aGF0IGNhc2UsIHlvdSBjYW4gcHJldHR5IGVhc2lseSBoaXQgdGhlIEJVR19PTi4gIFRob3VnaCBJ
IGNsYWltDQo+ID4gPj4gdGhhdCwgd2hpbGUgY2FsbGluZyBtYXJrX21hdGNoaW5nX2xzZWdzX2lu
dmFsaWQgZG9lc24ndCBodXJ0LCBpdA0KPiA+ID4+IHNob3VsZCBiZSB1bm5lY2Vzc2FyeS4NCj4g
PiA+DQo+ID4gPiBSaWdodC4uLiBTbyBtYXliZSBqdXN0IGEgZHByaW50aygpIGZvciBkZWJ1Z2dp
bmcgcHVycG9zZXM/DQo+ID4gPg0KPiA+ID4gQlRXOiBXaHkgc2hvdWxkbid0IHdlIGRvIHRoZSBt
YXJrX21hdGNoaW5nX2xzZWdzX2ludmFsaWQ/IElmIG5vdCwgdGhlbg0KPiA+ID4gd2Ugd2lsbCBu
ZWVkIGVpdGhlciB0byBkbyBhbiBleHRyYSBsYXlvdXRyZXR1cm4gb3IgZmFpbCBhIHJlYWQvd3Jp
dGUNCj4gPiA+IGF0dGVtcHQgdG8gdGhlIERTIGluIG9yZGVyIHRvIGZpZ3VyZSBvdXQgdGhhdCB0
aGUgc3RhdGVpZCBpcyBub3cNCj4gPiA+IGludmFsaWQuDQo+ID4gPg0KPiA+IA0KPiA+IA0KPiA+
IFRoZXkgc2hvdWxkIGhhdmUgYWxyZWFkeSBiZWVuIG1hcmtlZCBhcyBpbnZhbGlkLCBhbmQgYXJl
IGp1c3Qgd2FpdGluZw0KPiA+IG9uIGlvIHRvIGZpbmlzaCBmb3IgcmVsZWFzZS4NCj4gDQo+IFNv
IGZhbGxiYWNrIHRvIE1EUz8gV2h5IGFyZSB3ZSBpc3N1aW5nIGEgbGF5b3V0cmV0dXJuIGluIHRo
YXQgY2FzZT8NCg0KRG9oLi4uIE5ldmVyIG1pbmQuLi4NCg0KLS0gDQpUcm9uZCBNeWtsZWJ1c3QN
CkxpbnV4IE5GUyBjbGllbnQgbWFpbnRhaW5lcg0KDQpOZXRBcHANClRyb25kLk15a2xlYnVzdEBu
ZXRhcHAuY29tDQp3d3cubmV0YXBwLmNvbQ0KDQo=
T24gV2VkLCAyMDEyLTA4LTA4IGF0IDE4OjQ4ICswMjAwLCBUaWdyYW4gTWtydGNoeWFuIHdyb3Rl
Og0KPiBIaSwNCj4gDQo+IEl0J3MgcXVpdGUgc29tZSB0aW1lIHdpdGhvdXQga2VybmVsIHBhbmlj
IHJlcG9ydHMgZnJvbSBtZSAuLi4uDQo+IA0KPiBPYnNlcnZlciBvbiBNRFMgYW5kIERTIHNodXRk
b3duIGR1cmluZyBJTy4NCj4gDQo+IFRoaXMgaXMgd2l0aCAgMy41LjAtMi5mYzE3Lng4Nl82NCBr
ZXJuZWwuIExpbmUgaW4gY29kZToNCj4gDQo+IG5mczRwcm9jLmM6NjI1MiA6ICAgQlVHX09OKCFs
aXN0X2VtcHR5KCZsby0+cGxoX3NlZ3MpKTsNCj4gDQoNCklmIHRoZSBzZXJ2ZXIgZG9lc24ndCBy
ZXR1cm4gYSBzdGF0ZWlkLCB0aGVuIHRoYXQgaXMgc3VwcG9zZWQgdG8NCmluZGljYXRlIHRoYXQg
aXQgdGhpbmtzIHRoYXQgaXQgZG9lc24ndCBob2xkIGFueSBtb3JlIGxheW91dCBzZWdtZW50cw0K
Zm9yIHRoaXMgZmlsZS4NClRvIG1lLCB0aGF0IGluZGljYXRlcyB0aGF0IHdlIHNob3VsZCBiZSBj
YWxsaW5nDQptYXJrX21hdGNoaW5nX2xzZWdzX2ludmFsaWQoKSByYXRoZXIgdGhhbiBPb3BzaW5n
Lg0KDQpBbnkgZGlzc2VudGluZyB2b2ljZXMgZnJvbSB0aGUgcE5GUyBjcm93ZD8NCg0KLS0gDQpU
cm9uZCBNeWtsZWJ1c3QNCkxpbnV4IE5GUyBjbGllbnQgbWFpbnRhaW5lcg0KDQpOZXRBcHANClRy
b25kLk15a2xlYnVzdEBuZXRhcHAuY29tDQp3d3cubmV0YXBwLmNvbQ0KDQo=