Received-SPF: pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 2620:137:e000::3:8 as permitted sender) client-ip=2620:137:e000::3:8;
From:   Trond Myklebust <trondmy@hammerspace.com>
To:     "bcodding@redhat.com" <bcodding@redhat.com>
CC:     "linux-nfs@vger.kernel.org" <linux-nfs@vger.kernel.org>
Subject: bpftrace script to monitor tasks that are stuck in NFSv4 exception
 loops
Thread-Topic: bpftrace script to monitor tasks that are stuck in NFSv4
 exception loops
Thread-Index: AQHZ/FW3DFOHpl6yCkG7BbkGJ7G3oA==
Date:   Wed, 11 Oct 2023 15:15:06 +0000
Message-ID: <c3e1e5ccc8ac88cee2c0f2b8414283038dc9b8f7.camel@hammerspace.com>
Accept-Language: en-US, en-GB
Content-Language: en-US
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: =?utf-8?B?d2NHUnNsUFc2eVpGL2RObEFoRXJ0clhVNkVVcWxIYm5GRW5qY0xwVTVFSjFi?=
 =?utf-8?B?MThVVXN3WE1UbEUxWjJRVEpQUElxN294T3dpamN4bUpncFBGcThueGJyOG9P?=
 =?utf-8?B?SUJlcVBtc1ZmMGU0bVRaOWlHelMyelVYTXpRd3RMTzZwKy9FVEdib3hyTHNB?=
 =?utf-8?B?d3JNWHJveXdFUFUxMEdxSkhaZWE4SDFiR09IWURqWnNzdzFDSzdDRGJnUzR0?=
 =?utf-8?B?VjBFQ0pFZHJHcG1vVFdqS0s3bW80dkpMamtWM2dCcVY0SW5MM2FUN215WUZ3?=
 =?utf-8?B?YndFdkVieERyU0FxMkdWN3g4RGhOcEpqa2VMODMvaDBjb0YvRys3dmZmaHoy?=
 =?utf-8?B?N3E0ZjIzbmorczVVUWJHcWJmQXRYdTI3bTVLZG12YkxzWWFUY1ZkQUlGRVc2?=
 =?utf-8?B?WEtnTkZwekFuSHpxV1JZeStoSWVLeDBMbXoyQnErUTNqc0h6VGVvSzFKaW5s?=
 =?utf-8?B?N3AxK3Rsb1ZMZWVVcXVvWHovMUFSV2pvZDdMT2Z6azJXamJPV1pTSG5ibElJ?=
 =?utf-8?B?K253SDBOanV6U0V4dDF2NHlxOXNNazNnc2t2UjBVcWlESmJFRHhVbGJwY3dw?=
 =?utf-8?B?QjZIK2VQQVNRMXVaNCtjdGxMSW14dENreHJUcE1YTDl3RDc0U1hlQXZ4Qk9Q?=
 =?utf-8?B?c0Q3MDZOL2lybTA1cXd4cUNuWUhUR3JYaWJ1bEF4VEpzQkF5QzVJNTNici9M?=
 =?utf-8?B?TVRJQzhFWlBjTnRkZXFUWWVLS000VTNiWm5JL2xTcWJaR09CODEwY0UwbTNN?=
 =?utf-8?B?ZnJJVGo3d2NmVjN5WEU3L1pHcGhIblRJV2lqZ2o0NjNBbEEzTHZLSk5RRER5?=
 =?utf-8?B?d3BPYUZzSjJUUzRrbVMyLzdjd1R0aGRHdXpSd1l1WFNkRFRxd3pLTkpCb3hQ?=
 =?utf-8?B?dm5TZjM0YzV1WmRvV3RPNUNQeVJ1OTJ0UlBsZlB4V2tnOGEydGtOZ0hHZGpw?=
 =?utf-8?B?RTFqazR4bmFOckZ4VEgwbE9qc1Z1WnY1VW96U2VLMnJ6MkZxVEwrMWxFcHox?=
 =?utf-8?B?cjhBeHRSdWwrLzNqK0tidWhzUWN0MFJtMGJhMVBxekRGS0RXUkRCWmd0K3Rr?=
 =?utf-8?B?N0xYUnFrN0lndEE1M2hrdER5S2xjWW52MndlbUNqZDN4QURJMy93WVFuM3JM?=
 =?utf-8?B?TnRyTWZPeXkrUHZncjd5eHBXaTJFWEtiN3dtSkMzWS91R2NUMlJqZGJaaWNq?=
 =?utf-8?B?QzdaU3BIYTFHNGo3ekdxZzZPRm9lSEtoYkVWc2lWc0YvUUdQRXpFaUMrMnEr?=
 =?utf-8?B?SzM5R2VIUmw1R0xLc3ZGaXNGb1RYT29wTUhwZmVpcitsZitMQmdjWFF1V3Zm?=
 =?utf-8?B?UVIza2FpV3BaNzRoNlpSV2lacnRLR00zWjVDTXpUSUJJQWpBNk9jcnh1Vzky?=
 =?utf-8?B?NjVncFZWc25nQklUK0hvOXBwWExxalFhdEl0cHpHeWhKM2Qzbk12eXNDWldn?=
 =?utf-8?B?WEVNQUNaazdvVmVFZElKeGtRR3doelRWbWRQT2hNZXlNV2RJOFg3NHBxNnUw?=
 =?utf-8?B?ZHVjMkhZYkpvWCtRSVlhdlFIM3h0Y1lSSzR4Qy80cE03U2h4aEhHR0g5bFgx?=
 =?utf-8?B?bnl4MTljVW1GU1B6THhjUUFHS0tnZkVnbWV4NFpIWWN2TDJvTlFEL21CZXQ2?=
 =?utf-8?B?SWhyUk0xblZKZ0R1VWJHWGZGQUtBNUt1THc2VXRFNFh4N3JnQjR3SytjdjE2?=
 =?utf-8?B?MTY0enR0M1JuSnJ0eElYS1drZWNzTStXQkpNblp3OGJ3cWQyUWV4dkt1bDRO?=
 =?utf-8?B?U1h3dGVUdncyTGEwVDFHYXVYaEVmTnlhUXdQSFdFQWxUWjlQR2JmRlJJekVB?=
 =?utf-8?B?Zlp4dURuZEwwa2tUOHVzOUZsaGRIWW4xSzM5SXJ2TkdEaXdlYlR1MVpvc1ZQ?=
 =?utf-8?B?dDRnZmExMWIyQTlQOEZDbGtmYjV1UldGNVdsZFJtUEIwK0dtV3dDaXg1aWha?=
 =?utf-8?B?cW4zTGRlSmpSQUFnSTZVT0FNQ1BNNnJRT1VkdmlCRWZTdHV2WVJOeG9qSm9N?=
 =?utf-8?B?UkpMaTY4ZXRkcmtXQlgrdytOSGR2MDhVSTk0S0t4S1AwSDVEZkZNQ3JVRkQ2?=
 =?utf-8?B?UTJLR202dmEvcjYva1NrRkxoMnpYd0xGZDFJODVodkRiQ1RYbjdKYjM0bExr?=
 =?utf-8?B?alJGM053Q3lCdUxCcFR3UVlkRXFGZ0JRb2dXeWdWVjZMQUxMQlFtZkIrT2h1?=
 =?utf-8?B?Z2c9PQ==?=
Content-Type: multipart/mixed;
        boundary="_002_c3e1e5ccc8ac88cee2c0f2b8414283038dc9b8f7camelhammerspac_"
MIME-Version: 1.0
X-OriginatorOrg: hammerspace.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: CH0PR13MB5084.namprd13.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 724014d7-bedf-4c6a-33d4-08dbca6cd9b6
X-MS-Exchange-CrossTenant-originalarrivaltime: 11 Oct 2023 15:15:06.0371
 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 0d4fed5c-3a70-46fe-9430-ece41741f59e
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: OpTgUhyKX/ws5Ueyzd6A5uoiN5ObhZ1VU7n5sMczICu30EafpfLVVioQGILLpdGxHm0u9soN3F7+HQocMpBgsg==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CO6PR13MB5275
X-Spam-Status: No, score=2.7 required=5.0 tests=DKIM_SIGNED,DKIM_VALID,
	DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,
	RCVD_IN_SBL_CSS,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED autolearn=no
	autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on fry.vger.email
Precedence: bulk
List-ID: <linux-nfs.vger.kernel.org>
X-Mailing-List: linux-nfs@vger.kernel.org
X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (fry.vger.email [0.0.0.0]); Wed, 11 Oct 2023 08:15:14 -0700 (PDT)
X-Spam-Level: **

--_002_c3e1e5ccc8ac88cee2c0f2b8414283038dc9b8f7camelhammerspac_
Content-Type: text/plain; charset="utf-8"
Content-ID: <1A0BE7AB64A48B438FC89F4FF1BF51D5@namprd13.prod.outlook.com>
Content-Transfer-Encoding: base64

U2VlIGF0dGFjaG1lbnQuDQoNCi0tIA0KVHJvbmQgTXlrbGVidXN0DQpMaW51eCBORlMgY2xpZW50
IG1haW50YWluZXIsIEhhbW1lcnNwYWNlDQp0cm9uZC5teWtsZWJ1c3RAaGFtbWVyc3BhY2UuY29t
DQoNCg0K

--_002_c3e1e5ccc8ac88cee2c0f2b8414283038dc9b8f7camelhammerspac_
Content-Type: text/plain; name="nfs4-client-monitor-exceptions"
Content-Description: bpftrace script
Content-Disposition: attachment; filename="nfs4-client-monitor-exceptions";
	size=852; creation-date="Wed, 11 Oct 2023 15:15:05 GMT";
	modification-date="Wed, 11 Oct 2023 15:15:05 GMT"
Content-ID: <D692BF2FA7E96346AD80D4FBAC1397C4@namprd13.prod.outlook.com>
Content-Transfer-Encoding: base64

IyEvdXNyL2Jpbi9icGZ0cmFjZQovKgogKiBNb25pdG9yIE5GU3Y0IGV4Y2VwdGlvbnMKICoKICog
Q29weXJpZ2h0IDIwMjMgVHJvbmQgTXlrbGVidXN0CiAqIExpY2Vuc2VkIHVuZGVyIHRoZSBHUEx2
MgogKgogKi8Kc3RydWN0IG5mczRfZXhjZXB0aW9uIHsKCXN0cnVjdCBuZnM0X3N0YXRlICpzdGF0
ZTsKCXN0cnVjdCBpbm9kZSAqaW5vZGU7CglzdHJ1Y3QgbmZzNF9zdGF0ZWlkX3N0cnVjdCAqc3Rh
dGVpZDsKCWxvbmcgdGltZW91dDsKCXVuc2lnbmVkIHNob3J0IHJldHJhbnM7Cgl1bnNpZ25lZCBj
aGFyIHRhc2tfaXNfcHJpdmlsZWdlZCA6IDE7Cgl1bnNpZ25lZCBjaGFyIGRlbGF5IDogMSwKCQkg
ICAgICByZWNvdmVyaW5nIDogMSwKCQkgICAgICByZXRyeSA6IDE7Cglib29sIGludGVycnVwdGli
bGU7Cn07CgprcHJvYmU6bmZzNF9kb19oYW5kbGVfZXhjZXB0aW9uIHsKCSRzZXJ2ZXIgPSAoc3Ry
dWN0IG5mc19zZXJ2ZXIgKilhcmcwOwoJJGVycm9yY29kZSA9IChpbnQzMilhcmcxOwoJJGV4Y2Vw
dGlvbiA9IChzdHJ1Y3QgbmZzNF9leGNlcHRpb24gKilhcmcyOwoJJGlub2RlID0gJGV4Y2VwdGlv
bi0+aW5vZGU7CgoJaWYgKCRlcnJvcmNvZGUgIT0gMCAmJiAkaW5vZGUgIT0gMCkgewoJCSRkZXYg
PSAodWludDMyKSRpbm9kZS0+aV9zYi0+c19kZXY7CgkJcHJpbnRmKCIlcyBbJWRdOiBpbm9kZT0l
dToldToldSwgZXJyb3I9JWQgJXNcbiIsCgkJICAgICAgIHN0cmZ0aW1lKCIlRiAlSDolTTolUyIs
IG5zZWNzKSwgcGlkLCAkZGV2ID4+IDIwLAoJCSAgICAgICAkZGV2ICYgKCgxIDw8IDIwKSAtIDEp
LCAkaW5vZGUtPmlfaW5vLCAkZXJyb3Jjb2RlLAoJCSAgICAgICBrc3RhY2soKSk7Cgl9Cn0K

--_002_c3e1e5ccc8ac88cee2c0f2b8414283038dc9b8f7camelhammerspac_--