Received-SPF: pass (google.com: domain of linux-nfs+bounces-3835-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.199.223 as permitted sender) client-ip=147.75.199.223;
From: Chuck Lever III <chuck.lever@oracle.com>
To: Linux NFS Mailing List <linux-nfs@vger.kernel.org>
CC: Christoph Hellwig <hch@infradead.org>
Subject: reservation errors during fstests on pNFS block
Thread-Topic: reservation errors during fstests on pNFS block
Thread-Index: AQHavmmwmYhbjkJRLE+REETskoBGAg==
Date: Fri, 14 Jun 2024 14:46:49 +0000
Message-ID: <34F83726-2A28-4E29-A40E-A01BED7744EC@oracle.com>
Accept-Language: en-US
Content-Language: en-US
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: 
 =?us-ascii?Q?vhEVPJou1W18vNa3CGg3AueZ2b0ZFqBLDL0teuoX60xhbxClNKKuKjt5ONk6?=
 =?us-ascii?Q?8VsHDmHSjsJCOymUh2EXIG0ymzYra5zwxGYGTtWhWAl7NK4UhRtBuCeIaUlN?=
 =?us-ascii?Q?WgZIadqDluLRc5VHxRPQuUbyYPwGnGDWpey37TSXhd1iaef2cXCLFcYk5awZ?=
 =?us-ascii?Q?+6dbPYTSHazS0brg947d+ZVEvfZO20g5xLTE7teTNXZF9E9mmvAgJ3GjE+RU?=
 =?us-ascii?Q?YWMVsLiLO6PYfv0Tufpg9Jt0fQAgI1z3F60ayLloUTWswrfamg8eh4vI1+RK?=
 =?us-ascii?Q?ukK9TDHvv5GycM6TOS+L1+auUaYaXpRj4rhCQIlZmtENVlkXzqD/4Fx/7N1U?=
 =?us-ascii?Q?d74TTp7wCBPbAcyHhaa2j/ykRejyRMcGiuEXf2qU2AoleVq2zU8tk7FZj+Di?=
 =?us-ascii?Q?bATplvTDXBbb6XiLc37NmGQ7Y/S5Q3MZ1ZBQhn7NZUONMCu51Ca51AYjlg41?=
 =?us-ascii?Q?eqlIul/S0hYiMCv/C84iZOzwgTdZi4OXKrXygS5LfeVK9tNvWQhVm5M+7WJl?=
 =?us-ascii?Q?vH4YQxELe4Om10HKyjmgZEnjElWxgy7txQUk4MOskmvQqftxl4Rz71NNHc1C?=
 =?us-ascii?Q?L5Z7Y8S7sJsSRPl/V3EMwS1vJcdWK2xDX4ZOeDr6eWKXrVaspqwUv7/6Qimx?=
 =?us-ascii?Q?A12qotUS/WogTkcYpzPc9zJlcctNJ8NQtMs+CYACEXgL0HXYv2xxGtUtJnN1?=
 =?us-ascii?Q?g0Gep0daF+RnrezDiRSKZMeaotu70CEx3WCpIaGE1cazuC45dza1BhgmyCtc?=
 =?us-ascii?Q?dcCjjx7Ohhjd7WV5D7AnHpeiQwnC3WFypGsGZfVRSdSsb7DUBSGE/anTv/b5?=
 =?us-ascii?Q?XvgvtNM9W8ZY5y9F8BkWxPMhd4LHceq5JLUrBww+cE8lb3LnvYjgR7Z1UhRG?=
 =?us-ascii?Q?/mmQe5I67S1+0Yb/ZxpN0ZRgZbwwtcdErKEA2jfsEOQPLg8TetKmuT1rV+Hn?=
 =?us-ascii?Q?ukgSmy9vV/EQFek0TVpiKvhsUKr3vprYZ5koe6MBLworD6cCL0ggkxR2u7vz?=
 =?us-ascii?Q?JfsgiKzDhVsjcOF2WJMQaZWycnvp3oOQpnCcy+2tgu+Y10J3Cxilid8pW4y3?=
 =?us-ascii?Q?22WGSofE00m/vQ7cMAAwVehxgo5K1fQ3YXTn/Zii8CCWQ5xgcB5GkOjOc9ZS?=
 =?us-ascii?Q?L3Hadl06Tuj1t4ABcF4dCWS/Csx9Ig8e8E276B3RxeD56xe0cyHl/GdQE1RX?=
 =?us-ascii?Q?ulONlFTLV/ctxsjHh8Eb3pHJGMTTaD+nEXOjhOrr1sKmDLczNdhGtMKW29BL?=
 =?us-ascii?Q?2WpErvvWHrDg/OPER6o4VaKYDFKK+s1rLpoI57crZyQsOWIBb9KMYYTRJxgD?=
 =?us-ascii?Q?UFKVgzlWbh1UApcxfE7+FzWvCpxRukkrky6GZYmhcxWHGPf8W7HOU2tIZBCD?=
 =?us-ascii?Q?+4ZZ+dm8sd94K8cmJ7q4dgtBPkz2nj/Ecu8zYd0DSt7+eMsox4miXnd5Rnq4?=
 =?us-ascii?Q?mMC0DtiwhXngoiBpliAOtOOT2JcHDNQjvfQobK93cg/bt+fNrVbnH2+B7sno?=
 =?us-ascii?Q?73t980v27+jYYwZ+4OkdpdkH9n44uDz/MpK5eK0hnqMvTHGvg4pyK+tNSxtP?=
 =?us-ascii?Q?Cf07XBC6ESqaSIuMJz3ulKbPadrxcHCgNszK+YQCapdgeXPNt8+Ttf/Bw8/l?=
 =?us-ascii?Q?Vw=3D=3D?=
Content-Type: text/plain; charset="us-ascii"
Content-ID: <BB9D765C9680D547ADC0811C2F5FF64D@namprd10.prod.outlook.com>
Content-Transfer-Encoding: quoted-printable
Precedence: bulk
X-Mailing-List: linux-nfs@vger.kernel.org
List-Id: <linux-nfs.vger.kernel.org>
List-Subscribe: <mailto:linux-nfs+subscribe@vger.kernel.org>
List-Unsubscribe: <mailto:linux-nfs+unsubscribe@vger.kernel.org>
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: 
	bpDWdTFRDmg3STLE+StuN0YxgTfy79GL709F5ixksti2CHsu9FDN7ayUqX0fd3R3T2he2L5ySu6bPm9rJVyESbZoZPsXwNFSb17ZBktb+2OF8ldf33pmuboSwoMr8SFXmq8sY+bb7dFB5rSywWspwmB9dMfqjkpkjQkrK/KrLYf2Nl7NrcLajj9gVjBcNiKrAiWT/4QiHq1/pt6YfPg1tGawe11XWQvjjYN20ClsBvGQbIXufOXX8qNPoNRRGCOtPXOnUyNOLdoTI269F+73iQ/KG0eGUn887KMTLkbsTPbJHtUk8OE8zNTCP826OJF09l3FVCn9+Y+VMzPjY5jrZqK/JHQAdEAlRi/F7mgrEUVelEVfOgmpwR5iE76dzplPgW2o1+YtWMSQU3YBWUnjRfS0fvkSH6TvTSE4utqir9tWELq1AGDk7BPq9YTfo6TpQyUs9SaymVa9DpnrjL0+O5Jji/a6iqZoGjdUUOUdkYH6iGRHEgEY75yzeTRX3aRh0hagFnLUNKUskhHRyHkr9flKhcrbCQPezeokwjsxnmjOiceRrTYW/qSKCF0ZiOTrk/jRK918qFIq34IVOZ4r3VPk1pgTmdXmR/HAHd4sYpE=
X-OriginatorOrg: oracle.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: BN0PR10MB5128.namprd10.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: f8cc0c25-28d5-4018-bfbc-08dc8c80d2a4
X-MS-Exchange-CrossTenant-originalarrivaltime: 14 Jun 2024 14:46:49.7432
 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: 5appHouCzGkuk4/iDncIeg0uREDgeHTsqZinh/FFIjtFphj3hs0SljuWHmQzwSb3+unsPGbpxJIKRtFUaeM8yg==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: IA1PR10MB5971
X-Proofpoint-Virus-Version: vendor=baseguard
 engine=ICAP:2.0.293,Aquarius:18.0.1039,Hydra:6.0.680,FMLib:17.12.28.16
 definitions=2024-06-14_13,2024-06-14_03,2024-05-17_01
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 spamscore=0 phishscore=0 adultscore=0
 mlxscore=0 bulkscore=0 malwarescore=0 mlxlogscore=999 suspectscore=0
 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2405010000
 definitions=main-2406140098
X-Proofpoint-GUID: XRsoVjexJQsBZrTI5Fy1YszRuy8UtRkn
X-Proofpoint-ORIG-GUID: XRsoVjexJQsBZrTI5Fy1YszRuy8UtRkn

I've finally gotten kdevops and pNFS block to the point where
it can run fstests smoothly with an iSCSI target. I'm seeing
error messages on occasion in the system journal. This set is
from generic/069:

unknown: run fstests generic/069 at 2024-06-14 09:21:08
systemd[1]: Started fstests-generic-069.scope - /usr/bin/bash -c test -w /p=
roc/self/oom_score_adj && echo 250 > /proc/self/oom_score_adj; exec ./tests=
/generic/069.
nfsrahead[34274]: setting /media/scratch readahead to 128
systemd[1]: media-scratch.mount: Deactivated successfully.
nfsrahead[34284]: setting /media/scratch readahead to 128
kernel: pNFS: failed to open device /dev/disk/by-id/dm-uuid-mpath-0x6001405=
e3366f045b7949eb8e4540b51 (-2)
kernel: pNFS: using block device sdb (reservation key 0x666b60901e7b26b3)
kernel: pNFS: failed to open device /dev/disk/by-id/dm-uuid-mpath-0x6001405=
e3366f045b7949eb8e4540b51 (-2)
kernel: pNFS: using block device sdb (reservation key 0x666b60901e7b26b3)
kernel: sd 6:0:0:1: reservation conflict
kernel: sd 6:0:0:1: [sdb] tag#16 FAILED Result: hostbyte=3DDID_OK driverbyt=
e=3DDRIVER_OK cmd_age=3D0s
kernel: sd 6:0:0:1: [sdb] tag#16 CDB: Write(10) 2a 00 00 00 00 50 00 00 08 =
00
kernel: reservation conflict error, dev sdb, sector 80 op 0x1:(WRITE) flags=
 0x0 phys_seg 1 prio class 2
kernel: sd 6:0:0:1: reservation conflict
kernel: sd 6:0:0:1: reservation conflict
kernel: sd 6:0:0:1: [sdb] tag#18 FAILED Result: hostbyte=3DDID_OK driverbyt=
e=3DDRIVER_OK cmd_age=3D0s
kernel: sd 6:0:0:1: [sdb] tag#17 FAILED Result: hostbyte=3DDID_OK driverbyt=
e=3DDRIVER_OK cmd_age=3D0s
kernel: sd 6:0:0:1: [sdb] tag#18 CDB: Write(10) 2a 00 00 00 00 60 00 00 08 =
00
kernel: sd 6:0:0:1: [sdb] tag#17 CDB: Write(10) 2a 00 00 00 00 58 00 00 08 =
00
kernel: reservation conflict error, dev sdb, sector 96 op 0x1:(WRITE) flags=
 0x0 phys_seg 1 prio class 0
kernel: reservation conflict error, dev sdb, sector 88 op 0x1:(WRITE) flags=
 0x0 phys_seg 1 prio class 0
systemd[1]: fstests-generic-069.scope: Deactivated successfully.
systemd[1]: fstests-generic-069.scope: Consumed 5.092s CPU time.
systemd[1]: media-test.mount: Deactivated successfully.
systemd[1]: media-scratch.mount: Deactivated successfully.
kernel: sd 6:0:0:1: reservation conflict
kernel: failed to unregister PR key.

But note that generic/069 is recorded as passing without error.

I'm about to start digging into this. Any advice or guidance
is welcome.

--
Chuck Lever