From:   "Seymour, Shane M" <shane.seymour@hpe.com>
To:     Greg KH <gregkh@linuxfoundation.org>
CC:     "Martin K. Petersen" <martin.petersen@oracle.com>,
        "jejb@linux.ibm.com" <jejb@linux.ibm.com>,
        "linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
        "linux-api@vger.kernel.org" <linux-api@vger.kernel.org>,
        "linux-scsi@vger.kernel.org" <linux-scsi@vger.kernel.org>
Subject: RE: [PATCH for-next] scsi: Implement host state statistics
Thread-Topic: [PATCH for-next] scsi: Implement host state statistics
Thread-Index: AdlW08zNHKI7PyClSKC1+KomWCdnWgANKaCAACDMkHA=
Date:   Wed, 15 Mar 2023 22:41:28 +0000
Message-ID: <DM4PR84MB13737BE099BF599DF83617DBFDBF9@DM4PR84MB1373.NAMPRD84.PROD.OUTLOOK.COM>
References: <DM4PR84MB1373DCD07EABD28D88129C50FDBF9@DM4PR84MB1373.NAMPRD84.PROD.OUTLOOK.COM>
 <ZBFnYwtr+2bfjvcY@kroah.com>
In-Reply-To: <ZBFnYwtr+2bfjvcY@kroah.com>
Accept-Language: en-US
Content-Language: en-US
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?YoU3D+EQlTZRw+GeTcEbKMtoWMFVCjUsloos6y+WACzgZ8bYMkSpi95R+kW0?=
 =?us-ascii?Q?XRZABEUy7B6B325Y1vPOKzvqHXRQAsJNqqDwM9oqoVq3ABNAN32TcC2dyL9i?=
 =?us-ascii?Q?UtyyH0HOzi0jLKTAOxG5V9AYE3aSmsla/Rknxqhr3Wn7k1u7oWvXUnRUjNfx?=
 =?us-ascii?Q?TANntG2t1aWHgmGpLWejlJPFg1zgTzRsT/TmpB4S5zklsNY2pJ8S8mBOSuoB?=
 =?us-ascii?Q?bKPdJc+LH5ICAS0i357O50bLlOva/vtnFqAzRAWObFGcd8W/w+SchGxVrgmK?=
 =?us-ascii?Q?QDsnkHlrWxNeWqrXp0q9buWZ3Ja6jkL7KJnvz7qlacIE1aG1z6AsHh1uVaba?=
 =?us-ascii?Q?WS51GtPC4sFBW7oZrUtRIDysXQTAO29Pk13l0HdIeDvnlilTcxtOX/8wtYpC?=
 =?us-ascii?Q?JF1s0C+oEP1Ka0koMu+hbxkYgjUtRN50JNoJEuOEPZO+c4+P5rOHUstfWxeA?=
 =?us-ascii?Q?yGgbMARfNUwv0FK9nig61JSzOSTAsJxR+sAU5x3e99fmBgflNdmQIQm6qV/3?=
 =?us-ascii?Q?8348UnaRGsoRNv9QoTPHr2t/8FeRpjTrzGkum74EObqd4U4iv28u1eNkx1Za?=
 =?us-ascii?Q?FLBkM4JatynUZPF9vFmtvPFa0DVjKd3ekDKr580zuUhuQJPB6ezzEMn7gWNW?=
 =?us-ascii?Q?RiFJVDQRzeTkgk48EBwn5KpBeKVMlFJd9/aw0uIAzWXGAO1+h3fD9MQNp9qv?=
 =?us-ascii?Q?hp/F2OB3V5vjQf65NmvsPY6AUEwMPOHls/qDQTgK8xzYkUBL2mGq2GMQ3EG6?=
 =?us-ascii?Q?T5zBZkuu9oMMGRL+DLNBZN7Whgm2AhWideE019LOSsvyLjSW+GjDwDgeBcsv?=
 =?us-ascii?Q?oy9urrhlfpOkFKWlYVGqmQLiVYnIt0qQnM/GhhT9my3msnqEQaS7KvGZ0pcY?=
 =?us-ascii?Q?B65QZum3drLw5zgsaM6noJgsb/pS1gzLpu1Rx7xvlo6l0HHu8rvZzOmwrJQz?=
 =?us-ascii?Q?Ub3SwAwCcaztKh9zTMOVVZzpkqHtEEXDF3lco8Npbh6aA+zQKoUKZhqxUcuY?=
 =?us-ascii?Q?DtscQmufi2ACF/qj/y4P4uyTnEPNHac0Ao3gAtWTkYJsK0ji+vzmzrp9iOBP?=
 =?us-ascii?Q?WB86kkuYLBWlq9Syz9MP5cx8ZQFc8j7NsJA0Td2OSdDcY6c7zL6WxjbHA7B/?=
 =?us-ascii?Q?PcyLXbBgX/StxBpp7Uoyr0IvnP/UhYBROKxwf8MVi0UvXxl18jmCH7i526Kz?=
 =?us-ascii?Q?M3HBw/QH+VGEqFuLJCHKD5ExbGryL6/PzyeQblmvq5XNWt4hgHs4r7SlRz1G?=
 =?us-ascii?Q?4CI1URm85DHxH+GUFdlM8W9OUzQinD5CHqbhMpnQ8TPRN/R3U/Fi140x/HXg?=
 =?us-ascii?Q?UVgpyKo/093drWhcq0+rJJ838tFitFKmv7pE3ZnWEfKk4Rq2d2XhWYAMcdRx?=
 =?us-ascii?Q?3bC3umot0RjeMq6AY3cL0Mq+jTpWPnoZIIctexepNXqClL/Qu0aZWkDGpJKq?=
 =?us-ascii?Q?syxd9i0OptdHr8uV4EYG9tLRNHsDNRVS7iUysV+TzI4lAAfHCQ7HfjhVYER0?=
 =?us-ascii?Q?UkznLN8h4hSGH+n8PO28eRJgDcJSf0V+0CfZU4WW0y2puYLP2uWXdv3l06eR?=
 =?us-ascii?Q?hWCg62QA2j9/ovu+iALG5VnHjx6AfATR9DSLnY/v?=
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: DM4PR84MB1373.NAMPRD84.PROD.OUTLOOK.COM
X-MS-Exchange-CrossTenant-Network-Message-Id: 06c6e308-3bd4-4109-9ae2-08db25a66a74
X-MS-Exchange-CrossTenant-originalarrivaltime: 15 Mar 2023 22:41:28.3257
 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 105b2061-b669-4b31-92ac-24d304d195dc
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: P96b7sLCfGzyLER9p2zM+YH5PVTPGbBrjCbTRkDeQocMsmEQvphuRAnNf8b5p6Q+zcQwYYAiMovV4FbdWAcOVA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW4PR84MB1659
X-OriginatorOrg: hpe.com
X-Proofpoint-GUID: MxvndzKBbCT9GMbkUm8sIHeAeGGdowR-
X-Proofpoint-ORIG-GUID: MxvndzKBbCT9GMbkUm8sIHeAeGGdowR-
X-HPE-SCL: -1
X-Proofpoint-Virus-Version: vendor=baseguard
 engine=ICAP:2.0.254,Aquarius:18.0.942,Hydra:6.0.573,FMLib:17.11.170.22
 definitions=2023-03-15_12,2023-03-15_01,2023-02-09_01
X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 mlxlogscore=651
 suspectscore=0 bulkscore=0 phishscore=0 malwarescore=0 lowpriorityscore=0
 spamscore=0 clxscore=1011 adultscore=0 impostorscore=0 priorityscore=1501
 mlxscore=0 classifier=spam adjust=0 reason=mlx scancount=1
 engine=8.12.0-2303150001 definitions=main-2303150185
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

> On Wed, Mar 15, 2023 at 06:08:19AM +0000, Seymour, Shane M wrote:
> > The following patch implements host state statistics via sysfs. The int=
ent
> > is to allow user space to see the state changes and be able to report w=
hen
> > a host changes state. The files do not separate out the time spent into
> > each state but only into three:
>=20
> Why does userspace care about these things at all?  What tool needs them
> and what can userspace do with the information?
>=20

In enterprise setups you may a significant number of LUNs presented to a
system (100s to 1000s) via a single HBA (usually via FC). Having a HBA goin=
g
into error handling causes issues. Every time a host goes into SCSI EH all
I/O to that host is blocked until SCSI EH completes. That means waiting for
every I/O to either complete or timeout before starting any recovery
processing.

At this time there is no way for anything outside of the kernel to know if =
a
HBA is having any issues. The cause of those issues can vary significantly,
just two examples:

1) Storage end point issues
2) SAN issues (e.g. laser transmit power at any point in the SAN)

My experience with downstream distros is that nobody seems to notice the
noise that SCSI EH produces (LUN, device, bus, host resets) and we see it
when we get a vmcore and have to try and work out what caused an I/O hang.

I wanted to be more proactive in warning users that you've got a potential
storage issue you need to look at. It won't help when you have a sudden
massive issue but if you have an issue that is slowly getting worse over
a period of time you will at least get some warning.

> >
> > A (GPLv2) program called hostmond will be released in a few months that
> > will monitor these interfaces and report (local host only via syslog(3C=
))
> > when hosts change state.
>=20
> We kind of need to see this before the kernel changes can be accepted
> for obvious reasons, what is preventing that from happening now?

If you don't mind I'll answer this in my reply to James' email soon since
he commented about this.

>=20
> Please always use sysfs_emit() instead of the crazy scnprintf() for
> sysfs entries.

No problem I can make that change.

>=20
> u32 is a kernel type, not uint32_t please, but I don't know what the
> scsi layer is used to.

No problem I can make that change.

>=20
> thanks,
>=20
> greg k-h

Thank you for your willingness to provide feedback.

Shane