Received-SPF: pass (google.com: domain of linux-kernel+bounces-79177-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) client-ip=147.75.80.249;
Message-ID: <abbff26c-c626-42ce-82a9-4dc983372de3@intel.com>
Date: Fri, 23 Feb 2024 13:07:08 -0800
User-Agent: Mozilla Thunderbird
Subject: Re: [PATCH RFC net-next v1 1/6] ethtool: add interface to read Tx
 hardware timestamping statistics
Content-Language: en-US
To: Rahul Rameshbabu <rrameshbabu@nvidia.com>, Saeed Mahameed
	<saeed@kernel.org>, Leon Romanovsky <leon@kernel.org>, "David S. Miller"
	<davem@davemloft.net>, Eric Dumazet <edumazet@google.com>, Jakub Kicinski
	<kuba@kernel.org>, Paolo Abeni <pabeni@redhat.com>, Jonathan Corbet
	<corbet@lwn.net>, Richard Cochran <richardcochran@gmail.com>, Tariq Toukan
	<tariqt@nvidia.com>, Gal Pressman <gal@nvidia.com>, Vadim Fedorenko
	<vadim.fedorenko@linux.dev>, Andrew Lunn <andrew@lunn.ch>, Heiner Kallweit
	<hkallweit1@gmail.com>, Przemek Kitszel <przemyslaw.kitszel@intel.com>, Ahmed
 Zaki <ahmed.zaki@intel.com>, Alexander Lobakin
	<aleksander.lobakin@intel.com>, Hangbin Liu <liuhangbin@gmail.com>, "Paul
 Greenwalt" <paul.greenwalt@intel.com>, Justin Stitt <justinstitt@google.com>,
	Randy Dunlap <rdunlap@infradead.org>, Maxime Chevallier
	<maxime.chevallier@bootlin.com>, Kory Maincent <kory.maincent@bootlin.com>,
	Wojciech Drewek <wojciech.drewek@intel.com>, Vladimir Oltean
	<vladimir.oltean@nxp.com>, Jiri Pirko <jiri@resnulli.us>, Alexandre Torgue
	<alexandre.torgue@foss.st.com>, Jose Abreu <joabreu@synopsys.com>, "Dragos
 Tatulea" <dtatulea@nvidia.com>
CC: <netdev@vger.kernel.org>, <linux-kernel@vger.kernel.org>,
	<linux-doc@vger.kernel.org>
References: <20240223192658.45893-1-rrameshbabu@nvidia.com>
 <20240223192658.45893-2-rrameshbabu@nvidia.com>
From: Jacob Keller <jacob.e.keller@intel.com>
In-Reply-To: <20240223192658.45893-2-rrameshbabu@nvidia.com>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 7bit
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?VEd6ZU5iWjhBTFoydnFvR2FMSEt6V3B4eWwydzFGVGl3T2RZMDAyL3RTQ3Vx?=
 =?utf-8?B?SWZ5TElpMGhiNFlETFdDMnA4blhJMWR6RE9VMldZaFVNL2hIN0lMQVkxa0pD?=
 =?utf-8?B?b0FYdkdEUmphNWlmY3dtNjRiK2MrOXpWaFpWR091Q2JBV2pFNUIrS2crZ1Fu?=
 =?utf-8?B?ZlI0NmluUGc0UDlsU0NwNUM2dHAyNHozODRJY3BWYlZ4NFZpWElVUUFXdElw?=
 =?utf-8?B?OTd1M3JQdXR0SFVTa0wxU2VmWGRLUnZWZFhSMGZmY1hXY3VlVndCV0hNZW1W?=
 =?utf-8?B?c2o5eG1EWTVMdHFnbi9weGVTamNYaWd6bU5nUndydDJkQUF4TFZZZ0M5UnF6?=
 =?utf-8?B?bXhGNWdxNDVYZW1kYWwzQU1NSGdZanl5RGtUUytQNVRIZEVQajd2KzRPazNX?=
 =?utf-8?B?SVI4K1oxbTM2NVF4Mkt3Y0NCcFdNM2NvKzJmQ3h1YVpMVE10U3pIVWJ0cURD?=
 =?utf-8?B?bS9seDNFRzcvemJCelFqY3BpT29hQm92Unc1RnV6dkpKeWhsdFpGdjNaUFhQ?=
 =?utf-8?B?WFVUYkNFa3NDU212YlBiT2NkVFFDWGc1SVlHVG5kdlFTM3BoQXE2a0ZiSm94?=
 =?utf-8?B?NzdDNVJ1TEhQem1YdDEvUUJYYUpMOGcyS3ZqUU1Qam9CdXU1bnRTc1FHd0s2?=
 =?utf-8?B?U25YVG42bElFK3l6RXh1VEYzcno0OER6QWhyNHB2Sms4N1h6dkZKUU1mRUdN?=
 =?utf-8?B?WkpQVHlaOEVwMWlHYUdOSVZ0VEw0ak5VNWxKQ1FRZUhDMUhNVVVuNTFnd1pU?=
 =?utf-8?B?bWxuTzFaa1NYT0tvTStyYTZ1NkUrdWZuR0ZnWWFyV0RrdlJvdm41SU1mRGFi?=
 =?utf-8?B?RThXMzI0eGFJV2k5eWxBendTTm9aZTd6S1BGRjJKakZzbWJFVVphZVNDYnN4?=
 =?utf-8?B?QWMyWU9JL1pOZmtVU3lYTmpPeitjamEzQWQ0a3YvRENMSnN2UFRUSnQzRjVD?=
 =?utf-8?B?cVZ5UWg2QzZUL2NleWJhRWxhRlduNW4rREthV1RHUHV4S0tPMEVNV3crTXcv?=
 =?utf-8?B?MnJjNDZhUlBwdUlZL2VIZUdpWTA3QkVXTXFKL0h5em5sVUNXNFN0OENVSk5M?=
 =?utf-8?B?V3F4c1VLa24vNi9BNGg5UFZsZWN0dEJUQlZodmxldGNENFllTlRoV3YvZmow?=
 =?utf-8?B?em1LUy9pNWRoSUtVMVhhb0xKNm9oWlhDbFlDTURWc3ZWMThvZ0VxSVBSU3Nl?=
 =?utf-8?B?QjV0QVlMbHhmd1pzd3p0WldpN0M3RzllQTVPcHZ0WklGaGVmbjBvRTRMOENX?=
 =?utf-8?B?SDM0cXFjK3NsdXhIZGlNNmJqa2lWQmNzVlZNclpEZjJpdVlKM0QxNVJibTNr?=
 =?utf-8?B?NWhNWWR6Wjd4bXg5OW5najRETGNyaCtySEk4Tk9BaUxSZDJ5dTVGbzhPUjNa?=
 =?utf-8?B?QkRVa25mVFpRSjhZcVYvYThocHpRcFlhbUlwckg1Z0RXWjJTcGo0dDB2R3ls?=
 =?utf-8?B?diszU1I0bXp6R0ovZHFOY0NPa095RE9mekdaV0ZLSDUzTkt3MWo4L29Oemh2?=
 =?utf-8?B?Z2cyK3VNMGxjUk5rOFFvem9XZUhzQ2FhQXFLdi9oOUY3RGFJRjZuYjB6VC80?=
 =?utf-8?B?MHIxZzFFRzBqSVljQXQxTk80bFlzdFBTWTNXVUoyL1JyMWpkTFRzSkI3UzBm?=
 =?utf-8?B?QUhHUHd0cGdoVTgvNXBOWW9MUnBHQnZ3bHh2djY4RFpmcFBmeXJjNTEyYVRp?=
 =?utf-8?B?enErcHEweFZjaEN6TlZWZmJGR2EzWVpWUG1DTm1ISTZrcEhFUXB4YkQrRVUw?=
 =?utf-8?B?blJOamhPaGNrK2Mxd2xiODFhbHRlcEVWcWtwVFhOOHpIMjNHZWNSWllFRGI4?=
 =?utf-8?B?WWZmcHJ4SENZK3ZjTG45M3VGSWkzZjVueDQ2VGZCVUpFSDJ5cnJmeGpNSUVa?=
 =?utf-8?B?OEtncjNaYlR3NWw2SVJ4aUl1UnVOL0IzMTlLVHMxQlkrbjUxMk05Smo5SkNs?=
 =?utf-8?B?eHdTeGRYSVBZc0xPNHlRcnI4b0puYjlkdFNUMkpvbVZFd005TWtpUUZnWmdT?=
 =?utf-8?B?QVB4azQ1c3hUS0VZSHpaMWFBMDZWZzh2YXZraHdRZFNQWjZXU0UrN2lYOUJQ?=
 =?utf-8?B?d1Z2emZUMzVVcnNjTkErNlMzOGlPNk51MnA4ZGJOU2lvdVZGcXdYbm9WeTRP?=
 =?utf-8?B?czE5VExITFNFQTM3RExkR2JZQlEwNGppRGEwYVdVNFpYR3FoN041MjhLTDZv?=
 =?utf-8?B?bVE9PQ==?=
X-MS-Exchange-CrossTenant-Network-Message-Id: b568b7f7-aba8-4af1-119f-08dc34b36768
X-MS-Exchange-CrossTenant-AuthSource: CO1PR11MB5089.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 23 Feb 2024 21:07:11.9741
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: jJXY7D1YD65poUInibChpbyXcLMn9T80W0dF+THhsC/fEPNjMMjM/eUCPNH3nThqBz7uorkFJyXxlquZbZltVg5OtBhaVGE8esn8/yrYHJ8=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SA2PR11MB5100
X-OriginatorOrg: intel.com


On 2/23/2024 11:24 AM, Rahul Rameshbabu wrote:
> +/**
> + * struct ethtool_ts_stats - HW timestamping statistics
> + * @layer: input field denoting whether stats should be queried from the DMA or
> + *        PHY timestamping layer. Defaults to the active layer for packet
> + *        timestamping.
> + * @tx_stats: struct group for TX HW timestamping
> + *	@pkts: Number of packets successfully timestamped by the queried
> + *	      layer.
> + *	@lost: Number of packet timestamps that failed to get applied on a
> + *	      packet by the queried layer.
> + *	@late: Number of packet timestamps that were delivered by the
> + *	      hardware but were lost due to arriving too late.
> + *	@err: Number of timestamping errors that occurred on the queried
> + *	     layer.
> + */
> +struct ethtool_ts_stats {
> +	enum ethtool_ts_stats_layer layer;
> +	struct_group(tx_stats,
> +		u64 pkts;
> +		u64 lost;
> +		u64 late;
> +		u64 err;
> +	);
> +};

The Intel ice drivers has the following Tx timestamp statistics:

tx_hwtstamp_skipped - indicates when we get a Tx timestamp request but
are unable to fulfill it.
tx_hwtstamp_timeouts - indicates we had a Tx timestamp skb waiting for a
timestamp from hardware but it didn't get received within some internal
time limit.
tx_hwtstamp_flushed - indicates that we flushed an outstanding timestamp
before it completed, such as if the link resets or similar.
tx_hwtstamp_discarded - indicates that we obtained a timestamp from
hardware but were unable to complete it due to invalid cached data used
for timestamp extension.

I think these could be translated roughly to one of the lost, late, or
err stats. I am a bit confused as to how drivers could distinguish
between lost and late, but I guess that depends on the specific hardware
design.

In theory we could keep some of these more detailed stats but I don't
think we strictly need to be as detailed as the ice driver is.

The only major addition I think is the skipped stat, which I would
prefer to have. Perhaps that could be tracked in the netdev layer by
checking whether the skb flags to see whether or not the driver actually
set the appropriate flag?

I think i can otherwise translate the flushed status to the lost
category, the timeout to the late category, and everything else to the
error category. I can easily add a counter to track completed timestamps
as well.

TL;DR; I would like to see a "skipped" category since I think that
should be distinguished from general errors.

Thanks!