Received-SPF: pass (google.com: domain of linux-kernel+bounces-43527-linux.lists.archive=gmail.com@vger.kernel.org designates 139.178.88.99 as permitted sender) client-ip=139.178.88.99;
Date: Mon, 29 Jan 2024 16:29:46 -0500
From: Rodrigo Vivi <rodrigo.vivi@intel.com>
To: Johannes Berg <johannes@sipsolutions.net>
CC: <linux-kernel@vger.kernel.org>, Jose Souza <jose.souza@intel.com>, Maarten
 Lankhorst <maarten.lankhorst@linux.intel.com>, Greg Kroah-Hartman
	<gregkh@linuxfoundation.org>, "Rafael J . Wysocki" <rafael@kernel.org>
Subject: Re: [PATCH 1/2] devcoredump: Remove devcoredump device if failing
 device is gone
Message-ID: <ZbgYyra1Ypa0nf6u@intel.com>
References: <20240126151121.1076079-1-rodrigo.vivi@intel.com>
 <d57dc34fa8b0e25cec014b8001dcd0527d1c1013.camel@sipsolutions.net>
Content-Type: text/plain; charset="us-ascii"
Content-Disposition: inline
In-Reply-To: <d57dc34fa8b0e25cec014b8001dcd0527d1c1013.camel@sipsolutions.net>
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?6BOKIwMZEUPaiYoEQifD3DtPI1n6kgqxpoAwFtxf19yRbLoj965uxGDHSdI+?=
 =?us-ascii?Q?tSAHF8mOdwoYuoYIIEKUwSkH3LHyYX10BHK5d1m0cwPwv41dMmRXTrsQu3GA?=
 =?us-ascii?Q?Q9NQdURiUZcTISjHHabdPU3+K2LI/OK8Yzyte2TJcZqAfMGFExa2AQZ2Egev?=
 =?us-ascii?Q?LQauv3f9FYpVgMfJhRwlgBnNf92ksODfXyCTA6NwaR6C2MDI4nyU/e8LeHc4?=
 =?us-ascii?Q?m5yNixFGZFgwEO3OZ++PQiC9dApPUbt5qzIO8o20Hl7+ThUlIlRTtTx+RQVR?=
 =?us-ascii?Q?uR5EQM1rygdG39II11KxakpM+RN4cx4qmtNbtXlP/jwV5ca3sOmfT16pWm05?=
 =?us-ascii?Q?oss3Ealb2yJ/frY2ADvSYGHSw6tsdBwzqDwKzAK3a4YLKp9jNhT85pNt6uNr?=
 =?us-ascii?Q?TPQWI5zBGE9MPmbBop/g0maHXzjmjOafnPoe+pm50bk8DP24g/ftoRDSVy4n?=
 =?us-ascii?Q?aiYORrKCjy6oFOhmInBpVxJK5v9RcbR7egKvVUG4H2tFJjvQiQRUh5xTKRBe?=
 =?us-ascii?Q?Ng45pvrmC/BD0N7ArYNkWSYwNKnVMuBGrFXIFugJlxd4Q4zP/jZcnvZZKuzi?=
 =?us-ascii?Q?+MAuctnhLNXiWo8AvrNdb0ffUVRlpU7ZdS/cO0dg7csECeO5XMMbpYtYJI3P?=
 =?us-ascii?Q?Eh/bt+/LMBrkmv3LaOHWb3bJJ4Dk0WEbHCEqLbIRyckytQDORLgM5L7lAqPm?=
 =?us-ascii?Q?bGSu5e7OlygRLYXwmwHLg2DWEF5Zk54A+VLWz0oM/sEgcG3ibqQ+2iLh8p8e?=
 =?us-ascii?Q?cOnZUsfCtmybFXchp9sfDm+tkoXpCrKtGwN3ZiN5+q7wsn83GNj5rep7JpNl?=
 =?us-ascii?Q?ErC8vSFPR6JjYmOu6tGW1GTHypMx5p1H6OkPvqNyxGtdTNEPytAndcxS9VCE?=
 =?us-ascii?Q?FwNYhf6P8aIHUPUe4+NNuyeb7WPpv9YLkait/+xAFl8cpOQd9sKobUiScLlt?=
 =?us-ascii?Q?bUE/iwKtwDpoH0cU1yym1WDe8ihjdp26R9numRV7Ogs+7Z+5zU9KUmnpeult?=
 =?us-ascii?Q?JDQABDhUz9RsT1vqp0k3q5+ArbA/MqL46iG79sC5dP78+qND6tTNQkZXOgN8?=
 =?us-ascii?Q?6Ly6UogacRgfs1mPcZht2eMlBicH3v/y1NBIthdIMDKw2CyyfyampOJGSKEr?=
 =?us-ascii?Q?OAfugLQu0zJ2NA46Eof+skinYC5s54tpzrEEcKjU4yD3wvuKrWr3BRdFjoCz?=
 =?us-ascii?Q?mZvi7uCxLYfEKOONEmGMCeimrLpFpQTV7h9HYHiClbqSXG0QBCHRpNSlb3gX?=
 =?us-ascii?Q?Fdya7gA/jeZ52FMKHgymej0uGqZONa1frbqxIEnBl53G+TTQMgGofAp8zg7t?=
 =?us-ascii?Q?F81gBMcu+2/HoumhHLbdzyDKbO93axrmJQ95QfZFj4PEuvzzlurqZUNRLZ7o?=
 =?us-ascii?Q?xvbubrXZH8/j2tQ6jg+DTs6AaaCNGV7Q1UwCNQgV2TILLIecX39B/ic7M+If?=
 =?us-ascii?Q?o3DtHp5BA2gSGcwXLJN5jD4qSPv5rVMQlM07o8rI34zL79O9N0Lk9RRRWTFm?=
 =?us-ascii?Q?T0zjSknBgy8dfSCqV4u9j7RXSZ1CoLHCmBHppMK8DL9tIdCJvafGMlyuwu0G?=
 =?us-ascii?Q?rIuT0sk5XFHPxJWv21U28POZDVNJYxs/qry8tZQK?=
X-MS-Exchange-CrossTenant-Network-Message-Id: 237104c5-218e-4b2c-ace0-08dc21116b37
X-MS-Exchange-CrossTenant-AuthSource: MN0PR11MB6059.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 29 Jan 2024 21:29:47.9880
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: yrfY2u2/ukeUTBqt0eyEn3y5GJUTpgeQtpLGJMFYOB2bSq/4//nbfSabznYZglyeZ9F+iszM3f+iSu81iUd80Q==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SA2PR11MB4953
X-OriginatorOrg: intel.com

On Mon, Jan 29, 2024 at 06:48:12PM +0100, Johannes Berg wrote:
> On Fri, 2024-01-26 at 10:11 -0500, Rodrigo Vivi wrote:
> > Make dev_coredumpm a real device managed helper, that not only
> > frees the device after a scheduled delay (DEVCD_TIMEOUT), but
> > also when the failing/crashed device is gone.
> > 
> > The module remove for the drivers using devcoredump are currently
> > broken if attempted between the crash and the DEVCD_TIMEOUT, since
> > the symbolic sysfs link won't be deleted.
> 
> Hmm, is it a problem to remove a whole dev when it still has some link
> here? 

Well, the big problem is that with link there, the base sysfs dir
is not deleted/removed. So, the next reload fails to recreate beucase
file exists.

> Maybe we could just make the link be managed/auto-removed?

this would help this angle indeed.

> 
> Probably regardless of that you should change the comment in
> devcd_dev_release() since it's no longer a concern?

indeed, I don't believe that that is a concern because this
is exactly the only place deleting the link and it can't race
with itself.

> 
> > On top of that, for PCI devices, the unbind of the device will
> > call the pci .remove void function, that cannot fail. At that
> > time, our device is pretty much gone, but the read and free
> > functions are alive trough the devcoredump device and they
>                       ^ through, I guess
> 
> > can get some NULL dereferences or use after free.
> 
> Not sure I understand this part, how's this related to PCI's .remove?

Well, this is my secondary concern that the idea of the link_auto_removal
doesn't cover.

If the failing_device is gone, the 'data cookie' it used to register with
dev_coredumpm(... void *data,...), is also likely gone on a clean removal.

And to be honest, we shouldn't even count that the registered *read()
function pointer is valid anymore.

I'm sorry for not being clear on this point. The other one was the
immediate one blocking our CI so I ended up writing up the commit
message with that in mind and without thinking about alternatives
like only removing the link.

> 
> > So, if the failing-device is gone let's also request for the
> > devcoredump-device removal using the same mod_delayed_work
> > as when writing anything through data. The flush cannot be
> > used since it is synchronous and the devcd would be surely
> > gone right before the mutex_unlock on the next line.
> 
> Can we just decouple it instead and remove the symlink? Which is kind of
> what the comment in devcd_dev_release() says but at the time I wasn't
> aware of all the devm mechanics etc.

Well, we could indeed. And that would unblock our CI, but I'm afraid
it wouldn't protect the final user from bad memory access on a direct
$ cat /sys/class/devcoredump/devcd<n>/data

Shouldn't we consider this critical itself to justify this entirely
removal?

> 
> I'm thinking this might be annoying in certain recovery cases, e.g.
> iwlwifi uses this but may sometimes unbind/rebind itself to recover from
> certain errors, and that'd make the FW dumps disappear.

I see... but it looks like dev_coredumpsg have a different handle of
the data cookie and read functions with the read direct from the
sgtable and might not face this bad memory access, since it allocates
the sg_dump_data which is only deleted/freed by the devcoredump removal...

But I'm concerned with the direct usage of the drivers using
dev_coredumpm() directly.

Should I then move dev_coredumpm to  _dev_coredumpm()
and then create a new dev_coredumpm that calls for
_dev_coredump and this devm_add_action(dev, devcd_remove, devcd)

?

And also an improved commit message to show the bad memory access issue?

Thank you so much for the feedback,
Rodrigo.

> 
> johannes