Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
From:   Peng Fan <peng.fan@nxp.com>
To:     Mathieu Poirier <mathieu.poirier@linaro.org>,
        Peng Fan <peng.fan@nxp.com>
CC:     "bjorn.andersson@linaro.org" <bjorn.andersson@linaro.org>,
        "linux-remoteproc@vger.kernel.org" <linux-remoteproc@vger.kernel.org>,
        "linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>
Subject: RE: [PATCH V5 2/2] remoteproc: support attach recovery after rproc
 crash
Thread-Topic: [PATCH V5 2/2] remoteproc: support attach recovery after rproc
 crash
Thread-Index: AQHYgGarCm9RA61pbUCfdvVoyqslW61buVWAgAAkCkA=
Date:   Wed, 22 Jun 2022 19:44:08 +0000
Message-ID: <DU0PR04MB941734D3AE30D57EBE0C71D888B29@DU0PR04MB9417.eurprd04.prod.outlook.com>
References: <20220615032048.465486-1-peng.fan@oss.nxp.com>
 <20220615032048.465486-3-peng.fan@oss.nxp.com>
 <20220622172529.GC1606016@p14s>
In-Reply-To: <20220622172529.GC1606016@p14s>
Accept-Language: en-US
Content-Language: en-US
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?kKtDXIIvX2r4qJDFCRFZ6H9XOOzrlgzYV/0mL0DT/AKx8V53zP8ADa7f0Cxo?=
 =?us-ascii?Q?2wzpmusnfyP/6827CO6n7PH70yjHaEnImMp0aUOnsbN0R63AujVBIU3kLqKx?=
 =?us-ascii?Q?ksaTnVZ54y3AQnjnvfHJ74gQT4ohyQyIv5pQ8zhXN9wRET8q+SLC+Hpcd0a9?=
 =?us-ascii?Q?SbNWT5ahjWOuvJni1oE/Xbv7kmKrofyJCKWPZ7FgWxAv4it3Xg6jHVFCAdaS?=
 =?us-ascii?Q?NdRZP35ipLRIseN5qSGg0sVRaTg6IG0e3W82ykzqhY7/GegMzBQP38ZjhVEE?=
 =?us-ascii?Q?pWGB+LTZC8J30mnxVPT/c3qXGb3x8MOhTz3YE++W6u28Onsuh7q4eN8CKD8I?=
 =?us-ascii?Q?z+I0QgKqHXigl2m2uQKgForUHBta7iQJ8eNMiwcwJA/pdyC0PVcCOKUZUk+Q?=
 =?us-ascii?Q?D8hDDV1QNjlfQBAoueXOC9TCwOzOSpYgnWKFqahooQZo1+ZDYwacplXn2tu0?=
 =?us-ascii?Q?xSAm3qFN1xJ8mDV754fRZ2Vj3ilFZzrqypYZR9JsIHZWoCVLEXEdlg1+e0kC?=
 =?us-ascii?Q?KvjL9Pkhb3YRH5Wu7/DBP6IqzJD00bPNQ5lwizZAarqULBalSS5FaxlgE2cL?=
 =?us-ascii?Q?dbATv4srFbcrTg8+/KoRXaUSfT4oZFJjrG1yUh6n7kOKbZkQ+wKTq6+cwd2E?=
 =?us-ascii?Q?2yjDXz0OxXJGy5jR31VdcOvtbx045w2F3BxINpxKd5wA+ilSZ405tVm2SDKc?=
 =?us-ascii?Q?TGf+67hnNOmGbh36bRMh8mzandgbZ47GviYBSurO37dos5R/IcCNL4bomZGL?=
 =?us-ascii?Q?ya3B7CniGevARAZg/P4FgWhul8zkJb5o0nbuYcv/WphYGK0eR6jc+ehlIyuU?=
 =?us-ascii?Q?+VuNiiamDSMyUijjcEX8OmPBcrByo6eHyd0XyvwQlQ7Zlv3P6EYczSIm+SdH?=
 =?us-ascii?Q?Ii1rGrXwAYqePS9dJMonoVqsS31FvkOKiuSX3rnpR3f6EQC9rOgl+l9+4k34?=
 =?us-ascii?Q?40coFmfUbOm5r51QzqqreTQxmJ3gU6wFgHXpL3mnHhd+P0xCEuMdmpjU0NvA?=
 =?us-ascii?Q?H/TQ6HGrbx+/7rd5+sjH5S0EgkBqWTAEx4eTdqC3F4eFZXE6OsKqq/1lggtl?=
 =?us-ascii?Q?NXyhbmcRjAg0FYvC58M73VJOWmzPMCsrNBa+err6JLSq/UOVsJqVe1dySrwv?=
 =?us-ascii?Q?wwenThOtO5N65gYN8pv+i0c3VcGvqOhoe3AqTQGQapqXtQVQ3AzNLZPt5/Cs?=
 =?us-ascii?Q?JxaTCm0oV8QM3N61rsbqorIBTWMF02zl3dX85pBsxVx8zL8rZj0nHV1ty9ge?=
 =?us-ascii?Q?hl/Yv8idxLV60FbUl64gSBKihUrNioqb3fzLGaBFoeQTgFhRPgsy7XBizQq4?=
 =?us-ascii?Q?MqCERcYwC/DTD1UbPClZZi5t//LF3wk2vWqrGj8pDQUB4bHbQ1NEszjMEbS+?=
 =?us-ascii?Q?ijklUV/u6f/0uE4x9+OkxnwyfodFFYmuyqIW3pnX4/lb3NE+LUFcIJkiH25R?=
 =?us-ascii?Q?P/bfc7qwZWcKUrCOTiSO3+gqd53f5a9XeKkUAS0HurmG6o1tcjkTac4DePjb?=
 =?us-ascii?Q?1eSNCVhb7fKs5N4Ewfq8LCc0SZcm4nbplg3sqyOso5558VDuWsBUU+qojrn/?=
 =?us-ascii?Q?P/wWf+lnXICDhUvPYG2SeZZbTvnryNv3a/FGEdjOO2TmYHoPsQ+/LDXLwazK?=
 =?us-ascii?Q?Qf7omxK1l/Qt8D1E3khNg7okcHjZdBP4hnxJeQWV4IiYu8kJMIy9/RdbSgD9?=
 =?us-ascii?Q?SvbL5uMLYtMOAyavG7mfz9ULozkxSJBdrW+kxYA7aE0hRkQQ?=
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-OriginatorOrg: nxp.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: DU0PR04MB9417.eurprd04.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 2c66f832-5c09-4e88-4990-08da548792a7
X-MS-Exchange-CrossTenant-originalarrivaltime: 22 Jun 2022 19:44:08.3945
 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 686ea1d3-bc2b-4c6f-a92c-d99c5c301635
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: bjpmXmjlYRMgPTEggCRlMHtwiSDumHVAbB9EdE1dMzWQ49yNb5ZNyOCJaHdCv3Wf4HIDuhM1cuhqdUOkXkk8iw==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM8PR04MB7297
X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIM_SIGNED,
        DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_NONE,
        RCVD_IN_MSPIKE_H2,SPF_HELO_PASS,SPF_PASS,T_SCC_BODY_TEXT_LINE
        autolearn=ham autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

Hi Mathieu,

> Subject: Re: [PATCH V5 2/2] remoteproc: support attach recovery after rpr=
oc
> crash
>=20
> On Wed, Jun 15, 2022 at 11:20:48AM +0800, Peng Fan (OSS) wrote:
> > From: Peng Fan <peng.fan@nxp.com>
> >
> > Current logic only support main processor to stop/start the remote
> > processor after rproc crash. However to SoC, such as i.MX8QM/QXP, the
> > remote processor could do attach recovery after crash and trigger
> > watchdog reboot. It does not need main processor to load image, or
> > stop/start M4 core.
> >
> > Introduce two functions: rproc_attach_recovery,
> > rproc_firmware_recovery for the two cases. Firmware recovery is as
> > before, let main processor to help recovery, while attach recovery is r=
ecover
> itself withou help.
> > To attach recovery, we only do detach and attach.
> >
> > Signed-off-by: Peng Fan <peng.fan@nxp.com>
> > ---
> >  drivers/remoteproc/remoteproc_core.c | 64
> > +++++++++++++++++++---------
> >  1 file changed, 45 insertions(+), 19 deletions(-)
> >
> > diff --git a/drivers/remoteproc/remoteproc_core.c
> > b/drivers/remoteproc/remoteproc_core.c
> > index 02a04ab34a23..1c1c90176aff 100644
> > --- a/drivers/remoteproc/remoteproc_core.c
> > +++ b/drivers/remoteproc/remoteproc_core.c
> > @@ -1883,6 +1883,47 @@ static int __rproc_detach(struct rproc *rproc)
> >  	return 0;
> >  }
> >
> > +static int rproc_attach_recovery(struct rproc *rproc) {
> > +	int ret;
> > +
> > +	mutex_unlock(&rproc->lock);
> > +	ret =3D __rproc_detach(rproc);
> > +	mutex_lock(&rproc->lock);
> > +	if (ret)
> > +		return ret;
> > +
> > +	return __rproc_attach(rproc);
> > +}
> > +
> > +static int rproc_firmware_recovery(struct rproc *rproc)
>=20
> s/rproc_firmware_recovery/rproc_boot_recovery
>=20
> > +{
> > +	const struct firmware *firmware_p;
> > +	struct device *dev =3D &rproc->dev;
> > +	int ret;
> > +
> > +	ret =3D rproc_stop(rproc, true);
> > +	if (ret)
> > +		return ret;
> > +
> > +	/* generate coredump */
> > +	rproc->ops->coredump(rproc);
> > +
> > +	/* load firmware */
> > +	ret =3D request_firmware(&firmware_p, rproc->firmware, dev);
> > +	if (ret < 0) {
> > +		dev_err(dev, "request_firmware failed: %d\n", ret);
> > +		return ret;
> > +	}
> > +
> > +	/* boot the remote processor up again */
> > +	ret =3D rproc_start(rproc, firmware_p);
> > +
> > +	release_firmware(firmware_p);
> > +
> > +	return ret;
> > +}
> > +
> >  /**
> >   * rproc_trigger_recovery() - recover a remoteproc
> >   * @rproc: the remote processor
> > @@ -1897,7 +1938,6 @@ static int __rproc_detach(struct rproc *rproc)
> >   */
> >  int rproc_trigger_recovery(struct rproc *rproc)  {
> > -	const struct firmware *firmware_p;
> >  	struct device *dev =3D &rproc->dev;
> >  	int ret;
> >
> > @@ -1911,24 +1951,10 @@ int rproc_trigger_recovery(struct rproc
> > *rproc)
> >
> >  	dev_err(dev, "recovering %s\n", rproc->name);
> >
> > -	ret =3D rproc_stop(rproc, true);
> > -	if (ret)
> > -		goto unlock_mutex;
> > -
> > -	/* generate coredump */
> > -	rproc->ops->coredump(rproc);
> > -
> > -	/* load firmware */
> > -	ret =3D request_firmware(&firmware_p, rproc->firmware, dev);
> > -	if (ret < 0) {
> > -		dev_err(dev, "request_firmware failed: %d\n", ret);
> > -		goto unlock_mutex;
> > -	}
> > -
> > -	/* boot the remote processor up again */
> > -	ret =3D rproc_start(rproc, firmware_p);
> > -
> > -	release_firmware(firmware_p);
> > +	if (rproc_has_feature(rproc, RPROC_FEAT_ATTACH_ON_RECOVERY))
> > +		ret =3D rproc_attach_recovery(rproc);
> > +	else
> > +		ret =3D rproc_firmware_recovery(rproc);
>=20
> This patch contains a serious flaw related to locking that should have be=
en
> obvious when it was put together.  Please go back and carefully review th=
e
> code you are submitting.

I think you mean the following change? In v4, I use rproc_detach, but
I missed to drop the unlock and lock when changing to use __rproc_detach
based on your comments in V4. My bad.
+static int rproc_attach_recovery(struct rproc *rproc)
+{
+       int ret;
+
+       mutex_unlock(&rproc->lock);
+       ret =3D __rproc_detach(rproc);
+       mutex_lock(&rproc->lock);
+       if (ret)
+               return ret;
+
+       return __rproc_attach(rproc);
+}

I will drop the unlock and lock as below.
static int rproc_attach_recovery(struct rproc *rproc)
{
        int ret;

        ret =3D __rproc_detach(rproc);
        if (ret)
                return ret;

        return __rproc_attach(rproc);
}

>=20
> I will not consider another revision of this set until July 15th.

No problem. Hope until then, my v6 patch would not be just
enter into your queue and be the end one :)

Thanks,
Peng.

>=20
> Thanks,
> Mathieu
>=20
> >
> >  unlock_mutex:
> >  	mutex_unlock(&rproc->lock);
> > --
> > 2.25.1
> >