Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Date:   Wed, 11 Jan 2023 15:29:14 +0000
From:   Mark Brown <broonie@kernel.org>
To:     Naresh Kamboju <naresh.kamboju@linaro.org>
Cc:     linux-kernel@vger.kernel.org, linux-kselftest@vger.kernel.org,
        lkft-triage@lists.linaro.org, skhan@linuxfoundation.org,
        will@kernel.org, anders.roxell@linaro.org
Subject: Re: [PATCH] selftests/arm64: bump timeout to 15 minutes
Message-ID: <Y77Vynb+rhiQMJQB@sirena.org.uk>
References: <20230111142912.81606-1-naresh.kamboju@linaro.org>
MIME-Version: 1.0
Content-Type: multipart/signed; micalg=pgp-sha512;
        protocol="application/pgp-signature"; boundary="OpEFxpQGrRN7OL+v"
Content-Disposition: inline
In-Reply-To: <20230111142912.81606-1-naresh.kamboju@linaro.org>
Precedence: bulk


--OpEFxpQGrRN7OL+v
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline

On Wed, Jan 11, 2023 at 07:59:12PM +0530, Naresh Kamboju wrote:

> LKFT CI found that with the latest mainline kernel (6.1) on
> some QEMU emulators and FVP, the following tests will take
> longer than the kselftest framework default timeout (45 seconds) to
> run and thus got terminated with TIMEOUT error:
> * fp-stress - took about 11m30s
> * sve-ptrace - took about 8m50s
> * check_gcr_el1_cswitch - took about 6m
> * check_user_mem - took about 3m
> * syscall-abi - took about 5m

We should really only be applying this to emulated platforms, all these
tests will run in a much more sensible time on physical platforms (eg,
fp-stress runs for the target of slightly more than 10s on every
physical platform I've tried it on and I've no reason to believe it'd
have problems on others).  Even for emulated specific configuration
that's a bit of a moving target given the range of emulation options out
there.

I do also note that the systems you're using appear to be giving
astonishingly poor performance even for emulated platforms, for example
on my desktop here syscall-abi takes about 12s in qemu and what the FVP
internally thinks is 10s there for the default set of vector lengths
(the actual wall clock time for the FVP is more like 45s, but I'd expect
the runner to enforce the internally recorded time).  Even fp-stress is
running in about 20s on qemu, though it does rather badly stress the
current versions of the FVP and start getting up to something more like
what you're reporting with 8 cores (the biggest performance issues there
are for things that stress multiple cores simultaneously).

Conincidentally I just wrote a change to the ptrace tests which will
reduce the number of cases which will reduce the I/O costs a lot if
nothing else.

--OpEFxpQGrRN7OL+v
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----

iQEzBAABCgAdFiEEreZoqmdXGLWf4p/qJNaLcl1Uh9AFAmO+1ckACgkQJNaLcl1U
h9B0Wgf/enT1TUVf8j97uV900bXkgbamjFrE4LK9cU//1/7Wlo5kf0evIp/A7pwm
mHWMr8Zw4eRxoemDXY74qE1nbDo1EU52XM006lKnSIcFvfq9qnbZkt2nsndyuXbB
+NyWKQ3sjqsoO6UVs/jl9HyA7ZyAyeYQnaWTeEtMD8ionSjpjJcYUg4v0god9CfR
11x78bbe5ugPtIW/68CqjK24EQnED6iMZXzt/yLcgrHgBazC9+ml9JxrfuVQCaY6
EB273IF166Cu93ijgnHNyebcN7NhRZP58mSYAAoohfIXrhXawjAFUuKA2pQ9/Fsb
1+sP3N99zbyewIHcIK/DM9Dyxr3XXg==
=SJkQ
-----END PGP SIGNATURE-----

--OpEFxpQGrRN7OL+v--