Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
MIME-Version: 1.0
From:   Naresh Kamboju <naresh.kamboju@linaro.org>
Date:   Wed, 16 Nov 2022 17:46:33 +0530
Message-ID: <CA+G9fYu0p4cFdkrkQyV4OC-iPpY18asV0VTP=O_sysLNaJJAQw@mail.gmail.com>
Subject: kselftest: Bad test result: from results parsing in LAVA
To:     open list <linux-kernel@vger.kernel.org>,
        "open list:KERNEL SELFTEST FRAMEWORK" 
        <linux-kselftest@vger.kernel.org>, lkft-triage@lists.linaro.org
Cc:     Shuah Khan <shuah@kernel.org>, Mark Brown <broonie@kernel.org>,
        Kees Cook <keescook@chromium.org>,
        Anders Roxell <anders.roxell@linaro.org>,
        Remi Duraffort <remi.duraffort@linaro.org>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
Precedence: bulk

kselftest running on LAVA infrastures provides test results parser
from test-definitions repository.
which is getting  "Bad test result:".

I have noticed this on kernelci [1] and LKFT LAVA instances [2].
We need to investigate and change parse_output [3] inside test-definitions.

Report-by: Linux Kernel Functional Testing <lkft@linaro.org>

Test results parser showing =E2=80=9CBad test results: =E2=80=9C,

Received signal: <TESTCASE> TEST_CASE_ID=3Darm64.sve-ptrace.SVE RESULT=3DFP=
SIMD
Bad test result: FPSIMD
<LAVA_SIGNAL_TESTCASE TEST_CASE_ID=3Darm64.sve-ptrace.SVE RESULT=3DFPSIMD>
Received signal: <TESTCASE> TEST_CASE_ID=3Darm64.sve-ptrace.SVE
RESULT=3Dget_fpsimd()
Bad test result: get_fpsimd()
<LAVA_SIGNAL_TESTCASE TEST_CASE_ID=3Darm64.sve-ptrace.SVE RESULT=3Dget_fpsi=
md()>
Received signal: <TESTCASE> TEST_CASE_ID=3Darm64.sve-ptrace.SVE
RESULT=3DSVE_PT_VL_INHERIT
Bad test result: SVE_PT_VL_INHERIT
<LAVA_SIGNAL_TESTCASE TEST_CASE_ID=3Darm64.sve-ptrace.SVE
RESULT=3DSVE_PT_VL_INHERIT>
Received signal: <TESTCASE> TEST_CASE_ID=3Darm64.sve-ptrace.SVE
RESULT=3DSVE_PT_VL_INHERIT
Bad test result: SVE_PT_VL_INHERIT
<LAVA_SIGNAL_TESTCASE TEST_CASE_ID=3Darm64.sve-ptrace.SVE
RESULT=3DSVE_PT_VL_INHERIT>
Received signal: <TESTCASE> TEST_CASE_ID=3Darm64.sve-ptrace.Set RESULT=3DSV=
E
Bad test result: SVE
<LAVA_SIGNAL_TESTCASE TEST_CASE_ID=3Darm64.sve-ptrace.Set RESULT=3DSVE>
<LAVA_SIGNAL_TESTCASE TEST_CASE_ID=3Darm64.sve-ptrace.Set RESULT=3Dand>
Received signal: <TESTCASE> TEST_CASE_ID=3Darm64.sve-ptrace.Set RESULT=3Dan=
d
Bad test result: and
Received signal: <TESTCASE> TEST_CASE_ID=3Darm64.sve-ptrace.Set RESULT=3Dan=
d
Bad test result: and
..
<LAVA_SIGNAL_TESTCASE TEST_CASE_ID=3Dclone3.clone3_set_tid.[1710] RESULT=3D=
Result>
Received signal: <TESTCASE> TEST_CASE_ID=3Dclone3.clone3_set_tid.[1710]
RESULT=3DResult
Bad test result: Result

[1] https://storage.kernelci.org/next/master/next-20221116/arm64/defconfig+=
arm64-chromebook/gcc-10/lab-collabora/kselftest-arm64-mt8173-elm-hana.html#=
L3105
[2] https://linaro.atlassian.net/browse/LKQ-934
[3] https://github.com/Linaro/test-definitions/blob/master/automated/linux/=
kselftest/kselftest.sh#L124
[4] https://lkft.validation.linaro.org/scheduler/job/5729151#L2511

--
Linaro LKFT
https://lkft.linaro.org