Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
MIME-Version: 1.0
References: <20221102022111.398283374@linuxfoundation.org>
In-Reply-To: <20221102022111.398283374@linuxfoundation.org>
From:   Naresh Kamboju <naresh.kamboju@linaro.org>
Date:   Wed, 2 Nov 2022 23:51:41 +0530
Message-ID: <CA+G9fYvcV7QSfN3GpjzxgLUD+TSJsFErCFeX-JvyCEN8yC8bcg@mail.gmail.com>
Subject: Re: [PATCH 6.0 000/240] 6.0.7-rc1 review
To:     Greg Kroah-Hartman <gregkh@linuxfoundation.org>
Cc:     stable@vger.kernel.org, patches@lists.linux.dev,
        linux-kernel@vger.kernel.org, torvalds@linux-foundation.org,
        akpm@linux-foundation.org, linux@roeck-us.net, shuah@kernel.org,
        patches@kernelci.org, lkft-triage@lists.linaro.org, pavel@denx.de,
        jonathanh@nvidia.com, f.fainelli@gmail.com,
        sudipm.mukherjee@gmail.com, srw@sladewatkins.net
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
Precedence: bulk

Results from Linaro=E2=80=99s test farm.
No regressions on arm64, arm, x86_64, and i386.

Tested-by: Linux Kernel Functional Testing <lkft@linaro.org>

NOTE:
We LKFT running same test suites on multiple configurations builds
on latest toolchains and on real hardware and qemu 's.

Because of the above reason we have been finding mixed results.
For example, Due to the slowness of the qemu few tests got timeout
but the same test passed on real hardware.

* qemu-arm64-gcc-12-lkftconfig-debug-kmemleak, ltp-cve
  - cve-2017-15299
  - cve-2017-15951
    tst_test.c:1524: TINFO: Timeout per run is 0h 02m 30s
    request_key03.c:59: TCONF: kernel doesn't support key type 'encrypted'
    request_key03.c:59: TCONF: kernel doesn't support key type 'trusted'
    <47>[  759.437664] systemd-journald[212]: Sent WATCHDOG=3D1 notificatio=
n.
    request_key03.c:135: TPASS: didn't crash while updating key of type 'us=
er'
    <47>[  869.408908] systemd-journald[212]: Sent WATCHDOG=3D1 notificatio=
n.
    Test timeouted, sending SIGKILL!
    tst_test.c:1569: TINFO: Killed the leftover descendant processes
    tst_test.c:1575: TINFO: If you are running on slow machine, try
exporting LTP_TIMEOUT_MUL > 1
    tst_test.c:1577: TBROK: Test killed! (timeout?)

  - cve-2020-25705
    tst_kconfig.c:82: TINFO: Parsing kernel config '/proc/config.gz'
    tst_test.c:1524: TINFO: Timeout per run is 0h 02m 30s
    <6>[ 1826.776891] IPv6: ADDRCONF(NETDEV_CHANGE): ltp_veth1: link
becomes ready
    <6>[ 1826.781937] IPv6: ADDRCONF(NETDEV_CHANGE): ltp_veth2: link
becomes ready
    icmp_rate_limit01.c:230: TINFO: Batch 0: Got 100 ICMP errors
    icmp_rate_limit01.c:234: TINFO: Batch 1: Got 100 ICMP errors
    icmp_rate_limit01.c:234: TINFO: Batch 2: Got 100 ICMP errors
    icmp_rate_limit01.c:234: TINFO: Batch 3: Got 100 ICMP errors
    icmp_rate_limit01.c:234: TINFO: Batch 4: Got 100 ICMP errors
    icmp_rate_limit01.c:234: TINFO: Batch 5: Got 100 ICMP errors
    icmp_rate_limit01.c:234: TINFO: Batch 6: Got 100 ICMP errors
    icmp_rate_limit01.c:234: TINFO: Batch 7: Got 100 ICMP errors
    icmp_rate_limit01.c:238: TFAIL: ICMP rate limit not randomized,
system is vulnerable

    HINT: You _MAY_ be missing kernel fixes:

    https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/comm=
it/?id=3Db38e7819cae9

    HINT: You _MAY_ be vulnerable to CVE(s):

    https://cve.mitre.org/cgi-bin/cvename.cgi?name=3DCVE-2020-25705

    Summary:
    passed   0
    failed   1
    [1] https://qa-reports.linaro.org/lkft/linux-stable-rc-linux-6.0.y/buil=
d/v6.0.6-241-g436175d0f780/testrun/12807800/suite/ltp-cve/test/cve-2017-152=
99/details/
    [2] https://qa-reports.linaro.org/lkft/linux-stable-rc-linux-6.0.y/buil=
d/v6.0.6-241-g436175d0f780/testrun/12807800/suite/ltp-cve/test/cve-2017-152=
99/log

* qemu-arm64-64k-page-size, ltp-hugetlb
  - hugemmap05
  - hugemmap05_1
  - hugemmap05_2
  - hugemmap05_3
    All these test failed due to ENOMEM.
        hugemmap05.c:83: TBROK: mmap((nil),1610612736,3,1,3,0) failed:
ENOMEM (12)
        hugemmap05.c:83: TBROK: mmap((nil),1610612736,3,1,3,0) failed:
ENOMEM (12)
    These failures only seen on qemu-arm64 but test passed on
    bcm2711-rpi-4-b-64k_page_size device with same config.
   [3] https://qa-reports.linaro.org/lkft/linux-stable-rc-linux-6.0.y/build=
/v6.0.6-241-g436175d0f780/testrun/12807533/suite/ltp-hugetlb/test/hugemmap0=
5/log
   [4] https://qa-reports.linaro.org/lkft/linux-stable-rc-linux-6.0.y/build=
/v6.0.6-241-g436175d0f780/testrun/12807533/suite/ltp-hugetlb/test/hugemmap0=
5/details/

* qemu-arm64-clang-15-lkftconfig, ltp-syscalls
  - add_key05
    add_key05.c:136: TFAIL: max used bytes 19991, key allow max bytes 20000

  - futex_cmp_requeue01
    futex_cmp_requeue01.c:68: TFAIL: process 89996 wasn't woken up:
ETIMEDOUT (110)
    [5] https://qa-reports.linaro.org/lkft/linux-stable-rc-linux-6.0.y/buil=
d/v6.0.6-241-g436175d0f780/testrun/12808167/suite/ltp-syscalls/test/add_key=
05/log

* qemu-arm64-gcc-12-lkftconfig-debug-kmemleak, ltp-syscalls
  - request_key03
    tst_test.c:1524: TINFO: Timeout per run is 0h 02m 30s
    request_key03.c:59: TCONF: kernel doesn't support key type 'encrypted'
    request_key03.c:59: TCONF: kernel doesn't support key type 'trusted'
    <47>[ 4891.998441] systemd-journald[211]: Sent WATCHDOG=3D1 notificatio=
n.
    request_key03.c:135: TPASS: didn't crash while updating key of type 'us=
er'
    Test timeouted, sending SIGKILL!
    tst_test.c:1569: TINFO: Killed the leftover descendant processes
    tst_test.c:1575: TINFO: If you are running on slow machine, try
exporting LTP_TIMEOUT_MUL > 1
    tst_test.c:1577: TBROK: Test killed! (timeout?)
        [6] https://qa-reports.linaro.org/lkft/linux-stable-rc-linux-6.0.y/=
build/v6.0.6-241-g436175d0f780/testrun/12810384/suite/ltp-syscalls/test/req=
uest_key03/log

* qemu-i386, ltp-fs_bind
  - fs_bind_rbind07_sh
    fs_bind_rbind07 1 TPASS: umount share2 passed as expected
    umount: /scratch/ltp-BdrYN1uDRZ/LTP_fs_bind_rbind07.R6J2DAH7FB/sandbox/=
parent2:
target is busy.
    fs_bind_rbind07 1 TFAIL: umount parent2 failed unexpectedly
    fs_bind_rbind07 1 TPASS: umount parent2 passed as expected
    fs_bind_rbind07 1 TPASS: umount parent1 passed as expected
    fs_bind_rbind07 1 TFAIL: There are still mounts in the sandbox:\nparent=
2
        [7] https://qa-reports.linaro.org/lkft/linux-stable-rc-linux-6.0.y/=
build/v6.0.6-241-g436175d0f780/testrun/12808354/suite/ltp-fs_bind/test/fs_b=
ind_rbind07_sh/log

## Build
* kernel: 6.0.7-rc1
* git: https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable-rc
* git branch: linux-6.0.y
* git commit: 436175d0f780af8302164b3102ecf0ff99f7a376
* git describe: v6.0.6-241-g436175d0f780
* test details:
https://qa-reports.linaro.org/lkft/linux-stable-rc-linux-6.0.y/build/v6.0.6=
-241-g436175d0f780

## No Test Regressions (compared to v6.0.5-94-gd5a53a666fb9)

## No Metric Regressions (compared to v6.0.5-94-gd5a53a666fb9)

## No Test Fixes (compared to v6.0.5-94-gd5a53a666fb9)

## No Metric Fixes (compared to v6.0.5-94-gd5a53a666fb9)


## Test result summary
total: 160584, pass: 131298, fail: 11489, skip: 17432, xfail: 365

## Build Summary
* arc: 5 total, 5 passed, 0 failed
* arm: 149 total, 146 passed, 3 failed
* arm64: 47 total, 47 passed, 0 failed
* i386: 37 total, 36 passed, 1 failed
* mips: 27 total, 26 passed, 1 failed
* parisc: 6 total, 6 passed, 0 failed
* powerpc: 34 total, 30 passed, 4 failed
* riscv: 12 total, 12 passed, 0 failed
* s390: 12 total, 12 passed, 0 failed
* sh: 12 total, 12 passed, 0 failed
* sparc: 6 total, 6 passed, 0 failed
* x86_64: 40 total, 40 passed, 0 failed

## Test suites summary
* fwts
* igt-gpu-tools
* kselftest-android
* kselftest-arm64
* kselftest-arm64/arm64.btitest.bti_c_func
* kselftest-arm64/arm64.btitest.bti_j_func
* kselftest-arm64/arm64.btitest.bti_jc_func
* kselftest-arm64/arm64.btitest.bti_none_func
* kselftest-arm64/arm64.btitest.nohint_func
* kselftest-arm64/arm64.btitest.paciasp_func
* kselftest-arm64/arm64.nobtitest.bti_c_func
* kselftest-arm64/arm64.nobtitest.bti_j_func
* kselftest-arm64/arm64.nobtitest.bti_jc_func
* kselftest-arm64/arm64.nobtitest.bti_none_func
* kselftest-arm64/arm64.nobtitest.nohint_func
* kselftest-arm64/arm64.nobtitest.paciasp_func
* kselftest-breakpoints
* kselftest-capabilities
* kselftest-cgroup
* kselftest-clone3
* kselftest-core
* kselftest-cpu-hotplug
* kselftest-cpufreq
* kselftest-drivers-dma-buf
* kselftest-efivarfs
* kselftest-filesystems
* kselftest-filesystems-binderfs
* kselftest-firmware
* kselftest-fpu
* kselftest-futex
* kselftest-gpio
* kselftest-intel_pstate
* kselftest-ipc
* kselftest-ir
* kselftest-kcmp
* kselftest-kexec
* kselftest-kvm
* kselftest-lib
* kselftest-livepatch
* kselftest-membarrier
* kselftest-memfd
* kselftest-memory-hotplug
* kselftest-mincore
* kselftest-mount
* kselftest-mqueue
* kselftest-net
* kselftest-net-forwarding
* kselftest-net-mptcp
* kselftest-netfilter
* kselftest-nsfs
* kselftest-openat2
* kselftest-pid_namespace
* kselftest-pidfd
* kselftest-proc
* kselftest-pstore
* kselftest-ptrace
* kselftest-rseq
* kselftest-rtc
* kselftest-seccomp
* kselftest-sigaltstack
* kselftest-size
* kselftest-splice
* kselftest-static_keys
* kselftest-sync
* kselftest-sysctl
* kselftest-tc-testing
* kselftest-timens
* kselftest-timers
* kselftest-tmpfs
* kselftest-tpm2
* kselftest-user
* kselftest-vm
* kselftest-x86
* kselftest-zram
* kunit
* kvm-unit-tests
* libgpiod
* libhugetlbfs
* log-parser-boot
* log-parser-test
* ltp-cap_bounds
* ltp-commands
* ltp-containers
* ltp-controllers
* ltp-cpuhotplug
* ltp-crypto
* ltp-cve
* ltp-dio
* ltp-fcntl-locktests
* ltp-filecaps
* ltp-fs
* ltp-fs_bind
* ltp-fs_perms_simple
* ltp-fsx
* ltp-hugetlb
* ltp-io
* ltp-ipc
* ltp-math
* ltp-mm
* ltp-nptl
* ltp-open-posix-tests
* ltp-pty
* ltp-sched
* ltp-securebits
* ltp-smoke
* ltp-syscalls
* ltp-tracing
* network-basic-tests
* perf
* perf/Zstd-perf.data-compression
* rcutorture
* v4l2-compliance
* vdso

--
Linaro LKFT
https://lkft.linaro.org