2020-01-20 16:40:53

by Cyril Hrubis

[permalink] [raw]
Subject: [ANNOUNCE] The Linux Test Project has been released for JANUARY 2020

Good news everyone,

the Linux Test Project test suite stable release for *January 2020* has been
released.

Since the last release 195 patches by 31 authors were merged.

NOTABLE CHANGES
===============

* New tests
- vmsplice03 (splicing pipe to user memory)
- prctl08, prctl09 (PR_{SET,GET}_TIMERSLACK)

* New regression tests
- bpf_prog03

* Increased coverage
- quotactl tests were rewritten and coverage was increased

* Additional 19 tests were converted to the new test library

* Removed tests
- TI-RPC authdes related tests (authdes is disabled by default since libtirpc 1.2.5)
- openposix/pi_test*
- ext4 features tests
(the interesting bits are being moved to xfstests
https://patchwork.kernel.org/patch/11290345/)

* Our Travis now includes native ppc64le and s390x builds

* Improved musl support, build with musl in Travis CI using Alpine Linux
(broken tests are documented in Travis build script travis/alpine.sh)

* Regression tests now print possibly missing kernel commits:

--------------------------------------------------------------------------
snd_timer01.c:134: FAIL: kernel seems vulnerable

HINT: You _MAY_ be missing kernel fixes, see:

https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=d11662f4f798
https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=ba3021b2c79b

HINT: You _MAY_ be vulnerable to CVE(s), see:

https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2017-1000380

Summary:
passed 0
failed 1
skipped 0
warnings 0
--------------------------------------------------------------------------

+ The usual amount of fixes and cleanups.


METADATA EXTRACTION & TEST CATALOGUE
====================================

There is an ongoing experiment that attempts to extract metadata[1] from the
testcases, we also have a proof of concept web page that renders the json
metadata into a browseable test documentation[2]. There is not much there yet,
but we are hoping, among other things, to build a nice, searchable and
browseable test catalogue based on these efforts.

[1] https://github.com/metan-ucw/ltp/tree/master/docparse
[2] http://metan.ucw.cz/outgoing/metadata.html
http://metan.ucw.cz/outgoing/metadata.html?test=abort01
http://metan.ucw.cz/outgoing/metadata.html?test=pcrypt_aead01


NOTABLE CHANGES IN NETWORK TESTS
================================
brought to you by Petr Vorel

* iptables: add new test for iptables-translate and nft, add IPv6 support
* route: rewrite route change destination, gateway and interface tests into new API


DOWNLOAD AND LINKS
==================

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20190930

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp
http://linux-test-project.github.io/

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://github.com/linux-test-project/ltp/wiki/C-Test-Case-Tutorial
https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines
https://github.com/linux-test-project/ltp/wiki/BuildSystem

Patches, new tests, bugs, comments or questions should go to to our mailing
list at [email protected].


CREDITS
=======

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20190930..
45 Petr Vorel <[email protected]>
22 Jan Stancek <[email protected]>
22 Yang Xu <[email protected]>
13 Cyril Hrubis <[email protected]>
13 Petr Vorel <[email protected]>
11 Li Wang <[email protected]>
10 Joerg Vehlow <[email protected]>
10 Martin Doucha <[email protected]>
7 Alexey Kodanev <[email protected]>
6 Clemens Famulla-Conrad <[email protected]>
5 Xiao Yang <[email protected]>
3 Feiyu Zhu <[email protected]>
2 Jorik Cronenberg <[email protected]>
2 Pengfei Xu <[email protected]>
2 Ping Fang <[email protected]>
2 Richard Palethorpe <[email protected]>
1 Cai Zhenglong <[email protected]>
1 Dylan Chung <[email protected]>
1 Eric Lin <[email protected]>
1 Fabrice Fontaine <[email protected]>
1 He Zhe <[email protected]>
1 Ivan Hu <[email protected]>
1 Ma Feng <[email protected]>
1 Mathias Fiedler <[email protected]>
1 Rachel Sibley <[email protected]>
1 Song Jian <[email protected]>
1 Sultan Alsawaf <[email protected]>
1 Xiang Li <[email protected]>
1 Yi Zhao <[email protected]>
1 Yongxin Liu <[email protected]>
1 Zou Wei <[email protected]>


And also thanks to patch reviewers:

git log 20190930.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r
76 Cyril Hrubis <[email protected]>
46 Petr Vorel <[email protected]>
28 Li Wang <[email protected]>
19 Jan Stancek <[email protected]>
9 Alexey Kodanev <[email protected]>
5 Clemens Famulla-Conrad <[email protected]>
4 Richard Palethorpe <[email protected]>
3 Yang Xu <[email protected]>
1 Thadeu Lima de Souza Cascardo <[email protected]>
1 Sumit Garg <[email protected]>
1 Steve Dickson <[email protected]>
1 Petr Vorel <[email protected]>
1 Joerg Vehlow <[email protected]>
1 Amir Goldstein <[email protected]>

--
Cyril Hrubis
[email protected]