2018-05-15 14:24:04

by Cyril Hrubis

[permalink] [raw]
Subject: [LTP] [ANNOUNCE] The Linux Test Project has been released for MAY 2018

Good news everyone,

the Linux Test Project test suite stable release for *May 2018* has been
released.

Since the last release 297 patches by 38 authors were merged.

NOTABLE CHANGES
===============

* New testcases:

- two inotify regression tests for:
764baba80168 ("ovl: hash non-dir by lower inode for fsnotify")
31747eda41ef ("ovl: hash directory inodes for fsnotify")

- sysclt01 a regression test for:
5ccba44ba118 ("sched/sysctl: Check user input value of sysctl_sched_time_avg")

- CVE regression tests for:
* CVE-2017-17053 - ccd5b3235180 ("x86/mm: Fix use-after-free of ldt_struct")
* CVE-2017-16939 - 1137b5e2529a ("ipsec: Fix aborted xfrm policy dump crash")
* CVE-2015-3290 - 9b6e6a8334d5 ("x86/nmi/64: Switch stacks on userspace NMI entry")
* CVE-2017-17052 - 2b7e8665b4ff ("fork: fix incorrect fput of ->exe_file causing use-after-free")
* CVE-2017-17807 - 4dca6ea1d943 ("KEYS: add missing permission check for request_key() destination")

- read_all

Test that aims to stress test /proc, /sys, and safe subset of /dev
filesystems by reading by reading each readable file using several
threads.

- The pwritev03 and preadv03 tests with O_DIRECT executed on all supported filesystems.
(https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines#2214-testing-with-a-block-device)

- Pids controller tests fixed a race that made them fail sporadically and
the the coverage was increased.

- pwrite03, write02

Write syscall tests for special case with NULL buffer and len 0
where the call is expected to return 0 i.e. success.

* Removed outdated and broken tests
- sssd daemon test
- mail command test
- ht_interrupt -- hyperthreading interrupt balancing test

* 54 testcases were cleaned up and converted to the new test library

* The syscalls testrun has been speeded up by about a minute which is 5% of the runtime.

* Several Android fixes have been applied.

* New macro for automatic retry with exponential backoff has been added to the
test library, which should replace all the ad-hoc retry loops we do have all
around the codebase.

* IMA (Integrity Measurement Architecture) tests
- Were rewritten to use new API, updated, and various bugs has been fixed.
- The most important changes:
* Avoid running on tmpfs ima_measurements.sh and ima_violations.sh
* ima_measurements.sh: support new IMA measurement templates, support testing
most of IMA supported hash algorithms, fix & update iversion check
* tpm.sh: replace ima_measure with evmctl (external)
* ima_policy.sh: improve check of policy writability
* ima_boot_aggregate: fixing event size for modern BIOS

Many thanks to Mimi Zohar for her review and testing of IMA test cases.

+ The usual number of fixes and cleanups all over the place

NETWORK TESTS
=============

Changelog for network tests brought to you by Peter Vorel.

* New testcases:
- for IP_BIND_ADDRESS_NO_PORT, DCCP and UDP ipsec and for UDPLITE protocol
- regression test sctp_big_chunk aka CVE-2018-5803
- netstress gained support for IP_BIND_ADDRESS_NO_PORT, SO_ZEROCOPY flags
and UDPLITE protocol
- Use libtirpc for all RPC tests

* Test cases rewritten into new shell API:
- interface and multicast tests cases
- in6_02

* Removed tests cases
- route{4,6}-ifdown

+ Various fixes and doc cleanups


TODO LIST AND ISSUE TRACKER
===========================

Just recently we started to maintain a LTP TODO list in the form GitHub issues,
so far there is very coarse list of missing, mostly syscall, coverage:

https://github.com/linux-test-project/ltp/labels/missing%20coverage

Which I suppose will expand quite a bit soon.

And also nearly empty list of reproducers:

https://github.com/linux-test-project/ltp/labels/reproducer

Which I'm about to feed with a list of CVE reproducers I have, that
can be converted into regression testcases.

Lastly but not least I would like to ask everyone to contribute to that list.

DOWNLOAD AND LINKS
==================

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20180515

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp
http://linux-test-project.github.io/

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://github.com/linux-test-project/ltp/wiki/C-Test-Case-Tutorial
https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines
https://github.com/linux-test-project/ltp/wiki/BuildSystem

Patches, new tests, bugs, comments or questions should go to to our mailing
list at [email protected].

CREDITS
=======

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20180118..
76 Petr Vorel <[email protected]>
38 Cyril Hrubis <[email protected]>
37 Michael Moese <[email protected]>
30 Alexey Kodanev <[email protected]>
21 Xiao Yang <[email protected]>
12 yang xu <[email protected]>
9 Yixin Zhang <[email protected]>
7 Jinhui Huang <[email protected]>
7 Richard Palethorpe <[email protected]>
6 Jan Stancek <[email protected]>
6 Li Wang <[email protected]>
5 Amir Goldstein <[email protected]>
4 Carlo Marcelo Arenas Belon <[email protected]>
4 Stanislav Kholmanskikh <[email protected]>
3 Petr Vorel <[email protected]>
3 Steve Muckle <[email protected]>
2 Anders Roxell <[email protected]>
2 Eric Biggers <[email protected]>
2 Khem Raj <[email protected]>
2 Sandeep Patil <[email protected]>
2 Sebastian Chlad <[email protected]>
2 xiao yang <[email protected]>
1 Christian Lanig <[email protected]>
1 Dmitry Safonov <[email protected]>
1 Erick Reyes <[email protected]>
1 Greg Hackmann <[email protected]>
1 Harish <[email protected]>
1 Hoang Van Tuyen <[email protected]>
1 Hridya Valsaraju <[email protected]>
1 Joe Konno <[email protected]>
1 Lars Persson <[email protected]>
1 Lianwen Sun <[email protected]>
1 Pavel Boldin <[email protected]>
1 Qiao Zhao <[email protected]>
1 Xiong Zhou <[email protected]>
1 Yang Pengfei <[email protected]>
1 akodanev <[email protected]>
1 xie hui <[email protected]>
1 yosun <[email protected]>

And also thanks to patch reviewers:

git log 20180118.. | grep -Ei '(reviewed|acked)-by:' | \
sed 's/.*by: //' | sort | uniq -c | sort -n -r
34 Cyril Hrubis <[email protected]>
15 Petr Vorel <[email protected]>
15 Alexey Kodanev <[email protected]>
11 Jan Stancek <[email protected]>
7 Richard Palethorpe <[email protected]>
4 Li Wang <[email protected]>
3 Mimi Zohar <[email protected]>
2 Petr Vorel <[email protected]>
2 James Morris <[email protected]>
1 yang xu <[email protected]>
1 Xiao Yang <[email protected]>

--
Cyril Hrubis
[email protected]