Received-SPF: pass (google.com: domain of linux-kernel+bounces-44466-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45e3:2400::1 as permitted sender) client-ip=2604:1380:45e3:2400::1;
Date: Tue, 30 Jan 2024 12:13:11 +0100
From: Cyril Hrubis <chrubis@suse.cz>
To: ltp@lists.linux.it, linux-kernel@vger.kernel.org,
	libc-alpha@sourceware.org
Cc: lwn@lwn.net, akpm@linux-foundation.org, torvalds@linux-foundation.org
Subject: [ANNOUNCE] The Linux Test Project has been released for JANUARY 2024
Message-ID: <ZbjZxy4vbxoXUJ-i@yuki>
Precedence: bulk
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline

Good news everyone,

the Linux Test Project test suite stable release for *January 2024* has been
released.

Since the last release 315 patches by 34 authors were merged.

Patch review is what most of the projects struggle with and LTP is no
different. If you can spare some effort helping with the patch review is more
than welcomed.

NOTABLE CHANGES
===============

* New tests
  - splice07, accept03, readahead01:

    Tests that feeds the syscall all kinds of invalid file descriptors and
    checks that the syscall fails properly.

   - proc_sched_rt01 a regression test for:

     c1fc6484e1fb ("sched/rt: sysctl_sched_rr_timeslice show default timeslice after reset")
     079be8fc6309 ("sched/rt: Disallow writing invalid values to sched_rt_period_us")

  - ksm07 a test for KSM smart-scan.

  - pathconf02 negative testcases for pathconf()

  - pipe15 A regresson test for:

    46c4c9d1beb7 ("pipe: increase minimum default pipe size to 2 pages")

  - nft02 A regression test for:

     515ad530795c ("netfilter: nf_tables: do not ignore genmask when looking up chain by id") aka CVE-2023-31248

  - sched_setscheduler04 a test for SCHED_RESET_ON_FORK

  - setsockopt10 2c02d41d71f9 ("net/ulp: prevent ULP without clone op from entering the LISTEN status") aka CVE-2023-0461

  - gettid02 A basic gettid02 test.

  - splice06 A test that splicing from a /proc files works.

* Increased coverage

   - ioctl02 cover more modern termios ioctls() as well.

   - fanotify13 More test coverage for overlayfs.

   - input* test now check UI_GET_NAME ioctl() too.

* Removed tests

   - fork12 Which was a naive fork bomb test, we do have other tests
            (setrlimit01.c, ...) that better cover this scenario.

   - mongo test framework

     Which was test reiser, ext2 and jfs unmaintained for a decade.

   - simple_tracer.c Tracing test from 2009 that does not compile anymore.

   - runtest/fsx-linux This is consolidation of runtest files, since these test
                       duplicated in ltp-aiodio.part3.

   - testscripts/autofs{1,4}.sh, testscripts/sysfs.sh,
     testscripts/ltp-scsi_debug.sh, testscripts/ltpdmmapper.sh

     These were unmaintained and unused scripts.

   - scsi/* A testsuite with a custom kernel module for kernel 2.5 that didn't
            compile cleanly for decades.

   - load_stress_all_kernel_modules.sh Broken for quite some time.

* The LTP library now has a functions to iterate over different
  file descriptors. That allows us to easily implement more comprehensive tests
  that feed various syscalls all possible file descriptors and check that the
  syscall fails properly with invalid combinations. Most notable use of this
  library is the newly introduced splice07.c test.

* The minimal size of the device for a few filesystem tests was increased to
  1GB because modern filesystems, most notably Btrfs does not work properly on
  smaller devices.

* LTP now tests bcachefs if kernel support and bcache.mkfs is present

* 30 testcases were converted to the new test library

+ The usual amount of fixes and cleanups

NOTABLE CHANGES IN NETWORK TESTS
================================
brought to you by Petr Vorel

The performance tests in net.features can be now skipped by setting
LTP_NET_FEATURES_IGNORE_PERFORMANCE_FAILURE=1 which is useful when testing is
executed on VMs on a overloaded host or if we are running tests with a
background load.

KIRK (previously RUNLTP-NG)
===========================

Kirk was updated to v1.2

This version brings the following updates:

 - show both stdout and stderr when executing tests on host
 - support for external commands on different SUTs
 - warning message when SUT doesn't support parallel execution
 - more stable epoll() communication with LTX
 - minor fixes
 - updated documentation

DOWNLOAD AND LINKS
==================

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20240129

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp
http://linux-test-project.github.io/

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines

https://github.com/linux-test-project/ltp/wiki/C-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Network-API

https://github.com/linux-test-project/ltp/wiki/Shell-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Case-Tutorial

https://github.com/linux-test-project/ltp/wiki/Build-System

Patches, new tests, bugs, comments or questions should go to to our mailing
list at ltp@lists.linux.it.

CREDITS
=======

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20230929..

   147  Petr Vorel <pvorel@suse.cz>
    25  Yang Xu <xuyang2018.jy@fujitsu.com>
    21  Andrea Cervesato <andrea.cervesato@suse.com>
    18  Martin Doucha <mdoucha@suse.cz>
    12  Cyril Hrubis <chrubis@suse.cz>
    11  Marius Kittler <mkittler@suse.de>
     8  Wei Gao <wegao@suse.com>
     7  Amir Goldstein <amir73il@gmail.com>
     7  Richard Palethorpe <rpalethorpe@suse.com>
     6  Avinesh Kumar <akumar@suse.de>
     6  Edward Liaw <edliaw@google.com>
     6  Jan Kara <jack@suse.cz>
     5  Jan Stancek <jstancek@redhat.com>
     4  Hongchen Zhang <zhanghongchen@loongson.cn>
     4  Kevin Brodsky <kevin.brodsky@arm.com>
     4  Xiao Yang <yangx.jy@fujitsu.com>
     3  Shiyang Ruan <ruansy.fnst@fujitsu.com>
     2  Li Wang <liwang@redhat.com>
     2  Li Zhijian <lizhijian@fujitsu.com>
     2  Pengfei Xu <pengfei.xu@intel.com>
     2  Stefan Roesch <shr@devkernel.io>
     1  Alexander Kanavin <alex@linutronix.de>
     1  Brennan Ashton <bashton@brennanashton.com>
     1  Korobeynikov Gleb <mathkgd@mail.ru>
     1  Marcos Paulo de Souza <mpdesouza@suse.com>
     1  Mengchi Cheng <mengcc@amazon.com>
     1  Murphy Zhou <jencce.kernel@gmail.com>
     1  Shizhao Chen <shichen@redhat.com>
     1  Shoukui Zhang <zhangshoukui@xiaomi.com>
     1  Subramanya Swamy <subramanya.swamy.linux@gmail.com>
     1  haopengxiang <haopengxiang@xiaomi.com>
     1  nietingting <nietingting@xiaomi.com>
     1  wangxuewen <wangxuewen@kylinos.cn>
     1  ybonatakis <ybonatakis@suse.com>

And also thanks to patch reviewers:

git log 20230929.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

    111 Petr Vorel <pvorel@suse.cz>
     70 Cyril Hrubis <chrubis@suse.cz>
     47 Li Wang <liwang@redhat.com>
     35 Richard Palethorpe <rpalethorpe@suse.com>
     14 Martin Doucha <mdoucha@suse.cz>
      8 Amir Goldstein <amir73il@gmail.com>
      7 Xiao Yang <yangx.jy@fujitsu.com>
      7 Marius Kittler <mkittler@suse.de>
      6 Jan Kara <jack@suse.cz>
      4 Avinesh Kumar <akumar@suse.de>
      3 Andrea Cervesato <andrea.cervesato@suse.com>
      3 Jan Stancek <jstancek@redhat.com>
      2 Yang Xu <xuyang2018.jy@fujitsu.com>
      1 Petr Vorel <petr.vorel@gmail.com>
      1 Christian Brauner <brauner@kernel.org>
-- 
Cyril Hrubis
chrubis@suse.cz