2017-07-06 20:25:12

by Shuah Khan

[permalink] [raw]
Subject: [GIT PULL] Kselftest update for 4.13-rc1

Hi Linus,

Please pull the following update for 4.13-rc1

This update consists of:

-- TAP13 framework and changes to some tests to convert to TAP13.
Converting kselftest output to standard format will help identify
run to run differences and pin point failures easily. TAP13 format
has been in use for several years and the output is human friendly.

Please find the specification:
https://testanything.org/tap-version-13-specification.html

Credit goes to Tim Bird for recommending TAP13 as a suitable format,
and to Grag KH for kick starting the work with help from Paul Elder
and Alice Ferrazzi

The first phase of the TAP13 conversion is included in this update.
Future updates will include updates to rest of the tests.

-- Masami Hiramatsu fixed ftrace to run on 4.9 stable kernels.

-- Kselftest documnetation has been converted to ReST format. Document
now has a new home under Documentation/dev-tools.

-- kselftest_harness.h is now available for general use as a result of
Mickaël Salaün's work.

-- Several fixes to skip and/or fail tests gracefully on older releases.

Diff for the update attached.

thanks,
-- Shuah

-----------------------------------------------------------------------------------

The following changes since commit 3c2993b8c6143d8a5793746a54eba8f86f95240f:

Linux 4.12-rc4 (2017-06-04 16:47:43 -0700)

are available in the git repository at:

git://git.kernel.org/pub/scm/linux/kernel/git/shuah/linux-kselftest tags/linux-kselftest-4.13-rc1-update

for you to fetch changes up to e67f85fb96ca80e5a60ea69c536affed0affc77d:

selftests: membarrier: use ksft_* var arg msg api (2017-06-30 16:16:23 -0600)

----------------------------------------------------------------
linux-kselftest-4.13-rc1-update

This update consists of:

-- TAP13 framework and changes to some tests to convert to TAP13.
Converting kselftest output to standard format will help identify
run to run differences and pin point failures easily. TAP13 format
has been in use for several years and the output is human friendly.

Please find the specification:
https://testanything.org/tap-version-13-specification.html

Credit goes to Tim Bird for recommending TAP13 as a suitable format,
and to Grag KH for kick starting the work with help from Paul Elder
and Alice Ferrazzi

The first phase of the TAp13 conversion is included in this update.
Future updates will include updates to rest of the tests.

-- Masami Hiramatsu fixed ftrace to run on 4.9 stable kernels.

-- Kselftest documnetation has been converted to ReST format. Document
now has a new home under Documentation/dev-tools.

-- kselftest_harness.h is now available for general use as a result of
Mickaël Salaün's work.

-- Several fixes to skip and/or fail tests gracefully on older releases.

----------------------------------------------------------------
Alice Ferrazzi (1):
kselftest: membarrier: make test names more informative

Andy Lutomirski (1):
selftests/capabilities: Fix the test_execve test

Greg Kroah-Hartman (1):
ksefltest: MAINTAINERS git tree entry is incorrect

Masami Hiramatsu (8):
selftests/ftrace: Skip full-glob-matching filter test on older kernel
selftests/ftrace: Reduce trace buffer checking overhead
ftrace/kprobes: selftests: Check kretprobe maxactive is supported
selftests/ftrace: Reset ftrace filter on older kernel
selftests/ftrace: Add instance indication in test log
selftests/ftrace: Use top-level available_filter_function
selftests/ftrace: Return unsupported if it detects older kernel
selftests: ftrace: Use md5sum to take less time of checking logs

Mauro Carvalho Chehab (1):
kselftest.rst: do some adjustments after ReST conversion

Michael Ellerman (1):
selftests: sync: Skip the test if kernel support is not found

Michal Suchanek (1):
selftests/vm: Fix test for virtual address range mapping for arm64

Mickaël Salaün (8):
selftests: Make test_harness.h more generally available
selftests: Cosmetic renames in kselftest_harness.h
Documentation/dev-tools: Add kselftest
Documentation/dev-tools: Use reStructuredText markups for kselftest
selftests: Remove the TEST_API() wrapper from kselftest_harness.h
Documentation/dev-tools: Add kselftest_harness documentation
selftests/seccomp: Force rebuild according to dependencies
selftests: kselftest_harness: Fix compile warning

Naresh Kamboju (1):
selftests: futex: print testcase-name and PASS/FAIL/ERROR status

Orson Zhai (1):
tools/testing/selftests/sysctl: Add pre-check to the value of writes_strict

Paul Elder (8):
kselftest: add TAP13 conformant versions of ksft_* functions
kselftest: membarrier: convert to TAP13 output
kselftest: breakpoints: convert breakpoint_test to TAP13 output
kselftest: breakpoints: convert step_after_suspend_test to TAP13 output
kselftest: make ksft_exit_skip() output a reason for skipping
kselftest: make callers of ksft_exit_skip() output the reason for skipping
kselftest: make ksft_* output functions variadic
kselftest: add ksft_print_msg() function to output general information

Po-Hsu Lin (5):
selftests: typo correction for memory-hotplug test
selftests: check hot-pluggagble memory for memory-hotplug test
selftests: check percentage range for memory-hotplug test
selftests: add missing test name in memory-hotplug test
selftests: fix memory-hotplug test

SeongJae Park (3):
selftest/memfd/Makefile: Fix build error
selftest/intel_pstate/aperf: Use LDLIBS instead of LDFLAGS
selftest/net/Makefile: Specify output with $(OUTPUT)

Shuah Khan (6):
kselftest: MAINTAINERS git tree entry update files and dirs
selftests: intel_pstate: add .gitignore
selftests: breakpoint_test: use ksft_* var arg msg api
selftests: breakpoints: step_after_suspend_test use ksft_* var arg msg api
selftests: breakpoints: breakpoint_test_arm64: convert test to use TAP13
selftests: membarrier: use ksft_* var arg msg api

Sumit Semwal (1):
selftests: lib: Skip tests on missing test modules

Tim Bird (1):
kselftest: convert get_size to use stricter TAP13 format

Documentation/00-INDEX | 2 -
Documentation/dev-tools/index.rst | 1 +
.../{kselftest.txt => dev-tools/kselftest.rst} | 82 ++-
MAINTAINERS | 6 +-
kernel/trace/trace.c | 3 +-
.../selftests/breakpoints/breakpoint_test.c | 45 +-
.../selftests/breakpoints/breakpoint_test_arm64.c | 95 +--
.../breakpoints/step_after_suspend_test.c | 84 ++-
tools/testing/selftests/capabilities/test_execve.c | 7 +-
tools/testing/selftests/ftrace/ftracetest | 2 +-
.../ftrace/test.d/event/toplevel-enable.tc | 8 +-
.../ftrace/test.d/ftrace/func-filter-glob.tc | 28 +-
.../ftrace/test.d/ftrace/func_event_triggers.tc | 9 +
.../test.d/ftrace/func_traceonoff_triggers.tc | 19 +-
.../ftrace/test.d/instances/instance-event.tc | 5 +-
.../ftrace/test.d/kprobe/kretprobe_maxactive.tc | 1 +
.../selftests/futex/functional/futex_requeue_pi.c | 3 +-
.../functional/futex_requeue_pi_mismatched_ops.c | 4 +-
.../functional/futex_requeue_pi_signal_restart.c | 3 +-
.../functional/futex_wait_private_mapped_file.c | 5 +-
.../futex/functional/futex_wait_timeout.c | 4 +-
.../functional/futex_wait_uninitialized_heap.c | 3 +-
.../futex/functional/futex_wait_wouldblock.c | 3 +-
tools/testing/selftests/futex/include/logging.h | 4 +-
tools/testing/selftests/intel_pstate/.gitignore | 2 +
tools/testing/selftests/intel_pstate/Makefile | 2 +-
tools/testing/selftests/kselftest.h | 98 ++-
.../test_harness.h => kselftest_harness.h} | 689 +++++++++++++--------
tools/testing/selftests/lib/bitmap.sh | 4 +
tools/testing/selftests/lib/printf.sh | 4 +
.../testing/selftests/membarrier/membarrier_test.c | 97 ++-
tools/testing/selftests/memfd/Makefile | 2 +-
.../selftests/memory-hotplug/mem-on-off-test.sh | 86 ++-
tools/testing/selftests/net/Makefile | 3 +-
tools/testing/selftests/seccomp/Makefile | 2 +
tools/testing/selftests/seccomp/seccomp_bpf.c | 4 +-
tools/testing/selftests/size/get_size.c | 27 +-
tools/testing/selftests/sync/sync_test.c | 13 +
tools/testing/selftests/sysctl/common_tests | 22 +
tools/testing/selftests/sysctl/run_numerictests | 2 +-
tools/testing/selftests/sysctl/run_stringtests | 2 +-
tools/testing/selftests/vm/virtual_address_range.c | 35 +-
42 files changed, 1011 insertions(+), 509 deletions(-)
rename Documentation/{kselftest.txt => dev-tools/kselftest.rst} (59%)
create mode 100644 tools/testing/selftests/intel_pstate/.gitignore
rename tools/testing/selftests/{seccomp/test_harness.h => kselftest_harness.h}

-----------------------------------------------------------------------------------


Attachments:
linux-kselftest-4.13-rc1-update.diff (80.63 kB)