Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18;
From:   Leonard Crestez <cdleonard@gmail.com>
To:     Jakub Kicinski <kuba@kernel.org>, Shuah Khan <shuah@kernel.org>,
        David Ahern <dsahern@kernel.org>
Cc:     "David S. Miller" <davem@davemloft.net>,
        Ido Schimmel <idosch@nvidia.com>,
        Seth David Schoen <schoen@loyalty.org>,
        netdev@vger.kernel.org, linux-kselftest@vger.kernel.org,
        linux-kernel@vger.kernel.org
Subject: [PATCH 00/11] selftests: Improve nettest and net/fcnal-test.sh
Date:   Wed,  6 Oct 2021 14:47:16 +0300
Message-Id: <cover.1633520807.git.cdleonard@gmail.com>
MIME-Version: 1.0
Content-Transfer-Encoding: 8bit
Precedence: bulk

This is a series of improvements to nettest and fcnal-test.sh from
tools/testing/selftests/net which make tests run faster. For me this
reduces the runtime from ~40minutes to ~5minutes and makes the tcp
tests very fast.

Some of the early commits are outright bugfixes.

The tests DO NOT pass perfectly for me on latest net-next/master but I
verified that the failures also happen without my changes. Here is the
list of failures:

TEST: ping local, VRF bind - VRF IP                                           [FAIL]
TEST: Raw socket bind to local address - VRF IP                               [FAIL]
TEST: ping out, VRF bind - ns-B IPv6 LLA                                      [FAIL]
TEST: ping out, VRF bind - multicast IP                                       [FAIL]
TEST: TCP socket bind to out of scope local address - ns-A loopback IPv6      [FAIL]
TEST: TCP socket bind to VRF address with device bind - VRF IPv6              [FAIL]

Three of those were not tested by default before my changes, only with
explicit -t 'bind bind6'

This is related to my work on TCP-AO but there are no patch
dependencies
Link: https://lore.kernel.org/netdev/cover.1632240523.git.cdleonard@gmail.com/

Leonard Crestez (11):
  selftests: net/fcnal: Fix {ipv4,ipv6}_bind not run by default
  selftests: net/fcnal: Mark unknown -t or TESTS value as error
  selftests: net/fcnal: Non-zero exit on failures
  selftests: net/fcnal: Use accept_dad=0 to avoid setup sleep
  selftests: net/fcnal: kill_procs via spin instead of sleep
  selftests: net/fcnal: Do not capture do_run_cmd in verbose mode
  selftests: nettest: Implement -k to fork after bind or listen
  selftests: net/fcnal: Replace sleep after server start with -k
  selftests: nettest: Convert timeout to miliseconds
  selftests: nettest: Add NETTEST_CLIENT,SERVER}_TIMEOUT envvars
  selftests: net/fcnal: Reduce client timeout

 tools/testing/selftests/net/fcnal-test.sh | 710 ++++++++--------------
 tools/testing/selftests/net/nettest.c     | 134 +++-
 2 files changed, 378 insertions(+), 466 deletions(-)


base-commit: 0693b27644f04852e46f7f034e3143992b658869
-- 
2.25.1