Received: by 2002:a05:6358:7058:b0:131:369:b2a3 with SMTP id 24csp7978097rwp; Wed, 19 Jul 2023 03:27:15 -0700 (PDT) X-Google-Smtp-Source: APBJJlGzCsBJnyCkgsFuwo1vxdmbu6okzD7vUNwOB8Pmo4lcVrmEht9nm8wq5Mlfjytl5tZIitO8 X-Received: by 2002:a17:907:86ab:b0:989:450:e567 with SMTP id qa43-20020a17090786ab00b009890450e567mr710583ejc.65.1689762435536; Wed, 19 Jul 2023 03:27:15 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1689762435; cv=none; d=google.com; s=arc-20160816; b=S5Q2Z8BaU9sxzH5haAMFD3VqBfAvdhWIrNrMqNkHqUV9E6HgDwoX4hN4Rl3+a/85J+ xFMajFfdanx6BIVSt0f+lhlE0cgjhGQBe/qL5uzGiwwct9R9pOOOO7oqIZQd75KW8kOU TXivDp0h10ehDvkf3xIwgzK4fyM7tDjttHVB3v5Mb9eOZvgafTk9dvvzWsg8Wwvd2tCl 85LvgTaQox06lTT/5/iMn7J4mJfb+YGvgybJ3AFn70u02NeJBx9W0lN+2+C7GOAcHeJN yzMARlheTcb6THmgQ4AaqPulp5vI2XXi9Hxjw+VXKlE/XA9CTcH4whXAhJN2rAHZ1N6S WJnA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:cc:to:in-reply-to:references:date:message-id :from:subject:content-transfer-encoding:mime-version:dkim-signature; bh=ggfdhaOmCwn/aYwJbE/eThuzPdjmZtw5T0lwKKsHAs4=; fh=79nYkmuuI3jGn3FPbYvEeeTVzqg3I0lhhXtMPMurCBU=; b=mW7XB0GL/gcvciZqB7BWTkK3SryTQe9xLCx7Xgb6/snFqxso7c04xo3Lj+QR9wwIBz 7sieAnvKGC1D0E+/obkGAXu9zFeGAu/B350jP3C9E+PxYpDfIliIrKQo51DCC86ng3XW WkZNb3r89JJMenx6lRLfWtOhOwuVooPUmqKJK4yWRVPFL9ibq6X7LGAxFHwjmw0om8IV 3OvK3q59BhgJGHWy6AsG5y7fAqVW6aRlPzR6ESQ3lbl8YvB6FuYREXqLH7NG275KUiYY FDLVoAPVsGEndBE7nlkP7QRZVE5ZZ81+K4yHMZcPNSoJ8GYzR6GPEbY4/HbL4K0Vgn4J 07+g== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=dyPvgc7Q; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id r2-20020a170906350200b00991df86ac0esi2408552eja.338.2023.07.19.03.26.50; Wed, 19 Jul 2023 03:27:15 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=dyPvgc7Q; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229757AbjGSKU0 (ORCPT + 99 others); Wed, 19 Jul 2023 06:20:26 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:42388 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229576AbjGSKUY (ORCPT ); Wed, 19 Jul 2023 06:20:24 -0400 Received: from dfw.source.kernel.org (dfw.source.kernel.org [139.178.84.217]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 46C7B1BEF; Wed, 19 Jul 2023 03:20:23 -0700 (PDT) Received: from smtp.kernel.org (relay.kernel.org [52.25.139.140]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by dfw.source.kernel.org (Postfix) with ESMTPS id D3F0061373; Wed, 19 Jul 2023 10:20:22 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPS id 208FBC433C9; Wed, 19 Jul 2023 10:20:22 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1689762022; bh=vf8HyJJMrc8y7a7IGPiDvWuMwVrymE8dAVACw2+VXLk=; h=Subject:From:Date:References:In-Reply-To:To:Cc:From; b=dyPvgc7QPw92aTMqOMCFf0EVygxyojg/kI76uXPrVf0yXopJTOOw98lV/L4NSn+uM aiHrCeLetjHDC6LImN7FStfe20PaCqqqoS5vEloINk9sRfZSte3N0XX1OYCNALUY3j Gz0Iw9hAs5SHbKzfYEa6p5rwnh+Ouj1I5/ERYOFMuuN/FQDsIzZb/oB6VyV9spijCp XW/3S7UgTEEU/RKI4atORf03n1N6zkbdHtttu7AAnaU3hxlZrji3382yGicDMzfeEa CqRPbZPMRrkK65sdBeB6Xb47afXkp40enwisLphkCSfUCSv7hZrTFsDi03F2SF5o4v dR6MxgixWCQtA== Received: from aws-us-west-2-korg-oddjob-1.ci.codeaurora.org (localhost.localdomain [127.0.0.1]) by aws-us-west-2-korg-oddjob-1.ci.codeaurora.org (Postfix) with ESMTP id 03177E21EFE; Wed, 19 Jul 2023 10:20:22 +0000 (UTC) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Subject: Re: [PATCH net-next 00/13] selftests: mptcp: format subtests results in TAP From: patchwork-bot+netdevbpf@kernel.org Message-Id: <168976202200.10961.989071815064643315.git-patchwork-notify@kernel.org> Date: Wed, 19 Jul 2023 10:20:22 +0000 References: <20230717-upstream-net-next-20230712-selftests-mptcp-subtests-v1-0-695127e0ad83@tessares.net> In-Reply-To: <20230717-upstream-net-next-20230712-selftests-mptcp-subtests-v1-0-695127e0ad83@tessares.net> To: Matthieu Baerts Cc: mptcp@lists.linux.dev, martineau@kernel.org, davem@davemloft.net, edumazet@google.com, kuba@kernel.org, pabeni@redhat.com, shuah@kernel.org, netdev@vger.kernel.org, linux-kselftest@vger.kernel.org, linux-kernel@vger.kernel.org X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF, RCVD_IN_DNSWL_BLOCKED,SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hello: This series was applied to netdev/net-next.git (main) by David S. Miller : On Mon, 17 Jul 2023 15:21:20 +0200 you wrote: > The current selftests infrastructure formats the results in TAP 13. This > version doesn't support subtests and only the end result of each > selftest is taken into account. It means that a single issue in a > subtest of a selftest containing multiple subtests forces the whole > selftest to be marked as failed. It also means that subtests results are > not tracked by CI executing selftests. > > [...] Here is the summary with links: - [net-next,01/13] selftests: mptcp: connect: don't stop if error https://git.kernel.org/netdev/net-next/c/edbc16c43b27 - [net-next,02/13] selftests: mptcp: userspace pm: don't stop if error https://git.kernel.org/netdev/net-next/c/e141c1e8e4c1 - [net-next,03/13] selftests: mptcp: userspace_pm: fix shellcheck warnings https://git.kernel.org/netdev/net-next/c/8320b1387a15 - [net-next,04/13] selftests: mptcp: userspace_pm: uniform results printing https://git.kernel.org/netdev/net-next/c/e198ad759273 - [net-next,05/13] selftests: mptcp: userspace_pm: reduce dup code around printf https://git.kernel.org/netdev/net-next/c/d8463d81652d - [net-next,06/13] selftests: mptcp: lib: format subtests results in TAP https://git.kernel.org/netdev/net-next/c/c4192967e62f - [net-next,07/13] selftests: mptcp: connect: format subtests results in TAP https://git.kernel.org/netdev/net-next/c/dd350f46e35e - [net-next,08/13] selftests: mptcp: pm_netlink: format subtests results in TAP https://git.kernel.org/netdev/net-next/c/d85555ac11f9 - [net-next,09/13] selftests: mptcp: join: format subtests results in TAP https://git.kernel.org/netdev/net-next/c/7f117cd37c61 - [net-next,10/13] selftests: mptcp: diag: format subtests results in TAP https://git.kernel.org/netdev/net-next/c/ce9902573652 - [net-next,11/13] selftests: mptcp: simult flows: format subtests results in TAP https://git.kernel.org/netdev/net-next/c/675d99338e7a - [net-next,12/13] selftests: mptcp: sockopt: format subtests results in TAP https://git.kernel.org/netdev/net-next/c/9e86a297796b - [net-next,13/13] selftests: mptcp: userspace_pm: format subtests results in TAP https://git.kernel.org/netdev/net-next/c/f589234e1af0 You are awesome, thank you! -- Deet-doot-dot, I am a bot. https://korg.docs.kernel.org/patchwork/pwbot.html