Received: by 2002:a05:7412:5112:b0:fa:6e18:a558 with SMTP id fm18csp95394rdb; Mon, 22 Jan 2024 13:08:35 -0800 (PST) X-Google-Smtp-Source: AGHT+IGgs95YMoCvw/VAMNK2NipN/t2ZJtuqk0s5rLwzzFXRs/yOPESveuTYHuEF0JxwO9J5/Wz+ X-Received: by 2002:a2e:bb86:0:b0:2cd:fb11:df33 with SMTP id y6-20020a2ebb86000000b002cdfb11df33mr1642765lje.29.1705957715191; Mon, 22 Jan 2024 13:08:35 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1705957715; cv=pass; d=google.com; s=arc-20160816; b=ljvMEbsJEnPZ4BxkhJUyvOKRjUUdJ/ZNs4IuIKGRgosHkAvzWU4zVvYFt5iNUwOzM3 QY2R+1KMlexni1R029WzAVj35O6KUyomz+r725iGRQzI5HU5SFCsvM8EgqYGdeNyW0Ia YQTEYpeOe2AxWL/4YRHBPXpUpQMYI9Suh/86/TXuhy6DBmvUMQ0+54WJz/JVHCFgMfBP ekAQl/e2y+ZC53e6kWIJINFRQfBuuw73mQC7Amc/pRdT1PS11iDCklVowz6v8K/sTe70 z4IAg1kvZJ3MLwdyLDwX2gbLiqe+e+pdOu2k7o4SJK0th/xwmP5qdDe6qNS7tqzXXuKR G8yQ== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=cc:to:content-transfer-encoding:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:message-id:date:subject:from :dkim-signature; bh=qiASw1LqO4faIj2hLbPU5cQggbqoOZMI5kV9aTA5if4=; fh=eBs+z3cdUgmHt86TGE0VSSkyDyUe/TSov8Em/nz9veM=; b=IMKzt7dXVVQjfG9sa0K/RePkxlKWhkWNhp8yH89TrpV9+szA7SlwAYfmbfsd95yxnZ QMOI2e9qQVU4qX61iQnAvWOvitP93UkbY3ieAaEcBOkdHntkQ4Y9KmCXCoQHs3Ilsh07 CVc0YZluvzY39mnxgBY39uxnz4xPtlmjlOh+ga2NkbHfHqbJnaGcJRM6DbwHMt+oJIwQ QZ5Q6Yu89o+H8aZ09Lbl/CPshWGCluk+x9b1HRrW0rSuM/iaNwLgnj99AiKoWEEBKcLL jW3EpSTsHXjMlGldW/I6zhZJy+Ql7IZvMueejNjLkh1KxxXBv9bSF9W9gmiyk4xIv0Rc 3Ldg== ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b="bYDk/qTO"; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-34167-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) smtp.mailfrom="linux-kernel+bounces-34167-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from am.mirrors.kernel.org (am.mirrors.kernel.org. [147.75.80.249]) by mx.google.com with ESMTPS id em3-20020a056402364300b00557447b5d27si5105846edb.596.2024.01.22.13.08.35 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 22 Jan 2024 13:08:35 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel+bounces-34167-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) client-ip=147.75.80.249; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b="bYDk/qTO"; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-34167-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) smtp.mailfrom="linux-kernel+bounces-34167-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by am.mirrors.kernel.org (Postfix) with ESMTPS id E94AA1F2861A for ; Mon, 22 Jan 2024 21:08:34 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 39DB547F58; Mon, 22 Jan 2024 21:08:26 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="bYDk/qTO" Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 64E4B47F44; Mon, 22 Jan 2024 21:08:25 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1705957705; cv=none; b=ilm2AguQrFfkMHpkyjV2n7Ij6CfudVOo6tEGJSCN+gbgXAR549eyTp0NaN1rUpnoni663zzFfgx/W5F8t7s5Hp+wWR32h1qGoivqYQPkulMZLpQn2ZZtRx6qosFzym3E2GZd/3Tlw8dINxDqErynYdB/fZZdCAmwv1aMNv0T4LQ= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1705957705; c=relaxed/simple; bh=x0Jy8C6TAh6LqyiLvnL2mux6L8/DDB6WSuNHGAgnn94=; h=From:Subject:Date:Message-Id:MIME-Version:Content-Type:To:Cc; b=fYT9Rfg652bskAHUtCSV86QSkgCmYaABRcus3L5ejHqyTz7zPOO+v7cyLmXlim//T37sNwST7eXiJUeYn6WH3maWP+2Brty/ELn1mhK5337TXV2H0GANTDLeQaGZLn2+uLAmiCz9JuNgxKZ+Kh8FaiadMUDCotmWky2MQbWTG9Y= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=bYDk/qTO; arc=none smtp.client-ip=10.30.226.201 Received: by smtp.kernel.org (Postfix) with ESMTPSA id 6B2EBC433C7; Mon, 22 Jan 2024 21:08:23 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1705957705; bh=x0Jy8C6TAh6LqyiLvnL2mux6L8/DDB6WSuNHGAgnn94=; h=From:Subject:Date:To:Cc:From; b=bYDk/qTOpASvu642sidXVMdmofgixM70PFGkfS6SfcPaEXx679N3mGMDW9m8ekVz/ Xha4rcwQ80CikpCzQ4D4mBFmys4iulF/O8t/DwrJWV1lenFxWI5BFaNm8rwwwSpSGl G6JaaKedu36XRt6FyijHIhWW1DDPixo8bMIU40gkqBoBD00k18tFAo8GOaV8yDtRza 4T1eP1GmACs25nHxVknr0RjiUUjPlGvmOlwi4kgxXVeMMYrrvLiLFGNZd83Q/TpJ0V zy9S11JuPbyajITKxTzjjj6mvRpt3ypEDnYyRFZ5ld3048lFQStADtF6DquCxTdOv8 UbV4AB3wq3M8w== From: Mark Brown Subject: [PATCH v3 0/2] kselftest/seccomp: Convert to KTAP output Date: Mon, 22 Jan 2024 21:08:16 +0000 Message-Id: <20240122-b4-kselftest-seccomp-benchmark-ktap-v3-0-785bff4c04fd@kernel.org> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit X-B4-Tracking: v=1; b=H4sIAEDZrmUC/5XNvQ6CMBSG4VshnT2mPUV+nLwP41DgAA3QkpY0G sK9W0gc3HR8v+H5VubJafLsmqzMUdBeWxNDnhJW98p0BLqJzZCjFChKqFIYPI3tQn4BT3Vtpxk qMnU/KTfAsKgZ5CXPuCxQ5rxgUZodtfp5vNwfsXvtF+tex2kQ+/qfHwRwaMuSEItMiorfBnKGx rN1HdsPAn7QlAvE31CMqKJGyJwUqVR8odu2vQF9CGAmLAEAAA== To: Kees Cook , Andy Lutomirski , Will Drewry , Shuah Khan Cc: linux-kselftest@vger.kernel.org, linux-kernel@vger.kernel.org, Mark Brown , Anders Roxell X-Mailer: b4 0.13-dev-5c066 X-Developer-Signature: v=1; a=openpgp-sha256; l=1297; i=broonie@kernel.org; h=from:subject:message-id; bh=x0Jy8C6TAh6LqyiLvnL2mux6L8/DDB6WSuNHGAgnn94=; b=owEBbQGS/pANAwAKASTWi3JdVIfQAcsmYgBlrtlEhS/57HUUTEDja9J6qPYiqCHOXY07VzgZ0SNG ME0drnqJATMEAAEKAB0WIQSt5miqZ1cYtZ/in+ok1otyXVSH0AUCZa7ZRAAKCRAk1otyXVSH0GfWB/ 4+cIOt0hHvWZkdmoZ+bcw1UFGe5zFh0nEwzC1ypiwsvHsyTmXlk5Z3pqMr+zV0o9f60l1SFuyB6alT Vx7RnQ/EtYnzhnxWXB22KyVYvUs2Zl3F/yk2Yn128OwLPWNG8X7XNTpYoaSNTVUXJe5PGj8BQtv6AD aVDIAEAvQhv2qWK7vsJA2vrF7wG8AH9P87XJo1Zs/ZTeETb8dJ/YkvYzKdAtLm5OG+rnzzKr+2EUMA KyVb+qmJ0iqNzp39KpOl4hKsfrBHc+VLBLa3BupUTinXpxEvzHrZKgTlQaLsrH0ZLu8mEXIW0FsP6i TTDc4B7ZA382Mkwgce/iZAL/zuveDz X-Developer-Key: i=broonie@kernel.org; a=openpgp; fpr=3F2568AAC26998F9E813A1C5C3F436CA30F5D8EB Currently the seccomp benchmark selftest produces non-standard output, meaning that while it makes a number of checks of the performance it observes this has to be parsed by humans. This means that automated systems running this suite of tests are almost certainly ignoring the results which isn't ideal for spotting problems. Let's rework things so that each check that the program does is reported as a test result to the framework. Signed-off-by: Mark Brown --- Changes in v3: - Re-add signoff. - Link to v2: https://lore.kernel.org/r/20240122-b4-kselftest-seccomp-benchmark-ktap-v2-0-aed137eaea41@kernel.org Changes in v2: - Rebase onto v6.8-rc1. - Link to v1: https://lore.kernel.org/r/20231219-b4-kselftest-seccomp-benchmark-ktap-v1-0-f99e228631b0@kernel.org --- Mark Brown (2): kselftest/seccomp: Use kselftest output functions for benchmark kselftest/seccomp: Report each expectation we assert as a KTAP test .../testing/selftests/seccomp/seccomp_benchmark.c | 105 +++++++++++++-------- 1 file changed, 65 insertions(+), 40 deletions(-) --- base-commit: 6613476e225e090cc9aad49be7fa504e290dd33d change-id: 20231219-b4-kselftest-seccomp-benchmark-ktap-357603823708 Best regards, -- Mark Brown