Received: by 2002:a05:7412:7c14:b0:fa:6e18:a558 with SMTP id ii20csp456997rdb; Mon, 22 Jan 2024 09:14:51 -0800 (PST) X-Google-Smtp-Source: AGHT+IHq45KaTR/HLzlGAokIkon0+FoHcqplTrxxiaQFdWX1CVMpTOgVz7TLQHt0VMdNEU9bAXbq X-Received: by 2002:a17:907:d50c:b0:a2f:d3c6:61b7 with SMTP id wb12-20020a170907d50c00b00a2fd3c661b7mr2121051ejc.137.1705943691303; Mon, 22 Jan 2024 09:14:51 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1705943691; cv=pass; d=google.com; s=arc-20160816; b=dfV1iEorTuduv8z6nTbQ3d1V39Iel+MSiVYscYg9+0uouLqOpDu8mFvhj8KAUb4iSx 1tKRoI7Ox3mb734snMiKmFT4p+MAIlt3Ly8gqSI02u2LeRJjX72+kzt6pqVw0peRakGH KL8js3rSBNQiiIxhzQ7bUDQHU1W7z6UXDRNNkA1VMj+jNGF0Bl+F9a0KPvY9oCdLyM5u AiTVoiKgODRTFR92w+IOPf6YadtC/M7JywpB+Plg8+i76MbXm4eJkfLdPTK96XlPLHxX hmrgZ2allBabcZXXaV9fbrb+I03X1K2WrV2iM+cReIyqeronVplWlTOa7KR+X5JqdHdg Z8cg== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=cc:to:content-transfer-encoding:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:message-id:date:subject:from :dkim-signature; bh=yTYwdA5MJ6oCZAI/PY1ITXCnTO3v1mEUESoBMZe6uqU=; fh=eBs+z3cdUgmHt86TGE0VSSkyDyUe/TSov8Em/nz9veM=; b=XmfTzUqipBkGLgOeSclJ0ruRwyRQzEH4j6tNFMSd5/YGyB3qKxSu11l/YP7A7+gfu8 RDNhXphZIv79tiYX4eyf57xL+ZoUs1xKTvFkZbZEfTxXwbHEx/gNIR0TL2aiJLaapzf+ BpZZ4gc3bVjNzsgfJDJRc8HvAxOT0Xo+8xxmPGTIxSvODWX2AGMqNlS8z+UD5T+YvkW1 79TGBN+IULNcxYHM3XEisukSIlB2yM09lOJrUqFwW1SXYHIv3LovDcb3wpsQWEmtpc2p pYNBftdJza9WlZnEpiDzQ39QkOzY9kD4X/sa/JWCZP+ZC8EKUm6MyYkKMbtgOA0Z0qg/ P6qQ== ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=PmveBwGU; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-33649-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) smtp.mailfrom="linux-kernel+bounces-33649-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from am.mirrors.kernel.org (am.mirrors.kernel.org. [147.75.80.249]) by mx.google.com with ESMTPS id z3-20020a1709060ac300b00a2ae61c4c32si10942066ejf.277.2024.01.22.09.14.51 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 22 Jan 2024 09:14:51 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel+bounces-33649-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) client-ip=147.75.80.249; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=PmveBwGU; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-33649-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) smtp.mailfrom="linux-kernel+bounces-33649-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by am.mirrors.kernel.org (Postfix) with ESMTPS id 1465E1F270BF for ; Mon, 22 Jan 2024 17:14:51 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 35E12633E5; Mon, 22 Jan 2024 16:04:28 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="PmveBwGU" Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 5F3F43EA83; Mon, 22 Jan 2024 16:04:27 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1705939467; cv=none; b=jiB2Pa+E1Nciyk+DE8HPB2ivjDYi/VIpZh9aeVx9Hzg7E2u1JAlON+XgJcMjFxFu3n94r8Sh/MHD0rnDkmtIKvOM4bl6NU9FeEsVS2N2TNzVtrgWY4CjxEUGBA1qDur5FwPFDxjBjkUeqmXqHBJAa01MWHd6G4wMYnjVQzp0s5E= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1705939467; c=relaxed/simple; bh=9NOW4PJJJHRMNdIzMEfidVAyIfbuRCPZbGomXALQm0g=; h=From:Subject:Date:Message-Id:MIME-Version:Content-Type:To:Cc; b=TjcWpxoZi3yxKb/hpj56HK05JZT2c6IhLzTxvP/kCrnSZiEsa+tEBVL2BeUsKKeYrp4AvOVnpsjcDB0quGlbNi0gj2IxbC3RZoPEAzauwkSmmijOy0d5gOFwc0zYlVdz0uC4WcNBtDy55ax2S+hDP17rCDSNys++rK/m484B9tU= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=PmveBwGU; arc=none smtp.client-ip=10.30.226.201 Received: by smtp.kernel.org (Postfix) with ESMTPSA id 33BC7C433F1; Mon, 22 Jan 2024 16:04:25 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1705939466; bh=9NOW4PJJJHRMNdIzMEfidVAyIfbuRCPZbGomXALQm0g=; h=From:Subject:Date:To:Cc:From; b=PmveBwGUz8JvHM7e6ofP1ebzsZpdb43APmUivPMUAd7D3BO2vFuia6u+dSSJPY3Ck Xs1voI1XS4+rxqadPge+7SqUTTuUh1SJZ/ji26xOUDUVL+B0nbCNX3cFUpZ0mw1pfO Vo1WdWzhODF8vxiymPkL5hydPDQflwoaxE4Nl5IU2Tsoomp70k5oH9k/f0Kn4FvtkT ez2yu6DB8NQ9NT8FyiaU1yBEWuKKpy8ZfcgqgeAq8Lh8fJKM2/8Rd/S58Lb6rYGTX3 CaoskedoYo2ARCg98Wff9mU+J/05oX6vKz+u1m3eagWt0CGngQ5Qdnvy2CZ4iOUnq7 eIPkBP4lAUxWg== From: Mark Brown Subject: [PATCH v2 0/2] kselftest/seccomp: Convert to KTAP output Date: Mon, 22 Jan 2024 16:04:14 +0000 Message-Id: <20240122-b4-kselftest-seccomp-benchmark-ktap-v2-0-aed137eaea41@kernel.org> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit X-B4-Tracking: v=1; b=H4sIAP6RrmUC/5WNSw6CMBQAr2Le2mfaV+XjynsYFlAf0BRa0jZEQ 7i7lRu4nFnMbBA5GI5wP20QeDXReJeBzifQY+sGRvPKDCRISZI1dle0kac+cUwYWWs/L9ix0+P cBos2tQuqW1kIVZEqRQW5tATuzfu4PJvMo4nJh88xXeXP/tdfJQrs65qJqkLJTjwsB8fTxYcBm n3fv8+l4l/XAAAA To: Kees Cook , Andy Lutomirski , Will Drewry , Shuah Khan Cc: linux-kselftest@vger.kernel.org, linux-kernel@vger.kernel.org, Mark Brown , Anders Roxell X-Mailer: b4 0.13-dev-5c066 X-Developer-Signature: v=1; a=openpgp-sha256; l=1145; i=broonie@kernel.org; h=from:subject:message-id; bh=9NOW4PJJJHRMNdIzMEfidVAyIfbuRCPZbGomXALQm0g=; b=owEBbQGS/pANAwAKASTWi3JdVIfQAcsmYgBlrpIG/0Ays7HCrytmcrA21yoUdZu+RYOgOVqEfPuu xXq3ASiJATMEAAEKAB0WIQSt5miqZ1cYtZ/in+ok1otyXVSH0AUCZa6SBgAKCRAk1otyXVSH0KhYB/ 9uafPxDt7FR88b0KSa2blor4TZ957DpjYC1XeYc/N3BdmNmn+O+jEI8xAe9OQXGbVzWspfgyBOO/iY O9WZlsvNFZle2TC+YpqahqKZoFjK0Jaza+Hi4Auv4rS69XisXrS704R2rpnHupruftoJ802DZpdhY+ ryqqby578Eb0ikADFCqrX3diOHE8Jj3aSkeOeLkMbq2qK3rJTUMIlPiwAVbSri0shbnqd3jATiE1dQ LtNefuMLrxHM+gXmvJtK5FgmxE/RzxLG+WrAi5PSWTyBPxHAk+GlRrn8boX7eRHHqKoiucZu+tOa3x 2M23AbzDAj1Xo88LQZPuSRLl4i+6F3 X-Developer-Key: i=broonie@kernel.org; a=openpgp; fpr=3F2568AAC26998F9E813A1C5C3F436CA30F5D8EB Currently the seccomp benchmark selftest produces non-standard output, meaning that while it makes a number of checks of the performance it observes this has to be parsed by humans. This means that automated systems running this suite of tests are almost certainly ignoring the results which isn't ideal for spotting problems. Let's rework things so that each check that the program does is reported as a test result to the framework. Signed-off-by: Mark Brown --- Changes in v2: - Rebase onto v6.8-rc1. - Link to v1: https://lore.kernel.org/r/20231219-b4-kselftest-seccomp-benchmark-ktap-v1-0-f99e228631b0@kernel.org --- Mark Brown (2): kselftest/seccomp: Use kselftest output functions for benchmark kselftest/seccomp: Report each expectation we assert as a KTAP test .../testing/selftests/seccomp/seccomp_benchmark.c | 105 +++++++++++++-------- 1 file changed, 65 insertions(+), 40 deletions(-) --- base-commit: 6613476e225e090cc9aad49be7fa504e290dd33d change-id: 20231219-b4-kselftest-seccomp-benchmark-ktap-357603823708 Best regards, -- Mark Brown