Received: by 2002:a05:6a10:22f:0:0:0:0 with SMTP id 15csp3293000pxk; Mon, 28 Sep 2020 13:28:53 -0700 (PDT) X-Google-Smtp-Source: ABdhPJyHnusVJLVKGzsDPXss0CU4O9IlxZwF9TxUHiQBd2uPpNTre8oM1EZ0nP5/zanbTL/7wDMm X-Received: by 2002:a50:d68a:: with SMTP id r10mr3959954edi.9.1601324933072; Mon, 28 Sep 2020 13:28:53 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1601324933; cv=none; d=google.com; s=arc-20160816; b=aq6pPZo9ZMMBxu/Kbxuse92JALPfAHGu0c7PKOg0PUEdZCNbLnF/6cuQYSzMW6Wzgh yLXLZkTBoru9+SN7LepeS7lYa4FsFPx+Ia1lnZP75NT0SbXbAK+9PtdY47zniN76QuB3 W8kA6bAAqDBdXWUgZNzY+nRPFWfH/7pe4/LlqabC9Yb0kFIPytMrmWuCjd4I1jAV+yir FHDp04bm+kZpQL50DRTOuXpGdtckHSxLJrIWIPVROqCeKZ+gYycJt5zLss49V062aAbF Az+Nu4bckoFbWfH60JkR6F9+uzyZ5SfgW63wNwZXjjuyN/vHTn9uVffakGGdnfdgnj26 tBVw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=lJ5ZdKcP2oAkwJGbJu7+t9DxeD4UPnPYjzHySuJB9PE=; b=met76RgdG0nEC1ESpZeEngTZEXJzYC0WlWOkscdRxGNB59pU4WMO88raFVes4o6zLu +qIDTDn0n1JHDk3X4GRVDiKBWD1LlfQrBLhuSohXMsBw68FMv48Tvvfam7AbJbRffgkJ KctiV/rJIlj4ktH/3b/jihfRnSuw0EPZFhFgD35LzSVQq+KVsoVy4JhbszMLxpi86tOV WBX0IJBaSZqhVjdc0Pjup6Irt17VZPfWx/erQE9CAq/+/pyhfs/gNDrIqsrgkXLvcC+v LcAJkZIV0EIyceDnIr07pVbVLXNb7/HsWK83RRJsdWEI1nicEe0hlVgIebmq+PZKd8Da qCbg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@chromium.org header.s=google header.b=MlFab++6; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=chromium.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id mf8si1330065ejb.197.2020.09.28.13.28.29; Mon, 28 Sep 2020 13:28:53 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@chromium.org header.s=google header.b=MlFab++6; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=chromium.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726656AbgI1U1H (ORCPT + 99 others); Mon, 28 Sep 2020 16:27:07 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:38872 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726590AbgI1U0z (ORCPT ); Mon, 28 Sep 2020 16:26:55 -0400 Received: from mail-pg1-x543.google.com (mail-pg1-x543.google.com [IPv6:2607:f8b0:4864:20::543]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id F0217C0613CF for ; Mon, 28 Sep 2020 13:26:54 -0700 (PDT) Received: by mail-pg1-x543.google.com with SMTP id y14so1869016pgf.12 for ; Mon, 28 Sep 2020 13:26:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=chromium.org; s=google; h=from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=lJ5ZdKcP2oAkwJGbJu7+t9DxeD4UPnPYjzHySuJB9PE=; b=MlFab++6Ip3miUqv0VUcTTNeUxVV45WuF5PFiNzVNk1Ih0DWAMRo93baww8sIoZcuL Cva6K7F9j2ZeLMDPnoJunPlqO7v4JnzhXtJIVt+mbmxZjzYIy/ZTeUA5TsNyRtLBpmWe jArZUszX6PfOEgwGFNEEE6ZGNMbxfVeBhqs64= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=lJ5ZdKcP2oAkwJGbJu7+t9DxeD4UPnPYjzHySuJB9PE=; b=HUf567T1fAhN2LgxNI/NVL+LLBHYejnE85i+VUbPaZ51M5SHou3BoYnv5rdkWPob/N 2v0Io6nTXPdqRUi3Cb7yGHP3xVAnSeEaXne2uw1/kjlB8rGgJZnoF+C0+kCb9QKEqJKh jAuACskZLkf1unm5TQXLKVSTqqbyb78QXHE380F/vhtxf8CZ/37sc0rVICUE1MAD+yVs CKCjHF5hv1WpZN2uzrq8TsCEXURAY7g87FXvJlogm/Vtq/UNgC+HrmtmPsRTLB33X0rh E65g+Cp20o4EFsYMHLqJq/YTKg8ICJGhZK6liKY1jXH4KiyofzPPaMKG7A4OyY1rYffA l8yQ== X-Gm-Message-State: AOAM530X5SbcyvDMpN6FCUa2o6G/K3KWH7TPGqXFxXlMa19MvU8QHuuZ YBBJpAtRZW4wMOUuFMC2G1FKGg== X-Received: by 2002:a17:902:14f:b029:d2:562d:e84 with SMTP id 73-20020a170902014fb02900d2562d0e84mr1027485plb.64.1601324814455; Mon, 28 Sep 2020 13:26:54 -0700 (PDT) Received: from www.outflux.net (smtp.outflux.net. [198.145.64.163]) by smtp.gmail.com with ESMTPSA id q4sm2484432pjl.28.2020.09.28.13.26.52 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 28 Sep 2020 13:26:53 -0700 (PDT) From: Kees Cook To: Shuah Khan Cc: Kees Cook , Naresh Kamboju , Hangbin Liu , Jonathan Corbet , linux-doc@vger.kernel.org, Tim.Bird@sony.com, lkft-triage@lists.linaro.org, Anders Roxell , Justin Cook , Linux-Next Mailing List , linux-kernel@vger.kernel.org, linux-kselftest@vger.kernel.org Subject: [PATCH v2 0/3] Extract run_kselftest.sh and generate stand-alone test list Date: Mon, 28 Sep 2020 13:26:47 -0700 Message-Id: <20200928202650.2530280-1-keescook@chromium.org> X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org v2: - update documentation - include SPDX line in extracted script v1: https://lore.kernel.org/linux-kselftest/20200925234527.1885234-1-keescook@chromium.org/ Hi! I really like Hangbin Liu's intent[1] but I think we need to be a little more clean about the implementation. This extracts run_kselftest.sh from the Makefile so it can actually be changed without embeds, etc. Instead, generate the test list into a text file. Everything gets much simpler. :) And in patch 2, I add back Hangbin Liu's new options (with some extra added) with knowledge of "collections" (i.e. Makefile TARGETS) and subtests. This should work really well with LAVA too, which needs to manipulate the lists of tests being run. Thoughts? -Kees [1] https://lore.kernel.org/lkml/20200914022227.437143-1-liuhangbin@gmail.com/ Kees Cook (3): selftests: Extract run_kselftest.sh and generate stand-alone test list selftests/run_kselftest.sh: Make each test individually selectable doc: dev-tools: kselftest.rst: Update examples and paths Documentation/dev-tools/kselftest.rst | 35 +++++---- tools/testing/selftests/Makefile | 26 ++----- tools/testing/selftests/lib.mk | 5 +- tools/testing/selftests/run_kselftest.sh | 93 ++++++++++++++++++++++++ 4 files changed, 124 insertions(+), 35 deletions(-) create mode 100755 tools/testing/selftests/run_kselftest.sh -- 2.25.1