Received: by 2002:a05:6a10:22f:0:0:0:0 with SMTP id 15csp4696302pxk; Wed, 30 Sep 2020 09:20:00 -0700 (PDT) X-Google-Smtp-Source: ABdhPJyX9erUeETGZrNY5reC67o4rH0zUECyOkhsf+lOf+fk9GoE4pR4lkzPHfk38j/01rlIap9S X-Received: by 2002:a50:8524:: with SMTP id 33mr3754102edr.123.1601482800000; Wed, 30 Sep 2020 09:20:00 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1601482799; cv=none; d=google.com; s=arc-20160816; b=iLd/mY73CIgf/yl8Dub4tqJQ522JWW4CqraNhKkXybqFV3mL+g/LdrAs8XB+ngJls0 DSeolOypjwERVFjzYF8kiz6FcMKNZed4fh/IwQpj691+bQvQtOAJMOrRCE/E04qu7rse zqBWvzQuXgkpExooL8v2meKoqvU219EXYOWcBi/pV8gZTTl37OQkLwhEEJI5oMDPSrOD qiAtjoqXF1G5bqRaxjzb00QTrdayPx8Fp60ejniuPrWKlz+cxolaen++1ruY43mOtO65 pwN+4EExDG8mWEL7pSGp7MgzcBCpuk456YgkKTmrKx+3gOWqf5sOSJss5jKDbw3mkXzE 9O2w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:cc:to:subject:message-id:date:from:in-reply-to :references:mime-version:dkim-signature; bh=QY2l/Yt+N6Qm5zwEsafOSNC/Vn5PVtgIOgVEBv2bpzc=; b=LmOlL5Dub6EKDuq0xy3o0qlfOjOszng9sEVP/5AS51nS0ZULVZ6jDkkiMJqLvFIQhp F38t7SHOPIlFShFJT5kNEy+9Db6svCzhiIYXlS/F8cp9jai5hNQErtwTQ52CtJF0YgP0 Qm3XKop4QeyR6riFPrN7vo5/uETs0iAuU4raYNJqI89NYRQJhNHhwJ3X7u60oMyV8Aky u6KJQCmBFPtFMXb50KY0AAzO1mOIZvKFLqTkawsA4FT8XIaiTVKQaMP6a1ER8tgOMmyH r2JYuUynfhrjmAhQlFZZ4H54ZKaWbC1lOv9ojUvoSBLd73MtS8FMEMILBRYrhgfwGd4H 1/mQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=enqjfInl; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id o60si1336036edd.426.2020.09.30.09.19.36; Wed, 30 Sep 2020 09:19:59 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=enqjfInl; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1731050AbgI3QSD (ORCPT + 99 others); Wed, 30 Sep 2020 12:18:03 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:49918 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1728744AbgI3QSD (ORCPT ); Wed, 30 Sep 2020 12:18:03 -0400 Received: from mail-oo1-xc41.google.com (mail-oo1-xc41.google.com [IPv6:2607:f8b0:4864:20::c41]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 7E137C0613D0 for ; Wed, 30 Sep 2020 09:18:01 -0700 (PDT) Received: by mail-oo1-xc41.google.com with SMTP id k13so642011oor.2 for ; Wed, 30 Sep 2020 09:18:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=QY2l/Yt+N6Qm5zwEsafOSNC/Vn5PVtgIOgVEBv2bpzc=; b=enqjfInlrBuTD//8bd1nIYeKHK/pBJcmYVk1pRtxQAJfynhwLhsAbwJu/a8NGRTBng EPXUmFjbMGVH3UDVYZRS2LyQi7OmXp+RLZbpPOzDU6pdcLQRnsiOtS+sh9A93BUBwh3N zkVrB6Q0VSXEBP2FcH4Spiaq8QDmQpIMgkK/VoyLy6G7J4xw3Z8my9GrNyUo6OtP0ouE GnIXWKIDIW8mY4gIJqZOW4d7ko3aarGG32xxla4i7ivAhHS3jmDA18ZzjMzvT4K3K4rg Eq/XE+0/52E4tDpTOxwoVFRMD0P3+qaSZHWxqD5ivAXZa9gZ9u/syditveIyoiT/pg8j J4Pw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=QY2l/Yt+N6Qm5zwEsafOSNC/Vn5PVtgIOgVEBv2bpzc=; b=D6mrMwnLirfTocSFeqAVXrdtQQxExf2MIi02cGIF16UCvfNbkIHpqwIRR6yPw27kFb JIWoKWBKXj431Wfe3uWxZw6409Pc1rpQ334yy9fh4Ql01GFFRjtyRgv5EH/t3q6ISwnJ q000PccD1bojoALwL3a9iWK56ZeER+cRj4BURO1z7EbQQ+Fx893/qYQI5NwudtS1qRzb QeKfKp3sSODOYLKG+DHQ+wdfHw/Bb7W4O92ZXbFYQnM3G4CVtD4Ex6YcFADnrPOBe8kP /Y5EnwA5+0bUXH9HBGSdDNAQTZM35yO5ATMCM8nh0OS8XKw/ULTQsokroUsL0d3oPcnf Skrg== X-Gm-Message-State: AOAM531iZUpcg5nY/CPNet+UnWJEh08PaXI1rDU5OlLHvQ+kE4V8AOJz dpgif95o49ZFoqtHmc58nd+NzoLKhWkx8E4ZeANXPw== X-Received: by 2002:a4a:95f1:: with SMTP id p46mr2358703ooi.93.1601482680767; Wed, 30 Sep 2020 09:18:00 -0700 (PDT) MIME-Version: 1.0 References: <20200928202650.2530280-1-keescook@chromium.org> In-Reply-To: <20200928202650.2530280-1-keescook@chromium.org> From: Naresh Kamboju Date: Wed, 30 Sep 2020 21:47:49 +0530 Message-ID: Subject: Re: [PATCH v2 0/3] Extract run_kselftest.sh and generate stand-alone test list To: Kees Cook Cc: Shuah Khan , Hangbin Liu , Jonathan Corbet , linux-doc@vger.kernel.org, Tim.Bird@sony.com, lkft-triage@lists.linaro.org, Anders Roxell , Justin Cook , Linux-Next Mailing List , open list , "open list:KERNEL SELFTEST FRAMEWORK" Content-Type: text/plain; charset="UTF-8" Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Tue, 29 Sep 2020 at 01:56, Kees Cook wrote: > > v2: > - update documentation > - include SPDX line in extracted script > v1: https://lore.kernel.org/linux-kselftest/20200925234527.1885234-1-keescook@chromium.org/ > > > Hi! > > I really like Hangbin Liu's intent[1] but I think we need to be a little > more clean about the implementation. This extracts run_kselftest.sh from > the Makefile so it can actually be changed without embeds, etc. Instead, > generate the test list into a text file. Everything gets much simpler. > :) > > And in patch 2, I add back Hangbin Liu's new options (with some extra > added) with knowledge of "collections" (i.e. Makefile TARGETS) and > subtests. This should work really well with LAVA too, which needs to > manipulate the lists of tests being run. > > Thoughts? I have tested this patch set on LAVA with full run and it went well. > > -Kees > > [1] https://lore.kernel.org/lkml/20200914022227.437143-1-liuhangbin@gmail.com/ > > Kees Cook (3): > selftests: Extract run_kselftest.sh and generate stand-alone test list > selftests/run_kselftest.sh: Make each test individually selectable > doc: dev-tools: kselftest.rst: Update examples and paths > > Documentation/dev-tools/kselftest.rst | 35 +++++---- > tools/testing/selftests/Makefile | 26 ++----- > tools/testing/selftests/lib.mk | 5 +- > tools/testing/selftests/run_kselftest.sh | 93 ++++++++++++++++++++++++ > 4 files changed, 124 insertions(+), 35 deletions(-) > create mode 100755 tools/testing/selftests/run_kselftest.sh > > -- > 2.25.1 > - Naresh