Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.33 as permitted sender) client-ip=23.128.96.33;
Message-ID: <VI1P193MB0752C18200A14B449C863B1899FCA@VI1P193MB0752.EURP193.PROD.OUTLOOK.COM>
Date:   Mon, 25 Sep 2023 18:25:42 +0800
User-Agent: Mozilla Thunderbird
To:     shuah@kernel.org
From:   Juntong Deng <juntong.deng@outlook.com>
Subject: [RFC] selftests: Add dependencies information for kselftest
Cc:     linux-kselftest@vger.kernel.org,
        "linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
        "linux-kernel-mentees@lists.linuxfoundation.org" 
        <linux-kernel-mentees@lists.linuxfoundation.org>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
MIME-Version: 1.0
X-MS-Exchange-MessageSentRepresentingType: 1
X-MS-PublicTrafficType: Email
X-MS-TrafficTypeDiagnostic: VI1P193MB0752:EE_|GV1P193MB2023:EE_
X-MS-Office365-Filtering-Correlation-Id: 72458393-8ac6-4af1-3b02-08dbbdb1c5f8
X-Microsoft-Antispam: BCL:0;
X-Microsoft-Antispam-Message-Info: P04eYQCHpk9T/4f+ZFEKE3aU+sK+5+cJL56O/Lj5LhuwaQzBCEACUC0UXs0Mf/WxvQ/Wih52vdneILD+fMDIrKJmGhDoVi69pDppNIt9fGU8ovBVzu06MguICaqV5XBz2yWT2yPpLv8XTCcOAoDlwmop8pTqy6ciSW5wB3UnmEHlqsF7Js/KLUzoZKCXkUf+mdxRgBAuIelaJrPtM/WFepJivsFvu8kg9mwJF6/m9xQz53xtgn2UwF4HN9QxZIXv1BF9AF1k0RsRAfeFXLtFxsWcfJPWu6aAgWnPa+NfsJErXf2GOg/E3jHJr/vsBefV+dUNcYQny2uYBa3QAkMLLipzxgxgXa2knnWbpAIEt8yEOmcpWb+9wndV4QqASo/cD8B9WnN3h3AvK0o3VCqhHpY4h5bTec4ntdN0kQuw9KCgLRxHfFnIPhYyG10QZ5r4prPkXOuaEjRiF1V/gUgej/qmn+4WmT4xQUB9cIr9M5YzgrX4YgKZjwq8Hpj+LJNGRi2bj3LOJ8emIteQ+4/sV+QQ/ZxlXOoxtA5993SzTuv/A5OKIjPPUVLwMsLXXDul
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?VEFWV01LSDNVU1M4c2JwQUpYWXh6bmpLam5JWUxMY2drL2o5a1VNWXlBL0I4?=
 =?utf-8?B?bUdMM2dSYUROc3FKZE9RSGdnSEFETTZYa0Z2REM2L3dSSjZVVHByNk1ndEZO?=
 =?utf-8?B?ajQ1emQ4RzBBanlneXdCZjZXTWhndmxMNXdGRjEwMTQ0ekc2UlVWMDdZTW1r?=
 =?utf-8?B?UU5lREw3cWhlaHJaa2JFUUFpbkl4MkFJY2o3TjVKZmU2ZGJ4cjgxSDFDS3VY?=
 =?utf-8?B?aGxvVnRSbVNPa0RFQUFGN3lKMzhTSC9IdURuQlBXajJGWWVLMGZOdE1RWnF3?=
 =?utf-8?B?NTQvV3hqcFppRlN3NWp4UVN0MUN6U2NQYWYvZ1ptQUlDa2d0VDZQRHp6QlVH?=
 =?utf-8?B?ZTIvbkF3cjNTWmw1ZjlmaGl1VXAva3hXcy9OSFFsWDBYRjZOR2plelRoZXBn?=
 =?utf-8?B?Y0JjNnZMVlVxZ09wcFJUOEttMGcydm5ZanI0aWlnUUE4Z00vSHRxZVZJWWVN?=
 =?utf-8?B?UVZ5V0ZHUVVEemJHTE43VzIwaWpYcXpGZlhrb2VRMkNoWi9aeGFMSm9nd0Jz?=
 =?utf-8?B?WDdVcnZzdU1kaHZJL1cxUjNXcVM3eHhGaFMyNnVSbUZ0dDFoeEJ4dkhTK1Vq?=
 =?utf-8?B?YkZ1cGREemtLTGZubmZWN3gzaWpPRXB0QWUzSEp4aXJPNURQV3lwSjRGL09i?=
 =?utf-8?B?eXI3QzRLLy9md3dSTlNWYnlNakdRY0ZUQm54Y3M3ZmpNZ2lySDFnM21LYmZl?=
 =?utf-8?B?ZFM5bGNVT1NRUDcvRXFTVzg1Rm00MlJXdGhoVVRMazZkOUloU1M3cUJMdmM5?=
 =?utf-8?B?S00vRFVMOTNOYVZlWXVibXE5ZG1tdEdkTzlqeW11MEwyU2lFcXBFYUhYOVVB?=
 =?utf-8?B?OXVtZ1I1Q0xCVXNKZlhqdkhxQTlMRTdWcHRPRlVFZlBCWW5HeXVtV21iNmUv?=
 =?utf-8?B?MkxqZ21UaE9BZkRtcDlKTUpGOUFZNXVHMCttVERjSjF0MmdEeXVEV0VoUUxL?=
 =?utf-8?B?VG5aMU5xdzk5YmlhcWtvTjVwVUFZRlR2aDBXUDBFMHAzeTFub25UbWRsaU0z?=
 =?utf-8?B?Q0lmejlVcVQwS0x0REJacWFlNEhlUWZGdm02WHZ2T3k0Q0ZsZm1jWG1Fb0ZT?=
 =?utf-8?B?SEFBcndFelNWaXhPeGJxNDhBWVFJdGdqaUlIZUhMc3k1QnZwNjhxR3RDN0c1?=
 =?utf-8?B?TVBIM0cycERqSVVjVDJUVERmVmN6ck5iS2N1S3RrREZMejFPWGtmS3ZiK3pI?=
 =?utf-8?B?clV1S2dVeTBhelhOaG5yY2JualNhWjlkb3lmMTZweDV6VDhXRjdlYW1hazVr?=
 =?utf-8?B?bHVjSittQUN3TldCYXg3MExscjYzQVNVYWo5a2Z1NEJaUGp5YmpTVjloenBt?=
 =?utf-8?B?WDNjMG40THRPMEdpekRaYUhkNlIxZkxlaHQ5T2RSb20rNXAvMFlzdDAxWlRQ?=
 =?utf-8?B?Y3JFTFlhTEhkY3ZZSysrZVhZM2pqWGJXWlNqbDNHWnlWS0QwQzlubnJ2U1B1?=
 =?utf-8?B?TWQrSTVhNjlpaGgwN2syNjRtTjNJR2hicjFrRkJVa1RCYnE1eEhzMkhoR0Vo?=
 =?utf-8?B?L1dQMjdqTGpXMnpkbWZIcHV2ejZtcFJ4cUovYzZsZ1lMTlJHMXQ3cjBzNzBN?=
 =?utf-8?B?Qm8xRVNTaWNFMWp6a1g5bjN5dkI2T2JjbkEveHBZQVY0eWNMY0tHTEhBRitN?=
 =?utf-8?Q?/C4NZ99Gy1wJQ/s07y5vNpHuyKjSj0UZQd7cE13pBgOg=3D?=
X-OriginatorOrg: outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 72458393-8ac6-4af1-3b02-08dbbdb1c5f8
X-MS-Exchange-CrossTenant-AuthSource: VI1P193MB0752.EURP193.PROD.OUTLOOK.COM
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 25 Sep 2023 10:25:43.5957
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa
X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000
X-MS-Exchange-Transport-CrossTenantHeadersStamped: GV1P193MB2023
X-Spam-Status: No, score=1.0 required=5.0 tests=DKIM_SIGNED,DKIM_VALID,
	DKIM_VALID_AU,FORGED_MUA_MOZILLA,FREEMAIL_FORGED_FROMDOMAIN,
	FREEMAIL_FROM,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,
	SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lipwig.vger.email
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org
X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (lipwig.vger.email [0.0.0.0]); Mon, 25 Sep 2023 03:26:04 -0700 (PDT)

Most of the tests in kselftest rely on external tools and libraries
to run, which means that in order to run the tests effectively we need
to have all the dependencies installed first.

But unfortunately, there is currently no way to know in advance what
tools and libraries the tests in kselftest depend on, and can only be
known when a test run fails.

For example after running the alsa subsystem test I realized I needed
to install the libasound-dev package.

This is inefficient for the test of subsystems that require a long
time to run.

For example, the net subsystem test, which takes more than an hour to
run a complete test.

I can only know that I need to install numactl, libnuma-dev, ethtool,
mausezahn, netsniff-ng, ndisc6, netperf, and other tools after carefully
reviewing the results of the tests.

I think we should add dependencies information to the Makefile for
each subsystem test, either as a comment or as an output target of
the Makefile, it would save a lot of time for the people running
the tests.

I can do this part of the work.

Welcome to discuss!

Juntong Deng