Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18;
Message-ID: <7ba5e99a-9169-75c4-2324-f9a3ce9a506e@intel.com>
Date:   Mon, 31 Jan 2022 11:37:02 -0800
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101
 Firefox/91.0 Thunderbird/91.5.1
Subject: Re: [PATCH] docs/kselftest: clarify running mainline tests on stables
Content-Language: en-US
To:     Shuah Khan <skhan@linuxfoundation.org>, <shuah@kernel.org>,
        <corbet@lwn.net>
CC:     <linux-kselftest@vger.kernel.org>, <linux-doc@vger.kernel.org>,
        <linux-kernel@vger.kernel.org>
References: <20220126201341.55771-1-skhan@linuxfoundation.org>
From:   Reinette Chatre <reinette.chatre@intel.com>
In-Reply-To: <20220126201341.55771-1-skhan@linuxfoundation.org>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 7bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?TGNWSGhkT215bVgyN3dCdEZjWUVRaCtEUkdqQUVpUmFzcXdYRzRLYmljVndE?=
 =?utf-8?B?aVVzUVprdXpLV1RtZUpKazhxU0dzbzJLUnVzek1NelkvRHFDdDhCQW0wQ3JJ?=
 =?utf-8?B?MDE4elZsWnh6OG9QNmI0d1lZajBGMy8rRFJEM0lzVTZqNDFlNU4razF4YWxS?=
 =?utf-8?B?NmMzS1ZFeUFRTFdYVGFlTkdmQkExNUZIdmYwTkRtQTkrNkJ4clVlNDhZcVhP?=
 =?utf-8?B?YVFIZGZ6UmlIVEJDMk1yMDBNNEdmbUgzcVdQb2paNXg5djNxMFhnNXlnY1Av?=
 =?utf-8?B?N2dicEtZanRUYzZZM2NpU095OS9JV3JyQjh1ZmFQdkRhWkhVc2FiczkvWTlY?=
 =?utf-8?B?dmxKTFRHaHYxYVBIZXFWTXZKQ1NOQ1JXZU8yS0lzNmlqNVNBN09Meit4bFJT?=
 =?utf-8?B?TjhhRWpEbkNOQU9zcUxTRHBOdzRMdE95TzVsbXk1V0FlSXRmOVpOOHZwL0ta?=
 =?utf-8?B?djZyejFQcEZBZHdQNWQ3NXB3NWFEYzFYZ2p2UGNHa0RPME5qcWw5UFREVkhJ?=
 =?utf-8?B?cDZEUnBuUTdiQ1VMUUhOUW5pY1VMa3lGUm5Gc0N2SnBIUldpMmhNckppTU1m?=
 =?utf-8?B?eVRKMEtwN1hSVnVOc0FSanY0VnVoMG5pUlR0U1lDdnlEOTA3TW5xT1lVZmVk?=
 =?utf-8?B?QzZzcmFRREZQRU5welBPd2oyVy80VkN2SW5GU1RqT0k3Z3dkdlpCUUFjZVNK?=
 =?utf-8?B?UHhjaFE1ZVFjdWltZ1haS0Y3QTgya2xJKy94YnpCWk9lL3puQ2hzRURuTUpw?=
 =?utf-8?B?YXdjS0NVUzJxdmlrZ05LaDllQkJxQ2dCQnhJanJnQ21uU1dxanYxcE53NGVU?=
 =?utf-8?B?c2thZkpxTVVhZlkyZEVzbGJReFpSbXRzejRzMUdGTnZPSUJyNUIxYmdNQjhH?=
 =?utf-8?B?dVlWOGdVM2xqNXhsaEdhd2Y0L2dUcTU1bTl3WUs5MFpEbmhvRnpZWjQ0Wkwr?=
 =?utf-8?B?YjllaGx5MVhrMmVENWN1eFJIWGg4MEVGcnZWNjM4OFFtYnBMNkFnTUF4MXdH?=
 =?utf-8?B?aU1RZlRIUVI1b2Qwakk2TXYvNElwazYvQWk2NU5LQVNZTUNaem04MGJvS2lZ?=
 =?utf-8?B?by9NZ2gveThmRXNTQk1BZFJCNW1YYjZ2RTZiRlA0QXBPZ29QTFF2UmYzRVFi?=
 =?utf-8?B?N05YRnVJT3ROL1NxVW0waGY2NHVsWlJpbjVjbFV1R2JmTFNSMkNIcE9LdlRO?=
 =?utf-8?B?bkVaQldVVlpTaHhRQVBCbjdBalEwaG5WNUJVUEtDbXU2Rm55S1dZRllkNXow?=
 =?utf-8?B?Rm5jU1E1U2dONzNlKzNZUzNEeUtwZWxJWW1UVjFQQ24zbTEvNnUveHJCK0Z1?=
 =?utf-8?B?QnVWNDJ5NkJwc2tmTHMzOUpQM0pvK0hFclRnL0dPVHJsYlUrbHBzeDV6WUJI?=
 =?utf-8?B?MHh3RDI3Q2pHMGJDcDhlbDRxZFJyVUNqeVQ2Rk5WM1NxMG5UYU83a011RUFo?=
 =?utf-8?B?Y3M0SW92akNDWjRQZGgrUHFhRmRKZnRaY3JzUkhxZlNaOVpCUXFiS0R3S0d6?=
 =?utf-8?B?L1Y3UFJsOEgyVEhwUzdqKzNBQkhoQWtiUHBuS2NPRjNjRkdJMTRSUzBxZmRv?=
 =?utf-8?B?akxNcWVNTmVOVndJa3ZNbSt5cXdLdS9HSlg2VUNhY2YwMHZQU1piQXlXcUxF?=
 =?utf-8?B?aVhrSTZqb3hsTkh3cEo0WlpFTStaNldpSkJUTm94OXlYdmxVOHc2QmlobzJ3?=
 =?utf-8?B?Wnd0V1poTFI5VWZBa2ZrS1FRMFJ4bVI5TXo5bUFoZkp5S1FvRnUwUjA1UEdD?=
 =?utf-8?B?alE4VUNRSzkrSVJZVTFESW40SVJBR3lrOUFYc0JISzQ0MndHNzRaVVBGQ1RH?=
 =?utf-8?B?aFAxekhqemx1YmIwNGEvSDlSYWoxbW9yK0ZPNjR2RGJvZWtXb0xHKzV4L1pC?=
 =?utf-8?B?RUdQeE9Pb1pwYTZpVnFWeUlvUURMN0F1dUNqVXNQUlpSaFdXRnVaSmhIZ1Nt?=
 =?utf-8?B?ZHV1OUFvVTJpM0pzaEprQXpTK1QwOTJXMHptSjNTRmxzNkxDRmFXeHFhZVla?=
 =?utf-8?B?N1FUVllTMnJhMUhwb1ZYWEt5QVJ0SFduU3ZYenJpbkM2ZUpTUmhQWW5CTStk?=
 =?utf-8?B?V2ZMenFrUjV0cmRQV3dLZWdFcGl4OWhDcUhQb24wSXQ2dFlYTWpsUUFaa0x4?=
 =?utf-8?B?ZWhYeHdYbVVqSHBvWUtJSzRwdHd2YTMzYUxrMXdGMHgwNUloS0lmZnlqVzVV?=
 =?utf-8?B?WjhSd0VVUjUyYUtpQUg2M1ZiNWgrc3JCOUdOVm9DdVBjbkYxaXd2bnhha1l6?=
 =?utf-8?B?Wlg3MC9rQ3VzZ0ZlSXd5Q0hjckJnPT0=?=
X-MS-Exchange-CrossTenant-Network-Message-Id: 140fe86a-3378-419f-b87c-08d9e4f110c8
X-MS-Exchange-CrossTenant-AuthSource: BN0PR11MB5744.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 31 Jan 2022 19:37:07.2445
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: 7Drk2pXqlqFoLa1fQXXFX7T13VIt3H1H8CkBO0tXxFPRmYzKQ1+IPyEcYv/zTakwisXytL24e6Fn5aTWvDq2jo1AmzCmP7Qu1yaRqsWpYaY=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN2PR11MB4094
X-OriginatorOrg: intel.com
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

Hi Shuah,

On 1/26/2022 12:13 PM, Shuah Khan wrote:
> Update the document to clarifiy support for running mainline
> kselftest on stable releases and the reasons for not removing
> test code that can test older kernels.
> 
> Signed-off-by: Shuah Khan <skhan@linuxfoundation.org>
> ---
>  Documentation/dev-tools/kselftest.rst | 8 ++++++++
>  1 file changed, 8 insertions(+)
> 
> diff --git a/Documentation/dev-tools/kselftest.rst b/Documentation/dev-tools/kselftest.rst
> index dcefee707ccd..a833ecf12fbc 100644
> --- a/Documentation/dev-tools/kselftest.rst
> +++ b/Documentation/dev-tools/kselftest.rst
> @@ -7,6 +7,14 @@ directory. These are intended to be small tests to exercise individual code
>  paths in the kernel. Tests are intended to be run after building, installing
>  and booting a kernel.
>  
> +Kselftest from mainline can be run on older stable kernels. Running tests
> +from mainline offers the best coverage. Several test rings run mainline
> +kselftest suite on stable releases. The reason is that when a new test
> +gets added to test existing code to regression test a bug, we should be
> +able to run that test on an older kernel. Hence, it is important to keep
> +code that can still test an older kernel and make sure it skips the test
> +gracefully on newer releases.
> +
>  You can find additional information on Kselftest framework, how to
>  write new tests using the framework on Kselftest wiki:
>  

(My apologies if this is already documented, I was not able to find this guidance
in Documentation/dev-tools/kselftest.rst nor when looking at the
"Kselftest use-cases..." slides linked from https://kselftest.wiki.kernel.org/)

Could you please clarify what the requirement/expectation is regarding fixes
to tests? Since the recommendation in the above change is that Kselftest from
mainline should be run on older stable kernels, is it required to backport
fixes to the tests themselves to stable kernels?

Thank you very much

Reinette