Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:5 as permitted sender) client-ip=2620:137:e000::3:5;
Message-ID: <8051f3ef-1126-41fb-b6cc-f48441936dd7@intel.com>
Date:   Thu, 2 Nov 2023 10:57:12 -0700
User-Agent: Mozilla Thunderbird
Subject: Re: [PATCH 23/24] selftests/resctrl: Add L2 CAT test
Content-Language: en-US
To:     =?UTF-8?Q?Ilpo_J=C3=A4rvinen?= <ilpo.jarvinen@linux.intel.com>,
        <linux-kselftest@vger.kernel.org>, Shuah Khan <shuah@kernel.org>,
        "Shaopeng Tan" <tan.shaopeng@jp.fujitsu.com>,
        =?UTF-8?Q?Maciej_Wiecz=C3=B3r-Retman?= 
        <maciej.wieczor-retman@intel.com>,
        Fenghua Yu <fenghua.yu@intel.com>
CC:     <linux-kernel@vger.kernel.org>
References: <20231024092634.7122-1-ilpo.jarvinen@linux.intel.com>
 <20231024092634.7122-24-ilpo.jarvinen@linux.intel.com>
From:   Reinette Chatre <reinette.chatre@intel.com>
In-Reply-To: <20231024092634.7122-24-ilpo.jarvinen@linux.intel.com>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 8bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?ZXp3TjRTdTRkbzdNWTdDQnBMRHhkZHFXd3MxS3FwWm0wSUV0U2lqWHlOWFZO?=
 =?utf-8?B?dnoyQXl0V0lhZGg5ZlVGZTJqNjhnNlBYOEF4UllYSThxMnV5dnR5ME54Qm9m?=
 =?utf-8?B?d1YvYTlpOHJoaHdEVjJLRHNrZWpGYzRLeTNZUWFiOHBscEVRUDVYUkhiNWEy?=
 =?utf-8?B?azNPd2hURE44QVZWYWtidi9VL2JEL0k2NFU0N0JvRE0vZUFyNkJ6TU1Wc0lU?=
 =?utf-8?B?NXo5QzhyL05DOVlWYTZKQlpsM0V1akh1bzlEa3dLbFc2citEVVEydmFRemhK?=
 =?utf-8?B?REJZZGFiNUtia0tIa3d3ZzJBbUpsRkY0Z2k2dUs3TjR6Um11ZUlhTU9sMENh?=
 =?utf-8?B?L3RHbWZDVlJaRm5jOVRFV3N0Ykw2aE10dUI1bUorSURVRWhTMWZ6REJ5Y3Q3?=
 =?utf-8?B?OEcvb3dHRm8yN09iako0bVE4Y0diUzRKQjJZcHJwNjRnNEVSMnAwMzFKNkxX?=
 =?utf-8?B?WTlZS2kzYytRM1R0MmI1TTN2czhJN2J0K2dkTWpQZFZ1UkF1Z2VlY0JkdG91?=
 =?utf-8?B?YS9pbElSSEZnK0NDbGsrWCtzWXdPcjF1dUtiemxpd3JGYkJ5R3ZSbTN0MWt3?=
 =?utf-8?B?Q2xTSjcvcTRUemVneG55a3VKaW5pdVRrdXNDZ1hKMmt6T243VlliTUJ0S0VV?=
 =?utf-8?B?VEZnTlJmOGVyZ21RSkhqSHpCQXBteHJCWjlNYSsxdk53VHZMWCtSU25ERHlj?=
 =?utf-8?B?byticU5CNWYxMHJ0Ti8zTVlFc3N0c3FpRG5ScnFyYkp4b3FmeDdzZzVXM2Vh?=
 =?utf-8?B?MHc0cHN0c1Y1RG5PQTU2ZlFDOGVHaXcraEhMcFllZEpqenNoZXhoTkhUV3FY?=
 =?utf-8?B?bTYrNWp3N0lDSGpGUy9VSlFzbmE4YUN1SHE4L3paZ0xUbyt5dVJUcUdnUGQw?=
 =?utf-8?B?OFdYSDRLam1IVERlN1EraGpNSERCNUc1cTdMQ2lyV1Q0bGhGM2hlSG5vck9U?=
 =?utf-8?B?UkluaXQ3RnZBQjRYS0tsOGNIb2p1NkZoR2c0N2pHR0RZMG9xWmxoNTdiSGVT?=
 =?utf-8?B?WGJseWZKZzFBemtoTUhrYzdhTXJ2NnY3MVZpU2k2Sm1WaHBVdmdtTkcraFgr?=
 =?utf-8?B?enc4K0NnckY1Y29uMkxDeno4SVRpS1oyY0ptZ2xJaWYzeWlBS2E5cjlVcFJI?=
 =?utf-8?B?VVduVXJKaWtTVFk2YVMyVjBjNTE4QmZGbWpUcUd5cTUzVTlhQkFteTd1SGFB?=
 =?utf-8?B?RWg3VHlKa0tndmR6Y3NEaHNGR3IrVWIzbk1Xcm84cnpXUThheE5IMWRmdC9s?=
 =?utf-8?B?cEFKZ3Z2bmNKQzVUMHQ1bEhCK3dnQnFJNm1CVzBBWDhPVTFGajVKN1h0MXZm?=
 =?utf-8?B?aWhzazBVUVdyc3lJd2NRUklWTVhhMXl1NU9QRHRhVWRsUzdBOEVXSnFWaEE3?=
 =?utf-8?B?cFJaa3g3ckRzRk80RkZpVSsvTXZrTFFrL0l1ZlZLeVlsbnVjTDJZQWVCWGsv?=
 =?utf-8?B?NzBhZE45eVdjMmRSR1FDVE1HYjFWS1BvaVAyMnFJeFgwWFo1bGJhQ1RnSWFO?=
 =?utf-8?B?MWg2VHJDV0xlZ01HWGxiaS95d0VkZm9NZ0RUYkNLOVBRV1dCLzZ0QWJhTzZw?=
 =?utf-8?B?SUFQLzJPZUFObFVJVEhDWTRDWXpHZVMyS3M4N1dXdDF3L2RjMWlHUFNuQnJD?=
 =?utf-8?B?R2NJNkNHNmtvemJjTENGY1NmQzBjeUdTUHE3b3VUT3FPSHQ1WWhGSEZNaUsw?=
 =?utf-8?B?MTdPQ0tYREZVRzRBU1BaU0JSN0pUMzlwNXhoTTRRNko3c1RYTVdBcjVOb0Zy?=
 =?utf-8?B?SGNyQjViN2VQMS9XQlk3dG53MElsZ01keHBxRVBWWDZjZTNaSmppcXU2T3Bn?=
 =?utf-8?B?N0NneEJGaGtDdDBFWTFiekxHU0o3T0ZTWDdKTE1OckFSaGkrWEIwUGg0ck04?=
 =?utf-8?B?RXdPUUpPTHRtRUtuUzJ2bmhRWHZPMEZuRlloSDZaS2FsQlcwYkJ4UExHbGVo?=
 =?utf-8?B?dlNjcFpTRUxubHZIVlRtdkx2YWVza0VIcCt5RE8wZ3F4YkhWZ29LL1pQTE5q?=
 =?utf-8?B?cHBLcGkrbGFmeXhjZmxocnRYSEtZLzY5UHp5MkJLQVVGeUdjMnVjWEZlYVZY?=
 =?utf-8?B?MGxjWG5ZL0hleEZMQmNFcDV1VllRR3FXUnlFcFN2TWl6TlhRd2tLWGZjNWEx?=
 =?utf-8?B?K3lKUEJGWkhaMk1IQnZEVENwSVVscTBONXN2c2ZOQ2JUN09JMlB3d0NvUmtx?=
 =?utf-8?B?MEE9PQ==?=
X-MS-Exchange-CrossTenant-Network-Message-Id: 18cd6839-87fd-4c55-a8b4-08dbdbcd259e
X-MS-Exchange-CrossTenant-AuthSource: SJ2PR11MB7573.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 02 Nov 2023 17:57:15.0466
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: woPlHkUo65fc40/LIAXrdAMlJnjs7itA81Ohlq7SCBcY4hjlLuCMubeN3GTDcpvMA8+JCOUaClkBfRqmPov2DN453rUeuLs+aSMz2fu0WZs=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SA1PR11MB6943
X-OriginatorOrg: intel.com
X-Spam-Status: No, score=-1.3 required=5.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED,
	DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,
	MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE,
	URIBL_BLOCKED autolearn=unavailable autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on groat.vger.email
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org
X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (groat.vger.email [0.0.0.0]); Thu, 02 Nov 2023 10:58:03 -0700 (PDT)

Hi Ilpo,

On 10/24/2023 2:26 AM, Ilpo Järvinen wrote:
> CAT selftests only cover L3 but some newer CPUs come also with L2 CAT
> support.

No need to use "new" language. L2 CAT has been available for a long time
... since Apollo Lake. Which systems actually support it is a different
topic. This is an architectural feature that has been available for a
long time. Whether a system supports it will be detected and the test
run based on that. 

> 
> Add L2 CAT selftest. As measuring L2 misses is not easily available
> with perf, use L3 accesses as a proxy for L2 CAT working or not.

I understand the exact measurement is not available but I do notice some
L2 related symbolic counters when I run "perf list". l2_rqsts.all_demand_miss
looks promising.

L3 cannot be relied on for those systems, like Apollo lake, that do
not have an L3.

> 
> Signed-off-by: Ilpo Järvinen <ilpo.jarvinen@linux.intel.com>
> ---
>  tools/testing/selftests/resctrl/cat_test.c    | 68 +++++++++++++++++--
>  tools/testing/selftests/resctrl/resctrl.h     |  1 +
>  .../testing/selftests/resctrl/resctrl_tests.c |  1 +
>  3 files changed, 63 insertions(+), 7 deletions(-)
> 
> diff --git a/tools/testing/selftests/resctrl/cat_test.c b/tools/testing/selftests/resctrl/cat_test.c
> index 48a96acd9e31..a9c72022bb5a 100644
> --- a/tools/testing/selftests/resctrl/cat_test.c
> +++ b/tools/testing/selftests/resctrl/cat_test.c
> @@ -131,8 +131,47 @@ void cat_test_cleanup(void)
>  	remove(RESULT_FILE_NAME);
>  }
>  
> +/*
> + * L2 CAT test measures L2 misses indirectly using L3 accesses as a proxy
> + * because perf cannot directly provide the number of L2 misses (there are
> + * only platform specific ways to get the number of L2 misses).
> + *
> + * This function sets up L3 CAT to reduce noise from other processes during
> + * L2 CAT test.

This motivation is not clear to me. Does the same isolation used during L3 CAT
testing not work? I expected it to follow the same idea with the L2 cache split
in two, the test using one part and the rest of the system using the other.
Is that not enough isolation?

Reinette