Received-SPF: pass (google.com: domain of linux-kernel+bounces-111878-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) client-ip=147.75.80.249;
Message-ID: <0910f9ed-2312-46b7-9c64-2982709da3d8@intel.com>
Date: Fri, 22 Mar 2024 10:44:18 -0700
User-Agent: Mozilla Thunderbird
Subject: Re: [PATCH v2 02/13] selftests/resctrl: Calculate resctrl FS derived
 mem bw over sleep(1) only
Content-Language: en-US
To: =?UTF-8?Q?Ilpo_J=C3=A4rvinen?= <ilpo.jarvinen@linux.intel.com>
CC: <linux-kselftest@vger.kernel.org>, Shuah Khan <shuah@kernel.org>, "Babu
 Moger" <babu.moger@amd.com>, =?UTF-8?Q?Maciej_Wiecz=C3=B3r-Retman?=
	<maciej.wieczor-retman@intel.com>, Fenghua Yu <fenghua.yu@intel.com>, LKML
	<linux-kernel@vger.kernel.org>
References: <20240311135230.7007-1-ilpo.jarvinen@linux.intel.com>
 <20240311135230.7007-3-ilpo.jarvinen@linux.intel.com>
 <fe5c0d10-a57c-4a3a-ae30-a7cfa93bc3e8@intel.com>
 <f214c635-500f-43ea-fce8-0a7083bc1606@linux.intel.com>
From: Reinette Chatre <reinette.chatre@intel.com>
In-Reply-To: <f214c635-500f-43ea-fce8-0a7083bc1606@linux.intel.com>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 8bit
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?aHdBdnBTWm9YeFh4M1FIalhReXBHT0xkYWNBYUZ4dUZoUnFocEF3bWxvNDVq?=
 =?utf-8?B?eW5HN0FhVjVxam5IYzR6R0xwZTNPQXF1YTlnQnRvN3E5T0kvZVFhT2lXM2xC?=
 =?utf-8?B?djdSbEpiUXlicE5KMVh1emlWeHVJYldqQmZXWngvci8rcE9YZkJLVi8zT3Fp?=
 =?utf-8?B?TUZaVHJkQ2h0eWRXWFVLZXh6SENUcWlQSTdaVWhwOWxnMm1KZDdpRVlMV3VP?=
 =?utf-8?B?NC9NYmZNY1BpSzVOSTNQR3NrTkgyRXk4YzNjb0VydVNTLy9ibnVYNmhibEFy?=
 =?utf-8?B?RklDVXpiYTdXM2xMV2t2V25PQ1lEdkdmU1FaSjkvQmIrTVFzZFNhdlhabGQr?=
 =?utf-8?B?REdNRGc3a2hZbVdtdDRPSjdEdUpoa0FtaFI0L1RuYVplRERvQUxaekZPUnl2?=
 =?utf-8?B?UG5zUWlqSlpGUmJZVkdrcmNlaDBLZkFwMnFIY0p5eHhUSElnV3AzQkZDWThW?=
 =?utf-8?B?ZUJTbjg5ZUpkUjNNRW5NVjM4cjZyamNaeXYzNFUyZU1PMWh3VStLblVKb2lo?=
 =?utf-8?B?d0JGUWNGZnVhMlM4aVd2UGZQYUN5aUhZWnZ1SUtJWXRjellia202blVXRDFO?=
 =?utf-8?B?WTVHcUhZR29wbmUvSkpvUmpoTTl2RWcyOHFycFJwczZ6ZU1TaFFvSmgrMlRn?=
 =?utf-8?B?MmErL01mSjZsTTlHNEg2SU5jWU1mL29vdlRhbFI1SlJsa1VMUUJoNldYbFha?=
 =?utf-8?B?N2Y5Tk1HVlRKUi9Nd0puamczbFJzQ2tUZjQ4TUtvbm1PNHNzeUZ0eWkrUWJi?=
 =?utf-8?B?VlhIdUxxM0NERFB6K0tZUldIQUIxQVpobVR5aEN1R294eWQ2OGduNS8raHht?=
 =?utf-8?B?OHF0cFdBb3NPcnB2OUVicmJnT1BRdm9NVUk0YnZPUjNheE1LN2ZhMHJjQUFy?=
 =?utf-8?B?YU13Y1VBd2M4Qk5WOVNxTExqeTRXbkxIMGxxaGtLRnRvSnQ0TElRekNScGJH?=
 =?utf-8?B?NEJRQW1zL0FsMWRsOXkvWE13cllXT3hDMzhRZytRM1VZSjRWYzRaRG5EcWwx?=
 =?utf-8?B?cDFNZndGNDk0Tkh0Z25SWDNoTjJCa2phYjVGejArekFpbUljSnNEYWhOL3VO?=
 =?utf-8?B?SFB6NWpQM1FJVWpvTmN2cDFnLzMvL2w4alJ6c3pVa1FPOTQ5RlZmdEZJbkNt?=
 =?utf-8?B?Ukt1WnB2ckx4Q0Fqakt2UUlHZ29tc21KcTVycU9jRzNqcGVmNGVJdWlUTUNi?=
 =?utf-8?B?U3pCbG9YbTNWaWJGbHRBQmpwNUpuMXBmS2JhM3FPTVRES1d6UENkYk4wSVJU?=
 =?utf-8?B?TjBnRElTVUZBa3NQeG5helQ2Vmphd2l3QXN6V0JHUUR2b3hwaVduZUlkWUJX?=
 =?utf-8?B?a1hodzVKOVRRZVZKeERNUENsWVlBeVJZWFNWUFd1bjJnaTlPSFo5cWJrWkRk?=
 =?utf-8?B?ZVVIWGsrZ3poVVpNNTJMb3Yyc2EyQS9pMGM4SXp6MFJpQy8xaTZJOEJOSzZs?=
 =?utf-8?B?eGQwSTQvZzZpR2hta1g2TVBFWHhUSy94L0ZLRUhtUTBMUSsvTi9mUTRUZi9y?=
 =?utf-8?B?Um9Wbll5VkdoUTlJWnhYRGZrcHlYYklXMGpibUxzRkpKdGoyMjdDSWppOGUx?=
 =?utf-8?B?dTFpZGtDS2JWc3FEa1F0ang4RnhUYlk3blFCYWd0K2pJaXhXZUF1R0FyV092?=
 =?utf-8?B?d3d2aktTSkMxZHFwMTRNdTBVTmZEYlVuNkNoaG5QOUlsaXQvNW5Ecm52ME1Z?=
 =?utf-8?B?VFY3aE80WDhGaVF2Z1drd2w0WkNmT2VOTnlFakx3em02MW93b0YxeUN3bXNJ?=
 =?utf-8?B?dGtXT1pOZ1AvbXNrR0Y4bTlsWG0zemR3OGdFYU94T0tjTS9obVRhRUdiUmNq?=
 =?utf-8?B?UmhsNytnajhHZTRlSzcvMXhCcTdtTVBzaktIY0ZFRUlibk90QzBWd1NjLzc5?=
 =?utf-8?B?TlJCck56Uy9nb1Q1ZWlXWVJOck1FWjBrbEZNRUk5VnJQMnVRRWZJdTN3K0Ru?=
 =?utf-8?B?TWVWT1dPeVBxMVVnR0pJdGw2bk4xUkdPU3g5UmpEdXBpTXJJM0pab0lxaHZn?=
 =?utf-8?B?VllVcWI3MmR3eVo4MTJDU25vOUhldTBKd2RjVnkvY2dJYk91amhJMEJNL1or?=
 =?utf-8?B?WXQvRDQrc09FRnh0TTY1N3V6Rm82SVdlOGNiT3gzbnJ1YVZFSmtwc09VTTk0?=
 =?utf-8?B?dWQ2TlNkUURmR1lhSVRScU41aVFnc0NXQnZJUGRQWXRxc20zamE3T29YRWZW?=
 =?utf-8?B?RXc9PQ==?=
X-MS-Exchange-CrossTenant-Network-Message-Id: cc5a2a66-7e72-4895-4be3-08dc4a97b408
X-MS-Exchange-CrossTenant-AuthSource: SJ2PR11MB7573.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 22 Mar 2024 17:44:20.2220
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: +9zFuc58IwELfA7LZAr18/wbIfh0tYLpQjQ/J8GPypXtRXSxxtqDuCvDaE7hompuvrJA/kalBglp0xLv8v+Dh6lw6UUgje3/YeRLITbZnbA=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH8PR11MB6950
X-OriginatorOrg: intel.com

Hi Ilpo,

On 3/22/2024 5:11 AM, Ilpo Järvinen wrote:
> On Tue, 19 Mar 2024, Reinette Chatre wrote:
>> On 3/11/2024 6:52 AM, Ilpo Järvinen wrote:


>>> -static int get_mem_bw_imc(int cpu_no, char *bw_report, float *bw_imc)
>>> +static int perf_open_imc_mem_bw(int cpu_no)
>>>  {
>>> -	float reads, writes, of_mul_read, of_mul_write;
>>>  	int imc, j, ret;
>>>  
>>> -	/* Start all iMC counters to log values (both read and write) */
>>> -	reads = 0, writes = 0, of_mul_read = 1, of_mul_write = 1;
>>>  	for (imc = 0; imc < imcs; imc++) {
>>>  		for (j = 0; j < 2; j++) {
>>>  			ret = open_perf_event(imc, cpu_no, j);
>>>  			if (ret)
>>>  				return -1;
>>>  		}
>>
>> I'm feeling more strongly that this inner loop makes the code harder to
>> understand and unwinding it would make it easier to understand.
> 
> Okay, I'll unwind them in the first patch.

Thank you very much.

> 
>>>  	}
>>> +}
>>> +
>>> +/*
>>> + * get_mem_bw_imc - Memory band width as reported by iMC counters
>>> + * @bw_report:		Bandwidth report type (reads, writes)
>>> + *
>>> + * Memory B/W utilized by a process on a socket can be calculated using
>>> + * iMC counters. Perf events are used to read these counters.
>>
>> In the above there are three variations of the same: "band width", "Bandwidth",
>> and "B/W". Please just use one and use it consistently.
> 
> Okay but I'll do that in a separate patch because these are just the 
> "removed" lines above, the diff is more messy than the actual change 
> here as is often the case with this kind of split function refactoring 
> because the diff algorithm fails to pair the lines optimally from 
> human-readed PoV.

I have not used these much myself bit I've heard folks having success
getting more readable diffs when using the --patience or --histogram
algorithms.

> 
>>> + * Return: = 0 on success. < 0 on failure.
>>> + */
>>> +static int get_mem_bw_imc(char *bw_report, float *bw_imc)
>>> +{
>>> +	float reads, writes, of_mul_read, of_mul_write;
>>> +	int imc, j;
>>> +
>>> +	/* Start all iMC counters to log values (both read and write) */
>>> +	reads = 0, writes = 0, of_mul_read = 1, of_mul_write = 1;
>>>  
>>>  	/*
>>>  	 * Get results which are stored in struct type imc_counter_config
> 
>>> @@ -696,7 +725,6 @@ int resctrl_val(const struct resctrl_test *test,
>>>  		struct resctrl_val_param *param)
>>>  {
>>>  	char *resctrl_val = param->resctrl_val;
>>> -	unsigned long bw_resc_start = 0;
>>
>> In the current implementation the first iteration's starting measurement
>> is, as seen above, 0 ... which makes the first measurement unreliable
>> and dropped for both the MBA and MBM tests. In this enhancement, the
>> first measurement is no longer skewed so much so I wonder if this enhancement
>> can be expanded to the analysis phase where first measurement no longer
>> needs to be dropped?
> 
> In ideal world, yes, but I'll have to check the raw numbers. My general 
> feel is that the numbers tend to converge slowly with more iterations 
> being run so the first iteration might still be "off" by quite much (this 
> is definitely the case with CAT tests iterations but I'm not entirely sure 
> any more how it is with other selftests).
> 

From what I can tell the CAT test is not dropping any results. It looks
to me that any "settling" is and should be handled in the test before
the data collection starts.

Reinette