Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Message-ID: <ba080508-5f55-a56e-db78-299d8523a88a@intel.com>
Date:   Fri, 14 Jul 2023 10:38:00 -0700
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101
 Firefox/102.0 Thunderbird/102.13.0
Subject: Re: [PATCH v4 10/19] selftests/resctrl: Express span internally in
 bytes
Content-Language: en-US
To:     "Wieczor-Retman, Maciej" <maciej.wieczor-retman@intel.com>,
        =?UTF-8?Q?Ilpo_J=c3=a4rvinen?= <ilpo.jarvinen@linux.intel.com>,
        <linux-kselftest@vger.kernel.org>, Shuah Khan <shuah@kernel.org>,
        "Shaopeng Tan" <tan.shaopeng@jp.fujitsu.com>,
        Fenghua Yu <fenghua.yu@intel.com>,
        <linux-kernel@vger.kernel.org>
References: <20230713131932.133258-1-ilpo.jarvinen@linux.intel.com>
 <20230713131932.133258-11-ilpo.jarvinen@linux.intel.com>
 <1dd10447-b03d-937a-fe55-ff324864c358@intel.com>
 <0c94daef-3642-9e8e-0e8a-3f8eaa2953e3@intel.com>
From:   Reinette Chatre <reinette.chatre@intel.com>
In-Reply-To: <0c94daef-3642-9e8e-0e8a-3f8eaa2953e3@intel.com>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 8bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?OERaWmpWTTZOQ2MxUXBEUHBJVENrRHdjdDBnenZRNXFQUkNTMHNaVyt5RUVo?=
 =?utf-8?B?Ti9HbFJDdTFpNkZqMzlqaldLU2lBZnVMTVFFQVBpdVpEZ1lTTlRxZnNzYWJl?=
 =?utf-8?B?eGE0SEJnb2daMEE2eDBhMUtBQktYZll4YlNvdllTWjFoYytMKy9oS0k2MS81?=
 =?utf-8?B?T2JpeExLYnpnNXBZbGx3eUxyY0xPZWZTUDVTdlg0TG9PbnpiU2hzV0UwNWxO?=
 =?utf-8?B?N090SWY1SXM3ay8rc1BrS0M4bE9yQlpWeWphak93MFNjMUFjTVRzcVhwbmI2?=
 =?utf-8?B?MmZzZ1kwVXBxemlDdEs2eE0zekFNcmVUOXRTWGJlWmJrZG03L3V3YlFHSkpR?=
 =?utf-8?B?QjhOWHM0Z3MwK0hCM0loNEVWaXRUYi9jWjBHSnlnSFh0aXVWZTRsUkdwelF6?=
 =?utf-8?B?NUsyZ2NoTmcvdWF4RjQ2bkR3aHNGNSt5WkhDc2VtRCtocWFaWCtBNlh4Wmp4?=
 =?utf-8?B?SnRKSUh1YkhYTUlKVVBTVCs1N0FCVmUyTDVPSTBEbnN3Wnd6RFZVQVZ6THVU?=
 =?utf-8?B?MkVrSG9VNVhncFNKVUhBaGc2RFNRK1VWWFFUTDg5M0g3RzhHcUpUS1NKbE9n?=
 =?utf-8?B?S1d0b2N4YW1pY0NvV1pIRHN5Y3U4RUJ0WVp1em1xQjBUT1Bra21hcUdYWTd1?=
 =?utf-8?B?eUxhcGFLUXk2ZnovWnZMMWZIL2k1c2tUS05CN2xEMk0ydzBaNExuYUUrVVNw?=
 =?utf-8?B?dmJ4dG9FdFFwYVBvcUc4UlRabVJqSVJYa24yQXRHdlNueU1wV1RHWDdibThC?=
 =?utf-8?B?S0dKUzM1bE1SYnlOTysrbVFDTjlqdXIvZGk5NG83SHZHWFBwd2pmV3VKZEgy?=
 =?utf-8?B?WU02YmRMUnNjRUxJbmZzYk5CZ2RwdTBMR2RQYk5pRG9oNTRvODZsNEFxQjUx?=
 =?utf-8?B?ZzVmU3I1a3o3UkVVT3JEUDYyK1VEU0xUUmV1WUhpaEFSRU85KzBkRGZPTE5n?=
 =?utf-8?B?UXdLcWZuVE0veTM4bVdmYXA0TTk1VzFGY09jdUc4THFXS0RrT3Z1UmFVUnZv?=
 =?utf-8?B?bWdQWUJhUkZQYzdRa2xsSFNGVkxVWnE2Unp2bW8ydTFoOTlOeUltT3JZNHhp?=
 =?utf-8?B?dDVxb09iWVJSWjUvVE9GMmJqV1FKUVUxYW1VbGkxQkFvZk4wTWNlTjBOcWhY?=
 =?utf-8?B?WVVEUVZTVmc3VXhobkdhaEQ3ZGFaUjU4bXZwNUhZY0NRR1VTb0k3dUhUMlFj?=
 =?utf-8?B?bE1SOUNqOXdBTDNseUxKMTZwMDU1NnlxQWJjZk95bWdUdHk0dGJvQ1VldTdZ?=
 =?utf-8?B?N2ZpTWNQNlBhU3VJM3JCV0puYURCQ0RpMy9PWis0Q2puMWNvTHJwNXNVcDVu?=
 =?utf-8?B?aWRHSk1lcWNDaEVOUmZ6c0xvVHRmOUI1NHN4a0tFT2Z5eE1qV0ZtRlBleURY?=
 =?utf-8?B?OG0rS04yZUplcDg0cHFtbEhDdGRwR29rNFordzZ4Ty8vUkFWWWZTbTdkb3NC?=
 =?utf-8?B?L0p6YUtOWm9TcFhWSGxVLzFkSVdHQ05xZWNPM2hLcjR4c21yVExEa1V4MjVa?=
 =?utf-8?B?dTBHeCtNVkhFbEpkVG9Td0hUQmplTVByNDJZQkJVOTdwdDRCUnJHQnVNNDRr?=
 =?utf-8?B?QU50aXFLZVZ1YlFBUDJkZy92Y2RXSDBpY3BDNTh2dndaVU5vUlRwWWwvZ1Mw?=
 =?utf-8?B?M2VQaEpGVDUySFRMaTZzaEg5ZzQ4ZnZqendIS3BtaXhLQ3A4dW9GWFJxOW41?=
 =?utf-8?B?d2k5UXY0cVFLeitzU3Z3VFZ0VXppVFk3WHk1azEvcDJnUTBKVm9FSDJPQ0JT?=
 =?utf-8?B?ZjdDUkhya3JWMkxMUnFKd1lsUTEzbTM4MTFHSWlva0ZQdGV6bEJxYjU2Z2lF?=
 =?utf-8?B?Q0t1QzRBUng1ZEVVS2RWaVRGT1daM0ZuRTBoQkdLWWJxeVZtVDlvZ3pEcEFa?=
 =?utf-8?B?RG1vVHNFZ1ZmMGtKWDkrUG5ZUmpvc2ZraUtrNnd4SGh0ZGN3OE42bnBwaDYy?=
 =?utf-8?B?QXA2MFE2T3BVVWdwRUdnSFp6QWltMmUxNEZNUHFjLzI0d1dyOFZ4ZkJDb0ds?=
 =?utf-8?B?M2R3bHpvZ3gvVDd0N3RyWDlXLytXeUNSRDA5dVZiVkFSTHQ4ZUw2VnZhbkxs?=
 =?utf-8?B?aklMLzZMM014S2creCtreCt3TzRwUis2UGo5REw2QXhjTTBGaHorZENtRWph?=
 =?utf-8?B?VEZhRkNOdm5USVhlYk5JeUJZMnpUbjYxWVowSGd2QzcvRVdsa2dTbDhIMDF3?=
 =?utf-8?B?R1E9PQ==?=
X-MS-Exchange-CrossTenant-Network-Message-Id: 37068bc4-4f11-4a52-4059-08db84911302
X-MS-Exchange-CrossTenant-AuthSource: SJ2PR11MB7573.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 14 Jul 2023 17:38:02.9137
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: MU4BCKfm7Eh8rqoWkedl8YBbp9/KLu5Ckpgf2b301BrpktmfPyg50cxiz6sema8AuylsY4bQITvfUGcPX8EWl5jvfYsdSQYY8bZfokWqaP4=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM4PR11MB7398
X-OriginatorOrg: intel.com
X-Spam-Status: No, score=-4.5 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH,
        DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,NICE_REPLY_A,
        RCVD_IN_DNSWL_MED,SPF_HELO_NONE,SPF_NONE,T_SCC_BODY_TEXT_LINE,
        URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

Hi Maciej,

On 7/13/2023 11:43 PM, Wieczor-Retman, Maciej wrote:
> Hi Reinette!
> 
> On 14.07.2023 01:00, Reinette Chatre wrote:
>> Hi Ilpo,
>>
>> On 7/13/2023 6:19 AM, Ilpo Järvinen wrote:
>>> MBA and MBM tests to use megabytes to represent span. CMT test uses
>>> bytes. The difference requires run_benchmark() to size the buffer
>>> differently based on the test name, which in turn requires passing the
>>> test name into run_benchmark().
>>>
>>> Convert MBA and MBM tests to use internally bytes like CMT test to
>>> remove the internal inconsistency between the tests. Remove the test
>>> dependent buffer sizing from run_benchmark().
>>
>> If I understand correctly the intention is to always use bytes internally
>> and only convert to megabytes when displayed to user space. The above
>> implies that this takes care of the conversion but there still seems
>> to be places that that do not follow my understanding. For example,
>> resctrl_val.c:measure_vals() converts to megabytes before proceeding.
> 
> Doesn't the use case inside resctrl_val.c:measure_vals() satisfy
> the idea of only displaying data to the user space? From my
> understanding it reads the number of bytes and only converts to
> MB when printing the value. Or did I miss some detail there?

For MBM and MBA tests resctrl_val.c:measure_vals() converts data
to MB before it writes the raw data to the file. Compare to CMT
test that uses cache.c:measure_cache_vals() to write raw data
in bytes to file.

On a high level I see the MBA, MBM, and CMT tests in three stages:
(1) A "benchmark" is run in background, 
(2) raw data is collected at intervals and written to a file,
(3) finally, data from file is processed and results displayed to user.

From what I can tell MBA and MBM tests continue to write data to file
in MB while CMT writes data in bytes.

The changelog claims "Convert MBA and MBM tests to use internally
bytes like CMT test to remove the internal inconsistency between
the tests.". This claim is not clear to me because from what I can tell
the three tests continue to handle data inconsistently after this change.

Reinette