Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Message-ID: <53238b86-5df4-a9cc-c60b-89085b7ab558@intel.com>
Date:   Thu, 8 Sep 2022 14:13:13 -0700
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101
 Firefox/102.0 Thunderbird/102.2.1
Subject: Re: [PATCH v6 12/21] x86/resctrl: Calculate bandwidth from the
 previous __mon_event_count() chunks
Content-Language: en-US
To:     James Morse <james.morse@arm.com>, haoxin <xhao@linux.alibaba.com>,
        <x86@kernel.org>, <linux-kernel@vger.kernel.org>
CC:     Fenghua Yu <fenghua.yu@intel.com>,
        Thomas Gleixner <tglx@linutronix.de>,
        Ingo Molnar <mingo@redhat.com>, Borislav Petkov <bp@alien8.de>,
        H Peter Anvin <hpa@zytor.com>,
        Babu Moger <Babu.Moger@amd.com>,
        <shameerali.kolothum.thodi@huawei.com>,
        D Scott Phillips OS <scott@os.amperecomputing.com>,
        <lcherian@marvell.com>, <bobo.shaobowang@huawei.com>,
        <tan.shaopeng@fujitsu.com>, Jamie Iles <quic_jiles@quicinc.com>,
        Cristian Marussi <cristian.marussi@arm.com>,
        <xingxin.hx@openanolis.org>, <baolin.wang@linux.alibaba.com>
References: <20220902154829.30399-1-james.morse@arm.com>
 <20220902154829.30399-13-james.morse@arm.com>
 <87aa9fd2-cae8-972d-81d4-8855cbd81569@linux.alibaba.com>
 <5b4da95f-28ac-a571-6c01-cf1a94d0753d@arm.com>
From:   Reinette Chatre <reinette.chatre@intel.com>
In-Reply-To: <5b4da95f-28ac-a571-6c01-cf1a94d0753d@arm.com>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 8bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?cWZtZkNyR1F2ZzlZR2gyS0lqY1NBZ0hQeDRBc2htTldUSFRDZWdHbkRMUUtj?=
 =?utf-8?B?cnlCdHFvckZaa2RSSHphTjl1US9hSnlyUk5jbGZhV0hlMzU0TGdITXFQaDF2?=
 =?utf-8?B?TTVvMmRmaWwrS2JGbFgyWTg2Tm94ZEthczZtd2dCR1VtRkp1QXBXMlZLWVkw?=
 =?utf-8?B?ZGErbCttenNtekxONXBhNCtQZmR1eW10Y05Ma0tab2RCK2JFWjNiOGFmcWJs?=
 =?utf-8?B?R0x1L3lnRW96NTNETGNvaFE3QzBBcTBzM2thM2J4ajVBVERzUzQ4ejNScEZj?=
 =?utf-8?B?TmtaQ2M3MXVOWXB1Y3Z6N0p3UGZ6d2VjaTNMbjVkcTB3cHZ5cjhLZ1hzMnBt?=
 =?utf-8?B?TWlXa1dtOVNRcklzbmFuTXcwZ3dxUjZaMHc3ZkhKaUhqRWJhd1E3QWJPRzRy?=
 =?utf-8?B?cTQ3eWFPcTBMQ09MMzl3SWowYVV5Nm9qODJaKzFvRFVwN01FaVFVQ0d4QjlW?=
 =?utf-8?B?c3M5UXA1Ymg1K0RpSmRsYytXWkdOUlRjMnkrNmxrR1FHRUpoYlQwUlAzWjBD?=
 =?utf-8?B?dmhRU2w2OFZMdGY4UmRjUFhtVXY3SW1YVy9mNkRyRUd0L1VSRDVXSmZ2cWMw?=
 =?utf-8?B?WVl4Z01ZbGVQUUg5elhXQVhhVGdacXNOZnpQOWl5U3N5Nk0vL2hIdjhlaCsz?=
 =?utf-8?B?ZWQyRVQwZGM2N2JPYk9JQ2V4SVlEMG5XaUdMMmgwRGRUbjJvRXBVeDJxN3h3?=
 =?utf-8?B?d1FtUzFtSTJtOXo5NS9jbk9BaEZZY0YxQlJFRkczVnB5MEhmcTMveWwxdjR1?=
 =?utf-8?B?Q0FnejZjUWh6bE50UWJ3NEVDTXpReUFwL2hGKzk4d0U5MmtKbFArTDNEemdI?=
 =?utf-8?B?aytWbWVTNVFXd0dyRjBoVEpiY2daODJlTGtXRG5hczJmVE04M0lpeGN3VXFt?=
 =?utf-8?B?b0V3ZEFIRi9nZWNOM0NQWFRPVkt4aFpaTnhMa0FIZWhMd1JiazRoZHd0dXlJ?=
 =?utf-8?B?c0Jsa2JHK3JUcUp4UmtnZVNCVUk4bnhKcVk2dVE4bnNSY0YxbEFBbndsWGJq?=
 =?utf-8?B?S3lkdnRYNmMvRm1sSXdIV25iOU5CWFVvWHBXSHJrRCtjVjJ6bUhuSHJoVTRk?=
 =?utf-8?B?MWlqUzFDQ1p3VVRTc1BOV1dEWU1zOFRJNVBRbm0yUVJrMUpHdm5FL2RyTXg0?=
 =?utf-8?B?aU4yTUI4d3RzWXVBREZPSExLa3NXNzhoNUNpR29DNGV1U1FZdVIvRm1mUTBR?=
 =?utf-8?B?OU13ZU5nQ21oRkh6YkhSSG5vQllFbzhyeUdDczVxWW15UXFyUzcwQ2JrZDkz?=
 =?utf-8?B?M3FjSThSWGhveko2Yzc3R0FlTjNNaUZvVkt2NFZQYjREdHlhUDRXbitQdDJw?=
 =?utf-8?B?c0VhcjlIVnF4VlRKRWRQWGJSV2V6eEowcFZvbmRMYW0wNEFHZW9JbWphT2xq?=
 =?utf-8?B?QVZFbWVUOTU5RlVYNzRIRlJwcFR0MnBqOUZGWjNNYUxYckJkTDZQWlpoOGRp?=
 =?utf-8?B?eTZaN0wyUi9WS1BYTFI3SXNFV3VDUy9iSDFiWGI4QkEzejNlR3R6SktpRG54?=
 =?utf-8?B?S1B6WkJweWgxN2ZHbjJNbnNCVXo0Zkc0L1gySVViR1lXVVdsd0JVNHRtbnJB?=
 =?utf-8?B?dUZnV3dkN2J3dllzdm9VNkFvbzlyMnZlWUpwRG1FWkR1U01uY25EUkhTaGkr?=
 =?utf-8?B?YnRIQjFRUUFCZXZUY0g5SnI4dFdCbGxIT1BWZ3RUaVR3dWc1bVMwZWcxOS9H?=
 =?utf-8?B?dXFUZWZSVzN1MmdBc2FidFNKTnVTVnpPSHZmbnhnOGhYelNWdGU4ZTJLSmdC?=
 =?utf-8?B?c01jSWtUTlJuTVdUa1lCaUxlZTMwczVkT1lzeGtlbCtJcmNLaGRxNFhoU0ZO?=
 =?utf-8?B?eFFsOEpPN0RuaGVHbkwvckxrMlc1elU2a3l3STN5dnFZTjNySmM3Wm9Udll5?=
 =?utf-8?B?bXduYkJXdGY0N3hvQXB4RXNCVHcyMG9lTU4yS21WUkVwYU5WUFhJbWtHNVMv?=
 =?utf-8?B?SUtoWllYS0ZtcTd3NTNjOXE1cWZublRQektIMmpUUTNTWXNXRlRXZXM0QUNU?=
 =?utf-8?B?L2F5SFZ3VVdUT0EzalllazJmNTRDeDVub095UzhkamdTL0RqbUlaOHZUVFNn?=
 =?utf-8?B?RzhRbFF6Y1dGd212RlFlTlRoZEN4dmRvY2ZXL01wRVZWTUM4b1NDc3N5Q1VS?=
 =?utf-8?B?RGI5c1EvQ3M0dGI3RGdYU3QrK05HaSszSWF6YmJhMFlZVGxtTEpsNkxPM0FZ?=
 =?utf-8?B?cGc9PQ==?=
X-MS-Exchange-CrossTenant-Network-Message-Id: 6e4febbd-cd48-45a9-5177-08da91def2e3
X-MS-Exchange-CrossTenant-AuthSource: CY4PR11MB1862.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 08 Sep 2022 21:13:17.1816
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: 8ZePbHA3ags0yyq4hqk1lVF8W4gfl7guEmAgK7R3jbP37LrI8JrPytAfIC1mFSDCxEcrWOL2hCYGydOGJJ1a88ve71/FIreLjTUTAzaXK6o=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN7PR11MB6946
X-OriginatorOrg: intel.com
X-Spam-Status: No, score=-5.3 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH,
        DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,NICE_REPLY_A,
        SPF_HELO_NONE,SPF_NONE,T_SCC_BODY_TEXT_LINE autolearn=ham
        autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org


On 9/8/2022 10:00 AM, James Morse wrote:
> Hi Hao Xin,
> 
> On 07/09/2022 07:47, haoxin wrote:
>> 在 2022/9/2 下午11:48, James Morse 写道:
>>> mbm_bw_count() is only called by the mbm_handle_overflow() worker once a
>>> second. It reads the hardware register, calculates the bandwidth and
>>> updates m->prev_bw_msr which is used to hold the previous hardware register
>>> value.
>>>
>>> Operating directly on hardware register values makes it difficult to make
>>> this code architecture independent, so that it can be moved to /fs/,
>>> making the mba_sc feature something resctrl supports with no additional
>>> support from the architecture.
>>> Prior to calling mbm_bw_count(), mbm_update() reads from the same hardware
>>> register using __mon_event_count().
>>>
>>> Change mbm_bw_count() to use the current chunks value most recently saved
>>> by __mon_event_count(). This removes an extra call to __rmid_read().
>>> Instead of using m->prev_msr to calculate the number of chunks seen,
>>> use the rr->val that was updated by __mon_event_count(). This removes an
>>> extra call to mbm_overflow_count() and get_corrected_mbm_count().
>>> Calculating bandwidth like this means mbm_bw_count() no longer operates
>>> on hardware register values directly.
> 
>>> diff --git a/arch/x86/kernel/cpu/resctrl/monitor.c b/arch/x86/kernel/cpu/resctrl/monitor.c
>>> index 3e69386cfe00..2d81b6cd9632 100644
>>> --- a/arch/x86/kernel/cpu/resctrl/monitor.c
>>> +++ b/arch/x86/kernel/cpu/resctrl/monitor.c
> 
>>> @@ -516,10 +521,12 @@ static void mbm_update(struct rdt_resource *r, struct rdt_domain
>>> *d, int rmid)
>>>        */
>>>       if (is_mbm_total_enabled()) {
>>>           rr.evtid = QOS_L3_MBM_TOTAL_EVENT_ID;>> +        rr.val = 0;
> 
>> In mbm_update,  there no use the rr.val, so there no need to initialize ？

This patch introduces using rr.val into mbm_bw_count() that is called
from mbm_update(). This patch thus introduces the requirement that rr.val needs
to be initialized. 

> 
>>>           __mon_event_count(rmid, &rr);
>>>       }
>>>       if (is_mbm_local_enabled()) {
>>>           rr.evtid = QOS_L3_MBM_LOCAL_EVENT_ID;
>>> +        rr.val = 0;
> 
>> ditto.
> 
>>>           __mon_event_count(rmid, &rr);
>>>             /*
> 
> No, but this just leaves that problem for someone else to discover the hard way! I think
> its fair for the compiler to complain that addition on an uninitialised field is a bug.
> 
> I'd prefer to keep this as it is on the principle of 'least surprise'.

Yes, please do keep this. If rr.val is not initialized then the software controller will
use wrong data to compute the delta bandwidth.

Reinette