Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.36 as permitted sender) client-ip=23.128.96.36;
Message-ID: <94a38b28-5af9-4280-1323-7c43d934ee37@intel.com>
Date:   Tue, 3 Oct 2023 14:44:18 -0700
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101
 Firefox/102.0 Thunderbird/102.15.1
Subject: Re: [PATCH v8 0/8] Add support for Sub-NUMA cluster (SNC) systems
Content-Language: en-US
To:     Tony Luck <tony.luck@intel.com>, Fenghua Yu <fenghua.yu@intel.com>,
        "Peter Newman" <peternewman@google.com>,
        Jonathan Corbet <corbet@lwn.net>,
        Shuah Khan <skhan@linuxfoundation.org>, <x86@kernel.org>
CC:     Shaopeng Tan <tan.shaopeng@fujitsu.com>,
        James Morse <james.morse@arm.com>,
        Jamie Iles <quic_jiles@quicinc.com>,
        Babu Moger <babu.moger@amd.com>,
        Randy Dunlap <rdunlap@infradead.org>,
        <linux-kernel@vger.kernel.org>, <linux-doc@vger.kernel.org>,
        <patches@lists.linux.dev>
References: <20230928191350.205703-1-tony.luck@intel.com>
 <20231003213043.13565-1-tony.luck@intel.com>
From:   Reinette Chatre <reinette.chatre@intel.com>
In-Reply-To: <20231003213043.13565-1-tony.luck@intel.com>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 7bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?TzI2dE5aQWIzK010ZUJzUC9FRzdydWNHai9YK0UyeFkvUk0zejhaZlQyenhR?=
 =?utf-8?B?NzRQVndrZ0tWZXovd0J0Ni9lYkd5dGZRdXRoUjlwM09PTncveFhtWkhOUStm?=
 =?utf-8?B?R1F5YVlCZ0tPL05jQVJiLzBPS1VIa3QwNjRkbXNyWHNzMGVpa2hRclZHRnc2?=
 =?utf-8?B?SFBkZkI2bE55S2Z1RFVkcXBGeFdNckJJdmFpNFB0Y2tXNUhIc3Q3TWJrd2Rv?=
 =?utf-8?B?UFJ0ZjRDb3IvZitSNzM4bmdEQ2NWRitxMjlHMnVEdFNjSHJLYjZqZk9VYlZJ?=
 =?utf-8?B?OFhiMFpON2RvRXFVV0xrd1ZiZXNYNlV4N0ZIZGFTTFFMVUZCWlU0M2djcFhV?=
 =?utf-8?B?WlBuMW1PRll5a0Ryc1kyMDRHM2wvM3VpNVpxN2JVVG1OeGlHbXpHQ3RvK1pX?=
 =?utf-8?B?NGYxTnU0dXhaT05hVGcxaHZFckhlOGZ3OXdHSURsSlZyQjNHM3pIcytoSmJB?=
 =?utf-8?B?eW1aR256OVhRWk1YYmhYS2V5aklOUDFXZWlRaG1CWlhUd0h2T2hKS25FTDdr?=
 =?utf-8?B?Qk1nVnE2QmtuTG5ZRDlNckdzL1VWTFlKL01QcEhzblUxSGRlUHloUU5vQ00v?=
 =?utf-8?B?RFkvb0RnSm1IcmFFaGZoUE9NOG5yMEZod2hWODV0NWptN1RGN2x2V2RvdXRC?=
 =?utf-8?B?Zmc2dE1NZ28vU1RkbVg0QXJCZmFxNjk0OHB3RTB5TkFwY0VvSXFOT0RUL09H?=
 =?utf-8?B?WFZYSVpqcWNBZWVzc0hETEwyY1Qza2Y4LzYxQThTWFl2N0VnYkp3N1gxVU1V?=
 =?utf-8?B?a3BTVjRDQ2YzRlpiRTREVTZWZTZIQlNhdFduT1hRTitTbUZuV2dpc05aZ1U1?=
 =?utf-8?B?WCtVdzBKbEMzb3RtNG5jNzlBWTRhN3hZSTBZQ2VsQXpqZCtXRmIzZEsvS1o2?=
 =?utf-8?B?cTZTNnlSVU1yR0VleUF2MTEzVy9mTEoycFFuN3huaUV2TEZBTkx5Y3lKV1Nq?=
 =?utf-8?B?aGx4Sy93T1h3MWVVK1F3SnlyNndrUkVpdUlFWVQ5RGh1REJpUjcyenJ6bk9m?=
 =?utf-8?B?dWgwYjZEOGYzQWR5ak5TZ0pZdUkvMXpJYnMrNThQNWgrL3lidE1ZeFJKN2ox?=
 =?utf-8?B?WnhEZVB2TVc5N1F4bUdMSkJMbnpEMXk1Um9pUkdBeEplYkpMWGh2Q010OEhv?=
 =?utf-8?B?VFVBRmZJRHFsWVBncnJUVUgxWTE3TWc1eTA4aW9sWlowcEdsTUgvNEN0WXIx?=
 =?utf-8?B?dGFWVmJpMGhPVXZ4bVI1Rm03TFV6WlZKdEVLZG9nck5wMk5GUXRwendZbm9B?=
 =?utf-8?B?S3ZnMVZGcEIvRVhYenk4Z2UrMGdWQ1ZidXp2TjFHSFEvSlBteHdSRU1pR2xy?=
 =?utf-8?B?WGV5UmJKRktCbVMrNk9HZ05hdS9RbFRLZmtlcTJQZDJPRFZMOHdpRWN0eEh1?=
 =?utf-8?B?cEFGS3Y0c0hWQ1FWOVNPWFVVV2dTNTk2UGovUDVHT1ZnOHl1d1oxWllKcGpW?=
 =?utf-8?B?bWMyTGNUZEpIbmUyZWk4bmJjYnVpNWdocGlJelNqTnlqZERoV2tEeGtWazE3?=
 =?utf-8?B?bnhlb0Q1ZkZBY3RwSDhHNFVsa0ZqamQ4ditiYjBVcCtWS2xaUFc1QWVwNUtw?=
 =?utf-8?B?MWZySUxJdjNOMTgzN1hnOVBtYkE1U2ZzZjVMdzlhaVpoQUxYUVM4bWhwWk9J?=
 =?utf-8?B?dmsxV0ZuMit3V3lhSGRNMkgrNW42MVREWXBBVkJ6OFg3aWJmSXhGT1BSQ3ox?=
 =?utf-8?B?cDNEVjRuanlKMGNsUmh2ZjUzdU8wenNnV2VhY004aTRkdllWNFJ5bVNtQkJz?=
 =?utf-8?B?SFdyTFNEdEdaQVV3U0hRSWJLdldMR3NEb21MMDBjaGpESG9GeGo1U0puRVI5?=
 =?utf-8?B?enJsL1ludnJlbTZxcDlDMXFGOTFJaE5ncUR3bjRsM0M5Uy92NnVMOWp3azhP?=
 =?utf-8?B?SmYwSDBMMk40VHlkZEM0RmZoNmtIRkRLa2Q4M3pORytKSlIwWGZPZExRa1BE?=
 =?utf-8?B?MFp1S3lGeWc5Y1Nod1NVaHoyYVpMVGUzRHNEdTBqamtTVlZLYUVwdjFXQWFG?=
 =?utf-8?B?d2lvMDg0YWE2ZjMrdStqR3lrVEJsRjRnR2FjMEdWT0dwZXFTbG5lcUl0WUV6?=
 =?utf-8?B?RGFGcHFTYzN4MGxzU0wraXJVb0RIY21wZWpyVCtRSzZTSjFOdVcvUmpmTmx0?=
 =?utf-8?B?enJXZUhxM0pMWElyT0R3bDBneVZ0ZWV4ODNSTXZvRTB5MTM3Ujg1cnZZd3g0?=
 =?utf-8?B?eGc9PQ==?=
X-MS-Exchange-CrossTenant-Network-Message-Id: 6ec955ae-a3df-4d31-952e-08dbc459e73d
X-MS-Exchange-CrossTenant-AuthSource: SJ2PR11MB7573.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 03 Oct 2023 21:44:21.4798
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: L2BN4cv/4dhc8UbK555IgBb27NbfkagfU62C6se4iE5zEE1r6I3NCMk1EQOiW/v6EP4P5jF4/W21hPbd80iArmCaW5qcK2KVJRU17kqamqc=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CO1PR11MB4963
X-OriginatorOrg: intel.com
X-Spam-Status: No, score=-1.9 required=5.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED,
	DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,
	MAILING_LIST_MULTI,NICE_REPLY_A,SPF_HELO_NONE,SPF_PASS
	autolearn=unavailable autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on pete.vger.email
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org
X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (pete.vger.email [0.0.0.0]); Tue, 03 Oct 2023 14:45:15 -0700 (PDT)

Tony,

On 10/3/2023 2:30 PM, Tony Luck wrote:
> The Sub-NUMA cluster feature on some Intel processors partitions
> the CPUs that share an L3 cache into two or more sets. This plays
> havoc with the Resource Director Technology (RDT) monitoring features.
> Prior to this patch Intel has advised that SNC and RDT are incompatible.
> 
> Some of these CPU support an MSR that can partition the RMID
> counters in the same way. This allows for monitoring features
> to be used (with the caveat that memory accesses between different
> SNC NUMA nodes may still not be counted accurately.

Almost. For reference:
https://lore.kernel.org/lkml/e350514e-76ed-14ea-3e74-c0852658182f@intel.com/

No need to send a new series just for this, but this series does find
itself at the back of my queue.

> Note that this patch series improves resctrl reporting considerably
> on systems with SNC enabled, but there will still be some anomalies
> for processes accessing memory from other sub-NUMA nodes.
> 
> Signed-off-by: Tony Luck <tony.luck@intel.com>

Reinette