Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Date:   Thu, 20 Apr 2023 16:52:01 -0400
From:   Daniel Jordan <daniel.m.jordan@oracle.com>
To:     Peter Zijlstra <peterz@infradead.org>
Cc:     Aaron Lu <aaron.lu@intel.com>,
        Dietmar Eggemann <dietmar.eggemann@arm.com>,
        Ingo Molnar <mingo@redhat.com>,
        Juri Lelli <juri.lelli@redhat.com>,
        Vincent Guittot <vincent.guittot@linaro.org>,
        Steven Rostedt <rostedt@goodmis.org>,
        Ben Segall <bsegall@google.com>, Mel Gorman <mgorman@suse.de>,
        Daniel Bristot de Oliveira <bristot@redhat.com>,
        Valentin Schneider <vschneid@redhat.com>,
        Tim Chen <tim.c.chen@intel.com>,
        Nitin Tekchandani <nitin.tekchandani@intel.com>,
        Waiman Long <longman@redhat.com>,
        Yu Chen <yu.c.chen@intel.com>, linux-kernel@vger.kernel.org
Subject: Re: [RFC PATCH] sched/fair: Make tg->load_avg per node
Message-ID: <20230420205201.36fphk5g3aolryjh@parnassus.localdomain>
References: <20230327053955.GA570404@ziqianlu-desk2>
 <943d44f7-1fa9-8545-dc1d-890e4dd20854@arm.com>
 <20230328125624.GA6130@ziqianlu-desk2>
 <76939bf6-1d9d-5f8f-f15c-f03b2322d684@arm.com>
 <20230329135455.GA108864@ziqianlu-desk2>
 <20230330174557.m6jsgb6hsni4mxwq@parnassus.localdomain>
 <20230412120736.GD628377@hirez.programming.kicks-ass.net>
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <20230412120736.GD628377@hirez.programming.kicks-ass.net>
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?7CpX5GuKB3cBJYm+WzmSGLNCA2F9uQw1ZadN9LD0YZzQRRMrj3WdB1EJTplf?=
 =?us-ascii?Q?4O8xwUic1K7PqslmrZnGD1jqGFTuloKweILFVVLPaPJ4vmbHNZnzLDBX67qH?=
 =?us-ascii?Q?XT4R6NH63JH+mGnuReDz7D/1hHoPHl5l9RfF0eKCKFFrjhJCYCKSSXOhMfCj?=
 =?us-ascii?Q?y31O4HnGeGUtyJkz8S0/E/QJC8IlyZqFsupqTTXG6tsDNEg1JNAucLEjrrcC?=
 =?us-ascii?Q?WCugDfw6MD1dUReEn9UUSmByBBN/u3WYrHSbwY39vDV/nt9to9bC8uuV1NSi?=
 =?us-ascii?Q?6iL7hgNNDqXpPVY8Tz2jk2UWNpTnTwBP8pWegFMDOH8X8Gw9+LLtZlRCeUrZ?=
 =?us-ascii?Q?PBbWpIHuIjiUCuCaOuukLmZ6oOLdxcwgk0mch00fZlKC3yoQYeTQIx8ofwTl?=
 =?us-ascii?Q?Kzdh8cFFfEGb0fTxXTQUCpiLjxib3/Lcd5/hTyBXv511A1gbZo4cXLTu3CdG?=
 =?us-ascii?Q?iMtvWcdYY3nUQVFRBBrh1eQf+uytjPcfx7QNfFC4nAHiJcFERkN8mGJgc2rh?=
 =?us-ascii?Q?ZL05fBO2IPjdifAVnBVQyTI7+Kkj1D4UwS0QKMAQeMfO29KwmZEWmtBHra8/?=
 =?us-ascii?Q?pLZXXVXQANyPeuv1zkGfbLpLaHSG7Nv3jH76qiUyNuTB43YsYepbyqmoe9D9?=
 =?us-ascii?Q?HMBf7lE6eGJir04UrzjoTNins2M3iN34Weqtq44qG1/mvSrhKc7ludXzhNpB?=
 =?us-ascii?Q?hvscTMoLX+tZ5ekEk8B0MHtorbFi9t9MWh7WdfjstIl/BTQ2zJud6NQoI7rM?=
 =?us-ascii?Q?d6LEQprpyjaWP+CtixKlr7P3rSDh+bm/zK10N3f7yDe5hUhjn8fx7oHfWPLf?=
 =?us-ascii?Q?FjkD1+epZPFCDIUxUWkgi/UoItWVSaQ2Y9V70q53eQ0trAUBMhtvn+ulQs4K?=
 =?us-ascii?Q?NFuGe0j17qdKrPUMcG1oRYEVQCYvCg8Lj3bAI5AdUCXHdNl33sjvOGFMJVaA?=
 =?us-ascii?Q?BiNmPo2p5bkGrMlmzZzj3c4VTPm73//Pimi5YET/bHjq9w8TXO9bYb7XjtQU?=
 =?us-ascii?Q?47y2U2oswD9m7rzH+r0s+RRAM0837LLNy9N2vs0bc2OTYXtkHAHzcQ4ba3L8?=
 =?us-ascii?Q?PMb2azGtpKLOgwI41/FVauGmnmDhpMfd6qLNLhpoiSUKeC7z8R1CY219qTFW?=
 =?us-ascii?Q?ns7n5TaV0oHTgRZUMDvn4UgHaYPBKkuhukYShkb4SqM90g3APR2iGJ5GiTpg?=
 =?us-ascii?Q?ZSTbWkjNumRRt4DiEV7fAsBQP3tRZZFxCZUI2pN/iXPUxhbxvP1vAOEr1yKA?=
 =?us-ascii?Q?m2kbIOVLFhoHamNJE1OV4Y3aiOU/rJy4zJXPvjvEYNnzS01Xx7zyi8r8f0lR?=
 =?us-ascii?Q?B/O/7nS4DQJK5Vn2excePB8ZruPYRGOqWQPOL++DEjUwI5qJR46zWynJBDxq?=
 =?us-ascii?Q?gTgfs3iuTizLuAnUSf6QPdPdt5wdtwFc605Rc1Qk5IuPtzUhaxe0aWaoQNpS?=
 =?us-ascii?Q?3iILDkuufWznizhsVqCEht4UXyfNKkbFRUqLi4n4O0z1ngVrj6s2ZxHnW9uP?=
 =?us-ascii?Q?ovX2dp2UwEIIU5C9Hx5nm1dL0sDdt0tT5HuO0R/JKvTJF1C3I49wTlAe0F8f?=
 =?us-ascii?Q?XaSBnKm0hlq0L29U5BbsOL0b8n3XIEZOxM51RZBlMUOUuuBI/ykMY4jReYuy?=
 =?us-ascii?Q?zA=3D=3D?=
X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: =?us-ascii?Q?IZQYwnSlCWEgetl7TEPTTR6TNYEbkcfekQjL6m55TGW8/cQhk3evE8O6Rk13?=
 =?us-ascii?Q?bJM/caEOe+o1y8SaZFgfI3R6W3PLh/URoR+cYnSQqeSD78rRHJzttEYc46RB?=
 =?us-ascii?Q?rTlDAnYyPtbwXpSGNLBa6ZVLy6YYj/Qk4c9pX6TBh8apXcxi/5Zq5TqAixOR?=
 =?us-ascii?Q?ZzLQpcwevP9yLds9pey+sjm2SJhysh/3PWSmZgzruurIqjtbc3mwgduVtccy?=
 =?us-ascii?Q?p0v4zPdj1K1bdU9tVjRI0xcyWrxBWlB8Ht1gGKMmddp+0g/9katu6Chkh6+Z?=
 =?us-ascii?Q?xQRXUiIk6tHsra9lfLv0k9/708zVUOTBeRjWLIY3KdUY8D4FsWiDoZ/t40oh?=
 =?us-ascii?Q?sosHfWRI2yugSio1Ok7k1DjLJMR2To5QnNT5QbY4rIvqZgw6JUPC3O7D+q3h?=
 =?us-ascii?Q?5OGsTf/21j2y4YOHt0qJDbUaDFS61xrtCmgmcOyMfr32iFEizsvXzOLiDYdF?=
 =?us-ascii?Q?PrX4+WqIyUbSlH+KfVdFX1m928x/D3Vmjd4hFvF89pS8t/y0qNSIpvFgxrA6?=
 =?us-ascii?Q?9FEvJdFNbg7apVPigqqLUYbJZLRUADSUZgalggX+p1HXuwJgCniBjRvQ2cku?=
 =?us-ascii?Q?RS024P4PtgHwiq19lJUajM0rZGhqT5XSpZJ7WGOr13PhAUcWpIyHE48J8KJa?=
 =?us-ascii?Q?ahwXdm87T7+BFJtZlXfQDimev8pgT7Vc58OhGeMGEezMSA81hpm1fmGKi5HI?=
 =?us-ascii?Q?+sxIcoUAbtvcBrsivbmhw3v2JZiAL/l9CYTuJdvcvgKoGa4i8kf6uoXd+1Vl?=
 =?us-ascii?Q?dxfJiLST8zmWUl2sn9OJ1WkkiWrfvpwcU3V3Fek809ukCHsCVpZ1RCLuRgjU?=
 =?us-ascii?Q?uPQwvdz/h5CdFZEMflsfFujVg28ADDH7rDGvB9BC6qCnUyr1ssGOraahw5cq?=
 =?us-ascii?Q?IZ8r1twWfI61obcv19ssicV+VzGBgapnFwXo/+iQDFryVWoHkOcuEB485Ubh?=
 =?us-ascii?Q?Ho9YT9pPrWyXS4gghNVoVA/Rw/RJh5Eb/O3QOF+hYMQ=3D?=
X-OriginatorOrg: oracle.com
X-MS-Exchange-CrossTenant-Network-Message-Id: c9721eaa-2d22-4519-5555-08db41e1198d
X-MS-Exchange-CrossTenant-AuthSource: SA1PR10MB5711.namprd10.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 20 Apr 2023 20:52:05.7895
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: 4edBTmFm5/jkcZwf/+z1Fk1kcULdPzOIoy1nGTmE4iRq1no0qmu41T3mx9NUlLVvmsF5494Wa2uJ1yxj87wttgw9OV34RZnzP6De57GOl6I=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SA1PR10MB6568
X-Proofpoint-Virus-Version: vendor=baseguard
 engine=ICAP:2.0.254,Aquarius:18.0.942,Hydra:6.0.573,FMLib:17.11.170.22
 definitions=2023-04-20_15,2023-04-20_01,2023-02-09_01
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 mlxlogscore=971 spamscore=0
 adultscore=0 malwarescore=0 bulkscore=0 suspectscore=0 mlxscore=0
 phishscore=0 classifier=spam adjust=0 reason=mlx scancount=1
 engine=8.12.0-2303200000 definitions=main-2304200175
X-Proofpoint-GUID: miEN7aiEscQdDOutB1Ek6tA-hTqNQCQf
X-Proofpoint-ORIG-GUID: miEN7aiEscQdDOutB1Ek6tA-hTqNQCQf
X-Spam-Status: No, score=-2.8 required=5.0 tests=BAYES_00,DKIM_SIGNED,
        DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_LOW,
        RCVD_IN_MSPIKE_H2,SPF_HELO_NONE,SPF_NONE,T_SCC_BODY_TEXT_LINE
        autolearn=ham autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

On Wed, Apr 12, 2023 at 02:07:36PM +0200, Peter Zijlstra wrote:
> On Thu, Mar 30, 2023 at 01:45:57PM -0400, Daniel Jordan wrote:
> 
> > The topology of my machine is different from yours, but it's the biggest
> > I have, and I'm assuming cpu count is more important than topology when
> > reproducing the remote accesses.  I also tried on
> 
> Core count definitely matters some, but the thing that really hurts is
> the cross-node (and cross-cache, which for intel happens to be the same
> set) atomics.
> 
> I suppose the thing to measure is where this cost rises most sharply on
> the AMD platforms -- is that cross LLC or cross Node?
> 
> I mean, setting up the split at boot time is fairly straight forward and
> we could equally well split at LLC.

To check the cross LLC case, I bound all postgres and sysbench tasks to
a node.  The two functions aren't free then on either AMD or Intel,
multiple LLCs or not, but the pain is a bit greater in the cross node
(unbound) case.

The read side (update_cfs_group) gets more expensive with per-node tg
load_avg on AMD, especially cross node--those are the biggest diffs.

These are more containerized sysbench runs, just the same as before.
Base is 6.2, test is 6.2 plus this RFC.  Each number under base or test
is the average over ten runs of the profile percent of the function
measured for 5 seconds, 60 seconds into the run.  I ran the experiment a
second time, and the numbers were fairly similar to what's below.

AMD EPYC 7J13 64-Core Processor (NPS1)
    2 sockets * 64 cores * 2 threads = 256 CPUs

                      update_load_avg profile%    update_cfs_group profile%        
affinity  nr_threads          base  test  diff             base  test  diff
 unbound          96           0.7   0.6  -0.1              0.3   0.6   0.4
 unbound         128           0.8   0.7   0.0              0.3   0.7   0.4
 unbound         160           2.4   1.7  -0.7              1.2   2.3   1.1
 unbound         192           2.3   1.7  -0.6              0.9   2.4   1.5
 unbound         224           0.9   0.9   0.0              0.3   0.6   0.3
 unbound         256           0.4   0.4   0.0              0.1   0.2   0.1
   node0          48           0.7   0.6  -0.1              0.3   0.6   0.3
   node0          64           0.7   0.7  -0.1              0.3   0.6   0.3
   node0          80           1.4   1.3  -0.1              0.3   0.6   0.3
   node0          96           1.5   1.4  -0.1              0.3   0.6   0.3
   node0         112           0.8   0.8   0.0              0.2   0.4   0.2
   node0         128           0.4   0.4   0.0              0.1   0.2   0.1
   node1          48           0.7   0.6  -0.1              0.3   0.6   0.3
   node1          64           0.7   0.6  -0.1              0.3   0.6   0.3
   node1          80           1.4   1.2  -0.1              0.3   0.6   0.3
   node1          96           1.4   1.3  -0.2              0.3   0.6   0.3
   node1         112           0.8   0.7  -0.1              0.2   0.3   0.2
   node1         128           0.4   0.4   0.0              0.1   0.2   0.1
                                                                                             
Intel(R) Xeon(R) Platinum 8358 CPU @ 2.60GHz
    2 sockets * 32 cores * 2 thread = 128 CPUs
                                                                                             
                      update_load_avg profile%    update_cfs_group profile%        
affinity  nr_threads          base  test  diff             base  test  diff
 unbound          48           0.4   0.4   0.0              0.4   0.5   0.1
 unbound          64           0.5   0.5   0.0              0.5   0.6   0.1
 unbound          80           2.0   1.8  -0.2              2.7   2.4  -0.3
 unbound          96           3.3   2.8  -0.5              3.6   3.3  -0.3
 unbound         112           2.8   2.6  -0.2              4.1   3.3  -0.8
 unbound         128           0.4   0.4   0.0              0.4   0.4   0.1
   node0          24           0.4   0.4   0.0              0.3   0.5   0.2
   node0          32           0.5   0.5   0.0              0.3   0.4   0.2
   node0          40           1.0   1.1   0.1              0.7   0.8   0.1
   node0          48           1.5   1.6   0.1              0.8   0.9   0.1
   node0          56           1.8   1.9   0.1              0.8   0.9   0.1
   node0          64           0.4   0.4   0.0              0.2   0.4   0.1
   node1          24           0.4   0.5   0.0              0.3   0.5   0.2
   node1          32           0.4   0.5   0.0              0.3   0.5   0.2
   node1          40           1.0   1.1   0.0              0.7   0.8   0.1
   node1          48           1.6   1.6   0.1              0.8   0.9   0.1
   node1          56           1.8   1.9   0.1              0.8   0.9   0.1
   node1          64           0.4   0.4   0.0              0.2   0.4   0.1