Received: by 2002:a05:7412:da14:b0:e2:908c:2ebd with SMTP id fe20csp1919318rdb; Mon, 9 Oct 2023 07:08:01 -0700 (PDT) X-Google-Smtp-Source: AGHT+IEJqTZzuGd1+a0hGRxvKmLPbR8mNlUrvCKg+y/oxdStnVH2ygi6iICxUmR7a41coGsXI6uP X-Received: by 2002:a17:90a:348d:b0:273:e8c0:f9b with SMTP id p13-20020a17090a348d00b00273e8c00f9bmr12276393pjb.15.1696860481316; Mon, 09 Oct 2023 07:08:01 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1696860481; cv=none; d=google.com; s=arc-20160816; b=XrtNbR4i2xBMNMzYVESXMLdVe8cIFc4MtNtkIdFfsof6dA19doZI8+CcIjPppZqG0T UejQkIwNv5qmSTe6Md5j5aBhwQ7/v9mRp4WH34KtgC2f0ZveEiTJyEQzRzMG8jOwXopw QPWsEPuHgrfUnpUh7xgcgo9JKsWaKGVJTdae7kC/EkcTnwNj9BizGKze2v93s6jflULH +Y5liH9SFuTMiqmm0YqvjGIQXD44JnYxVEaVZ6rScfT9clWpHJC0Y1vr5LbIo7Oqovfa SXdBt4+/6jcJ9S3TJEMB0kiILW/b/N1sPgbCWghLh/dS8D1sQDU7QSe/YaKoc8K2A6VM p+rg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:mime-version:references:message-id:in-reply-to :subject:cc:to:from:date:dkim-signature; bh=5y3Xsrg6mk7ndh55t4FBA+9rbjhoIzV35V6eekUHwTo=; fh=VZgiKpmYDC8E3n8Ot4MQmmZECsSy6u5F8EXyIB0MZDY=; b=BP0/oZ+nh5u/JxmLjRwjjL+dctLAP+XOAG9HgrKaAwMYnVQee0gn3Zv/CujAnBgxUz yy0ALODJwMdPDjTR1STp4nGyE7+A6bLuuehPI+GIp6jGNJ2vEL2UL6StM0Rb7StIpzXr DaBh0i2dYDjrhMThF9LATYc37hfJ67RyqYTqk2cnupjQIFAV3RTuJeLZhaCFxTpxt15n JkfHxZDYCEiWL1FzQ96NIc7zkl4jb0j3NnAdtpA0CdO74uBkidDevO4NwhDPG7GwA7qc Sul1AQloSiMLyWPfBLHalX9mM3ru9gLj/ErLnKUy/gKbmktjJoU0hebD3zTqu3RWxFpq Y/oQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@inria.fr header.s=dc header.b=VZ3p57vB; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.36 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=inria.fr Return-Path: Received: from pete.vger.email (pete.vger.email. [23.128.96.36]) by mx.google.com with ESMTPS id pj3-20020a17090b4f4300b0027724d42e7esi9962217pjb.123.2023.10.09.07.08.00 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 09 Oct 2023 07:08:01 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.36 as permitted sender) client-ip=23.128.96.36; Authentication-Results: mx.google.com; dkim=pass header.i=@inria.fr header.s=dc header.b=VZ3p57vB; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.36 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=inria.fr Received: from out1.vger.email (depot.vger.email [IPv6:2620:137:e000::3:0]) by pete.vger.email (Postfix) with ESMTP id 732B2802F721; Mon, 9 Oct 2023 07:07:58 -0700 (PDT) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.10 at pete.vger.email Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1376728AbjJIOHi (ORCPT + 99 others); Mon, 9 Oct 2023 10:07:38 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:50892 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1345013AbjJIOHh (ORCPT ); Mon, 9 Oct 2023 10:07:37 -0400 Received: from mail2-relais-roc.national.inria.fr (mail2-relais-roc.national.inria.fr [192.134.164.83]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id B3AA58E for ; Mon, 9 Oct 2023 07:07:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc; h=date:from:to:cc:subject:in-reply-to:message-id: references:mime-version; bh=5y3Xsrg6mk7ndh55t4FBA+9rbjhoIzV35V6eekUHwTo=; b=VZ3p57vBdFg3cnHKD/TzCH/AydoKIMd8h2aFWeZ6dXdAyygoMlolMMpw 1HmoYhHGxBUZMjm5EWxdP7cyGS+pp+XeEaKg2N79TJY8O0bURTngtRcjX 5ERGyAs4wodpK7W5Mps8wiBAiZMDEfR+f1uB48hAKqcYAMKFdwlPt6q29 w=; Authentication-Results: mail2-relais-roc.national.inria.fr; dkim=none (message not signed) header.i=none; spf=SoftFail smtp.mailfrom=julia.lawall@inria.fr; dmarc=fail (p=none dis=none) d=inria.fr X-IronPort-AV: E=Sophos;i="6.03,210,1694728800"; d="scan'208";a="130251998" Received: from wifi-eduroam-84-160.paris.inria.fr ([128.93.84.160]) by mail2-relais-roc.national.inria.fr with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 09 Oct 2023 16:07:32 +0200 Date: Mon, 9 Oct 2023 16:07:32 +0200 (CEST) From: Julia Lawall To: Peter Zijlstra cc: Ingo Molnar , Vincent Guittot , Dietmar Eggemann , Mel Gorman , linux-kernel@vger.kernel.org Subject: Re: EEVDF and NUMA balancing In-Reply-To: <20231009102949.GC14330@noisy.programming.kicks-ass.net> Message-ID: References: <20231003215159.GJ1539@noisy.programming.kicks-ass.net> <20231004120544.GA6307@noisy.programming.kicks-ass.net> <20231004174801.GE19999@noisy.programming.kicks-ass.net> <20231009102949.GC14330@noisy.programming.kicks-ass.net> MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII X-Spam-Status: No, score=2.7 required=5.0 tests=DKIM_SIGNED,DKIM_VALID, DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI, RCVD_IN_SBL_CSS,SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on pete.vger.email Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (pete.vger.email [0.0.0.0]); Mon, 09 Oct 2023 07:07:58 -0700 (PDT) X-Spam-Level: ** On Mon, 9 Oct 2023, Peter Zijlstra wrote: > On Wed, Oct 04, 2023 at 08:04:34PM +0200, Julia Lawall wrote: > > > I'll go build the benchmark thing tomorrow, if I can figure out how that > > > works, this NAS stuff looked 'special'. Nothing simple like ./configure; > > > make -j$lots :/ > > > > Starting from git clone, I had to do: > > > > cd NPB3.4-OMP > > mkdir bin > > cd config > > cp make.def.template make.def > > cd .. > > make ua CLASS=C > > > > You also need gfortran to be installed. > > W00t, that worked like a charm. > > The sad new is that I can't seem to reproduce the issue: > > So my (freshly re-installed with debian testing) 4 socket Intel(R) > Xeon(R) CPU E7-8890 v3 machine gives me: > > root@hsw-ex:/usr/local/src/nas-parallel-benchmarks/NPB3.4-OMP/bin# uname -a > Linux hsw-ex 6.6.0-rc4+ #2 SMP PREEMPT_DYNAMIC Mon Oct 9 11:14:21 CEST 2023 x86_64 GNU/Linux > root@hsw-ex:/usr/local/src/nas-parallel-benchmarks/NPB3.4-OMP/bin# cat /proc/sys/kernel/numa_balancing > 1 > root@hsw-ex:/usr/local/src/nas-parallel-benchmarks/NPB3.4-OMP/bin# ./ua.C.x | grep "Time in seconds" > Time in seconds = 26.69 > root@hsw-ex:/usr/local/src/nas-parallel-benchmarks/NPB3.4-OMP/bin# ./ua.C.x | grep "Time in seconds" > Time in seconds = 26.31 > root@hsw-ex:/usr/local/src/nas-parallel-benchmarks/NPB3.4-OMP/bin# ./ua.C.x | grep "Time in seconds" > Time in seconds = 25.43 How many runs did you try? I would suggest 50. 25-26 looks like what I get when things go well. julia > > > And this is using a .config very near what Debian ships for 6.5 (make > olddefconfig -CONFIG_DEBUG_INFO_BTF) > > I'll try again in a little bit, perhaps I'm suffering PEBKAC :-) > > >