Received: by 2002:a05:6a11:4021:0:0:0:0 with SMTP id ky33csp611204pxb; Tue, 14 Sep 2021 05:07:13 -0700 (PDT) X-Google-Smtp-Source: ABdhPJxSedmv1rEE9lnvbIhZqq8d6t3IKJb4c1zzQa0wV3vIm6OZsZXJgHvPo//fAn4Um9R3S6nO X-Received: by 2002:a2e:a4ad:: with SMTP id g13mr15043568ljm.391.1631621233704; Tue, 14 Sep 2021 05:07:13 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1631621233; cv=none; d=google.com; s=arc-20160816; b=bJKjeZyV5u/3Vp2Hrp4wpe5OVPUqn4CZgP53cBCKfCGfxbw+6Gd3Y4gITGoysGvIfs r9csoy4vMAcsDh5Z3YmdzkUh+gzR299TXjeg5zapY/P8Nn6UmvIQUrlZm0JmWkvb4wdb s31190ewoB9bmf8JedY/I9JNN87DXOAc++zDv+KOU7X8O1L/wgLqZVllBmzXYCAisxF/ 1a3KnDCGALnQcMIyTth0iJNBH1sjolHfb6agnri5U2pjVRuEr46o8/9p5Ee/SuDoMFot q5TkcPM4BxGurfZ5rJBrJhNy82YCkbtXeiQ1DW5vLKFe86z5Wdd/Q8IQ7zVrKF63PV6d i5VQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:in-reply-to:content-disposition:mime-version :references:message-id:subject:cc:to:from:date:dkim-signature; bh=sMURhasWH7o24sIx6k+KJwjL13GOVwjz4KzyTqvqMaA=; b=n/BEq4LsSo3abXfCRPdxPus7ESNjwBnHkjNStEAWWFkhG9UJnDe8kq6YU+415UfPpf cq3IfoLpu8iUQby8KHiR5O9MFwxlK4LGcRoobuHXGUuDNtucg1izqXJLmfVVGgnbqKWg wPz3HjJuBe/zmiE1dSK2zBC0Hti/w+ZBxi+DKsFE5m33OeIlsjHtYMRxPhdxV5N1efB/ GhVl7FYeFmA+X3NM3yBT2Dv94EvU3ke5iOkMZcSdMSw5CIgxffUFVNye5/h5S0OwDHrT 96fdUKao8w0nEqoXDXdVJkAoFCw5BPx6w+fSzXzyREIpCGGZOb2umsNPBmBUGLM8/6UJ OdZQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@infradead.org header.s=casper.20170209 header.b="AMH/RfTD"; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id w6si11737556lfa.133.2021.09.14.05.06.44; Tue, 14 Sep 2021 05:07:13 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@infradead.org header.s=casper.20170209 header.b="AMH/RfTD"; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232357AbhINMDa (ORCPT + 99 others); Tue, 14 Sep 2021 08:03:30 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:59578 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S232252AbhINMD3 (ORCPT ); Tue, 14 Sep 2021 08:03:29 -0400 Received: from casper.infradead.org (casper.infradead.org [IPv6:2001:8b0:10b:1236::1]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id D8D69C061574 for ; Tue, 14 Sep 2021 05:02:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=casper.20170209; h=In-Reply-To:Content-Type:MIME-Version: References:Message-ID:Subject:Cc:To:From:Date:Sender:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description; bh=sMURhasWH7o24sIx6k+KJwjL13GOVwjz4KzyTqvqMaA=; b=AMH/RfTDsWf9TbGEll27BOuxfZ YBIkPLhTMvDz+/zcYlxvuzyxFdRP5VeN/JLIriAD/nD96kRbe5gsvlT9gYvU35XdBdsONLGGLcuLT YncfwElFeMzY9ID4XsZe8S50K5jzeW9NcGepi733QDc2E5Wo4tJbQNG+DlNoNkKUIlxsy4uigGPQ4 SdsBYVh4fpWsnBxj9Yk+6QNWy1s2QnVtt9eP293P8lEBMFc05xwZZ+HupVSPgCOYcdo8SyNwwJKR+ f7v3G8S9oV908W54XhpItz0yz/DnXqfRfgwtinVsONMVQovXtVbJBwlfeuAZFy5Zr6muLrRa+m4fK 95gzQb5g==; Received: from j217100.upc-j.chello.nl ([24.132.217.100] helo=noisy.programming.kicks-ass.net) by casper.infradead.org with esmtpsa (Exim 4.94.2 #2 (Red Hat Linux)) id 1mQ74f-00Ed2c-5h; Tue, 14 Sep 2021 11:58:30 +0000 Received: from hirez.programming.kicks-ass.net (hirez.programming.kicks-ass.net [192.168.1.225]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (Client did not present a certificate) by noisy.programming.kicks-ass.net (Postfix) with ESMTPS id C270730003A; Tue, 14 Sep 2021 13:58:03 +0200 (CEST) Received: by hirez.programming.kicks-ass.net (Postfix, from userid 1000) id A3FD52D1FEA0E; Tue, 14 Sep 2021 13:58:03 +0200 (CEST) Date: Tue, 14 Sep 2021 13:58:03 +0200 From: Peter Zijlstra To: Vincent Guittot Cc: Yicong Yang , Ingo Molnar , Juri Lelli , Dietmar Eggemann , Steven Rostedt , Ben Segall , Mel Gorman , Daniel Bristot de Oliveira , 21cnbao@gmail.com, Linux Kernel Mailing List , "Song Bao Hua (Barry Song)" , prime.zeng@huawei.com, "guodong.xu@linaro.org" Subject: Re: [RFC] Perfomance varies according to sysctl_sched_migration_cost Message-ID: References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Tue, Sep 14, 2021 at 11:04:03AM +0200, Vincent Guittot wrote: > > I would say that it's a heuristic value that works for most of system > but it should probably be tuned per platform. But also note that it's > quite difficult to get a correct value > Right; so back before CFS there was some boot time benchmarks that measured something for each sched domain. Conceptually that makes sense, the larger the domain, the larger the cost, also, you get per platform etc.. In practise it had boot to boot variance and virt fail written all over it, which is why Ingo ripped it out. I think someone once tried to bring some of it back, but that was a long time ago. I'm also not convinced boot time benchmarks are the best idea, because the above reasons, but perhaps we can do something topology based, and maybe using a few platform inputs. And as with anything, some benchmarks will like it, others will not like it. It's only worth the complexity if we can get an improvement across the board.