Received: by 2002:a6b:500f:0:0:0:0:0 with SMTP id e15csp536751iob; Wed, 18 May 2022 07:34:21 -0700 (PDT) X-Google-Smtp-Source: ABdhPJyif7qyEg0z6Myp3O9l3pVGqY4jdQWlXAY+o3GF6xam66Q9WptEMGI9J1+dRTzYYq0zM6qK X-Received: by 2002:a05:6a00:a85:b0:4e0:57a7:2d5d with SMTP id b5-20020a056a000a8500b004e057a72d5dmr28036661pfl.81.1652884460926; Wed, 18 May 2022 07:34:20 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1652884460; cv=none; d=google.com; s=arc-20160816; b=gj9aPcuhCt8Y1bqR3rMGPpP7NZC16BEa4vlY7u2AZSxkLsCbHE63m6+F8IMqugLHab X+7/siyP5iR40wxfMUPXe37uEcyW6b7/1db5XEDg2e9ZAEMhOj17TSOkSgXiO2uHN7aQ aTzx3bAalos4630ET8wngIWi2TuworJA1OiLy87c4iuFVEtRC15uHDTTUUEgkaxpjO5d F3hRb7r7H62bmqIQHmDZPZq5PPZV2/5eMAVx14S1vi7uWMgn4Qd7OkyAr+/OhtcUYRnx KM16DwNgCv3rQmKI+bYqDBweYuwMrB+5QipvOL5ElpHv4IrpNeWgI6/rVi+V6UgTnE8N 5/kA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:cc:to:subject:message-id:date:from:in-reply-to :references:mime-version:dkim-signature; bh=7nmEi6ZoG9r127aWoO2La/t7onhMEzl5Gbs0ISxTId4=; b=PlDnSDoMXrvnX7DqMSvT0x3f39hIoaOqwO92YBBXCM+1Qkl7QFnob5/loAW8YA6W5E loOcBReEn020oeUCPB2w4p0JkNqPAKVdu6k8vRxoa7RnAYGu4M/t1sq1DnWFq8KydRrG 1tYQSkPsIMV9BH6nODGcg7RWAIDYkwzdEZBR2lcSC2eVf46Cg8zj2Dg5ZWc1xohSRpEr qbInqEbqSI0E/Ql7rgOdVbUjE908w7XIUWwtR7TsoEDNWCEwpABb1VWluWarAk9hvaXt ra8QcGXznqCmMJdjj7+KeHi28ytMvcqZrsUIZ0oWGW00nWlKZlrIJsNQeqmV5f4txdX0 Qw8g== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=QHkp2SHQ; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Return-Path: Received: from lindbergh.monkeyblade.net (lindbergh.monkeyblade.net. [2620:137:e000::1:18]) by mx.google.com with ESMTPS id i13-20020a63584d000000b003c5eccfb916si2521893pgm.435.2022.05.18.07.34.20 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 18 May 2022 07:34:20 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:18 as permitted sender) client-ip=2620:137:e000::1:18; Authentication-Results: mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=QHkp2SHQ; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by lindbergh.monkeyblade.net (Postfix) with ESMTP id CEBB61356A8; Wed, 18 May 2022 07:31:57 -0700 (PDT) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S238617AbiERObx (ORCPT + 99 others); Wed, 18 May 2022 10:31:53 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:36376 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S238567AbiERObw (ORCPT ); Wed, 18 May 2022 10:31:52 -0400 Received: from mail-yb1-xb2a.google.com (mail-yb1-xb2a.google.com [IPv6:2607:f8b0:4864:20::b2a]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 9D8B7131F0D for ; Wed, 18 May 2022 07:31:50 -0700 (PDT) Received: by mail-yb1-xb2a.google.com with SMTP id p139so3950971ybc.11 for ; Wed, 18 May 2022 07:31:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=7nmEi6ZoG9r127aWoO2La/t7onhMEzl5Gbs0ISxTId4=; b=QHkp2SHQ0ilczfAavRdE+bGwRoRlPSAVvvBQ/UKIKFlyIbmL071SoLuKxg2nQ4mA+S Bl1WVEyfZ5uoc4hHnDGf/USDpoHoVvIYv92hR2CnXGjbCDRT6QdxTYIvB2FOkGlxpRrQ fx8PX0tyYhijJpmU7oA+PmVGz59bta+zGUOz/Vy1uOLlBJ0Boi4TyEY1qN4AW4LWzZ10 I6URRpRzLgwtufvkwnBlWr1sC/oGRWtxEUaSxqgmvd8X1DlsETJBV81fx9iSiJ0nc/Fu p4rE7aOVOT24cJLnW1/9GN48oTV0uRlwKeik5fpwsCXv3NJi9woK15JY6MY1CRiQY/nB lUCQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=7nmEi6ZoG9r127aWoO2La/t7onhMEzl5Gbs0ISxTId4=; b=h+gGADsKM5OglcIgFkQJYDpdWS1BI74AJ513WtYgbG0N8FKY9uCzt56rE6gy9gr3up U8Kan+hLYQtlXI50/unOQhfVXn0N79VYeQ3OtTYgwQxjqzoOqrWcxQuwJjxc66RIPuKA L/p+4PVrn6f6MZ2K43u6Sxaj0Qrw6UPw2Xfn10glqKHOWutfPUB5zazsJQEpPMhYGcMo ImdgA/0pCaozdG9reOZbODr3fFQ8K5ui/iryj86Bs2JQpZAknJtNNnwkz6d8Fh5hSayh G4B9srr/VYZYsQBHDoHl06HmH3Yhh/mlcuZWYHCXZbx37ufDKXCERaF/w+ZAhP8sO4FC PKkw== X-Gm-Message-State: AOAM533TKF1/lCU4ERbQC3xOSPrlth45LHgwcz9RihG8bAQcHMBSZXSA RSwmq9rHmsWCJjA8tjcfZNhPlA3sNLhnBHGBQ1Znog== X-Received: by 2002:a25:5e45:0:b0:64d:7707:e8c2 with SMTP id s66-20020a255e45000000b0064d7707e8c2mr18758338ybb.403.1652884309753; Wed, 18 May 2022 07:31:49 -0700 (PDT) MIME-Version: 1.0 References: <20220518100841.1497391-1-fam.zheng@bytedance.com> <20220518102140.GF10117@worktop.programming.kicks-ass.net> In-Reply-To: From: Vincent Guittot Date: Wed, 18 May 2022 16:31:38 +0200 Message-ID: Subject: Re: [External] Re: [RFC PATCH] sched: Enable root level cgroup bandwidth control To: "Feiran Zheng ." Cc: Peter Zijlstra , linux-kernel@vger.kernel.org, Steven Rostedt , Ben Segall , Daniel Bristot de Oliveira , Dietmar Eggemann , zhouchengming@bytedance.com, fam@euphon.net, Mel Gorman , Ingo Molnar , songmuchun@bytedance.com, Juri Lelli , Daniel Lezcano , Cristian Marussi Content-Type: text/plain; charset="UTF-8" X-Spam-Status: No, score=-2.0 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,RDNS_NONE,SPF_HELO_NONE,T_SCC_BODY_TEXT_LINE autolearn=no autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Adding daniel and cristian who works on some powercap implementation On Wed, 18 May 2022 at 14:56, Feiran Zheng . wrote: > > On Wed, May 18, 2022 at 1:03 PM Vincent Guittot > wrote: > > > > On Wed, 18 May 2022 at 12:38, Feiran Zheng . wrote: > > > > > > On Wed, May 18, 2022 at 11:21 AM Peter Zijlstra wrote: > > > > > > > > On Wed, May 18, 2022 at 11:08:41AM +0100, Fam Zheng wrote: > > > > > In the data center there sometimes comes a need to throttle down a > > > > > server, > > > > > > > > Why? > > > > > > For economical reasons there can be over-provisioning in DC power > > > supply (UPS capacity etc) because the utilization expectation of the > > > racks is not maximum value. But the workload can be client driven, > > > depending on how many users are online, and in the end the power > > > supply may overload and trip itself. To avoid that, upon a threshold, > > > some servers need to be brought down or throttled. The latter is > > > obviously going to be much more smooth. > > > > This looks like thermal or power budget management. We have other ways > > to do so with powercap or idle injection. Did you consider those > > solutions ? > > Hi Vincent, > > I looked at powercap, and it seems Intel only? Any idea about AMD/ARM? > There seems nothing for them under drivers/powercap/. there is a DTPM powercap provider in the latest kernel and a scmi power capp provider is under review > > I don't know the idle injection interface, can you please give more hints? idle injection can be used with cpuidle cooling device and there were some discussion to make a dtpm idle injection device but I think this has never been sent on mailing list > > I also plan to test uclamp, still need to learn more about that. > > Fam