Received: by 2002:a6b:500f:0:0:0:0:0 with SMTP id e15csp455488iob; Wed, 18 May 2022 06:01:20 -0700 (PDT) X-Google-Smtp-Source: ABdhPJzzNDkc/Zsp0yA/OmWHahltiKdYi3tbgenqcMyz8IYOZc3YAOS88pI5AX3v5YjsEty8/P0C X-Received: by 2002:a17:90b:1a8a:b0:1dc:ea29:f6a9 with SMTP id ng10-20020a17090b1a8a00b001dcea29f6a9mr42587920pjb.108.1652878879896; Wed, 18 May 2022 06:01:19 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1652878879; cv=none; d=google.com; s=arc-20160816; b=u2aPYdTXdPgKVbIVpdcg8rS+L2X/OoeG7qewR+/wYhva0+OUvjSx3Xw+I1FekUhhYo BkGSoEG48CeITnIrKJhI+fPDMcfGePxU3CxqzjV5a5ZOSyK59ItEdyKvXvrmZqW6qnAA /8ARqCc+MUPBKU48NdFBqc7LoR+LcWRzU/sozG3ow1r7f/TC1Hn4f3NPhJaYs8Dlop45 HUITBYrz16kpfFOz6o/OmrvYAzmZqQ+Rbi9UggOVsoDc7ptZJU/zuBsHd6Kea+5bHVif g13i/xmMRQGHJV+NLZ5RcbbI0uzEBGJjdYGHMSsFXb0UIk9KsNIo01hMmwpy9IShhBXa Dx2g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:cc:to:subject:message-id:date:from:in-reply-to :references:mime-version:dkim-signature; bh=dM4bl7eU/dULWWBp2eDh/PeRjPphqkSU0WhoA+v9GXg=; b=ODsdGgVnLiIHXzSH5fUBnDnA/uYboPVxAEx3XPmQUxaWtnjquUDM3NNF3ry/yLJlCN k3edYae2YRvYg/MfeMq/mGbDAL0EcReb5ydqqVzq7peDcCWps1st6kUF/00kNyknI8RT ZwwyytOTfWGEpaHdsSoaAZKL+DEwReyKPIP8jtb59wopuNufiuSRaxG7IiTQL45GAL/J g0D6zG0ccRGZ267TTGb3oKK2lYsF/JTJKbCl+rniuVwbJhFInA69bOhhOG8xxIiVZFsP adKuM72miwHPJwAIjhl9t7tON4wlHlHk+IF9eShykcrO0D7t56gVmB9aIvDR8w8Ny7e4 7FIQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@bytedance-com.20210112.gappssmtp.com header.s=20210112 header.b=KUyMcRSO; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=bytedance.com Return-Path: Received: from lindbergh.monkeyblade.net (lindbergh.monkeyblade.net. [2620:137:e000::1:18]) by mx.google.com with ESMTPS id v12-20020a17090a4ecc00b001c1171b611fsi6561314pjl.22.2022.05.18.06.01.18 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 18 May 2022 06:01:19 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:18 as permitted sender) client-ip=2620:137:e000::1:18; Authentication-Results: mx.google.com; dkim=pass header.i=@bytedance-com.20210112.gappssmtp.com header.s=20210112 header.b=KUyMcRSO; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=bytedance.com Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by lindbergh.monkeyblade.net (Postfix) with ESMTP id D702C31224; Wed, 18 May 2022 05:56:37 -0700 (PDT) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S237113AbiERM4Y (ORCPT + 99 others); Wed, 18 May 2022 08:56:24 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:35524 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S237555AbiERM4T (ORCPT ); Wed, 18 May 2022 08:56:19 -0400 Received: from mail-lj1-x22a.google.com (mail-lj1-x22a.google.com [IPv6:2a00:1450:4864:20::22a]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 7265D167FC for ; Wed, 18 May 2022 05:56:04 -0700 (PDT) Received: by mail-lj1-x22a.google.com with SMTP id h8so2412406ljb.6 for ; Wed, 18 May 2022 05:56:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bytedance-com.20210112.gappssmtp.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=dM4bl7eU/dULWWBp2eDh/PeRjPphqkSU0WhoA+v9GXg=; b=KUyMcRSOwDu6jx3pdPfF4rBn1VDHBiK4nQudYAkgaxNLKolk/LxQnZ8rCaNzA96DVy nyGOhCEtRt9cKP5qLIIAXqhqDuitw/7tK5iwTCbBD1sWxmkWhxcr03w9cKVvB2uRjAB6 H1KfMYClxSt54NLmBb7cidPlUzasjfOSB/qyJpAA+Td07l54yyAEniUSEvfyqooVrLu4 +Ok+u3LA71bM8EUThDJYof3NS0D0xvvz2jkPTfqJMYe5GTD+SYJp0RYQqlYyatiCBinW +nzzOGWCqt88Qv24FKXJRQQJKmsNTVKNUya3OzGPrkgloGoD2tunU15OJtoe3R1HRN45 9oGg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=dM4bl7eU/dULWWBp2eDh/PeRjPphqkSU0WhoA+v9GXg=; b=020xkVLRg/t5/gy2K18GNYvTC+i2zOv5gc+LP8gqU5UJGZThHRiTUMbk+uwIX2zM7s +LGY7AMrAfVrR2SgM17ORVWmzXBT/NQwYHVsbFZU50yGOOHk+2vmQBWwBIrJLEwrHJc4 dZFihMEaGTV1PdJoecnn5ZNq1Clfg8F20VuN4par7ImwtBHty+uE2GuODckm0ot/APly obI6/HJdeiiLK8lN5CgBECYPLJQJEhpYXyJbbMYVYPiiDJGKPLurEEl1NT++2QqaF5Of iWCavYTmz4lu7JpwA1KiBdBE+3XsL239C2/1MowtmwjqFRyNoupHUCo06lX7eQB/TQY/ BNLQ== X-Gm-Message-State: AOAM533dt7A4lvHNB7CU7SLKB/XQirYmzTmpQN3Ynn4PK4Pj5BwXc5GG 2t1ibhBMjwFOmgKiLiMNxngXN+066+3Wn0BHE/WyJg== X-Received: by 2002:a2e:a495:0:b0:253:c86e:328c with SMTP id h21-20020a2ea495000000b00253c86e328cmr2170676lji.175.1652878562764; Wed, 18 May 2022 05:56:02 -0700 (PDT) MIME-Version: 1.0 References: <20220518100841.1497391-1-fam.zheng@bytedance.com> <20220518102140.GF10117@worktop.programming.kicks-ass.net> In-Reply-To: From: "Feiran Zheng ." Date: Wed, 18 May 2022 13:55:51 +0100 Message-ID: Subject: Re: [External] Re: [RFC PATCH] sched: Enable root level cgroup bandwidth control To: Vincent Guittot Cc: Peter Zijlstra , linux-kernel@vger.kernel.org, Steven Rostedt , Ben Segall , Daniel Bristot de Oliveira , Dietmar Eggemann , zhouchengming@bytedance.com, fam@euphon.net, Mel Gorman , Ingo Molnar , songmuchun@bytedance.com, Juri Lelli Content-Type: text/plain; charset="UTF-8" X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,RDNS_NONE, SPF_HELO_NONE,T_SCC_BODY_TEXT_LINE autolearn=no autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Wed, May 18, 2022 at 1:03 PM Vincent Guittot wrote: > > On Wed, 18 May 2022 at 12:38, Feiran Zheng . wrote: > > > > On Wed, May 18, 2022 at 11:21 AM Peter Zijlstra wrote: > > > > > > On Wed, May 18, 2022 at 11:08:41AM +0100, Fam Zheng wrote: > > > > In the data center there sometimes comes a need to throttle down a > > > > server, > > > > > > Why? > > > > For economical reasons there can be over-provisioning in DC power > > supply (UPS capacity etc) because the utilization expectation of the > > racks is not maximum value. But the workload can be client driven, > > depending on how many users are online, and in the end the power > > supply may overload and trip itself. To avoid that, upon a threshold, > > some servers need to be brought down or throttled. The latter is > > obviously going to be much more smooth. > > This looks like thermal or power budget management. We have other ways > to do so with powercap or idle injection. Did you consider those > solutions ? Hi Vincent, I looked at powercap, and it seems Intel only? Any idea about AMD/ARM? There seems nothing for them under drivers/powercap/. I don't know the idle injection interface, can you please give more hints? I also plan to test uclamp, still need to learn more about that. Fam