Received: by 2002:a05:6a10:eb17:0:0:0:0 with SMTP id hx23csp1564721pxb; Fri, 10 Sep 2021 08:38:08 -0700 (PDT) X-Google-Smtp-Source: ABdhPJwgZV3H536g6Dx4Bp9WlDffnrzRXqljD07WAQmW+f5+W15DohFVQaghKRwCyg0RhwcDG18P X-Received: by 2002:a6b:ce17:: with SMTP id p23mr7591537iob.90.1631288288695; Fri, 10 Sep 2021 08:38:08 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1631288288; cv=none; d=google.com; s=arc-20160816; b=C/lLXLzs2RbaXhgQkRA3k3jMO9fqg1oNNqOECqcunSx52XsXj8WYLiKJIHItHZMZIS FP2/gNCpfIGbalqaYdF9RBE8CLgCc4YLUmXsum8UKIsdzBjf7FDSaBx+RHR9fMQZvktc jdIworgGJle1kdCFLQc80yRQ/8DXBsN/kNqoGvhMIkBgGQy992J4ft4u+bqv4x4561c4 FLTXC3s5tAU8Z66UHLmhA559lHs6lm2aR8h7KWTPDosu5gkRHKySl7k1oS/oZdf4GTUU Bf9abO1M5/Is2pudLn+BzCYkt/Qnc3pTUiDOgu+vH/Q9uBYEmO7edpDCjz9fBUWpwskN fA5w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:user-agent:in-reply-to:content-transfer-encoding :content-disposition:mime-version:references:message-id:subject:cc :to:from:date:dkim-signature; bh=ZBZRN9N1d5pyu4AdCx2wOykUXfyS79SPRhnX7ttZWoI=; b=fN0JpfFvNNFeUZEOMlYEIE3JMUuj+zWPUc3DpccirI+qnewbfHh3qZ7ch/cHKjHPhL 6tsUOu28CIXyXTThFgOLK4SS/Tw95xFFwjjld7FhSWNVZTEcRdUcSP0Gd8ZqOe0qO9AJ UDQk3tLNH0rNZK1/NCsUqku0K8mpP+t+U4O2+hX3i18tsfx35mwuvqrFRpKm+djUO+bA mwr3x4Vjib1ZqOQ/kLXADQs6OGj8Mq0x8KA51qGFyGAj0y0P8aWrBSKE67dWY3e7P7Bx mY9ni+iMuNDLLhrtcfUROXpqA9wSQcuU0EwSfevzFeJeq7RFgQOUD2fPA8puE1kkHRpT GuAA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@suse.com header.s=susede1 header.b=iyD4aQR1; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=QUARANTINE sp=NONE dis=NONE) header.from=suse.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id c32si5280174jaa.44.2021.09.10.08.37.56; Fri, 10 Sep 2021 08:38:08 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@suse.com header.s=susede1 header.b=iyD4aQR1; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=QUARANTINE sp=NONE dis=NONE) header.from=suse.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S234516AbhIJPh1 (ORCPT + 99 others); Fri, 10 Sep 2021 11:37:27 -0400 Received: from smtp-out1.suse.de ([195.135.220.28]:49546 "EHLO smtp-out1.suse.de" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S232438AbhIJPhX (ORCPT ); Fri, 10 Sep 2021 11:37:23 -0400 Received: from imap1.suse-dmz.suse.de (imap1.suse-dmz.suse.de [192.168.254.73]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-521) server-digest SHA512) (No client certificate requested) by smtp-out1.suse.de (Postfix) with ESMTPS id 5204021CC0; Fri, 10 Sep 2021 15:36:11 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.com; s=susede1; t=1631288171; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ZBZRN9N1d5pyu4AdCx2wOykUXfyS79SPRhnX7ttZWoI=; b=iyD4aQR13XtpyGuJ53I7aLFdhysvYSWSxVBZgnn7ZhwG3yVUitIv/qbfIUccgDvq7+i/13 M8/VtCPWPMg6CAslB/UzZsWpp8LGEPSL8AmuhZWP0ytWUTXcyj5NMnybRWgCLZyiyIX+y8 dHBUCVW0U6qmGCL5JxUEjKUpH+qJPvM= Received: from imap1.suse-dmz.suse.de (imap1.suse-dmz.suse.de [192.168.254.73]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-521) server-digest SHA512) (No client certificate requested) by imap1.suse-dmz.suse.de (Postfix) with ESMTPS id 398B4133D0; Fri, 10 Sep 2021 15:36:11 +0000 (UTC) Received: from dovecot-director2.suse.de ([192.168.254.65]) by imap1.suse-dmz.suse.de with ESMTPSA id C413DWt7O2F3FgAAGKfGzw (envelope-from ); Fri, 10 Sep 2021 15:36:11 +0000 Date: Fri, 10 Sep 2021 17:36:09 +0200 From: Michal =?iso-8859-1?Q?Koutn=FD?= To: "brookxu.cn" Cc: Vipin Sharma , tj@kernel.org, lizefan.x@bytedance.com, hannes@cmpxchg.org, linux-kernel@vger.kernel.org, cgroups@vger.kernel.org Subject: Re: [RFC PATCH 3/3] misc_cgroup: remove error log to avoid log flood Message-ID: <20210910153609.GC24156@blackbody.suse.cz> References: <988f340462a1a3c62b7dc2c64ceb89a4c0a00552.1631077837.git.brookxu@tencent.com> <86e89df640f2b4a65dd77bdbab8152fa8e8f5bf1.1631077837.git.brookxu@tencent.com> <20210909143720.GA14709@blackbody.suse.cz> <478e986c-bc69-62b8-936e-5b075f9270b4@gmail.com> <20210910092310.GA18084@blackbody.suse.cz> <1679f995-5a6f-11b8-7870-54318db07d0d@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <1679f995-5a6f-11b8-7870-54318db07d0d@gmail.com> User-Agent: Mutt/1.10.1 (2018-07-13) Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Fri, Sep 10, 2021 at 10:29:21PM +0800, "brookxu.cn" wrote: > Through events and events.local, we can determine which node has > insufficient resources. For example, when the ‘events’ is large, we traverse > down and use events.local to determine which node has insufficient > resources. IIUC, this works in situations when the limits are set in decreasing fashion (from root down) till very (controller) leaves. That's a valid config and you're right that following 'max' events gets you to the misbehaving/underprovisioned cgroup. > 'fail' counter does not seem to provide more effective > information in this regard. When 'fail' is big, it seems that we still need > to use events and events.local to determine the node of insufficient > resources. > I am not very sure what details can we learn through 'fail' counter. If there's a limit on certain level with otherwise unconstrained cgroup structure below (a valid config too), the 'fail' counter would help determining what the affected cgroup is. Does that make sense to you? The log messages as implemented currently, aren't as useful as proposed 'fail' counter (they would need report 'cg' path, not 'i'). I see justification for 'fail' events as a replacement for the dropped log messages. Although it's not a complete replacement due to longer persistence of the log, illustrated e.g. with the short-lived containers whose cgroups/fail counts are gone). Michal