Received: by 2002:ac0:a5a6:0:0:0:0:0 with SMTP id m35-v6csp7562057imm; Tue, 28 Aug 2018 14:32:39 -0700 (PDT) X-Google-Smtp-Source: ANB0VdZoqV2i0ollaXiZy7t9QjY2mGu4gdzYGH9V/3fgVFl/IflEj2AHNa50lKSFZhfrPA1XT4/+ X-Received: by 2002:a62:cfc6:: with SMTP id b189-v6mr3172230pfg.224.1535491959715; Tue, 28 Aug 2018 14:32:39 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1535491959; cv=none; d=google.com; s=arc-20160816; b=E4txx4dculV83c2ssaGqZepdiynEpqHVfYhToSd8GS2RGobPk4XwIo+64qQ8g5IZ9l CdWXZasqb1ElgD/lGBLRLp+YAUU7q7GsGiSfyOH2QR7Z6KchupqU7UKvcex8yP4k5VTB zrIZARGkheTf7DxmyJUsPZGQu9fkelWeuEdpDvh+a974JvI1tzvZKcsmH2+sTA3DS/gb pzDQwCfPjCxdX4HSLEWufm6HgdGIrlysopFsKtHQZESCqCWrueGVOxUwhX9Sk82Ogfz7 OlEEaL7bclp828hTiMcCKkvp4i8wOvZYz1kW2V/LV5czGWc67AIKQyNv/PoRKyH5CSmy iLvQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:from:references:cc:to:subject:dkim-signature :arc-authentication-results; bh=2oozRIhTdlGdOAU31T3EpY+oY+ftJ81J4AUJbdF4rPM=; b=LaLq0PEU6B/LkW9rcFHNiTPauPdSbv0+vMwQYLuYN+nPd6TxUEF7GSD7N3p/fIP461 tirazo3OXT9dT2AuIs2x1w9zTCHD2FynKRSOsagq9RxLcHhQJli/vt6ww1WIVrw8mMGn iSStp+/B1wNR0tqlnYajDpjqPeh+GTkGR0nnQcJKQ5mKk6VMHCEDeuYQ1XXbsy+0WIKX 0tpTMOP4REyTvn1khgfTE8dMwlth3l8VfvwxMidEknOc2FbBoT/nvCxDfQH5VaXmUzh/ ZzO5AMV/i5rFbRZ4jEaI5nITEf8MXmAU6i3wwfdVJ8oWWROzoFWE1BzGI6LL43hC6/wA UdmA== ARC-Authentication-Results: i=1; mx.google.com; dkim=fail header.i=@infradead.org header.s=merlin.20170209 header.b=E1FZCN+W; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id d34-v6si2028163pla.195.2018.08.28.14.32.22; Tue, 28 Aug 2018 14:32:39 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=fail header.i=@infradead.org header.s=merlin.20170209 header.b=E1FZCN+W; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727474AbeH2BYC (ORCPT + 99 others); Tue, 28 Aug 2018 21:24:02 -0400 Received: from merlin.infradead.org ([205.233.59.134]:47016 "EHLO merlin.infradead.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726998AbeH2BYC (ORCPT ); Tue, 28 Aug 2018 21:24:02 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=merlin.20170209; h=Content-Transfer-Encoding:Content-Type: In-Reply-To:MIME-Version:Date:Message-ID:From:References:Cc:To:Subject:Sender :Reply-To:Content-ID:Content-Description:Resent-Date:Resent-From: Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help: List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive; bh=2oozRIhTdlGdOAU31T3EpY+oY+ftJ81J4AUJbdF4rPM=; b=E1FZCN+WEVHEmMHoKx+objzW+4 fPrmCzkbFpKOaCs1FxZzHbnRSDDyKUh+bxQ4ggrZYp+TeSJwIqkp05rC1BHSqufQxk4xG6knIUbJg B0tLp2EPoHS9K5hDuNCAxgnq/jmOpXpWRVSflzGC+9DfedOevY82dgssqePUoD+OvTR/8DWjqn/M5 fotJhOC4Z9qjxxOSIZY6KVcSFPQ4WGcGyCTAbnAodjKwIzSXS4gONjG+CWqRbYjG9BT3iz+l521zx jFooFK2/g2hS1P1U5m+Dk88OINcxfiFAaoDxKGIs7+Y22uwPhanHEdbbNvNdRN3DzN9rv4B0mMIb8 y40EqvTQ==; Received: from static-50-53-52-16.bvtn.or.frontiernet.net ([50.53.52.16] helo=midway.dunlab) by merlin.infradead.org with esmtpsa (Exim 4.90_1 #2 (Red Hat Linux)) id 1fulZ6-0005Ay-3U; Tue, 28 Aug 2018 21:30:20 +0000 Subject: Re: [PATCH 8/9] psi: pressure stall information for CPU, memory, and IO To: Johannes Weiner Cc: Ingo Molnar , Peter Zijlstra , Andrew Morton , Linus Torvalds , Tejun Heo , Suren Baghdasaryan , Daniel Drake , Vinayak Menon , Christopher Lameter , Peter Enderborg , Shakeel Butt , Mike Galbraith , linux-mm@kvack.org, cgroups@vger.kernel.org, linux-kernel@vger.kernel.org, kernel-team@fb.com References: <20180828172258.3185-1-hannes@cmpxchg.org> <20180828172258.3185-9-hannes@cmpxchg.org> <6ff71c29-3b6a-4849-6f2a-3d829bbd43e2@infradead.org> <20180828205625.GA14030@cmpxchg.org> From: Randy Dunlap Message-ID: Date: Tue, 28 Aug 2018 14:30:17 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.9.1 MIME-Version: 1.0 In-Reply-To: <20180828205625.GA14030@cmpxchg.org> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 08/28/2018 01:56 PM, Johannes Weiner wrote: > On Tue, Aug 28, 2018 at 01:11:11PM -0700, Randy Dunlap wrote: >> On 08/28/2018 10:22 AM, Johannes Weiner wrote: >>> diff --git a/Documentation/accounting/psi.txt b/Documentation/accounting/psi.txt >>> new file mode 100644 >>> index 000000000000..51e7ef14142e >>> --- /dev/null >>> +++ b/Documentation/accounting/psi.txt >>> @@ -0,0 +1,64 @@ >>> +================================ >>> +PSI - Pressure Stall Information >>> +================================ >>> + >>> +:Date: April, 2018 >>> +:Author: Johannes Weiner >>> + >>> +When CPU, memory or IO devices are contended, workloads experience >>> +latency spikes, throughput losses, and run the risk of OOM kills. >>> + >>> +Without an accurate measure of such contention, users are forced to >>> +either play it safe and under-utilize their hardware resources, or >>> +roll the dice and frequently suffer the disruptions resulting from >>> +excessive overcommit. >>> + >>> +The psi feature identifies and quantifies the disruptions caused by >>> +such resource crunches and the time impact it has on complex workloads >>> +or even entire systems. >>> + >>> +Having an accurate measure of productivity losses caused by resource >>> +scarcity aids users in sizing workloads to hardware--or provisioning >>> +hardware according to workload demand. >>> + >>> +As psi aggregates this information in realtime, systems can be managed >>> +dynamically using techniques such as load shedding, migrating jobs to >>> +other systems or data centers, or strategically pausing or killing low >>> +priority or restartable batch jobs. >>> + >>> +This allows maximizing hardware utilization without sacrificing >>> +workload health or risking major disruptions such as OOM kills. >>> + >>> +Pressure interface >>> +================== >>> + >>> +Pressure information for each resource is exported through the >>> +respective file in /proc/pressure/ -- cpu, memory, and io. >>> + >> >> Hi, >> >>> +In both cases, the format for CPU is as such: >> >> I don't see what "In both cases" refers to here. It seems that you could >> just remove it. > > You're right, that must be a left-over from when I described CPU > separately; "both cases" referred to memory and IO which have > identical formats. It needs to be removed: > > diff --git a/Documentation/accounting/psi.txt b/Documentation/accounting/psi.txt > index e051810d5127..b8ca28b60215 100644 > --- a/Documentation/accounting/psi.txt > +++ b/Documentation/accounting/psi.txt > @@ -35,7 +35,7 @@ Pressure interface > Pressure information for each resource is exported through the > respective file in /proc/pressure/ -- cpu, memory, and io. > > -In both cases, the format for CPU is as such: > +The format for CPU is as such: > > some avg10=0.00 avg60=0.00 avg300=0.00 total=0 OK. However, after reading patch 9/9, I thought that the "both cases" could possibly mean the files in /proc/pressure/ and the files in cgroup ({cpu,io,memory}.pressure). -- ~Randy