Received: by 2002:a25:8b91:0:0:0:0:0 with SMTP id j17csp2478373ybl; Thu, 9 Jan 2020 13:30:32 -0800 (PST) X-Google-Smtp-Source: APXvYqy9PO2N5yGo4Nt9uP7/UNoNhkWE4AzRWg6RlGy2gk52LqsTI1dsTu4DdpctPOJZRL83C/M2 X-Received: by 2002:aca:eb83:: with SMTP id j125mr4619919oih.153.1578605432128; Thu, 09 Jan 2020 13:30:32 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1578605432; cv=none; d=google.com; s=arc-20160816; b=d6k98iJ7YXflDqGo1IsGXe6RLQVC7nZzY0zAEhm07VeaXBOykojM1yhEolMgPA3uVO 8S0go9+p0+nTVSf0NBP47McpUYl5G3e2fabs+hmIjmBATNzy7id0Jzx8yfEWtaXRwk4q Mbm+i57hxPEoNwHxmxLiG0XHJxTzOqYOOi52zGkbbnsrIQ7lnVXB1sCFyBzK26TsMgZT g2I9BLShWBxDYBKcyYaFm2bSLdc42gnebDXmo/QX9IrWt0Ow3F2OzkzuzHqxaeaoOR4B uIVtPCq4foDq1NLIjXtWDq+2UswF//NBiifkoNn0RG09YE0y7Qnu5bljWDXHrFOZ28vL 1Pgg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-disposition:mime-version:references:message-id:subject:cc :to:from:date; bh=gB1RyhHtTQ+0s49bn15C7GeS8pX+9LNGVaVb1fuNcDI=; b=DW7S8fVZUu5imgCmBR3Eae9efuwRsH8LWWxtqNpiarnuLqCbymbY4QVt1AuvR1IrxS IHINOJbPfLiQi9Tb26PIARkepdyd1gLLSFWLsXTj9nL8DiR9dK9HeqC2Utp8n8Un9jMJ u2aIfkoRDHr16pfNy91j29M29qNXLbBa/8nYFVu9JSsuEwiuSQsm46SCskkvFMKAR6V6 B3M3Z7LYKOryUupJ39rRed5rZkV/wbFOOJvgGcRHaZlHY7ZoKHJR8e6iIT0pE2iOLbxk WCRe0CX23nC1H45gXUSzldGFXhIRRKrD2+SwvsxgXUTvDTbKL55JojwqkAzI56E6vjv/ 9f4A== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id v1si5176403otf.161.2020.01.09.13.30.20; Thu, 09 Jan 2020 13:30:32 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726380AbgAIV2O (ORCPT + 99 others); Thu, 9 Jan 2020 16:28:14 -0500 Received: from mail-wr1-f41.google.com ([209.85.221.41]:35680 "EHLO mail-wr1-f41.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1725763AbgAIV2O (ORCPT ); Thu, 9 Jan 2020 16:28:14 -0500 Received: by mail-wr1-f41.google.com with SMTP id g17so9003129wro.2 for ; Thu, 09 Jan 2020 13:28:13 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=gB1RyhHtTQ+0s49bn15C7GeS8pX+9LNGVaVb1fuNcDI=; b=ltTqTJ2ga31fvB4Rmlw1tLP+UwDfe33U1U0vCua8WSOme48ZKf37l0vqRP2abw4S6l 3sQ/q7DFA6lU+WHd1X+diLsIIhyEe5Pn3tuRqSMcI0BbpR7ieQz3wcaZvKpTyVUvjhTg VBL48pQiitpShc2bsmNswbna7S3uKFYC+sx4wuJ60WZqF4gZt5PNhwYWL6RCnNXotdbG boguOaI56IhRhtNhwdfjSBO8kUi29BvhtNqRigpzWB54MOxUwvUhvz28JzYNqo4v6O1D yvMbELx7q7kcIBdzfEzBNkc+XSMKpmf+so2yL0Qx/eyiqwCLZTqY4s0xJAKeno1iw2Df zhEQ== X-Gm-Message-State: APjAAAV7nsSfYzYQFE6/VGqe37/tuaA4bxtPwezrUW4koLhyUP5dd8JC qEfKruXmaE4O1IOPaUXiiOOuEgZx X-Received: by 2002:a5d:4392:: with SMTP id i18mr13654938wrq.199.1578605292416; Thu, 09 Jan 2020 13:28:12 -0800 (PST) Received: from localhost (ip-37-188-146-105.eurotel.cz. [37.188.146.105]) by smtp.gmail.com with ESMTPSA id z4sm4225820wma.2.2020.01.09.13.28.11 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 09 Jan 2020 13:28:11 -0800 (PST) Date: Thu, 9 Jan 2020 22:28:10 +0100 From: Michal Hocko To: Pavel Machek Cc: kernel list , Andrew Morton , linux-mm@kvack.org, akpm@linux-foundation.org Subject: Re: OOM killer not nearly agressive enough? Message-ID: <20200109212810.GB23620@dhcp22.suse.cz> References: <20200107204412.GA29562@amd> <20200109115633.GR4951@dhcp22.suse.cz> <20200109210535.GB1553@duo.ucw.cz> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20200109210535.GB1553@duo.ucw.cz> User-Agent: Mutt/1.12.2 (2019-09-21) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu 09-01-20 22:05:36, Pavel Machek wrote: > On Thu 2020-01-09 12:56:33, Michal Hocko wrote: > > On Tue 07-01-20 21:44:12, Pavel Machek wrote: > > > Hi! > > > > > > I updated my userspace to x86-64, and now chromium likes to eat all > > > the memory and bring the system to standstill. > > > > > > Unfortunately, OOM killer does not react: > > > > > > I'm now running "ps aux", and it prints one line every 20 seconds or > > > more. Do we agree that is "unusable" system? I attempted to do kill > > > from other session. > > > > Does sysrq+f help? > > > > > Do we agree that OOM killer should have reacted way sooner? > > > > This is impossible to answer without knowing what was going on at the > > time. Was the system threshing over page cache/swap? In other words, is > > the system completely out of memory or refaulting the working set all > > the time because it doesn't fit into memory? > > What statistics are best to collect? Would the memory lines from top > do the trick? I normally have gkrellm running, but I found its results > hard to interpret. /proc/vmstat (and collecting it periodically) gives the most comprehensive picture about the state of MM. Interpreting numbers is far from trivial though. It requires to analyze multiple snapshots usually to see how the situation evolves. -- Michal Hocko SUSE Labs