Received: by 2002:a05:6a10:206:0:0:0:0 with SMTP id 6csp3844526pxj; Mon, 7 Jun 2021 23:24:00 -0700 (PDT) X-Google-Smtp-Source: ABdhPJxIdTYTEB+XFNh6yHVdBsLr+AJJv3p3DSNGHreevVQ3lOXE63UFxoPOZ3XTLqNVBahCNQBy X-Received: by 2002:aa7:d0cc:: with SMTP id u12mr20052432edo.48.1623133440750; Mon, 07 Jun 2021 23:24:00 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1623133440; cv=none; d=google.com; s=arc-20160816; b=HXen10XechIUC1S4qt5isdd4drRNPaM5maETgTLcSkthcl2draMXNTN1uvJ1MQx8qR 3N2nFRunc7PoUXZQR2ux2+r9X1J7nC7gLaYqiH9sMPtgIg1LJJH3USqBqfFnCUUxajxe fQOQT2J6JXaT7dRF1rDSUq6/o35znebfgRy4Q/ZhCcu8czHLgo64HqdojXJcSIteNiuq LD7FKHOWAC/inoasZ3FIY1ybrN7+0FUkNv1A4uTHtVKu3YzZEwRP+k+2rs+MRcBccV6j CjBSYN+rfSU6k1N40w3Rz8N2kS4sjOBFBJgVfXzxIe8qq0q8zv37pMJ8ZTBDlNL4r5Gk oqTQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:in-reply-to:content-transfer-encoding :content-disposition:mime-version:references:message-id:subject:cc :to:from:date:dkim-signature; bh=CWL1Gz39Uw1KoSvMRXLcselM6zrWtKZ54uDLZ9izpbQ=; b=0++V65rxc649U0c8el9Ysg4zulYMZVQyK2Pjlg+gYOi+fvBMexKxwlXLdcdGosUHLW Ag1IIY74ZeY5LCZYQaFd4I95xujAZrYv67iPzZJPDekXMxue1eHbkdza4WCdB3kAR1Hs mJjXuKyyJEfV0XijuYyD/LI7VmLu+QckM+3nre2mcXTw/J9AhzcH9d6CojtwpGdNd4Nd pffibfd+cCGAs+3WeCB/Uemvi2youqsinxkp4tBvPrgYsidX7AaYEddc+rtwn7E9xgf+ AcO5EEdw0M97ey8HGFsFeOGS1oNr/LHG1CKEm7pg5TPy+idCE7wE5DbQEVHlCxb4SPqm 9aCA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@suse.com header.s=susede1 header.b=teAIJFPw; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=QUARANTINE sp=NONE dis=NONE) header.from=suse.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id e17si14610390edq.196.2021.06.07.23.23.36; Mon, 07 Jun 2021 23:24:00 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@suse.com header.s=susede1 header.b=teAIJFPw; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=QUARANTINE sp=NONE dis=NONE) header.from=suse.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229937AbhFHGYB (ORCPT + 99 others); Tue, 8 Jun 2021 02:24:01 -0400 Received: from smtp-out2.suse.de ([195.135.220.29]:39548 "EHLO smtp-out2.suse.de" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229507AbhFHGX7 (ORCPT ); Tue, 8 Jun 2021 02:23:59 -0400 Received: from relay2.suse.de (relay2.suse.de [149.44.160.134]) by smtp-out2.suse.de (Postfix) with ESMTP id 8BB0C1FD50; Tue, 8 Jun 2021 06:22:06 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.com; s=susede1; t=1623133326; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=CWL1Gz39Uw1KoSvMRXLcselM6zrWtKZ54uDLZ9izpbQ=; b=teAIJFPwBLRe3GGABgRQ7cFx5SAUbjeMxuLJFBEBpkVrqeHbORDErk0pNL+4q3HgBSIm/g L0OxVxk74iqXL/gOdIWMAi2rqGgBuGaAHKTjZlBHYU0lEP5JFoj6eY3ir7rEp82x5MjX7j YrjpwvpZMnPdjT2WxHgYaKudsq1i05w= Received: from suse.cz (unknown [10.100.201.86]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by relay2.suse.de (Postfix) with ESMTPS id 4EDA9A3B8B; Tue, 8 Jun 2021 06:22:06 +0000 (UTC) Date: Tue, 8 Jun 2021 08:22:05 +0200 From: Michal Hocko To: Waiman Long Cc: Shakeel Butt , Aaron Tomlin , Linux MM , Andrew Morton , Vlastimil Babka , LKML Subject: Re: [RFC PATCH] mm/oom_kill: allow oom kill allocating task for non-global case Message-ID: References: <20210607163103.632681-1-atomlin@redhat.com> <6d23ce58-4c4b-116a-6d74-c2cf4947492b@redhat.com> <353d012f-e8d4-c54c-b33e-54737e1a0115@redhat.com> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <353d012f-e8d4-c54c-b33e-54737e1a0115@redhat.com> Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Mon 07-06-21 16:44:09, Waiman Long wrote: > On 6/7/21 4:03 PM, Michal Hocko wrote: > > On Mon 07-06-21 21:36:47, Michal Hocko wrote: > > > On Mon 07-06-21 15:18:38, Waiman Long wrote: > > [...] > > > > A partial OOM report below: > > > Do you happen to have the full report? > > > > > > > [ 8221.433608] memory: usage 21280kB, limit 204800kB, failcnt 49116 > > > > ? : > > > > [ 8227.239769] [ pid ]?? uid? tgid total_vm????? rss pgtables_bytes swapents oom_score_adj name > > > > [ 8227.242495] [1611298]???? 0 1611298??? 35869????? 635 167936??????? 0???????? -1000 conmon > > > > [ 8227.242518] [1702509]???? 0 1702509??? 35869????? 701 176128??????? 0???????? -1000 conmon > > > > [ 8227.242522] [1703345] 1001050000 1703294?? 183440??????? 0 2125824??????? 0?????????? 999 node > > > > [ 8227.242706] Out of memory and no killable processes... > > > > [ 8227.242731] node invoked oom-killer: gfp_mask=0x6000c0(GFP_KERNEL), nodemask=(null), order=0, oom_score_adj=999 > > Btw it is surprising to not see _GFP_ACCOUNT here. > > There are a number of OOM kills in the kernel log and none of the tasks that > invoke oom-killer has _GFP_ACCOUNT flag set. OK. A full report (including the backtrace) would tell us more what is the source of the charge. I thought that most #PF charging paths use the same gfp mask as the allocation (which would include other flags on top of GFP_KERNEL) but it seems we just use GFP_KERNEL at many places. There are also some direct callers of the charging API for kernel allocations. Not that this would be super important but it caught my attention. You are saying that there are other OOM kills going on. Are they all for the same memcg? Is it possible the only eligible task has been killed and oom reaped already? -- Michal Hocko SUSE Labs