Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1755816AbaFKQOf (ORCPT ); Wed, 11 Jun 2014 12:14:35 -0400 Received: from mail-we0-f177.google.com ([74.125.82.177]:36200 "EHLO mail-we0-f177.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751683AbaFKQOe (ORCPT ); Wed, 11 Jun 2014 12:14:34 -0400 Date: Wed, 11 Jun 2014 18:14:25 +0200 From: Michal Hocko To: Johannes Weiner Cc: Greg Thelen , Hugh Dickins , Andrew Morton , KAMEZAWA Hiroyuki , KOSAKI Motohiro , Michel Lespinasse , Tejun Heo , Roman Gushchin , linux-mm@kvack.org, LKML Subject: Re: [PATCH 1/2] mm, memcg: allow OOM if no memcg is eligible during direct reclaim Message-ID: <20140611161425.GC23343@dhcp22.suse.cz> References: <20140611075729.GA4520@dhcp22.suse.cz> <1402473624-13827-1-git-send-email-mhocko@suse.cz> <20140611152030.GB22516@cmpxchg.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20140611152030.GB22516@cmpxchg.org> User-Agent: Mutt/1.5.23 (2014-03-12) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Wed 11-06-14 11:20:30, Johannes Weiner wrote: > On Wed, Jun 11, 2014 at 10:00:23AM +0200, Michal Hocko wrote: > > If there is no memcg eligible for reclaim because all groups under the > > reclaimed hierarchy are within their guarantee then the global direct > > reclaim would end up in the endless loop because zones in the zonelists > > are not considered unreclaimable (as per all_unreclaimable) and so the > > OOM killer would never fire and direct reclaim would be triggered > > without no chance to reclaim anything. > > > > This is not possible yet because reclaim falls back to ignore low_limit > > when nobody is eligible for reclaim. Following patch will allow to set > > the fallback mode to hard guarantee, though, so this is a preparatory > > patch. > > > > Memcg reclaim doesn't suffer from this because the OOM killer is > > triggered after few unsuccessful attempts of the reclaim. > > > > Fix this by checking the number of scanned pages which is obviously 0 if > > nobody is eligible and also check that the whole tree hierarchy is not > > eligible and tell OOM it can go ahead. > > > > Signed-off-by: Michal Hocko > > --- > > mm/vmscan.c | 7 +++++++ > > 1 file changed, 7 insertions(+) > > > > diff --git a/mm/vmscan.c b/mm/vmscan.c > > index 8041b0667673..99137aecd95f 100644 > > --- a/mm/vmscan.c > > +++ b/mm/vmscan.c > > @@ -2570,6 +2570,13 @@ out: > > if (aborted_reclaim) > > return 1; > > > > + /* > > + * If the target memcg is not eligible for reclaim then we have no option > > + * but OOM > > + */ > > + if (!sc->nr_scanned && mem_cgroup_all_within_guarantee(sc->target_mem_cgroup)) > > + return 0; > > We can't just sprinkle `for each memcg in hierarchy` loops like this, > they can get really expensive. Yeah, I know. This one gets called only when nothing was scanned which shoudln't happen without the hard guarantee. And as said in other email we can optimize mem_cgroup_all_within_guarantee to skip all subtrees that are within their guarantee. > It's pretty stupid to not have a return value on shrink_zone(), which > could easily indicate whether a zone was reclaimable, and instead have > another iteration over the same zonelist and the same memcg hierarchy > afterwards to figure out if shrink_zone() was successful or not. I know it is stupid but this is the easiest way right now. We can/should refactor shrink_zones to forward that information. I was playing with sticking that infortmation into scan_control but that was even uglier. -- Michal Hocko SUSE Labs -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/