Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1753655Ab2KYWp0 (ORCPT ); Sun, 25 Nov 2012 17:45:26 -0500 Received: from zene.cmpxchg.org ([85.214.230.12]:35009 "EHLO zene.cmpxchg.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1753597Ab2KYWpZ (ORCPT ); Sun, 25 Nov 2012 17:45:25 -0500 Date: Sun, 25 Nov 2012 17:44:33 -0500 From: Johannes Weiner To: Rik van Riel Cc: Johannes Hirte , akpm@linux-foundation.org, mgorman@suse.de, Valdis.Kletnieks@vt.edu, jirislaby@gmail.com, jslaby@suse.cz, zkabelac@redhat.com, mm-commits@vger.kernel.org, linux-mm@kvack.org, linux-kernel@vger.kernel.org, torvalds@linux-foundation.org Subject: Re: [PATCH] mm,vmscan: free pages if compaction_suitable tells us to Message-ID: <20121125224433.GB2799@cmpxchg.org> References: <20121119202152.4B0E420004E@hpza10.eem.corp.google.com> <20121125175728.3db4ac6a@fem.tu-ilmenau.de> <20121125132950.11b15e38@annuminas.surriel.com> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20121125132950.11b15e38@annuminas.surriel.com> Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 2739 Lines: 59 On Sun, Nov 25, 2012 at 01:29:50PM -0500, Rik van Riel wrote: > On Sun, 25 Nov 2012 17:57:28 +0100 > Johannes Hirte wrote: > > > With kernel 3.7-rc6 I've still problems with kswapd0 on my laptop > > > And this is most of the time. I've only observed this behavior on the > > laptop. Other systems don't show this. > > This suggests it may have something to do with small memory zones, > where we end up with the "funny" situation that the high watermark > (+ balance gap) for a particular zone is less than the low watermark > + 2< compaction_suitable happy. > > Could you try this patch? It's not quite enough because it's not reaching the conditions you changed, see analysis in https://lkml.org/lkml/2012/11/20/567 But even fixing it up (by adding the compaction_suitable() test in this preliminary scan over the zones and setting end_zone accordingly) is not enough because no actual reclaim happens at priority 12 in a small zone. So the number of free pages is not actually changing and the compaction_suitable() checks keep the loop going. The problem is fairly easy to reproduce, by the way. Just boot with mem=800M to have a relatively small lowmem reserve in the DMA zone. Fill it up with page cache, then allocate transparent huge pages. With your patch and my fix to the preliminary zone loop, there won't be any hung task warnings anymore because kswapd actually calls shrink_slab() and there is a rescheduling point in there, but it still loops forever. It also seems a bit aggressive to try to balance a small zone like DMA for a huge page when it's not a GFP_DMA allocation, but none of these checks actually take the classzone into account. Do we have any agreement over what this whole thing is supposed to be doing? diff --git a/mm/vmscan.c b/mm/vmscan.c index b99ecba..f7e54df 100644 --- a/mm/vmscan.c +++ b/mm/vmscan.c @@ -2412,6 +2412,9 @@ static void age_active_anon(struct zone *zone, struct scan_control *sc) * would need to be at least 256M for it to be balance a whole node. * Similarly, on x86-64 the Normal zone would need to be at least 1G * to balance a node on its own. These seemed like reasonable ratios. + * + * The kswapd source code is brought to you by Advil?. "For today's + * tough pain, one might not be enough." */ static bool pgdat_balanced(pg_data_t *pgdat, unsigned long balanced_pages, int classzone_idx) -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/