Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S262485AbUCHNil (ORCPT ); Mon, 8 Mar 2004 08:38:41 -0500 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S262488AbUCHNil (ORCPT ); Mon, 8 Mar 2004 08:38:41 -0500 Received: from mtagate3.de.ibm.com ([195.212.29.152]:50862 "EHLO mtagate3.de.ibm.com") by vger.kernel.org with ESMTP id S262485AbUCHNih (ORCPT ); Mon, 8 Mar 2004 08:38:37 -0500 Subject: Re: blk_congestion_wait racy? To: Andrew Morton Cc: linux-kernel@vger.kernel.org, linux-mm@kvack.org X-Mailer: Lotus Notes Release 5.0.11 July 24, 2002 Message-ID: From: Martin Schwidefsky Date: Mon, 8 Mar 2004 14:38:16 +0100 X-MIMETrack: Serialize by Router on D12ML062/12/M/IBM(Release 6.0.2CF2|July 23, 2003) at 08/03/2004 14:38:18 MIME-Version: 1.0 Content-type: text/plain; charset=US-ASCII Sender: linux-kernel-owner@vger.kernel.org X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 3098 Lines: 116 > Gad, that'll make the VM scan its guts out. Yes, I expected something like this. > > 2.6.4-rc2 + "fix" with 1 cpu > > sys 0m0.880s > > > > 2.6.4-rc2 + "fix" with 2 cpu > > sys 0m1.560s > > system time was doubled though. That would be the additional cost for not waiting. > Nope, something is obviously broken. I'll take a look. That would be very much appreciated. > Perhaps with two CPUs you are able to get kswapd and mempig running page > reclaim at the same time, which causes seekier swap I/O patterns than with > one CPU, where we only run one app or the other at any time. > > Serialising balance_pgdat() and try_to_free_pages() with a global semaphore > would be a way of testing that theory. Just tried the following patch: Index: mm/vmscan.c =================================================================== RCS file: /home/cvs/linux-2.5/mm/vmscan.c,v retrieving revision 1.45 diff -u -r1.45 vmscan.c --- mm/vmscan.c 18 Feb 2004 17:45:28 -0000 1.45 +++ mm/vmscan.c 8 Mar 2004 13:30:56 -0000 @@ -848,6 +848,7 @@ * excessive rotation of the inactive list, which is _supposed_ to be an LRU, * yes? */ +static DECLARE_MUTEX(reclaim_sem); int try_to_free_pages(struct zone **zones, unsigned int gfp_mask, unsigned int order) { @@ -858,6 +859,8 @@ struct reclaim_state *reclaim_state = current->reclaim_state; int i; + down(&reclaim_sem); + inc_page_state(allocstall); for (i = 0; zones[i] != 0; i++) @@ -884,7 +887,10 @@ wakeup_bdflush(total_scanned); /* Take a nap, wait for some writeback to complete */ + up(&reclaim_sem); blk_congestion_wait(WRITE, HZ/10); + down(&reclaim_sem); + if (zones[0] - zones[0]->zone_pgdat->node_zones < ZONE_HIGHMEM) { shrink_slab(total_scanned, gfp_mask); if (reclaim_state) { @@ -898,6 +904,9 @@ out: for (i = 0; zones[i] != 0; i++) zones[i]->prev_priority = zones[i]->temp_priority; + + up(&reclaim_sem); + return ret; } @@ -926,6 +935,8 @@ int i; struct reclaim_state *reclaim_state = current->reclaim_state; + down(&reclaim_sem); + inc_page_state(pageoutrun); for (i = 0; i < pgdat->nr_zones; i++) { @@ -974,8 +985,11 @@ } if (all_zones_ok) break; - if (to_free > 0) + if (to_free > 0) { + up(&reclaim_sem); blk_congestion_wait(WRITE, HZ/10); + down(&reclaim_sem); + } } for (i = 0; i < pgdat->nr_zones; i++) { @@ -983,6 +997,9 @@ zone->prev_priority = zone->temp_priority; } + + up(&reclaim_sem); + return nr_pages - to_free; } It didn't help. Still needs almost a minute. blue skies, Martin - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/