Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1755976AbaBFSsr (ORCPT ); Thu, 6 Feb 2014 13:48:47 -0500 Received: from cantor2.suse.de ([195.135.220.15]:49399 "EHLO mx2.suse.de" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752015AbaBFSsq (ORCPT ); Thu, 6 Feb 2014 13:48:46 -0500 Message-ID: <52F3D912.4020607@suse.cz> Date: Thu, 06 Feb 2014 19:48:50 +0100 From: Vlastimil Babka User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.3.0 MIME-Version: 1.0 To: David Rientjes , Andrew Morton CC: Joonsoo Kim , Hugh Dickins , Mel Gorman , Rik van Riel , linux-kernel@vger.kernel.org, linux-mm@kvack.org Subject: Re: [patch v2] mm, compaction: avoid isolating pinned pages References: <20140203095329.GH6732@suse.de> <20140204000237.GA17331@lge.com> <20140204015332.GA14779@lge.com> <20140204021533.GA14924@lge.com> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 5.2.2014 3:44, David Rientjes wrote: > Page migration will fail for memory that is pinned in memory with, for > example, get_user_pages(). In this case, it is unnecessary to take > zone->lru_lock or isolating the page and passing it to page migration > which will ultimately fail. > > This is a racy check, the page can still change from under us, but in > that case we'll just fail later when attempting to move the page. > > This avoids very expensive memory compaction when faulting transparent > hugepages after pinning a lot of memory with a Mellanox driver. > > On a 128GB machine and pinning ~120GB of memory, before this patch we > see the enormous disparity in the number of page migration failures > because of the pinning (from /proc/vmstat): > > compact_pages_moved 8450 > compact_pagemigrate_failed 15614415 > > 0.05% of pages isolated are successfully migrated and explicitly > triggering memory compaction takes 102 seconds. After the patch: > > compact_pages_moved 9197 > compact_pagemigrate_failed 7 > > 99.9% of pages isolated are now successfully migrated in this > configuration and memory compaction takes less than one second. > > Signed-off-by: David Rientjes > --- > v2: address page count issue per Joonsoo > > mm/compaction.c | 9 +++++++++ > 1 file changed, 9 insertions(+) > > diff --git a/mm/compaction.c b/mm/compaction.c > --- a/mm/compaction.c > +++ b/mm/compaction.c > @@ -578,6 +578,15 @@ isolate_migratepages_range(struct zone *zone, struct compact_control *cc, > continue; > } > > + /* > + * Migration will fail if an anonymous page is pinned in memory, > + * so avoid taking lru_lock and isolating it unnecessarily in an > + * admittedly racy check. > + */ > + if (!page_mapping(page) && > + page_count(page) > page_mapcount(page)) > + continue; > + Hm this page_count() seems it could substantially increase the chance of race with prep_compound_page that your patch "mm, page_alloc: make first_page visible before PageTail" tries to fix :) > /* Check if it is ok to still hold the lock */ > locked = compact_checklock_irqsave(&zone->lru_lock, &flags, > locked, cc); > > -- > To unsubscribe, send a message with 'unsubscribe linux-mm' in > the body to majordomo@kvack.org. For more info on Linux MM, > see: http://www.linux-mm.org/ . > Don't email: email@kvack.org -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/