Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1756871Ab3H3N0v (ORCPT ); Fri, 30 Aug 2013 09:26:51 -0400 Received: from e31.co.us.ibm.com ([32.97.110.149]:35507 "EHLO e31.co.us.ibm.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1756857Ab3H3N0s (ORCPT ); Fri, 30 Aug 2013 09:26:48 -0400 From: "Srivatsa S. Bhat" Subject: [RFC PATCH v3 27/35] mm: Connect Page Allocator(PA) to Region Allocator(RA); add PA => RA flow To: akpm@linux-foundation.org, mgorman@suse.de, hannes@cmpxchg.org, tony.luck@intel.com, matthew.garrett@nebula.com, dave@sr71.net, riel@redhat.com, arjan@linux.intel.com, srinivas.pandruvada@linux.intel.com, willy@linux.intel.com, kamezawa.hiroyu@jp.fujitsu.com, lenb@kernel.org, rjw@sisk.pl Cc: gargankita@gmail.com, paulmck@linux.vnet.ibm.com, svaidy@linux.vnet.ibm.com, andi@firstfloor.org, isimatu.yasuaki@jp.fujitsu.com, santosh.shilimkar@ti.com, kosaki.motohiro@gmail.com, srivatsa.bhat@linux.vnet.ibm.com, linux-pm@vger.kernel.org, linux-mm@kvack.org, linux-kernel@vger.kernel.org Date: Fri, 30 Aug 2013 18:52:36 +0530 Message-ID: <20130830132232.4947.42185.stgit@srivatsabhat.in.ibm.com> In-Reply-To: <20130830131221.4947.99764.stgit@srivatsabhat.in.ibm.com> References: <20130830131221.4947.99764.stgit@srivatsabhat.in.ibm.com> User-Agent: StGIT/0.14.3 MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit X-TM-AS-MML: No X-Content-Scanned: Fidelis XPS MAILER x-cbid: 13083013-8236-0000-0000-000001461CA9 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 3326 Lines: 102 Now that we have built up an infrastructure that forms a "Memory Region Allocator", connect it with the page allocator. To entities requesting memory, the page allocator will function as a front-end, whereas the region allocator will act as a back-end to the page allocator. (Analogy: page allocator is like free cash, whereas region allocator is like a bank). Implement the flow of freepages from the page allocator to the region allocator. When the buddy freelists notice that they have all the freepages forming a memory region, they give it back to the region allocator. Simplification: We assume that the freepages of a memory region can be completely represented by a set of MAX_ORDER-1 pages. That is, we only need to consider the buddy freelists corresponding to MAX_ORDER-1, while interacting with the region allocator. Furthermore, we assume that pageblock_order == MAX_ORDER-1. (These assumptions are used to ease the implementation, so that one can quickly evaluate the benefits of the overall design without getting bogged down by too many corner cases and constraints. Of course future implementations will handle more scenarios and will have reduced dependence on such simplifying assumptions.) Signed-off-by: Srivatsa S. Bhat --- mm/page_alloc.c | 42 +++++++++++++++++++++++++++++++++++++++++- 1 file changed, 41 insertions(+), 1 deletion(-) diff --git a/mm/page_alloc.c b/mm/page_alloc.c index 9be946e..b8af5a2 100644 --- a/mm/page_alloc.c +++ b/mm/page_alloc.c @@ -634,6 +634,37 @@ out: return prev_region_id; } + +static void add_to_region_allocator(struct zone *z, struct free_list *free_list, + int region_id); + + +static inline int can_return_region(struct mem_region_list *region, int order) +{ + struct zone_mem_region *zone_region; + + zone_region = region->zone_region; + + if (likely(zone_region->nr_free != zone_region->present_pages)) + return 0; + + /* + * Don't release freepages to the region allocator if some other + * buddy pages can potentially merge with our freepages to form + * higher order pages. + * + * Hack: Don't return the region unless all the freepages are of + * order MAX_ORDER-1. + */ + if (likely(order != MAX_ORDER-1)) + return 0; + + if (region->nr_free * (1 << order) == zone_region->nr_free) + return 1; + + return 0; +} + static void add_to_freelist(struct page *page, struct free_list *free_list, int order) { @@ -650,7 +681,7 @@ static void add_to_freelist(struct page *page, struct free_list *free_list, if (region->page_block) { list_add_tail(lru, region->page_block); - return; + goto try_return_region; } #ifdef CONFIG_DEBUG_PAGEALLOC @@ -690,6 +721,15 @@ out: /* Save pointer to page block of this region */ region->page_block = lru; set_region_bit(region_id, free_list); + +try_return_region: + + /* + * Try to return the freepages of a memory region to the region + * allocator, if possible. + */ + if (can_return_region(region, order)) + add_to_region_allocator(page_zone(page), free_list, region_id); } /* -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/