Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S932191AbaGDHxD (ORCPT ); Fri, 4 Jul 2014 03:53:03 -0400 Received: from lgeamrelo01.lge.com ([156.147.1.125]:43395 "EHLO lgeamrelo01.lge.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1753434AbaGDHxA (ORCPT ); Fri, 4 Jul 2014 03:53:00 -0400 X-Original-SENDERIP: 10.177.220.145 X-Original-MAILFROM: iamjoonsoo.kim@lge.com From: Joonsoo Kim To: Andrew Morton Cc: "Kirill A. Shutemov" , Rik van Riel , Peter Zijlstra , Mel Gorman , Johannes Weiner , Minchan Kim , Yasuaki Ishimatsu , Zhang Yanfei , "Srivatsa S. Bhat" , Tang Chen , Naoya Horiguchi , Bartlomiej Zolnierkiewicz , Wen Congyang , Marek Szyprowski , Michal Nazarewicz , Laura Abbott , Heesub Shin , "Aneesh Kumar K.V" , Ritesh Harjani , t.stanislaws@samsung.com, Gioh Kim , linux-mm@kvack.org, linux-kernel@vger.kernel.org, Joonsoo Kim Subject: [PATCH 06/10] mm/page_alloc: separate freepage migratetype interface Date: Fri, 4 Jul 2014 16:57:51 +0900 Message-Id: <1404460675-24456-7-git-send-email-iamjoonsoo.kim@lge.com> X-Mailer: git-send-email 1.7.9.5 In-Reply-To: <1404460675-24456-1-git-send-email-iamjoonsoo.kim@lge.com> References: <1404460675-24456-1-git-send-email-iamjoonsoo.kim@lge.com> Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Currently, we use (set/get)_freepage_migratetype in two use cases. One usecase is to know migratetype of buddy list where page will be linked later. The other one is to know migratetype of buddy list where page is linked now. Although there is incompleteness for later case, there is no serious problem, because it is only used by limited context, such as memory isolation. But, now I'm preparing to fix many freepage counting bugs, and accurate information about the migratetype of buddy list where page is linked now is really needed. So this incompleteness would be problem. Before fixing this incompleteness, separation of interface is needed, because it is only used if CONFIG_MEMORY_ISOLATION is enabled and it has some overhead. So this patch just do separation of interface. There is no functional change and following patch will describe what we are missing and fix it. Signed-off-by: Joonsoo Kim --- include/linux/mm.h | 24 ++++++++++++++++++++---- mm/page_alloc.c | 18 +++++++++--------- mm/page_isolation.c | 4 ++-- 3 files changed, 31 insertions(+), 15 deletions(-) diff --git a/include/linux/mm.h b/include/linux/mm.h index e03dd29..278ecfd 100644 --- a/include/linux/mm.h +++ b/include/linux/mm.h @@ -281,14 +281,30 @@ struct inode; #define page_private(page) ((page)->private) #define set_page_private(page, v) ((page)->private = (v)) -/* It's valid only if the page is free path or free_list */ -static inline void set_freepage_migratetype(struct page *page, int migratetype) +static inline void set_onbuddy_migratetype(struct page *page, int migratetype) { page->index = migratetype; } -/* It's valid only if the page is free path or free_list */ -static inline int get_freepage_migratetype(struct page *page) +/* + * It's valid only if the page is on buddy list. It represents + * migratetype of the buddy list where page is linked now. + */ +static inline int get_onbuddy_migratetype(struct page *page) +{ + return page->index; +} + +static inline void set_onpcp_migratetype(struct page *page, int migratetype) +{ + page->index = migratetype; +} + +/* + * It's valid only if the page is on pcp. It represents migratetype of + * the buddy list where page will be linked later when going buddy. + */ +static inline int get_onpcp_migratetype(struct page *page) { return page->index; } diff --git a/mm/page_alloc.c b/mm/page_alloc.c index dcc2f08..9d8ba2d 100644 --- a/mm/page_alloc.c +++ b/mm/page_alloc.c @@ -737,7 +737,7 @@ static void free_pcppages_bulk(struct zone *zone, int count, page = list_entry(list->prev, struct page, lru); /* must delete as __free_one_page list manipulates */ list_del(&page->lru); - mt = get_freepage_migratetype(page); + mt = get_onpcp_migratetype(page); /* MIGRATE_MOVABLE list may include MIGRATE_RESERVEs */ __free_one_page(page, page_to_pfn(page), zone, 0, mt); @@ -797,7 +797,7 @@ static void __free_pages_ok(struct page *page, unsigned int order) migratetype = get_pfnblock_migratetype(page, pfn); local_irq_save(flags); __count_vm_events(PGFREE, 1 << order); - set_freepage_migratetype(page, migratetype); + set_onbuddy_migratetype(page, migratetype); free_one_page(page_zone(page), page, pfn, order, migratetype); local_irq_restore(flags); } @@ -1023,7 +1023,7 @@ struct page *__rmqueue_smallest(struct zone *zone, unsigned int order, rmv_page_order(page); area->nr_free--; expand(zone, page, order, current_order, area, migratetype); - set_freepage_migratetype(page, migratetype); + set_onpcp_migratetype(page, migratetype); return page; } @@ -1091,7 +1091,7 @@ int move_freepages(struct zone *zone, order = page_order(page); list_move(&page->lru, &zone->free_area[order].free_list[migratetype]); - set_freepage_migratetype(page, migratetype); + set_onbuddy_migratetype(page, migratetype); page += 1 << order; pages_moved += 1 << order; } @@ -1221,12 +1221,12 @@ __rmqueue_fallback(struct zone *zone, unsigned int order, int start_migratetype) expand(zone, page, order, current_order, area, new_type); - /* The freepage_migratetype may differ from pageblock's + /* The onpcp_migratetype may differ from pageblock's * migratetype depending on the decisions in * try_to_steal_freepages. This is OK as long as it does * not differ for MIGRATE_CMA type. */ - set_freepage_migratetype(page, new_type); + set_onpcp_migratetype(page, new_type); trace_mm_page_alloc_extfrag(page, order, current_order, start_migratetype, migratetype, new_type); @@ -1344,7 +1344,7 @@ static int rmqueue_bulk(struct zone *zone, unsigned int order, else list_add_tail(&page->lru, list); list = &page->lru; - if (is_migrate_cma(get_freepage_migratetype(page))) + if (is_migrate_cma(get_onpcp_migratetype(page))) __mod_zone_page_state(zone, NR_FREE_CMA_PAGES, -(1 << order)); } @@ -1510,7 +1510,7 @@ void free_hot_cold_page(struct page *page, bool cold) return; migratetype = get_pfnblock_migratetype(page, pfn); - set_freepage_migratetype(page, migratetype); + set_onpcp_migratetype(page, migratetype); local_irq_save(flags); __count_vm_event(PGFREE); @@ -1710,7 +1710,7 @@ again: if (!page) goto failed; __mod_zone_freepage_state(zone, -(1 << order), - get_freepage_migratetype(page)); + get_onpcp_migratetype(page)); } __mod_zone_page_state(zone, NR_ALLOC_BATCH, -(1 << order)); diff --git a/mm/page_isolation.c b/mm/page_isolation.c index 1fa4a4d..6e4e86b 100644 --- a/mm/page_isolation.c +++ b/mm/page_isolation.c @@ -192,7 +192,7 @@ __test_page_isolated_in_pageblock(unsigned long pfn, unsigned long end_pfn, * is MIGRATE_ISOLATE. Catch it and move the page into * MIGRATE_ISOLATE list. */ - if (get_freepage_migratetype(page) != MIGRATE_ISOLATE) { + if (get_onbuddy_migratetype(page) != MIGRATE_ISOLATE) { struct page *end_page; end_page = page + (1 << page_order(page)) - 1; @@ -202,7 +202,7 @@ __test_page_isolated_in_pageblock(unsigned long pfn, unsigned long end_pfn, pfn += 1 << page_order(page); } else if (page_count(page) == 0 && - get_freepage_migratetype(page) == MIGRATE_ISOLATE) + get_onpcp_migratetype(page) == MIGRATE_ISOLATE) pfn += 1; else if (skip_hwpoisoned_pages && PageHWPoison(page)) { /* -- 1.7.9.5 -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/