Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1030262AbWAJWmH (ORCPT ); Tue, 10 Jan 2006 17:42:07 -0500 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1030269AbWAJWl7 (ORCPT ); Tue, 10 Jan 2006 17:41:59 -0500 Received: from omx3-ext.sgi.com ([192.48.171.26]:47755 "EHLO omx3.sgi.com") by vger.kernel.org with ESMTP id S1030262AbWAJWlo (ORCPT ); Tue, 10 Jan 2006 17:41:44 -0500 Date: Tue, 10 Jan 2006 14:41:29 -0800 (PST) From: Christoph Lameter To: akpm@osdl.org Cc: Cliff Wickman , linux-kernel@vger.kernel.org, Christoph Lameter , lhms-devel@lists.sourceforge.net, Hirokazu Takahashi , KAMEZAWA Hiroyuki Message-Id: <20060110224129.19138.36323.sendpatchset@schroedinger.engr.sgi.com> In-Reply-To: <20060110224114.19138.10463.sendpatchset@schroedinger.engr.sgi.com> References: <20060110224114.19138.10463.sendpatchset@schroedinger.engr.sgi.com> Subject: [PATCH 3/5] Direct Migration V9: remove_from_swap() to remove swap ptes Sender: linux-kernel-owner@vger.kernel.org X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 4444 Lines: 139 Add remove_from_swap remove_from_swap() allows the restoration of the pte entries that existed before page migration occurred for anonymous pages by walking the reverse maps. This reduces swap use and establishes regular pte's without the need for page faults. V7->V8: - Move the removing of the page from the swap entries and from the swap cache to migrate page so that it can be done while the page lock on the new page is held. - Unlock anon_vma - Remove the page from the page cache V5->V6: - Somehow V5 did a remove_from_swap for the old page. Changed to new page V3->V4: - Add new function remove_vma_swap in swapfile.c to encapsulate the functionality needed instead of exporting unuse_vma. - Add #ifdef CONFIG_MIGRATION Signed-off-by: Christoph Lameter Index: linux-2.6.15/include/linux/swap.h =================================================================== --- linux-2.6.15.orig/include/linux/swap.h 2006-01-10 14:31:42.000000000 -0800 +++ linux-2.6.15/include/linux/swap.h 2006-01-10 14:31:45.000000000 -0800 @@ -231,6 +231,9 @@ extern int remove_exclusive_swap_page(st struct backing_dev_info; extern spinlock_t swap_lock; +#ifdef CONFIG_MIGRATION +extern int remove_vma_swap(struct vm_area_struct *vma, struct page *page); +#endif /* linux/mm/thrash.c */ extern struct mm_struct * swap_token_mm; Index: linux-2.6.15/mm/swapfile.c =================================================================== --- linux-2.6.15.orig/mm/swapfile.c 2006-01-10 14:31:39.000000000 -0800 +++ linux-2.6.15/mm/swapfile.c 2006-01-10 14:31:45.000000000 -0800 @@ -552,6 +552,16 @@ static int unuse_mm(struct mm_struct *mm return 0; } +#ifdef CONFIG_MIGRATION +int remove_vma_swap(struct vm_area_struct *vma, struct page *page) +{ + swp_entry_t entry = { .val = page_private(page) }; + + return unuse_vma(vma, entry, page); +} +#endif + + /* * Scan swap_map from current position to next entry still in use. * Recycle to start on reaching the end, returning 0 when empty. Index: linux-2.6.15/mm/rmap.c =================================================================== --- linux-2.6.15.orig/mm/rmap.c 2006-01-10 09:43:04.000000000 -0800 +++ linux-2.6.15/mm/rmap.c 2006-01-10 14:31:45.000000000 -0800 @@ -205,6 +205,35 @@ out: return anon_vma; } +#ifdef CONFIG_MIGRATION +/* + * Remove an anonymous page from swap replacing the swap pte's + * through real pte's pointing to valid pages and then releasing + * the page from the swap cache. + * + * Must hold page lock on page. + */ +void remove_from_swap(struct page *page) +{ + struct anon_vma *anon_vma; + struct vm_area_struct *vma; + + if (!PageAnon(page) || !PageSwapCache(page)) + return; + + anon_vma = page_lock_anon_vma(page); + if (!anon_vma) + return; + + list_for_each_entry(vma, &anon_vma->head, anon_vma_node) + remove_vma_swap(vma, page); + + spin_unlock(&anon_vma->lock); + + delete_from_swap_cache(page); +} +#endif + /* * At what user virtual address is page expected in vma? */ Index: linux-2.6.15/include/linux/rmap.h =================================================================== --- linux-2.6.15.orig/include/linux/rmap.h 2006-01-10 09:43:04.000000000 -0800 +++ linux-2.6.15/include/linux/rmap.h 2006-01-10 14:31:45.000000000 -0800 @@ -92,6 +92,9 @@ static inline void page_dup_rmap(struct */ int page_referenced(struct page *, int is_locked); int try_to_unmap(struct page *); +#ifdef CONFIG_MIGRATION +void remove_from_swap(struct page *page); +#endif /* * Called from mm/filemap_xip.c to unmap empty zero page Index: linux-2.6.15/mm/vmscan.c =================================================================== --- linux-2.6.15.orig/mm/vmscan.c 2006-01-10 14:31:42.000000000 -0800 +++ linux-2.6.15/mm/vmscan.c 2006-01-10 14:31:45.000000000 -0800 @@ -803,6 +803,15 @@ int migrate_page(struct page *newpage, s migrate_page_copy(newpage, page); + /* + * Remove auxiliary swap entries and replace + * them with real ptes. + * + * Note that a real pte entry will allow processes that are not + * waiting on the page lock to use the new page via the page tables + * before the new page is unlocked. + */ + remove_from_swap(newpage); return 0; } - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/