Received: by 2002:a25:8b91:0:0:0:0:0 with SMTP id j17csp1384517ybl; Fri, 6 Dec 2019 16:37:52 -0800 (PST) X-Google-Smtp-Source: APXvYqwQV8iRD2ARwNCq+81BYe5b1UONBhJeK8KNk4O5MknmbfGojKXMs2sKpWdchkgSwBWe6adF X-Received: by 2002:aca:1e11:: with SMTP id m17mr15250145oic.100.1575679072069; Fri, 06 Dec 2019 16:37:52 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1575679072; cv=none; d=google.com; s=arc-20160816; b=PzVjGKS0P4S6iQn5QvxzxxCn1Y1cjgSISBsbkn81576rgo1Tvc+5sU/zi7G9IyeXeL rBby31B7Mo/tKXpXSSa3USmlCn/gDzFDrPeInNeqk9UdQL4PrizI39zYeh6QP16zq0zL CbV7VUuY+hBLM0g/VFy9hdkvgQkgKstiBD9QHrVbJcX/R7oPyN5Wo1XSPLND9qkOS+gl N4KpVWXpsfHVz6H0HyE9liC0WyXotVAQf0awOD0aFhq3QbzLgKdLGp1NK92DBp0evPD7 Jy2tovD4YDeMLvxz7g0l36mVsf6s+x3LCGpRXXTil7NgdleajJ6qjxC5YU/IsmDSmS7i LSSw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding:mime-version :references:in-reply-to:message-id:subject:cc:to:from:date :dkim-signature; bh=i8bg+PNEc7ez/w6mYCyf9BTc3G7TrE8VggSCL05v7vw=; b=jqFjahIWzs4ep62oM+68VC0lAeaJ4sfPeIjOKE0WgkZSU5WTkIBdKMrKVmUvQsQGBA lf+6DVSmKtCox3IiZdtmsX7+rxuqB0/6RXBrFa/umrA2f2RTpv33cXz0Q2wQanyCVzBP fzEYJkS4eZRmjNhGrr76EEfHK6uG1NWHMk6yacb7iCevbTzu0xAA0CYrGT3QAb5Mnw2j z3PpU+XxuHrBzRD5Ic7W0d625zdqfhNU2gVG89qPmdY46HNi/YW01P4Ui+N9gFOrLGLa sPiF6yuHQS52Bm9IcwxIqIG3A7HobFK9uzkJGbT3iAhB8jVsbP1KjWRdT3D49Isbgmpg 0SUA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@kernel.org header.s=default header.b=hCUwOrYR; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id l131si8302960oig.120.2019.12.06.16.37.38; Fri, 06 Dec 2019 16:37:52 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=default header.b=hCUwOrYR; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726413AbfLGAhK (ORCPT + 99 others); Fri, 6 Dec 2019 19:37:10 -0500 Received: from mail.kernel.org ([198.145.29.99]:39436 "EHLO mail.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726374AbfLGAhJ (ORCPT ); Fri, 6 Dec 2019 19:37:09 -0500 Received: from localhost.localdomain (c-73-231-172-41.hsd1.ca.comcast.net [73.231.172.41]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id E51C6217F4; Sat, 7 Dec 2019 00:37:07 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1575679028; bh=7dRPatdPCbbZGZLlBLBgkiWBhSl7GWUs4mboLXQ5xMU=; h=Date:From:To:Cc:Subject:In-Reply-To:References:From; b=hCUwOrYRci73JrGgxEGqlNTxcjWwwXrJ5/yLUIIMvZ/cEWvggOe1UEAAgGsHvmLpK bwC3thokiEet0eWhvrewRZtbwwc5L8wXM9wMoJ5laFloknZHPoM9/3wKsBsvbbq4V9 9J9m0dkhLSnfpToe/MMZ4kqCHbdnlTOU8J8529X4= Date: Fri, 6 Dec 2019 16:37:07 -0800 From: Andrew Morton To: Daniel Axtens Cc: kasan-dev@googlegroups.com, linux-mm@kvack.org, aryabinin@virtuozzo.com, glider@google.com, linux-kernel@vger.kernel.org, dvyukov@google.com, daniel@iogearbox.net, cai@lca.pw Subject: Re: [PATCH 1/3] mm: add apply_to_existing_pages helper Message-Id: <20191206163707.17f627c502846bd636049ad4@linux-foundation.org> In-Reply-To: <20191205140407.1874-1-dja@axtens.net> References: <20191205140407.1874-1-dja@axtens.net> X-Mailer: Sylpheed 3.5.1 (GTK+ 2.24.31; x86_64-pc-linux-gnu) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Fri, 6 Dec 2019 01:04:05 +1100 Daniel Axtens wrote: > +/* > + * Scan a region of virtual memory, calling a provided function on > + * each leaf page table where it exists. > + * > + * Unlike apply_to_page_range, this does _not_ fill in page tables > + * where they are absent. > + */ > +int apply_to_existing_pages(struct mm_struct *mm, unsigned long addr, > + unsigned long size, pte_fn_t fn, void *data) > +{ > + pgd_t *pgd; > + unsigned long next; > + unsigned long end = addr + size; > + int err = 0; > + > + if (WARN_ON(addr >= end)) > + return -EINVAL; > + > + pgd = pgd_offset(mm, addr); > + do { > + next = pgd_addr_end(addr, end); > + if (pgd_none_or_clear_bad(pgd)) > + continue; > + err = apply_to_p4d_range(mm, pgd, addr, next, fn, data, false); > + if (err) > + break; > + } while (pgd++, addr = next, addr != end); > + > + return err; > +} > +EXPORT_SYMBOL_GPL(apply_to_existing_pages); This is almost identical to apply_to_page_range() and cries out for some deduplication. This? --- a/mm/memory.c~mm-add-apply_to_existing_pages-helper-fix +++ a/mm/memory.c @@ -2141,12 +2141,9 @@ static int apply_to_p4d_range(struct mm_ return err; } -/* - * Scan a region of virtual memory, filling in page tables as necessary - * and calling a provided function on each leaf page table. - */ -int apply_to_page_range(struct mm_struct *mm, unsigned long addr, - unsigned long size, pte_fn_t fn, void *data) +static int __apply_to_page_range(struct mm_struct *mm, unsigned long addr, + unsigned long size, pte_fn_t fn, + void *data, bool create) { pgd_t *pgd; unsigned long next; @@ -2159,13 +2156,25 @@ int apply_to_page_range(struct mm_struct pgd = pgd_offset(mm, addr); do { next = pgd_addr_end(addr, end); - err = apply_to_p4d_range(mm, pgd, addr, next, fn, data, true); + if (!create && pgd_none_or_clear_bad(pgd)) + continue; + err = apply_to_p4d_range(mm, pgd, addr, next, fn, data, create); if (err) break; } while (pgd++, addr = next, addr != end); return err; } + +/* + * Scan a region of virtual memory, filling in page tables as necessary + * and calling a provided function on each leaf page table. + */ +int apply_to_page_range(struct mm_struct *mm, unsigned long addr, + unsigned long size, pte_fn_t fn, void *data) +{ + return __apply_to_page_range(mm, addr, size, fn, data, true); +} EXPORT_SYMBOL_GPL(apply_to_page_range); /* @@ -2178,25 +2187,7 @@ EXPORT_SYMBOL_GPL(apply_to_page_range); int apply_to_existing_pages(struct mm_struct *mm, unsigned long addr, unsigned long size, pte_fn_t fn, void *data) { - pgd_t *pgd; - unsigned long next; - unsigned long end = addr + size; - int err = 0; - - if (WARN_ON(addr >= end)) - return -EINVAL; - - pgd = pgd_offset(mm, addr); - do { - next = pgd_addr_end(addr, end); - if (pgd_none_or_clear_bad(pgd)) - continue; - err = apply_to_p4d_range(mm, pgd, addr, next, fn, data, false); - if (err) - break; - } while (pgd++, addr = next, addr != end); - - return err; + return __apply_to_page_range(mm, addr, size, fn, data, false); } EXPORT_SYMBOL_GPL(apply_to_existing_pages); _