Received: by 2002:a05:6a10:1287:0:0:0:0 with SMTP id d7csp607845pxv; Thu, 15 Jul 2021 11:23:12 -0700 (PDT) X-Google-Smtp-Source: ABdhPJyn7z4VXXmbTnK6jE5ddQQVKZ0/Cfty3kxOHR3/3ADn70F+pSBO1gjp3Vgd7qTEwbRu8FvH X-Received: by 2002:aa7:c706:: with SMTP id i6mr8763132edq.191.1626373392369; Thu, 15 Jul 2021 11:23:12 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1626373392; cv=none; d=google.com; s=arc-20160816; b=tc1Q847urMP1qv/r4f9iA9K4GFjYwU4QqDtNMDcgK++ONHj83Z+WB/uwPFUbXbIy6d 2DZUOkkqs5+GE8YBURy00UTaDdDi85cWRhNY7pHdM8zkm4tnHJhY2IkK0UkoJYJYVcjJ wVGZkRUAb+fWEhfb/qrcchj+DUT1DQKFRvkLCf2Qx50NJRCfRAQcQ2MVAsFPdDuXbuxM EyUgwBZPg4HcwgLF9O7vteILiVkHrvWrpGXJDjR9k2lxvt9mIVk7KN67oUIa/iSG82h9 yzkc6bU+mGouqBz2X7a0lY3VyZY1F4lI4qPjnLIqOYtRmp8s/5AhvZJFRmUuiZjeHEys 4fUQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from; bh=lNxotMPciWj7CfdYSMJdYBK9dq3sVOzAuylwl6st3ns=; b=vH3wv+A7aTCi9ABYnEe4EakgXa5x3sjnBxYm6HB0HKIViC/zEDzTskb9Vb3MVIBkCx SA66YQMnacVcgMdFE9HzK56rUS+uGeMd+YwRWTMy9P2lf/XmYlEOBtPVgg0qCH+JlgAy ZuN8t7SrAGaNfbJnQjvgEXaJG1nOjZV6/OnmGSJuYagwqv+yy+rsqRF1yWmmA2bj2B89 ImzFIwMJDhnd7mq4Auo14vEG7TZUdSklTO1BH5qIOUpul7VCm667AXqe5SxpYb/+wDGc yhWliroZhiytBm7N2p4cdxxXyxkZ9Q9YkMcruf4N9CZWzHVo1Q95CaN9Kchtwv8LiDez J6+Q== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id bf26si8723184edb.356.2021.07.15.11.22.49; Thu, 15 Jul 2021 11:23:12 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S236675AbhGOQ5C (ORCPT + 99 others); Thu, 15 Jul 2021 12:57:02 -0400 Received: from mail.kernel.org ([198.145.29.99]:48632 "EHLO mail.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S236483AbhGOQ47 (ORCPT ); Thu, 15 Jul 2021 12:56:59 -0400 Received: from disco-boy.misterjones.org (disco-boy.misterjones.org [51.254.78.96]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id 4B8456128D; Thu, 15 Jul 2021 16:54:06 +0000 (UTC) Received: from sofa.misterjones.org ([185.219.108.64] helo=why.lan) by disco-boy.misterjones.org with esmtpsa (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1m44Ha-00DYjr-Ou; Thu, 15 Jul 2021 17:32:18 +0100 From: Marc Zyngier To: linux-arm-kernel@lists.infradead.org, kvmarm@lists.cs.columbia.edu, kvm@vger.kernel.org, linux-kernel@vger.kernel.org Cc: will@kernel.org, qperret@google.com, dbrazdil@google.com, Srivatsa Vaddagiri , Shanker R Donthineni , James Morse , Suzuki K Poulose , Alexandru Elisei , kernel-team@android.com Subject: [PATCH 12/16] mm/ioremap: Add arch-specific callbacks on ioremap/iounmap calls Date: Thu, 15 Jul 2021 17:31:55 +0100 Message-Id: <20210715163159.1480168-13-maz@kernel.org> X-Mailer: git-send-email 2.30.2 In-Reply-To: <20210715163159.1480168-1-maz@kernel.org> References: <20210715163159.1480168-1-maz@kernel.org> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-SA-Exim-Connect-IP: 185.219.108.64 X-SA-Exim-Rcpt-To: linux-arm-kernel@lists.infradead.org, kvmarm@lists.cs.columbia.edu, kvm@vger.kernel.org, linux-kernel@vger.kernel.org, will@kernel.org, qperret@google.com, dbrazdil@google.com, vatsa@codeaurora.org, sdonthineni@nvidia.com, james.morse@arm.com, suzuki.poulose@arm.com, alexandru.elisei@arm.com, kernel-team@android.com X-SA-Exim-Mail-From: maz@kernel.org X-SA-Exim-Scanned: No (on disco-boy.misterjones.org); SAEximRunCond expanded to false Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Add a pair of hooks (ioremap_page_range_hook/iounmap_page_range_hook) that can be implemented by an architecture. Signed-off-by: Marc Zyngier --- include/linux/io.h | 3 +++ mm/ioremap.c | 13 ++++++++++++- mm/vmalloc.c | 8 ++++++++ 3 files changed, 23 insertions(+), 1 deletion(-) diff --git a/include/linux/io.h b/include/linux/io.h index 9595151d800d..0ffc265f114c 100644 --- a/include/linux/io.h +++ b/include/linux/io.h @@ -21,6 +21,9 @@ void __ioread32_copy(void *to, const void __iomem *from, size_t count); void __iowrite64_copy(void __iomem *to, const void *from, size_t count); #ifdef CONFIG_MMU +void ioremap_page_range_hook(unsigned long addr, unsigned long end, + phys_addr_t phys_addr, pgprot_t prot); +void iounmap_page_range_hook(phys_addr_t phys_addr, size_t size); int ioremap_page_range(unsigned long addr, unsigned long end, phys_addr_t phys_addr, pgprot_t prot); #else diff --git a/mm/ioremap.c b/mm/ioremap.c index 8ee0136f8cb0..bd77a86088f2 100644 --- a/mm/ioremap.c +++ b/mm/ioremap.c @@ -28,10 +28,21 @@ early_param("nohugeiomap", set_nohugeiomap); static const unsigned int iomap_max_page_shift = PAGE_SHIFT; #endif /* CONFIG_HAVE_ARCH_HUGE_VMAP */ +void __weak ioremap_page_range_hook(unsigned long addr, unsigned long end, + phys_addr_t phys_addr, pgprot_t prot) +{ +} + int ioremap_page_range(unsigned long addr, unsigned long end, phys_addr_t phys_addr, pgprot_t prot) { - return vmap_range(addr, end, phys_addr, prot, iomap_max_page_shift); + int ret; + + ret = vmap_range(addr, end, phys_addr, prot, iomap_max_page_shift); + if (!ret) + ioremap_page_range_hook(addr, end, phys_addr, prot); + + return ret; } #ifdef CONFIG_GENERIC_IOREMAP diff --git a/mm/vmalloc.c b/mm/vmalloc.c index d5cd52805149..af18a6141093 100644 --- a/mm/vmalloc.c +++ b/mm/vmalloc.c @@ -38,6 +38,7 @@ #include #include #include +#include #include #include @@ -2551,6 +2552,10 @@ static void vm_remove_mappings(struct vm_struct *area, int deallocate_pages) set_area_direct_map(area, set_direct_map_default_noflush); } +void __weak iounmap_page_range_hook(phys_addr_t phys_addr, size_t size) +{ +} + static void __vunmap(const void *addr, int deallocate_pages) { struct vm_struct *area; @@ -2574,6 +2579,9 @@ static void __vunmap(const void *addr, int deallocate_pages) kasan_poison_vmalloc(area->addr, get_vm_area_size(area)); + if (area->flags & VM_IOREMAP) + iounmap_page_range_hook(area->phys_addr, get_vm_area_size(area)); + vm_remove_mappings(area, deallocate_pages); if (deallocate_pages) { -- 2.30.2