Received: by 2002:ac0:aa62:0:0:0:0:0 with SMTP id w31-v6csp3976449ima; Tue, 23 Oct 2018 14:38:39 -0700 (PDT) X-Google-Smtp-Source: ACcGV63DkB849q1eGG25CKm5PFX75JuBbJLUiGYAHuoNo9HdLsCjIQTFLJO+Vv5yhMWznyFNEug3 X-Received: by 2002:a62:2904:: with SMTP id p4-v6mr27214251pfp.233.1540330719792; Tue, 23 Oct 2018 14:38:39 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1540330719; cv=none; d=google.com; s=arc-20160816; b=KvA2QjbylbuLAqf3nnFG6Jg4Ej72t2fk+C7x9g/PYkYpp5IHCeejxx1Cs7DddTk38K S3X0a2s4E4u3XosRb2fiEUOCCybfgVOZV9f+4mfgxzeXeGhmAhlYC5fCqXbd31gJm8AQ ECV1GMMHl7gYtBYA+njtPFhZF/jYgMOylLJhuuPCmGF5gN0dOhf+i8Ncptc2jJE39x/E JeJBHjVApu+mA6T/EVMQdcwZyWVBFexWHCEjyb4UUzvobIaixvJcXl94ZKh8ylMgc9xT EQBn8H4TpgelAzF2clAi9QwFEdgK1njRsbv7xzU6HgSN3PNhAmcBrsuS7qj+1NyMUPzH K3WA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:reply-to:references:in-reply-to :message-id:date:subject:cc:to:from:dkim-signature; bh=6jXsMcNOASyEUd+AGjVZam8sdvDi65Nq+ICQnyI7NC8=; b=PBRQqXALHXOHOd+dm8r/5XCt1/wx3cGA1Y5R0NQbMu2ZDM6s29kQfdamg3uFf5yodJ bwPDe1tQCdh+T25X4j/jVobudzZe9UiYwxgq6aNi2XhJccwv+s3hwUTvHKwSNzuvrIvV n/ZmiYLArq4Yi51Q6m6GNoTOO8y5sRClZiWfCY3ZYb4IwMw/Nh6he8Rse8isiYRn7Ygs eoQwV38uCt/26+7mk3BfbybyvvBH1GhCckKZ1tR3VaX/hAZDGGlckkZi1kcBnHu+pYV6 R6jYWNWUWiDU4zyFfgrLti1eXQVC+xk9feSajQtF/0pz17aJPUIjsCX8e0pMXQ+wb3Z3 NF3A== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=D2P3EntG; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id a13-v6si2492263pgi.474.2018.10.23.14.38.24; Tue, 23 Oct 2018 14:38:39 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=D2P3EntG; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1729021AbeJXGBS (ORCPT + 99 others); Wed, 24 Oct 2018 02:01:18 -0400 Received: from mail-lf1-f66.google.com ([209.85.167.66]:39219 "EHLO mail-lf1-f66.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1728725AbeJXGBP (ORCPT ); Wed, 24 Oct 2018 02:01:15 -0400 Received: by mail-lf1-f66.google.com with SMTP id p11-v6so2330933lfc.6; Tue, 23 Oct 2018 14:36:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references:reply-to; bh=6jXsMcNOASyEUd+AGjVZam8sdvDi65Nq+ICQnyI7NC8=; b=D2P3EntG9KSCG0qbpHMKa1F9RkSy7Fi1vmdHYMZHlxzpBrRFHHM9NmSDNJ6UUFNIPF XSi1KAxTa0aD5TdT4IY4q5HajQnHuMo2x/tOfbQmk3e8Gv/273K7kgKcTKKN8ICPJDC8 4nfmvBBbpIlF4xCgqU3MJDPqYXXkrivUSNIamTfQjKKdnAPxoAywQP5MZOy3u2PJdNbN 2NQqXXVPhvdWOQYVBqXNNymOa3SgIAbrVfxW3CzlsnFmaD5CaeVIfl4C900BUKgXU5an FofC3Bb9uPmIhTPS+tO5MFQl0G6FTHn7fQfWj2uSai/ifDGqQQf+uh5p7/Lk5iQgg19Q Wf2w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:reply-to; bh=6jXsMcNOASyEUd+AGjVZam8sdvDi65Nq+ICQnyI7NC8=; b=SfM2Xhvrdmi9tlep41o0IOCS77/bDehyqLiCkRGqk5gME798Yp4AM5kBM5v5UD7S5i KZsgjyL44rfhPxIgPPoLoE5FnfsKEw4XRq0I0EsmipI3VYP2s6jrqUfeZtjJSD/GuKSE 1+RGnWV3yrpPQ3Nzyh8842Nsf4tfdjyV97wzvD+lnpnPVO6drcJHw23Dty8XwGVFEdac YUCYjamn2ATR07IKKzg3Y7hsGSCNTqWgaR7ueNl5F1kmAMyHPhY/F0Ocey7XKtC9jmJa RnQ6HJSm3t3ZPdOpGH8YmB+sRdZAIuE69XvEr5d/iy0UAFCIWc7vqzWA2cNFKg14WlKk SgrQ== X-Gm-Message-State: ABuFfogNA8TMmVctepClIZ7+2vb/MNzABj178VhoJdZocvxENiJt0JDW UE133X/5yj3xQI7SGHpg61s= X-Received: by 2002:a19:c954:: with SMTP id z81mr8626755lff.150.1540330561406; Tue, 23 Oct 2018 14:36:01 -0700 (PDT) Received: from localhost.localdomain (91-159-62-169.elisa-laajakaista.fi. [91.159.62.169]) by smtp.gmail.com with ESMTPSA id y127-v6sm377950lfc.13.2018.10.23.14.36.00 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 23 Oct 2018 14:36:00 -0700 (PDT) From: Igor Stoppa X-Google-Original-From: Igor Stoppa To: Mimi Zohar , Kees Cook , Matthew Wilcox , Dave Chinner , James Morris , Michal Hocko , kernel-hardening@lists.openwall.com, linux-integrity@vger.kernel.org, linux-security-module@vger.kernel.org Cc: igor.stoppa@huawei.com, Dave Hansen , Jonathan Corbet , Laura Abbott , Andrew Morton , Chintan Pandya , Joe Perches , "Luis R. Rodriguez" , Thomas Gleixner , Kate Stewart , Greg Kroah-Hartman , Philippe Ombredanne , linux-mm@kvack.org, linux-kernel@vger.kernel.org Subject: [PATCH 03/17] prmem: vmalloc support for dynamic allocation Date: Wed, 24 Oct 2018 00:34:50 +0300 Message-Id: <20181023213504.28905-4-igor.stoppa@huawei.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20181023213504.28905-1-igor.stoppa@huawei.com> References: <20181023213504.28905-1-igor.stoppa@huawei.com> Reply-To: Igor Stoppa Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Prepare vmalloc for: - tagging areas used for dynamic allocation of protected memory - supporting various tags, related to the property that an area might have - extrapolating the pool containing a given area - chaining the areas in each pool - extrapolating the area containing a given memory address NOTE: Since there is a list_head structure that is used only when disposing of the allocation (the field purge_list), there are two pointers for the take, before it comes the time of freeing the allocation. To avoid increasing the size of the vmap_area structure, instead of using a standard doubly linked list for tracking the chain of vmap_areas, only one pointer is spent for this purpose, in a single linked list, while the other is used to provide a direct connection to the parent pool. Signed-off-by: Igor Stoppa CC: Michal Hocko CC: Andrew Morton CC: Chintan Pandya CC: Joe Perches CC: "Luis R. Rodriguez" CC: Thomas Gleixner CC: Kate Stewart CC: Greg Kroah-Hartman CC: Philippe Ombredanne CC: linux-mm@kvack.org CC: linux-kernel@vger.kernel.org --- include/linux/vmalloc.h | 12 +++++++++++- mm/vmalloc.c | 2 +- 2 files changed, 12 insertions(+), 2 deletions(-) diff --git a/include/linux/vmalloc.h b/include/linux/vmalloc.h index 398e9c95cd61..4d14a3b8089e 100644 --- a/include/linux/vmalloc.h +++ b/include/linux/vmalloc.h @@ -21,6 +21,9 @@ struct notifier_block; /* in notifier.h */ #define VM_UNINITIALIZED 0x00000020 /* vm_struct is not fully initialized */ #define VM_NO_GUARD 0x00000040 /* don't add guard page */ #define VM_KASAN 0x00000080 /* has allocated kasan shadow memory */ +#define VM_PMALLOC 0x00000100 /* pmalloc area - see docs */ +#define VM_PMALLOC_WR 0x00000200 /* pmalloc write rare area */ +#define VM_PMALLOC_PROTECTED 0x00000400 /* pmalloc protected area */ /* bits [20..32] reserved for arch specific ioremap internals */ /* @@ -48,7 +51,13 @@ struct vmap_area { unsigned long flags; struct rb_node rb_node; /* address sorted rbtree */ struct list_head list; /* address sorted list */ - struct llist_node purge_list; /* "lazy purge" list */ + union { + struct llist_node purge_list; /* "lazy purge" list */ + struct { + struct vmap_area *next; + struct pmalloc_pool *pool; + }; + }; struct vm_struct *vm; struct rcu_head rcu_head; }; @@ -134,6 +143,7 @@ extern struct vm_struct *__get_vm_area_caller(unsigned long size, const void *caller); extern struct vm_struct *remove_vm_area(const void *addr); extern struct vm_struct *find_vm_area(const void *addr); +extern struct vmap_area *find_vmap_area(unsigned long addr); extern int map_vm_area(struct vm_struct *area, pgprot_t prot, struct page **pages); diff --git a/mm/vmalloc.c b/mm/vmalloc.c index a728fc492557..15850005fea5 100644 --- a/mm/vmalloc.c +++ b/mm/vmalloc.c @@ -742,7 +742,7 @@ static void free_unmap_vmap_area(struct vmap_area *va) free_vmap_area_noflush(va); } -static struct vmap_area *find_vmap_area(unsigned long addr) +struct vmap_area *find_vmap_area(unsigned long addr) { struct vmap_area *va; -- 2.17.1