Received: by 2002:ad5:474a:0:0:0:0:0 with SMTP id i10csp4070968imu; Fri, 30 Nov 2018 10:27:02 -0800 (PST) X-Google-Smtp-Source: AFSGD/XsvMQGh+CEtJiXTkCf8yJ3P9KroQBWCJqEm3X5SeDpe37spjiXxZEPbRfPW5soDMr6Zs3V X-Received: by 2002:aa7:8758:: with SMTP id g24mr6496416pfo.250.1543602422514; Fri, 30 Nov 2018 10:27:02 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1543602422; cv=none; d=google.com; s=arc-20160816; b=hDkNK4xrNrBl9sFlwD/mdSmnO8TxsyBLpmq1AXb7lvPy47y0mlAG7TfhUfxGdF/NEO B+ZBJ+3+LkUb8zb+q5QXOTlbTDPbJpTtstkJa4pnYLxnrQrUm8hKph/PkxrMtiwhSaIG tm6rdB9wJ6w7J+fXLcORXf+Y+SFuUPl8knZ5BxSiwqSWG4MzbNFdny0b1FBcn5QnZuLv IrmaVZq1QH7TGRuZ5bbIkktClV+UWlgtE7lfuKa+sgbh6q1bLfMuHrBrhZ4FZAB8WF47 5W/hqsNpfV3RgHDK0alYH8XK2NmQbbjiq48Ko3sOsnZOBGLfQGsHyeXDhd9SHY1UUc4R vxuA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-disposition:mime-version:references:message-id:subject:cc :to:from:date; bh=+sunH4skJPs7CwTPX2NYDuxSIQLv2ugHjc1zQcrzMiw=; b=OgitLz2fOUz0rtuCelSpVdXGQ4YdvbmIenczOFdCNeAUJ01Zqty57nAS7n4QFkDl73 NCPqrT8jPN/u0fde87DNQfExcTMj4bLtHy90HgdLDSf+rWtY3mrYVb6AGCgaxap7HMdJ 4HWc+zmgbbs5s2R6W5uvxkA995DxvTJ9xjuKLxN3cc7a8pdoEjpRV2bYIsywV9m0c13o JN2i8eixkC+CjTtAzzN7dky0dLBUC8Uz4FjZ2DK4Rgq6rRNtY9eow5YmKlP/nHQ95Fje 4YxV1GmSwoVZ7I0f+UvMEORqXhoz9V3lZQURTyXoFxNJpNNbeOH2INehvG5fUAqmIbDG D3yg== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id i1si5498506pgr.569.2018.11.30.10.26.47; Fri, 30 Nov 2018 10:27:02 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726159AbeLAFgU (ORCPT + 99 others); Sat, 1 Dec 2018 00:36:20 -0500 Received: from foss.arm.com ([217.140.101.70]:34354 "EHLO foss.arm.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1725817AbeLAFgT (ORCPT ); Sat, 1 Dec 2018 00:36:19 -0500 Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.72.51.249]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id 129F9165C; Fri, 30 Nov 2018 10:26:11 -0800 (PST) Received: from edgewater-inn.cambridge.arm.com (usa-sjc-imap-foss1.foss.arm.com [10.72.51.249]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPA id D5DA83F575; Fri, 30 Nov 2018 10:26:10 -0800 (PST) Received: by edgewater-inn.cambridge.arm.com (Postfix, from userid 1000) id B8FAC1AE0FA2; Fri, 30 Nov 2018 18:26:29 +0000 (GMT) Date: Fri, 30 Nov 2018 18:26:29 +0000 From: Will Deacon To: Ard Biesheuvel Cc: linux-kernel@vger.kernel.org, Daniel Borkmann , Alexei Starovoitov , Rick Edgecombe , Eric Dumazet , Jann Horn , Kees Cook , Jessica Yu , Arnd Bergmann , Catalin Marinas , Mark Rutland , "David S. Miller" , linux-arm-kernel@lists.infradead.org, netdev@vger.kernel.org Subject: Re: [PATCH v4 2/2] arm64/bpf: don't allocate BPF JIT programs in module memory Message-ID: <20181130182629.GA16085@arm.com> References: <20181123221804.440-1-ard.biesheuvel@linaro.org> <20181123221804.440-3-ard.biesheuvel@linaro.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20181123221804.440-3-ard.biesheuvel@linaro.org> User-Agent: Mutt/1.5.23 (2014-03-12) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Fri, Nov 23, 2018 at 11:18:04PM +0100, Ard Biesheuvel wrote: > The arm64 module region is a 128 MB region that is kept close to > the core kernel, in order to ensure that relative branches are > always in range. So using the same region for programs that do > not have this restriction is wasteful, and preferably avoided. > > Now that the core BPF JIT code permits the alloc/free routines to > be overridden, implement them by vmalloc()/vfree() calls from a > dedicated 128 MB region set aside for BPF programs. This ensures > that BPF programs are still in branching range of each other, which > is something the JIT currently depends upon (and is not guaranteed > when using module_alloc() on KASLR kernels like we do currently). > It also ensures that placement of BPF programs does not correlate > with the placement of the core kernel or modules, making it less > likely that leaking the former will reveal the latter. > > This also solves an issue under KASAN, where shadow memory is > needlessly allocated for all BPF programs (which don't require KASAN > shadow pages since they are not KASAN instrumented) > > Signed-off-by: Ard Biesheuvel > --- > arch/arm64/include/asm/memory.h | 5 ++++- > arch/arm64/net/bpf_jit_comp.c | 13 +++++++++++++ > 2 files changed, 17 insertions(+), 1 deletion(-) > > diff --git a/arch/arm64/include/asm/memory.h b/arch/arm64/include/asm/memory.h > index b96442960aea..ee20fc63899c 100644 > --- a/arch/arm64/include/asm/memory.h > +++ b/arch/arm64/include/asm/memory.h > @@ -62,8 +62,11 @@ > #define PAGE_OFFSET (UL(0xffffffffffffffff) - \ > (UL(1) << (VA_BITS - 1)) + 1) > #define KIMAGE_VADDR (MODULES_END) > +#define BPF_JIT_REGION_START (VA_START + KASAN_SHADOW_SIZE) > +#define BPF_JIT_REGION_SIZE (SZ_128M) > +#define BPF_JIT_REGION_END (BPF_JIT_REGION_START + BPF_JIT_REGION_SIZE) > #define MODULES_END (MODULES_VADDR + MODULES_VSIZE) > -#define MODULES_VADDR (VA_START + KASAN_SHADOW_SIZE) > +#define MODULES_VADDR (BPF_JIT_REGION_END) > #define MODULES_VSIZE (SZ_128M) > #define VMEMMAP_START (PAGE_OFFSET - VMEMMAP_SIZE) > #define PCI_IO_END (VMEMMAP_START - SZ_2M) > diff --git a/arch/arm64/net/bpf_jit_comp.c b/arch/arm64/net/bpf_jit_comp.c > index a6fdaea07c63..76c2ab40c02d 100644 > --- a/arch/arm64/net/bpf_jit_comp.c > +++ b/arch/arm64/net/bpf_jit_comp.c > @@ -940,3 +940,16 @@ struct bpf_prog *bpf_int_jit_compile(struct bpf_prog *prog) > tmp : orig_prog); > return prog; > } > + > +void *bpf_jit_alloc_exec(unsigned long size) > +{ > + return __vmalloc_node_range(size, PAGE_SIZE, BPF_JIT_REGION_START, > + BPF_JIT_REGION_END, GFP_KERNEL, > + PAGE_KERNEL_EXEC, 0, NUMA_NO_NODE, > + __builtin_return_address(0)); I guess we'll want VM_IMMEDIATE_UNMAP here if Rich gets that merged. In the meantime, I wonder if it's worth zeroing the region in bpf_jit_free_exec()? (although we'd need the size information...). Will