Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1753068AbaGAFrx (ORCPT ); Tue, 1 Jul 2014 01:47:53 -0400 Received: from mail-wg0-f46.google.com ([74.125.82.46]:38544 "EHLO mail-wg0-f46.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752818AbaGAFru convert rfc822-to-8bit (ORCPT ); Tue, 1 Jul 2014 01:47:50 -0400 MIME-Version: 1.0 In-Reply-To: References: <1403913966-4927-1-git-send-email-ast@plumgrid.com> <1403913966-4927-4-git-send-email-ast@plumgrid.com> Date: Mon, 30 Jun 2014 22:47:49 -0700 Message-ID: Subject: Re: [PATCH RFC net-next 03/14] bpf: introduce syscall(BPF, ...) and BPF maps From: Alexei Starovoitov To: Andy Lutomirski Cc: "David S. Miller" , Ingo Molnar , Linus Torvalds , Steven Rostedt , Daniel Borkmann , Chema Gonzalez , Eric Dumazet , Peter Zijlstra , Arnaldo Carvalho de Melo , Jiri Olsa , Thomas Gleixner , "H. Peter Anvin" , Andrew Morton , Kees Cook , Linux API , Network Development , "linux-kernel@vger.kernel.org" Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8BIT Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Mon, Jun 30, 2014 at 3:09 PM, Andy Lutomirski wrote: > On Sat, Jun 28, 2014 at 11:36 PM, Alexei Starovoitov wrote: >> On Sat, Jun 28, 2014 at 6:52 PM, Andy Lutomirski wrote: >>> On Sat, Jun 28, 2014 at 1:49 PM, Alexei Starovoitov wrote: >>>> >>>> Sorry I don't like 'fd' direction at all. >>>> 1. it will make the whole thing very socket specific and 'net' dependent. >>>> but the goal here is to be able to use eBPF for tracing in embedded >>>> setups. So it's gotta be net independent. >>>> 2. sockets are already overloaded with all sorts of stuff. Adding more >>>> types of sockets will complicate it a lot. >>>> 3. and most important. read/write operations on sockets are not >>>> done every nanosecond, whereas lookup operations on bpf maps >>>> are done every dozen instructions, so we cannot have any overhead >>>> when accessing maps. >>>> In other words the verifier is done as static analyzer. I moved all >>>> the complexity to verify time, so at run-time the programs are as >>>> fast as possible. I'm strongly against run-time checks in critical path, >>>> since they kill performance and make the whole approach a lot less usable. >>> >>> I may have described my suggestion poorly. I'm suggesting that all of >>> these global ids be replaced *for userspace's benefit* with fds. That >>> is, a map would have an associated struct inode, and, when you load an >>> eBPF program, you'd pass fds into the kernel instead of global ids. >>> The kernel would still compile the eBPF program to use the global ids, >>> though. >> >> Hmm. If I understood you correctly, you're suggesting to do it similar >> to ipc/mqueue, shmem, sockets do. By registering and mounting >> a file system and providing all superblock and inode hooks… and >> probably have its own namespace type… hmm… may be. That's >> quite a bit of work to put lightly. As I said in the other email the first >> step is root only and all these complexity just not worth doing >> at this stage. > > The downside of not doing it right away is that it's harder to > retrofit in without breaking early users. > > You might be able to get away with using anon_inodes. That will Spent quite a bit of time playing with anon_inode_getfd(). The model works ok for seccomp, but doesn't seem to work for tracing, since tracepoints are global. Say, syscall(bpf, load_prog) returns a process-local fd. This 'fd' as a string can be written to debugfs/tracing/events/.../filter which will increment a refcnt of a global ebpf_program structure and will keep using it. When process exits it will close all fds which in case of ebpf_prog_fd should be a nop, since the program is still attached to a global event. Now we have a program and maps that still alive and dangling, since tracepoint events keep coming, but no new process can access it. Here we just lost all benefits of making it 'fd' based. Theoretically we can extend tracing to be fd-based too and tracepoints will auto-detach upon process exit, but that's not going to work for all other global events. Like networking components (bridge, ovs, …) are global and they won't be adding fd-based interfaces. I'm still thinking about it, but it looks like that any process-local ebpf_prog_id scheme is not going to work for global events. Thoughts? -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/