Received: by 2002:ac0:a5a7:0:0:0:0:0 with SMTP id m36-v6csp169305imm; Fri, 3 Aug 2018 01:15:32 -0700 (PDT) X-Google-Smtp-Source: AAOMgpdXILmBBkkSoEMFKDtLlAFJnI6sA5Gmfyt41SlH9lu65wSd2bPjYSsl9LAQjpYqRscTP19T X-Received: by 2002:a17:902:758c:: with SMTP id j12-v6mr2572503pll.195.1533284132435; Fri, 03 Aug 2018 01:15:32 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1533284132; cv=none; d=google.com; s=arc-20160816; b=dZvfxfqA5kY7F/EHegJ01Pu1wy/LHZesTOFTMIqYKLiP61LhbWAnQmbJSs3tbNAJS0 xNDFsCd64H/ywtaMJ3rEuPH2DerwZ5ESO+oPmUhwE7wHrsS9PZP01jRQHVeQqb67fwZC lGVG7ty+Tes8xnqhNuutkoj35dfSyU+FEVscgA7kt/ebtVjGJKsJRuoa8mvAgHPqYUPy +FrTR9d7pADz/7BWqI0FFTXp0dwGBrUSKjS5Pnsdz30PAGwVYlzyOD8JlPNxHENAXjx0 wqHZEuFLpr3tCJFxyUhsMs1vvWgtZbdKDdAoerrsrXPAPxDXsuTfDOBDpWSxGkoX3aDs W4+g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:from:references:cc:to:subject:arc-authentication-results; bh=HdD5ZjZ8O0lW1RVXomZQahhSjdYTmgKSzdXJb3otlJM=; b=0iWoHPMb1cQWJ8TUQgtss4RlZsspLW4RFloTb/SUFqhyA03c9cy9ZpmquBLOWav0+a LlfL189mLcjkcuUwC5aVMSs+hpWNTWTx9WhC9+ml2Gbh0wMqeDeJPBxI69OY/zE2AI90 snZXOl18EXDwa5fAEpMy8Sb1hzAb7PVSrLnpRJt20dFHo73EzWclgCuRrIZMEfnd0eGU 1pXfXA4iuLcrppy+YbVHN9TToUaSl6aSdcXiIZ3DJ5wD16qbYwVLhAUusWAJ64xnQcVW YF56CqrYojMY0S74zgIldf2rmyIOLWfL/HwVy7/ouj8hW8U/+7mLghHT0I9CGsKU9Sab cDhQ== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id x7-v6si4316798pgb.297.2018.08.03.01.15.17; Fri, 03 Aug 2018 01:15:32 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1729008AbeHCKJh (ORCPT + 99 others); Fri, 3 Aug 2018 06:09:37 -0400 Received: from www62.your-server.de ([213.133.104.62]:49633 "EHLO www62.your-server.de" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727682AbeHCKJh (ORCPT ); Fri, 3 Aug 2018 06:09:37 -0400 Received: from [78.46.172.3] (helo=sslproxy06.your-server.de) by www62.your-server.de with esmtpsa (TLSv1.2:DHE-RSA-AES256-GCM-SHA384:256) (Exim 4.85_2) (envelope-from ) id 1flVE8-0003UQ-Fy; Fri, 03 Aug 2018 10:14:24 +0200 Received: from [2a02:120b:c3f4:b8b0:b5ea:3969:d380:aafd] (helo=linux.home) by sslproxy06.your-server.de with esmtpsa (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256) (Exim 4.89) (envelope-from ) id 1flVE8-000GiE-B5; Fri, 03 Aug 2018 10:14:24 +0200 Subject: Re: [PATCH v7 bpf-next 00/14] bpf: cgroup local storage To: Roman Gushchin , netdev@vger.kernel.org Cc: linux-kernel@vger.kernel.org, kernel-team@fb.com, Alexei Starovoitov , Martin KaFai Lau References: <20180802212730.18579-1-guro@fb.com> From: Daniel Borkmann Message-ID: <7c36a9aa-bfc6-6d97-ba86-c58d86e6713c@iogearbox.net> Date: Fri, 3 Aug 2018 10:14:23 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.3.0 MIME-Version: 1.0 In-Reply-To: <20180802212730.18579-1-guro@fb.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Authenticated-Sender: daniel@iogearbox.net X-Virus-Scanned: Clear (ClamAV 0.100.0/24807/Fri Aug 3 02:50:20 2018) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 08/02/2018 11:27 PM, Roman Gushchin wrote: > This patchset implements cgroup local storage for bpf programs. > The main idea is to provide a fast accessible memory for storing > various per-cgroup data, e.g. number of transmitted packets. > > Cgroup local storage looks as a special type of map for userspace, > and is accessible using generic bpf maps API for reading and > updating of the data. The (cgroup inode id, attachment type) pair > is used as a map key. > > A user can't create new entries or destroy existing entries; > it happens automatically when a user attaches/detaches a bpf program > to a cgroup. > > From a bpf program's point of view, cgroup storage is accessible > without lookup using the special get_local_storage() helper function. > It takes a map fd as an argument. It always returns a valid pointer > to the corresponding memory area. > > To implement such a lookup-free access a pointer to the cgroup > storage is saved for an attachment of a bpf program to a cgroup, > if required by the program. Before running the program, it's saved > in a special global per-cpu variable, which is accessible from the > get_local_storage() helper. > > This patchset implement only cgroup local storage, however the API > is intentionally made extensible to support other local storage types > further: e.g. thread local storage, socket local storage, etc. > > v7->v6: > - fixed a use-after-free bug, caused by not clearing > prog->aux->cgroup_storage pointer after releasing the map > > v6->v5: > - fixed an error with returning -EINVAL instead of a pointer > > v5->v4: > - fixed an issue in verifier (test that flags == 0 properly) > - added a corresponding test > - added a note about synchronization, sync docs to tools/uapi/... > - switched the cgroup test to use XADD > - added a check for attr->max_entries to be 0, and atter->max_flags > to be sane > - use bpf_uncharge_memlock() in bpf_uncharge_memlock() > - rebased to bpf-next > > v4->v3: > - fixed a leak in cgroup attachment code (discovered by Daniel) > - cgroup storage map will be released if the corresponding > bpf program failed to load by any reason > - introduced bpf_uncharge_memlock() helper > > v3->v2: > - fixed more build and sparse issues > - rebased to bpf-next > > v2->v1: > - fixed build issues > - removed explicit rlimit calls in patch 14 > - rebased to bpf-next > > Signed-off-by: Roman Gushchin > Cc: Alexei Starovoitov > Cc: Martin KaFai Lau > > Roman Gushchin (14): > bpf: add ability to charge bpf maps memory dynamically > bpf: introduce cgroup storage maps > bpf: pass a pointer to a cgroup storage using pcpu variable > bpf: allocate cgroup storage entries on attaching bpf programs > bpf: extend bpf_prog_array to store pointers to the cgroup storage > bpf/verifier: introduce BPF_PTR_TO_MAP_VALUE > bpf: don't allow create maps of cgroup local storages > bpf: introduce the bpf_get_local_storage() helper function > bpf: sync bpf.h to tools/ > bpftool: add support for CGROUP_STORAGE maps > bpf/test_run: support cgroup local storage > selftests/bpf: add verifier cgroup storage tests > selftests/bpf: add a cgroup storage test > samples/bpf: extend test_cgrp2_attach2 test to use cgroup storage Tossed the old series from bpf-next and replaced with this one which fixes the syzkaller issue, thanks Roman!