Received: by 2002:a05:6a10:8c0a:0:0:0:0 with SMTP id go10csp796831pxb; Thu, 25 Feb 2021 15:45:17 -0800 (PST) X-Google-Smtp-Source: ABdhPJy0zYf5uIqCUxhzbuB5yV+hXuvshrVLb4nEoqDPx7Lwl53YuH0dzJI9iYg3s4Q56DKdz71o X-Received: by 2002:a05:6402:1453:: with SMTP id d19mr405676edx.59.1614296717575; Thu, 25 Feb 2021 15:45:17 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1614296717; cv=none; d=google.com; s=arc-20160816; b=GWlvMWk9Ps7G4JO8qmnc6/RqJ7cryz0RUKMhngqyEqpyevrDKHri2mMye7eYku487Z LlSqP9p4MjjyvnVR0afiZHLa1ou3I0nk7Ra63Y6OsjFxYroDs/6a/RMtWVCRD/SWh1PN 5TBeErmRcGjOwogbA35Qu0pVdzTgCkgSgNtCbeda+xoDpUJrGxCHxIwwxMiC9OcDhDDx uk/ylvOfgCR4VjpHNlT4YGesFRxwWoT3Xki3+ajxzTD7U518+Sp624MO79EUw90RSok7 iFrSFk+Jq/1gWP59QqmCWcFdZUqZ3A2kTAutq4PwAIV9YwsASncNGzLevx0SXaQiVH84 r4pw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=6Qrdjjm1A1iswI+6pHkdMg7F8SIWOtnhJ67L1ELQJcI=; b=Kk+z13SAPe6jSgulDM8S9r4YibonHnBCw1kHkCkEpoQJmjyNwUqg80YyocQhdsDK2Z IvkMwAPhTWojjP1EWUco4wbPP0k0v3y1G1H3tKxH/02dupXyTiAUhgvFaXuLCpnv24Qr kme30JB5jnf3LJrhg2REFPPmWoCgdAhHumeOEMsZ2l3rSvumJ25+Bh1806DracSOFzjH pmBizkMv3nGneGK9D1mSztRTBLLQ+2PWfCqqIYfbOfaixqO01RpwF91POBgiRth+9d2u 9k0dE3k73SjyPLcbivtk6YmPkfwlfCnBNO1DHnf1HduikzhVSHPvVNAI8HqbB6rbbqtu SbtA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@fb.com header.s=facebook header.b=a5rCOHyv; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=fb.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id v7si4511663edj.572.2021.02.25.15.44.53; Thu, 25 Feb 2021 15:45:17 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@fb.com header.s=facebook header.b=a5rCOHyv; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=fb.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232412AbhBYXoS (ORCPT + 99 others); Thu, 25 Feb 2021 18:44:18 -0500 Received: from mx0b-00082601.pphosted.com ([67.231.153.30]:9746 "EHLO mx0b-00082601.pphosted.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S232077AbhBYXoR (ORCPT ); Thu, 25 Feb 2021 18:44:17 -0500 Received: from pps.filterd (m0148460.ppops.net [127.0.0.1]) by mx0a-00082601.pphosted.com (8.16.0.43/8.16.0.43) with SMTP id 11PNdw1j019990 for ; Thu, 25 Feb 2021 15:43:36 -0800 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fb.com; h=from : to : cc : subject : date : message-id : mime-version : content-transfer-encoding : content-type; s=facebook; bh=6Qrdjjm1A1iswI+6pHkdMg7F8SIWOtnhJ67L1ELQJcI=; b=a5rCOHyvNQVO4Ag/SXjNc/4usYSM1E1FztoRThwWNX4K4CNtsUfu6PtUzFWcMP6CXB66 4kKXezWq4fetbpASnTgvk+7MEr8C8PTZpiOTZ5ew0a++7j5bMqp98Sm5+pYBxEnePKUh 1UxzrAwXSvgblWWgHmFdS7l/BYJvENt30jY= Received: from mail.thefacebook.com ([163.114.132.120]) by mx0a-00082601.pphosted.com with ESMTP id 36x9cavfju-6 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT) for ; Thu, 25 Feb 2021 15:43:36 -0800 Received: from intmgw006.03.ash8.facebook.com (2620:10d:c085:108::4) by mail.thefacebook.com (2620:10d:c085:11d::7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.1979.3; Thu, 25 Feb 2021 15:43:34 -0800 Received: by devbig006.ftw2.facebook.com (Postfix, from userid 4523) id 2043D62E1BF5; Thu, 25 Feb 2021 15:43:30 -0800 (PST) From: Song Liu To: , , CC: , , , , Song Liu Subject: [PATCH v6 bpf-next 0/6] bpf: enable task local storage for tracing programs Date: Thu, 25 Feb 2021 15:43:13 -0800 Message-ID: <20210225234319.336131-1-songliubraving@fb.com> X-Mailer: git-send-email 2.24.1 MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable X-FB-Internal: Safe Content-Type: text/plain X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.369,18.0.761 definitions=2021-02-25_15:2021-02-24,2021-02-25 signatures=0 X-Proofpoint-Spam-Details: rule=fb_default_notspam policy=fb_default score=0 mlxlogscore=999 malwarescore=0 mlxscore=0 priorityscore=1501 impostorscore=0 clxscore=1015 adultscore=0 suspectscore=0 spamscore=0 lowpriorityscore=0 phishscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2009150000 definitions=main-2102250179 X-FB-Internal: deliver Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org This set enables task local storage for non-BPF_LSM programs. It is common for tracing BPF program to access per-task data. Currently, these data are stored in hash tables with pid as the key. In bcc/libbpftools [1], 9 out of 23 tools use such hash tables. However, hash table is not ideal for many use case. Task local storage provides better usability and performance for BPF programs. Please refer to 6/6 fo= r some performance comparison of task local storage vs. hash table. Changes v5 =3D> v6: 1. Add inc/dec bpf_task_storage_busy in bpf_local_storage_map_free(). Changes v4 =3D> v5: 1. Fix build w/o CONFIG_NET. (kernel test robot) 2. Remove unnecessary check for !task_storage_ptr(). (Martin) 3. Small changes in commit logs. Changes v3 =3D> v4: 1. Prevent deadlock from recursive calls of bpf_task_storage_[get|delete]= . (2/6 checks potential deadlock and fails over, 4/6 adds a selftest). Changes v2 =3D> v3: 1. Make the selftest more robust. (Andrii) 2. Small changes with runqslower. (Andrii) 3. Shortern CC list to make it easy for vger. Changes v1 =3D> v2: 1. Do not allocate task local storage when the task is being freed. 2. Revise the selftest and added a new test for a task being freed. 3. Minor changes in runqslower. Song Liu (6): bpf: enable task local storage for tracing programs bpf: prevent deadlock from recursive bpf_task_storage_[get|delete] selftests/bpf: add non-BPF_LSM test for task local storage selftests/bpf: test deadlock from recursive bpf_task_storage_[get|delete] bpf: runqslower: prefer using local vmlimux to generate vmlinux.h bpf: runqslower: use task local storage include/linux/bpf.h | 7 ++ include/linux/bpf_local_storage.h | 3 +- include/linux/bpf_lsm.h | 22 ---- include/linux/bpf_types.h | 2 +- include/linux/sched.h | 5 + kernel/bpf/Makefile | 3 +- kernel/bpf/bpf_inode_storage.c | 2 +- kernel/bpf/bpf_local_storage.c | 39 ++++--- kernel/bpf/bpf_lsm.c | 4 - kernel/bpf/bpf_task_storage.c | 100 +++++++++++------- kernel/fork.c | 5 + kernel/trace/bpf_trace.c | 4 + net/core/bpf_sk_storage.c | 2 +- tools/bpf/runqslower/Makefile | 5 +- tools/bpf/runqslower/runqslower.bpf.c | 33 +++--- .../bpf/prog_tests/task_local_storage.c | 92 ++++++++++++++++ .../selftests/bpf/progs/task_local_storage.c | 64 +++++++++++ .../bpf/progs/task_local_storage_exit_creds.c | 32 ++++++ .../selftests/bpf/progs/task_ls_recursion.c | 70 ++++++++++++ 19 files changed, 398 insertions(+), 96 deletions(-) create mode 100644 tools/testing/selftests/bpf/prog_tests/task_local_sto= rage.c create mode 100644 tools/testing/selftests/bpf/progs/task_local_storage.= c create mode 100644 tools/testing/selftests/bpf/progs/task_local_storage_= exit_creds.c create mode 100644 tools/testing/selftests/bpf/progs/task_ls_recursion.c -- 2.24.1