Received: by 2002:a05:6a10:8c0a:0:0:0:0 with SMTP id go10csp147508pxb; Tue, 23 Feb 2021 21:12:06 -0800 (PST) X-Google-Smtp-Source: ABdhPJyPawEEqrnqZEf9NJzC4XZNBfZucmHkMovouu6N2BNl0pvLEKmHl0Duh/YYy8wvwB2V24iQ X-Received: by 2002:aa7:dc4f:: with SMTP id g15mr30208778edu.184.1614143526211; Tue, 23 Feb 2021 21:12:06 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1614143526; cv=none; d=google.com; s=arc-20160816; b=HQXPmy8Gx9CxBWsr5On0CvVYPSSBFDlia3ho1qMkfLOKwhccpQonrDvTKtaOADLZyF 7lRRUM6FZBQ/YZNO436oLwKtTBaRDMccSGm3eUbDR7+fqO6h+2XoiSo3pv6/38bQHbfo 76fUoRcKmYOSW9hrjiyN9OXgPh5AYbwvnKzjq+6qn/K33i8wUafYEgq8JxOgdDRvhiuR 691We+EOc+PCcPYpX9SyE6PmPax6iPFCdrwyWK2pA/Xl97fBtS7FwEywCYRSbRXN+vPy N0W3v9rSwqEipMkYYvlVWpOB55jX/SPZ5e2MFPpis4Su98M9sCW2mlOD/Yim2U5GtyJw xBkA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=+i6vgqPYE//I0dGSp5B8jANfgLo0QJZd7ZWHoYw0sFQ=; b=Ft4uDvY+xXwBQbPedcrjGw9DxEfOcUrcqiR406LcdTfrTmH9kqJhUNABdHZQ7scPkM xcDJzXriSy22QBC4V/IieQhrvGKsjDSdOthqiauhlezaTPOddQnt9ygYRnCBsCyoYX9L g7vkCfn6/vGwuVl0CPldXHQCmObVQN4KtrWz6Kh1SMuzVxNvLqWrpp0e5OrQAMRObe7M JtCJAhI8KEhThFWnDSBtps3SVB1xaUf2ABvuRymB29ywgiocXH2sxeqlHP6scYKs87F1 Nmh2oqfNL3jyl5/y2ruZTAxfX2mNdLeC5+wXrOwl/m9ymcxUXl7scl9zdd4u/Z3L/9/w hxcg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@fb.com header.s=facebook header.b=O6WKiY5F; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=fb.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id a7si658606ejj.162.2021.02.23.21.11.01; Tue, 23 Feb 2021 21:12:06 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@fb.com header.s=facebook header.b=O6WKiY5F; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=fb.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232496AbhBWWc6 (ORCPT + 99 others); Tue, 23 Feb 2021 17:32:58 -0500 Received: from mx0b-00082601.pphosted.com ([67.231.153.30]:44298 "EHLO mx0b-00082601.pphosted.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S232267AbhBWW3p (ORCPT ); Tue, 23 Feb 2021 17:29:45 -0500 Received: from pps.filterd (m0109331.ppops.net [127.0.0.1]) by mx0a-00082601.pphosted.com (8.16.0.43/8.16.0.43) with SMTP id 11NMJWw8019847 for ; Tue, 23 Feb 2021 14:28:57 -0800 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fb.com; h=from : to : cc : subject : date : message-id : mime-version : content-transfer-encoding : content-type; s=facebook; bh=+i6vgqPYE//I0dGSp5B8jANfgLo0QJZd7ZWHoYw0sFQ=; b=O6WKiY5FzbyosmE5xPAnq4cVf2aFiylEo1jP++pZL2f13QSC5kKGq1tqqBy3WdAzgCia SpEWZNpyWP6v7KFt9Kb5uCxoZwOL7lFJgqBIVQwcapfcVGoQ9sNrFKGEM166mE9UprKf paFhdrir0Itp6s68T0ulIzZvI1HhCmr5w4A= Received: from mail.thefacebook.com ([163.114.132.120]) by mx0a-00082601.pphosted.com with ESMTP id 36u14q8y05-3 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT) for ; Tue, 23 Feb 2021 14:28:57 -0800 Received: from intmgw002.06.ash9.facebook.com (2620:10d:c085:108::8) by mail.thefacebook.com (2620:10d:c085:21d::4) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.1979.3; Tue, 23 Feb 2021 14:28:55 -0800 Received: by devbig006.ftw2.facebook.com (Postfix, from userid 4523) id E803962E093E; Tue, 23 Feb 2021 14:28:51 -0800 (PST) From: Song Liu To: , , CC: , , , , Song Liu Subject: [PATCH v5 bpf-next 0/6] bpf: enable task local storage for tracing programs Date: Tue, 23 Feb 2021 14:28:39 -0800 Message-ID: <20210223222845.2866124-1-songliubraving@fb.com> X-Mailer: git-send-email 2.24.1 MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable X-FB-Internal: Safe Content-Type: text/plain X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.369,18.0.761 definitions=2021-02-23_11:2021-02-23,2021-02-23 signatures=0 X-Proofpoint-Spam-Details: rule=fb_default_notspam policy=fb_default score=0 mlxscore=0 adultscore=0 malwarescore=0 bulkscore=0 spamscore=0 suspectscore=0 priorityscore=1501 phishscore=0 impostorscore=0 clxscore=1015 mlxlogscore=999 lowpriorityscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2009150000 definitions=main-2102230188 X-FB-Internal: deliver Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org This set enables task local storage for non-BPF_LSM programs. It is common for tracing BPF program to access per-task data. Currently, these data are stored in hash tables with pid as the key. In bcc/libbpftools [1], 9 out of 23 tools use such hash tables. However, hash table is not ideal for many use case. Task local storage provides better usability and performance for BPF programs. Please refer to 6/6 fo= r some performance comparison of task local storage vs. hash table. Changes v4 =3D> v5: 1. Fix build w/o CONFIG_NET. (kernel test robot) 2. Remove unnecessary check for !task_storage_ptr(). (Martin) 3. Small changes in commit logs. Changes v3 =3D> v4: 1. Prevent deadlock from recursive calls of bpf_task_storage_[get|delete]= . (2/6 checks potential deadlock and fails over, 4/6 adds a selftest). Changes v2 =3D> v3: 1. Make the selftest more robust. (Andrii) 2. Small changes with runqslower. (Andrii) 3. Shortern CC list to make it easy for vger. Changes v1 =3D> v2: 1. Do not allocate task local storage when the task is being freed. 2. Revise the selftest and added a new test for a task being freed. 3. Minor changes in runqslower. Song Liu (6): bpf: enable task local storage for tracing programs bpf: prevent deadlock from recursive bpf_task_storage_[get|delete] selftests/bpf: add non-BPF_LSM test for task local storage selftests/bpf: test deadlock from recursive bpf_task_storage_[get|delete] bpf: runqslower: prefer using local vmlimux to generate vmlinux.h bpf: runqslower: use task local storage include/linux/bpf.h | 7 ++ include/linux/bpf_lsm.h | 22 ----- include/linux/bpf_types.h | 2 +- include/linux/sched.h | 5 + kernel/bpf/Makefile | 3 +- kernel/bpf/bpf_local_storage.c | 28 +++--- kernel/bpf/bpf_lsm.c | 4 - kernel/bpf/bpf_task_storage.c | 98 ++++++++++++------- kernel/fork.c | 5 + kernel/trace/bpf_trace.c | 4 + tools/bpf/runqslower/Makefile | 5 +- tools/bpf/runqslower/runqslower.bpf.c | 33 ++++--- .../bpf/prog_tests/task_local_storage.c | 92 +++++++++++++++++ .../selftests/bpf/progs/task_local_storage.c | 64 ++++++++++++ .../bpf/progs/task_local_storage_exit_creds.c | 32 ++++++ .../selftests/bpf/progs/task_ls_recursion.c | 70 +++++++++++++ 16 files changed, 383 insertions(+), 91 deletions(-) create mode 100644 tools/testing/selftests/bpf/prog_tests/task_local_sto= rage.c create mode 100644 tools/testing/selftests/bpf/progs/task_local_storage.= c create mode 100644 tools/testing/selftests/bpf/progs/task_local_storage_= exit_creds.c create mode 100644 tools/testing/selftests/bpf/progs/task_ls_recursion.c -- 2.24.1