Received: by 2002:ab2:7855:0:b0:1f9:5764:f03e with SMTP id m21csp950522lqp; Thu, 23 May 2024 05:12:15 -0700 (PDT) X-Forwarded-Encrypted: i=3; AJvYcCWmD5fCtWPC4Y+A93084rERMUYYSlpgrZdWKjIlWT0sKL3wvDX8VCIPJmUBRNOH6zH74FvSLnhvnr/6ycmFZCgrKH6wcjG1728uHEgfOw== X-Google-Smtp-Source: AGHT+IH9FUAwPTPlTRlKTqe4B0S9iSeHsQvBtygpwnwBwO05CcIhBiM6Yx91ZxLTIh+78dLeH/mM X-Received: by 2002:a05:6a20:1587:b0:1af:a5b1:2907 with SMTP id adf61e73a8af0-1b1f87eb570mr5720004637.3.1716466335288; Thu, 23 May 2024 05:12:15 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1716466335; cv=pass; d=google.com; s=arc-20160816; b=hdULdOGc+2lemW+vWDBm8nT2zSsEOchY3NxQAE1GfMIm52xybIWdZqPmj3qRne+F5J bSgYx1Bg05QE7b5OLICNNO3MwDd5CWAxEVWfLyCfKKZAGlNmjJqzaBo2WEH0DAoX5CEq evTNHnbQfIF5E4HlfqJQeMlVPLKB0m28Vm41RlozjPe3ssD4iPsb6ZFRPKUpAl2bbC/R bP1FO3KYwURz9DSZbTs/KrxYRq59zApDwvQwUKcSrmakkJE2X03cdOl+oDNfb2u5UKie 8XuPqpPRfWOqJeeuhMfiGfndgAi71OquscEi+0g1LBHkqYaLgGcOFMQya8vwQIUro5cP XuAw== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:message-id:date:subject:cc:to :from:dkim-signature; bh=aRpQV0ggTZ9sYp7IVuvFrHSGBMytPnWj/34nkkpFoho=; fh=nmDo0evxWwTAvBlxNELHY/fYZbxD4K9pluaUjPt1MrQ=; b=MRfieuoFj07SMPO0cYwvHeruC+/pmgfeMnFL/FVnEpVC4bWcIsrx3cFmkYXBn4/63e ddikZqF6HvkUqxampS7VTe13uVX7n5fGHPUbDS5BRsU2MUys/QG9v8QmOwffK8hWjVlN 2WVCpWQcGS3TGt27ZtGtttg7LZ/52JhOmRqO2RT++iebQ0bwvM3j3dVpUmy0rlvRoS1r ibSK1aQ8XQI0e4kknJc3ryuR+02B63DFwNDc36QSpl6YUB7BNtLzvxeUt3YAjm5xoWUF 9fgrNvlhOpgXRkxWr6rubfoMeVI7mwsxqeFMIeT+TSTZhj3fIWhM/MdnQs2/dZTbG1PL Cs8w==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=rjDMZ+X8; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-187439-linux.lists.archive=gmail.com@vger.kernel.org designates 139.178.88.99 as permitted sender) smtp.mailfrom="linux-kernel+bounces-187439-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from sv.mirrors.kernel.org (sv.mirrors.kernel.org. [139.178.88.99]) by mx.google.com with ESMTPS id 41be03b00d2f7-6340fe3ae03si4355983a12.290.2024.05.23.05.12.14 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 23 May 2024 05:12:15 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel+bounces-187439-linux.lists.archive=gmail.com@vger.kernel.org designates 139.178.88.99 as permitted sender) client-ip=139.178.88.99; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=rjDMZ+X8; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-187439-linux.lists.archive=gmail.com@vger.kernel.org designates 139.178.88.99 as permitted sender) smtp.mailfrom="linux-kernel+bounces-187439-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by sv.mirrors.kernel.org (Postfix) with ESMTPS id C3806283559 for ; Thu, 23 May 2024 12:12:14 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id D461C1482F2; Thu, 23 May 2024 12:11:57 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="rjDMZ+X8" Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id DC26F13B7A6; Thu, 23 May 2024 12:11:56 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1716466317; cv=none; b=Bscr/JhCuOEaCoUxHZcfUChjIj6hK+6q4DeRM8V5CXySF4bfQDWEvo8Ru4rZVRZpuuwyr5UoY4Uj/qNPTVdCXX5caBJZjr9GF6+zyIjMuMyWz+nfiTKDYh0uDqxW0/8+TsE/8pk2wJR5FwOOMgonfdLdbpNIBz7Rh3c0J+KmvZg= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1716466317; c=relaxed/simple; bh=xhLp6+5V0xlmhrqkFX+elbSl9+y8oMbSY1GFvmjPOMM=; h=From:To:Cc:Subject:Date:Message-ID:MIME-Version; b=mR6Xq8AH3eigeuDqdR8+D2bIG3I8nB+GyzDwYhZJpcL7g2sj8b+hw8bbOAMQToIIp4kt1IiQ2pGMqR5ga05/d8T6HrneZBzEBd/J0gUibc1J1WwvuNpo8ONCL95n+M2H6cZfQyFr7eYGLfWU+AcEpoE47TG51yvPmmIcfYWoUuQ= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=rjDMZ+X8; arc=none smtp.client-ip=10.30.226.201 Received: by smtp.kernel.org (Postfix) with ESMTPSA id 93E38C2BD10; Thu, 23 May 2024 12:11:51 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1716466316; bh=xhLp6+5V0xlmhrqkFX+elbSl9+y8oMbSY1GFvmjPOMM=; h=From:To:Cc:Subject:Date:From; b=rjDMZ+X8rvVLbvGmOLGESPv2flNWTO5uiEF4aVPrnYqcBEI40idTkjYkjpLmJ8AxP yMNtzRML1akYobzaUUvzgijEo2WH1aqc2yNH4SJqAC4ka51mpDkaOxMlvP/bnXUJOY 86gt6pBJwVyX10PeTvqkKHh0rA99MckpFA9Nf27Nk646PpZXh2LXYlSai6snQzzfQq qmhKbO70BftIwXFOa7E9kpKdX5PY70PJRs9UF063WEJvWQwycNMk+1ZfoUhrD3JwU1 q4dHGphCD7bVVvIBq2fqOnW+TfHUdnEDlYiesTyFL3isB/WDPxjlIniUq25YXketjy xI8i4Yd5taK2A== From: Jiri Olsa To: Steven Rostedt , Masami Hiramatsu , Oleg Nesterov , Alexei Starovoitov , Daniel Borkmann , Andrii Nakryiko Cc: linux-kernel@vger.kernel.org, linux-trace-kernel@vger.kernel.org, linux-api@vger.kernel.org, linux-man@vger.kernel.org, x86@kernel.org, bpf@vger.kernel.org, Song Liu , Yonghong Song , John Fastabend , Peter Zijlstra , Thomas Gleixner , "Borislav Petkov (AMD)" , Ingo Molnar , Andy Lutomirski , "Edgecombe, Rick P" , Deepak Gupta Subject: [PATCHv7 bpf-next 0/9] uprobe: uretprobe speed up Date: Thu, 23 May 2024 14:11:40 +0200 Message-ID: <20240523121149.575616-1-jolsa@kernel.org> X-Mailer: git-send-email 2.45.1 Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit hi, as part of the effort on speeding up the uprobes [0] coming with return uprobe optimization by using syscall instead of the trap on the uretprobe trampoline. The speed up depends on instruction type that uprobe is installed and depends on specific HW type, please check patch 1 for details. Patches 1-8 are based on bpf-next/master, but patch 2 and 3 are apply-able on linux-trace.git tree probes/for-next branch. Patch 9 is based on man-pages master. v7 changes: - fixes in man page [Alejandro Colomar] - fixed patch #1 fixes tag [Oleg] Also available at: https://git.kernel.org/pub/scm/linux/kernel/git/jolsa/perf.git uretprobe_syscall thanks, jirka Notes to check list items in Documentation/process/adding-syscalls.rst: - System Call Alternatives New syscall seems like the best way in here, because we need just to quickly enter kernel with no extra arguments processing, which we'd need to do if we decided to use another syscall. - Designing the API: Planning for Extension The uretprobe syscall is very specific and most likely won't be extended in the future. At the moment it does not take any arguments and even if it does in future, it's allowed to be called only from trampoline prepared by kernel, so there'll be no broken user. - Designing the API: Other Considerations N/A because uretprobe syscall does not return reference to kernel object. - Proposing the API Wiring up of the uretprobe system call is in separate change, selftests and man page changes are part of the patchset. - Generic System Call Implementation There's no CONFIG option for the new functionality because it keeps the same behaviour from the user POV. - x86 System Call Implementation It's 64-bit syscall only. - Compatibility System Calls (Generic) N/A uretprobe syscall has no arguments and is not supported for compat processes. - Compatibility System Calls (x86) N/A uretprobe syscall is not supported for compat processes. - System Calls Returning Elsewhere N/A. - Other Details N/A. - Testing Adding new bpf selftests and ran ltp on top of this change. - Man Page Attached. - Do not call System Calls in the Kernel N/A. [0] https://lore.kernel.org/bpf/ZeCXHKJ--iYYbmLj@krava/ --- Jiri Olsa (8): x86/shstk: Make return uprobe work with shadow stack uprobe: Wire up uretprobe system call uprobe: Add uretprobe syscall to speed up return probe selftests/x86: Add return uprobe shadow stack test selftests/bpf: Add uretprobe syscall test for regs integrity selftests/bpf: Add uretprobe syscall test for regs changes selftests/bpf: Add uretprobe syscall call from user space test selftests/bpf: Add uretprobe shadow stack test arch/x86/entry/syscalls/syscall_64.tbl | 1 + arch/x86/include/asm/shstk.h | 4 + arch/x86/kernel/shstk.c | 16 ++++ arch/x86/kernel/uprobes.c | 124 ++++++++++++++++++++++++++++- include/linux/syscalls.h | 2 + include/linux/uprobes.h | 3 + include/uapi/asm-generic/unistd.h | 5 +- kernel/events/uprobes.c | 24 ++++-- kernel/sys_ni.c | 2 + tools/include/linux/compiler.h | 4 + tools/testing/selftests/bpf/bpf_testmod/bpf_testmod.c | 123 ++++++++++++++++++++++++++++- tools/testing/selftests/bpf/prog_tests/uprobe_syscall.c | 385 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ tools/testing/selftests/bpf/progs/uprobe_syscall.c | 15 ++++ tools/testing/selftests/bpf/progs/uprobe_syscall_executed.c | 17 ++++ tools/testing/selftests/x86/test_shadow_stack.c | 145 ++++++++++++++++++++++++++++++++++ 15 files changed, 860 insertions(+), 10 deletions(-) create mode 100644 tools/testing/selftests/bpf/prog_tests/uprobe_syscall.c create mode 100644 tools/testing/selftests/bpf/progs/uprobe_syscall.c create mode 100644 tools/testing/selftests/bpf/progs/uprobe_syscall_executed.c Jiri Olsa (1): man2: Add uretprobe syscall page man/man2/uretprobe.2 | 56 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 56 insertions(+) create mode 100644 man/man2/uretprobe.2