Received: by 2002:a05:6a10:1a4d:0:0:0:0 with SMTP id nk13csp636381pxb; Tue, 1 Feb 2022 07:25:48 -0800 (PST) X-Google-Smtp-Source: ABdhPJzgSOB8xwX0zx9jcemOzWoIq1+2D5VRWZVm7teipOLmtdpVUM0bLdibXxSuID8g35gQSIye X-Received: by 2002:a17:907:1c0d:: with SMTP id nc13mr21882501ejc.657.1643729147705; Tue, 01 Feb 2022 07:25:47 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1643729147; cv=none; d=google.com; s=arc-20160816; b=g7n4Vknti5jQbwKE3xmn9ZUnoOC1lwiNiSMIYW78iCB3mmaLxyrzFHAHUpuP5QY18M zJaOXDKUkF6tpHf8f8rzUJA6KFKfeQHrv7pZpz8v+dOyV91cr1ZYGtfv9kRWO+qW/Mij 5lTihJoz1BNTHz7ow9kx7d7nppUiMN+kPfWAhDzDLqCaNLEejTuoEXXhUQ5MxFjn2zh7 JeB1U6pt9N9nBCjeDxeLTu0HPP+WENjBeDzIqdK8uVMus7fjQKCBK0wCIoyqd1ZMjnef 7lh62qqoSJy+NylWomQ+A9b8EbNHk6vY1dx88l+b4wxIAO9Uwe5cXQhyPR1B6dPUx8qQ U5Dg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :user-agent:references:in-reply-to:message-id:date:subject:cc:to :from:dkim-signature; bh=RThdOapw+LeBaQgDpTnqnnCLKXsOUoTcJz0kIxHwpHk=; b=kg7sfXUjlqmY2+AF9pLsRWC+f7gs/sOfSIDsz/Y5HKf7vqYK3kJcOzK+ai8Axh+4Az OwaQUiQnIpl0TgTDUNsVSsRMwgPn8VRI3pA3Ho8IZnSSmILaS6ltAsMiV0JZaW9GWqR/ Hj+NTu8owwbwf8j28POPU50DE13s0FrWO+4n7LjcVrxJa4cLaXmiiU02i8dGhQnJA9OJ hK+IjKI9M3VFBW2rYswiWq3mulruafuoLU6V92+aTRnp9NeKgDI6/TE9nK93s/T+EaKD w7goarF1lTCoQh4zg+MoAWUgUWrsOKCeP3QB6XvDN/Ge7vdAruvR5IE2dqG+SuZJPsaA S+QQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b="LKl/sysI"; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id sg37si10136791ejc.314.2022.02.01.07.25.21; Tue, 01 Feb 2022 07:25:47 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b="LKl/sysI"; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S234077AbiAaFA4 (ORCPT + 99 others); Mon, 31 Jan 2022 00:00:56 -0500 Received: from ams.source.kernel.org ([145.40.68.75]:37980 "EHLO ams.source.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S232498AbiAaFAs (ORCPT ); Mon, 31 Jan 2022 00:00:48 -0500 Received: from smtp.kernel.org (relay.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ams.source.kernel.org (Postfix) with ESMTPS id BD2F6B829FB; Mon, 31 Jan 2022 05:00:43 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id 2B568C340E8; Mon, 31 Jan 2022 05:00:38 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1643605242; bh=BB1zt2QPRCNo1YQ4q2R9YMSE5n8crsmlD0x6g+S4hXg=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=LKl/sysIY88pgLqay9ttb/FWOe+OiCCB5P6whfpu0TIUwAh59PIIp0eI7coQqxgPn uZ9/JCwvrs2SuBnjSgyK9878O38B7N19dBD+0xoM84/skpBFrAZxdUPdu1LIH+PVij WYcNqNqF0HFi5m16wAZWfIHH6pKTSMc+VljyS5LObXZJG7BKyBd6vyYkCK1GbNaJut mCUlmKpC9VWOPw4FsuJlSMOGyIihGg3p1VVAcVau7Fp2kE8qQhZs6j8oMCL/zU8O2u Z+WcVO8Z+/Mb+U/Wlt97X9B/VMx9cUZw39IVPGa5Uvl9LXVs0DCK7BpFwBxeXv2ndV Wbejwo6qXuNRg== From: Masami Hiramatsu To: Jiri Olsa , Alexei Starovoitov Cc: Daniel Borkmann , Andrii Nakryiko , Masami Hiramatsu , netdev@vger.kernel.org, bpf@vger.kernel.org, lkml , Martin KaFai Lau , Song Liu , Yonghong Song , John Fastabend , KP Singh , Steven Rostedt , "Naveen N . Rao" , Anil S Keshavamurthy , "David S . Miller" Subject: [PATCH v7 01/10] ftrace: Add ftrace_set_filter_ips function Date: Mon, 31 Jan 2022 14:00:36 +0900 Message-Id: <164360523642.65877.2910927913807016348.stgit@devnote2> X-Mailer: git-send-email 2.25.1 In-Reply-To: <164360522462.65877.1891020292202285106.stgit@devnote2> References: <164360522462.65877.1891020292202285106.stgit@devnote2> User-Agent: StGit/0.19 MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org From: Jiri Olsa Adding ftrace_set_filter_ips function to be able to set filter on multiple ip addresses at once. With the kprobe multi attach interface we have cases where we need to initialize ftrace_ops object with thousands of functions, so having single function diving into ftrace_hash_move_and_update_ops with ftrace_lock is faster. The functions ips are passed as unsigned long array with count. Signed-off-by: Jiri Olsa --- Changes in v6: [Masami] - Fix a typo and add a comment. --- include/linux/ftrace.h | 3 ++ kernel/trace/ftrace.c | 58 +++++++++++++++++++++++++++++++++++++++++------- 2 files changed, 52 insertions(+), 9 deletions(-) diff --git a/include/linux/ftrace.h b/include/linux/ftrace.h index 9999e29187de..60847cbce0da 100644 --- a/include/linux/ftrace.h +++ b/include/linux/ftrace.h @@ -512,6 +512,8 @@ struct dyn_ftrace { int ftrace_set_filter_ip(struct ftrace_ops *ops, unsigned long ip, int remove, int reset); +int ftrace_set_filter_ips(struct ftrace_ops *ops, unsigned long *ips, + unsigned int cnt, int remove, int reset); int ftrace_set_filter(struct ftrace_ops *ops, unsigned char *buf, int len, int reset); int ftrace_set_notrace(struct ftrace_ops *ops, unsigned char *buf, @@ -802,6 +804,7 @@ static inline unsigned long ftrace_location(unsigned long ip) #define ftrace_regex_open(ops, flag, inod, file) ({ -ENODEV; }) #define ftrace_set_early_filter(ops, buf, enable) do { } while (0) #define ftrace_set_filter_ip(ops, ip, remove, reset) ({ -ENODEV; }) +#define ftrace_set_filter_ips(ops, ips, cnt, remove, reset) ({ -ENODEV; }) #define ftrace_set_filter(ops, buf, len, reset) ({ -ENODEV; }) #define ftrace_set_notrace(ops, buf, len, reset) ({ -ENODEV; }) #define ftrace_free_filter(ops) do { } while (0) diff --git a/kernel/trace/ftrace.c b/kernel/trace/ftrace.c index b01e1fa62193..a28b1bdb234a 100644 --- a/kernel/trace/ftrace.c +++ b/kernel/trace/ftrace.c @@ -4958,7 +4958,7 @@ ftrace_notrace_write(struct file *file, const char __user *ubuf, } static int -ftrace_match_addr(struct ftrace_hash *hash, unsigned long ip, int remove) +__ftrace_match_addr(struct ftrace_hash *hash, unsigned long ip, int remove) { struct ftrace_func_entry *entry; @@ -4976,9 +4976,30 @@ ftrace_match_addr(struct ftrace_hash *hash, unsigned long ip, int remove) return add_hash_entry(hash, ip); } +static int +ftrace_match_addr(struct ftrace_hash *hash, unsigned long *ips, + unsigned int cnt, int remove) +{ + unsigned int i; + int err; + + for (i = 0; i < cnt; i++) { + err = __ftrace_match_addr(hash, ips[i], remove); + if (err) { + /* + * This expects the @hash is a temporary hash and if this + * fails the caller must free the @hash. + */ + return err; + } + } + return 0; +} + static int ftrace_set_hash(struct ftrace_ops *ops, unsigned char *buf, int len, - unsigned long ip, int remove, int reset, int enable) + unsigned long *ips, unsigned int cnt, + int remove, int reset, int enable) { struct ftrace_hash **orig_hash; struct ftrace_hash *hash; @@ -5008,8 +5029,8 @@ ftrace_set_hash(struct ftrace_ops *ops, unsigned char *buf, int len, ret = -EINVAL; goto out_regex_unlock; } - if (ip) { - ret = ftrace_match_addr(hash, ip, remove); + if (ips) { + ret = ftrace_match_addr(hash, ips, cnt, remove); if (ret < 0) goto out_regex_unlock; } @@ -5026,10 +5047,10 @@ ftrace_set_hash(struct ftrace_ops *ops, unsigned char *buf, int len, } static int -ftrace_set_addr(struct ftrace_ops *ops, unsigned long ip, int remove, - int reset, int enable) +ftrace_set_addr(struct ftrace_ops *ops, unsigned long *ips, unsigned int cnt, + int remove, int reset, int enable) { - return ftrace_set_hash(ops, NULL, 0, ip, remove, reset, enable); + return ftrace_set_hash(ops, NULL, 0, ips, cnt, remove, reset, enable); } #ifdef CONFIG_DYNAMIC_FTRACE_WITH_DIRECT_CALLS @@ -5628,10 +5649,29 @@ int ftrace_set_filter_ip(struct ftrace_ops *ops, unsigned long ip, int remove, int reset) { ftrace_ops_init(ops); - return ftrace_set_addr(ops, ip, remove, reset, 1); + return ftrace_set_addr(ops, &ip, 1, remove, reset, 1); } EXPORT_SYMBOL_GPL(ftrace_set_filter_ip); +/** + * ftrace_set_filter_ips - set functions to filter on in ftrace by addresses + * @ops - the ops to set the filter with + * @ips - the array of addresses to add to or remove from the filter. + * @cnt - the number of addresses in @ips + * @remove - non zero to remove ips from the filter + * @reset - non zero to reset all filters before applying this filter. + * + * Filters denote which functions should be enabled when tracing is enabled + * If @ips array or any ip specified within is NULL , it fails to update filter. + */ +int ftrace_set_filter_ips(struct ftrace_ops *ops, unsigned long *ips, + unsigned int cnt, int remove, int reset) +{ + ftrace_ops_init(ops); + return ftrace_set_addr(ops, ips, cnt, remove, reset, 1); +} +EXPORT_SYMBOL_GPL(ftrace_set_filter_ips); + /** * ftrace_ops_set_global_filter - setup ops to use global filters * @ops - the ops which will use the global filters @@ -5653,7 +5693,7 @@ static int ftrace_set_regex(struct ftrace_ops *ops, unsigned char *buf, int len, int reset, int enable) { - return ftrace_set_hash(ops, buf, len, 0, 0, reset, enable); + return ftrace_set_hash(ops, buf, len, NULL, 0, 0, reset, enable); } /**