Received: by 2002:a05:6500:1b45:b0:1f5:f2ab:c469 with SMTP id cz5csp958073lqb; Wed, 17 Apr 2024 16:36:43 -0700 (PDT) X-Forwarded-Encrypted: i=3; AJvYcCU63Ts0g46UpgnGPSNv2yxAzbo13VrcsjEF737tebD/Q+UIfMa/K0sRoHtojch1Q2+yd9eYBlyyF1aTgGs91icFCJDIfvvKbbLbwHnI+Q== X-Google-Smtp-Source: AGHT+IFXXiBMZOBTKj7pTYptKkp9i8OZ3lJT7T4909bVYya6WYQZRX1IxlYyxwJf0Dcz5g8UxCDB X-Received: by 2002:a17:902:b78b:b0:1dd:c288:899f with SMTP id e11-20020a170902b78b00b001ddc288899fmr972929pls.18.1713397003314; Wed, 17 Apr 2024 16:36:43 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1713397003; cv=pass; d=google.com; s=arc-20160816; b=PmthDGweK67POyicbJd1bj5klNxndO3jdfOeZI+Gplg0cTXIKSosXCslXe372jM9Dv FDNsmdT6LhcW3mOeKuAl2h7SeyzmXUIA7QbZcu/fcaoH3FAKHas3HJUGoDsg1QWV5y7I FdLMX47kcDkbRCJOzixWHETkSrLntMXt1txWibP4lZEM4HSj+U7MvMX/yw51bWthGKWj LqzxuUDHqVYAmWhQOHrNlzI/3dumwsmK8trRYJF1Fhu8W0bTcb7SUhqBEKQ/G/w2hhY+ jzgOZlhCXSgPMK+n01aFPlSvlQMy2a/1i6VpKs63SnzU3rpuqQ2U2urToxFANZ3tOQBt 49rA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=cc:to:from:subject:message-id:references:mime-version :list-unsubscribe:list-subscribe:list-id:precedence:in-reply-to:date :dkim-signature; bh=aKWbykd/pvXefdqIhK0DoW6kcYAE/27xvKH2hViWgHo=; fh=nn8l+v0EJiRiIm54BdoMo5HEVu4Y/V42G0wvcVXLU2U=; b=Rye5VhekS18a2CzN5MXMzjoKYWTjva2w6A9lB/D75OncG/UERW6m69IoP9HLLb/mLf kqbcmkiGGz3C1I/YstNULwvHLkobQnGxASKYdmkgmPK4YeDrcgoThdyZAdM/g+NoOUmy CJFViNIrsIrGOevl6Vm1phE/FjSo66n950EPJXcXJE4IOblp66q4nmGWcAoKP2ozwvyO Vse/psQD8hGsvKe4Ey707lbuZ2wWCI3+turxQ0dVht6oE0c2EAbWMVpbeS9Q5xJWm0qt zqo9/cXlvjVCsY0BZLePBBJ5R0/sIVdvKirVjM4dSRPDmC2XK7gZcVaA+Cr8iqyrpeuc Lwpw==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@google.com header.s=20230601 header.b=EeQWBXMm; arc=pass (i=1 spf=pass spfdomain=flex--edliaw.bounces.google.com dkim=pass dkdomain=google.com dmarc=pass fromdomain=google.com); spf=pass (google.com: domain of linux-kernel+bounces-149315-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45e3:2400::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-149315-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Return-Path: Received: from sv.mirrors.kernel.org (sv.mirrors.kernel.org. [2604:1380:45e3:2400::1]) by mx.google.com with ESMTPS id z5-20020a1709028f8500b001e47d98b4e8si267467plo.183.2024.04.17.16.36.43 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 17 Apr 2024 16:36:43 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel+bounces-149315-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45e3:2400::1 as permitted sender) client-ip=2604:1380:45e3:2400::1; Authentication-Results: mx.google.com; dkim=pass header.i=@google.com header.s=20230601 header.b=EeQWBXMm; arc=pass (i=1 spf=pass spfdomain=flex--edliaw.bounces.google.com dkim=pass dkdomain=google.com dmarc=pass fromdomain=google.com); spf=pass (google.com: domain of linux-kernel+bounces-149315-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45e3:2400::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-149315-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by sv.mirrors.kernel.org (Postfix) with ESMTPS id AFA5428359E for ; Wed, 17 Apr 2024 23:36:42 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id D497F173339; Wed, 17 Apr 2024 23:36:04 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=google.com header.i=@google.com header.b="EeQWBXMm" Received: from mail-yw1-f201.google.com (mail-yw1-f201.google.com [209.85.128.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 3EB87171658 for ; Wed, 17 Apr 2024 23:36:01 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.128.201 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1713396963; cv=none; b=OWyUNJ9frQbYt1+zYyuBfTkAl1Y+7wmIxpnpf1j/EyZ9qvohS+r8ePypQcg70ZPLu4cyXS21yvwzlGopCat0cO/IQqSfQ7JSwjP5QEe024+IesYdFkcKSbZVEkeh/DvoEDBh5bnPuvUNbxwwrZsEJ5ydgAyLlnhj7gRA0HA1oF0= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1713396963; c=relaxed/simple; bh=TDxiqI6PHC/dVqTVdGJliaN8X5fJ3Jf4K0MnfEupi98=; h=Date:In-Reply-To:Mime-Version:References:Message-ID:Subject:From: To:Cc:Content-Type; b=NEaoMDe7H+/WBl7a3WQa0OaJ35UP9VZIwjOFN2qzBmiwrmRBbkh+a1KA+36GjGHjmMD7BkR1jxSlTQecxdA5LvlJge+lUdZAUvuA+BAnB6sl6YbBcJvwEQh3rR6EftxYaQfGtG/pvk+CRVOnV/FCGCU+VfWqrj5DPy6z25U7jE0= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=google.com; spf=pass smtp.mailfrom=flex--edliaw.bounces.google.com; dkim=pass (2048-bit key) header.d=google.com header.i=@google.com header.b=EeQWBXMm; arc=none smtp.client-ip=209.85.128.201 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=google.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=flex--edliaw.bounces.google.com Received: by mail-yw1-f201.google.com with SMTP id 00721157ae682-61892d91207so4014897b3.3 for ; Wed, 17 Apr 2024 16:36:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20230601; t=1713396960; x=1714001760; darn=vger.kernel.org; h=cc:to:from:subject:message-id:references:mime-version:in-reply-to :date:from:to:cc:subject:date:message-id:reply-to; bh=aKWbykd/pvXefdqIhK0DoW6kcYAE/27xvKH2hViWgHo=; b=EeQWBXMmhd+g2A9tmNlfA8bYL8gjKextG5Ye8GGNA2asT3n6aAC2cFbs4GuwYuYB/l zbEVvQL5Wkuk2NPkCBYFSAn8EEBAU+ZZauFrE2dGGZDxEiJA6MZP/Uotq5fZacxMLC60 fBiQnVMYZhvuITQcoFOfQlyrMfMMi66q1fbCrZvfKdImcrAH5H637VWX8oyRfs+ul0Yw jYWw55UGFkbhfZG4lh0ssjfQg34VEwt2MliM7iV1nIzkArYsCbNb1DWTpZHryx5BJtM1 XeOj7AlNZ/K6OPGCuVw8k5IKR0bMIO3PQ0ldJM8+90JwHBPNoc07OVCoDVVI3SDpRgEi KN2g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1713396960; x=1714001760; h=cc:to:from:subject:message-id:references:mime-version:in-reply-to :date:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=aKWbykd/pvXefdqIhK0DoW6kcYAE/27xvKH2hViWgHo=; b=ctkkEJT4S98ktV7AjpjbmdQFTdBykMl5uySihVVUaoJBo0mrQ98Do0Y4tH9kNmvtFi nqzzNLtgA3LzeqYmsrEUdT7Wbvpz2Vf5rjdr1pr5i9r2VOcKyXUdVOyd1JfLrtqkFM6M B44bLpOdqogsj5D8peqlLniGqoNLyB6IMa0UA3YZgHm13m6rVo75oHHxg7jIsDWaPOTk cv/YdmkPFc7TX6BJnRiSFEjDCMvFZv3aGjUTDp0vVlxINBetUb0ss9dFjdt8rPtpcSoO gTUNTfh3VwpBspzijzvtReGYK1cERBj40tj11SMikl26ua1tMn0X7gpAA6ao9YfsJYSH BsfA== X-Forwarded-Encrypted: i=1; AJvYcCX13LwSk05+Nalk1/rWZMeRrCmmY+VtzJWJsixy02djqGtXyy8VRu7hovt6pWfFllwnIgOU6g3JLuGfXF2R0aPSPS2ppLU1kVDo5Hxs X-Gm-Message-State: AOJu0YzdrqRQE3Tlw6OrM4Vs9bL+0qLzhDMOdn/a633LOrupuvNOK4aW l7QZ4KdkYkgLDCwkNhE7c32Ut+1qDTGbl3waxK7wkpwyTFd4SavV5rcvgsGO81F0qaYmpiHlDsM 80Q== X-Received: from edliaw.c.googlers.com ([fda3:e722:ac3:cc00:24:72f4:c0a8:305d]) (user=edliaw job=sendgmr) by 2002:a0d:ea44:0:b0:61b:3a8:330f with SMTP id t65-20020a0dea44000000b0061b03a8330fmr172771ywe.5.1713396960299; Wed, 17 Apr 2024 16:36:00 -0700 (PDT) Date: Wed, 17 Apr 2024 23:35:03 +0000 In-Reply-To: <20240417233517.3044316-1-edliaw@google.com> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: Mime-Version: 1.0 References: <16430256912363@kroah.com> <20240417233517.3044316-1-edliaw@google.com> X-Mailer: git-send-email 2.44.0.769.g3c40516874-goog Message-ID: <20240417233517.3044316-2-edliaw@google.com> Subject: [PATCH 5.15.y 1/5] bpf: Extend kfunc with PTR_TO_CTX, PTR_TO_MEM argument support From: Edward Liaw To: stable@vger.kernel.org, Alexei Starovoitov , Daniel Borkmann , Andrii Nakryiko , Martin KaFai Lau , Song Liu , Yonghong Song , John Fastabend , KP Singh , Hao Luo Cc: bpf@vger.kernel.org, kernel-team@android.com, Edward Liaw , netdev@vger.kernel.org, linux-kernel@vger.kernel.org, Kumar Kartikeya Dwivedi Content-Type: text/plain; charset="UTF-8" From: Kumar Kartikeya Dwivedi Allow passing PTR_TO_CTX, if the kfunc expects a matching struct type, and punt to PTR_TO_MEM block if reg->type does not fall in one of PTR_TO_BTF_ID or PTR_TO_SOCK* types. This will be used by future commits to get access to XDP and TC PTR_TO_CTX, and pass various data (flags, l4proto, netns_id, etc.) encoded in opts struct passed as pointer to kfunc. For PTR_TO_MEM support, arguments are currently limited to pointer to scalar, or pointer to struct composed of scalars. This is done so that unsafe scenarios (like passing PTR_TO_MEM where PTR_TO_BTF_ID of in-kernel valid structure is expected, which may have pointers) are avoided. Since the argument checking happens basd on argument register type, it is not easy to ascertain what the expected type is. In the future, support for PTR_TO_MEM for kfunc can be extended to serve other usecases. The struct type whose pointer is passed in may have maximum nesting depth of 4, all recursively composed of scalars or struct with scalars. Future commits will add negative tests that check whether these restrictions imposed for kfunc arguments are duly rejected by BPF verifier or not. Signed-off-by: Kumar Kartikeya Dwivedi Signed-off-by: Alexei Starovoitov Link: https://lore.kernel.org/bpf/20211217015031.1278167-4-memxor@gmail.com (cherry picked from commit 3363bd0cfbb80dfcd25003cd3815b0ad8b68d0ff) [edliaw: fixed up with changes from 45ce4b4f90091 ("bpf: Fix crash due to out of bounds access into reg2btf_ids.")] Signed-off-by: Edward Liaw --- kernel/bpf/btf.c | 93 +++++++++++++++++++++++++++++++++++++----------- 1 file changed, 73 insertions(+), 20 deletions(-) diff --git a/kernel/bpf/btf.c b/kernel/bpf/btf.c index 0c2fa93bd8d2..b02f074363dd 100644 --- a/kernel/bpf/btf.c +++ b/kernel/bpf/btf.c @@ -5441,6 +5441,46 @@ static u32 *reg2btf_ids[__BPF_REG_TYPE_MAX] = { #endif }; +/* Returns true if struct is composed of scalars, 4 levels of nesting allowed */ +static bool __btf_type_is_scalar_struct(struct bpf_verifier_log *log, + const struct btf *btf, + const struct btf_type *t, int rec) +{ + const struct btf_type *member_type; + const struct btf_member *member; + u32 i; + + if (!btf_type_is_struct(t)) + return false; + + for_each_member(i, t, member) { + const struct btf_array *array; + + member_type = btf_type_skip_modifiers(btf, member->type, NULL); + if (btf_type_is_struct(member_type)) { + if (rec >= 3) { + bpf_log(log, "max struct nesting depth exceeded\n"); + return false; + } + if (!__btf_type_is_scalar_struct(log, btf, member_type, rec + 1)) + return false; + continue; + } + if (btf_type_is_array(member_type)) { + array = btf_type_array(member_type); + if (!array->nelems) + return false; + member_type = btf_type_skip_modifiers(btf, array->type, NULL); + if (!btf_type_is_scalar(member_type)) + return false; + continue; + } + if (!btf_type_is_scalar(member_type)) + return false; + } + return true; +} + static int btf_check_func_arg_match(struct bpf_verifier_env *env, const struct btf *btf, u32 func_id, struct bpf_reg_state *regs, @@ -5449,6 +5489,7 @@ static int btf_check_func_arg_match(struct bpf_verifier_env *env, enum bpf_prog_type prog_type = env->prog->type == BPF_PROG_TYPE_EXT ? env->prog->aux->dst_prog->type : env->prog->type; struct bpf_verifier_log *log = &env->log; + bool is_kfunc = btf_is_kernel(btf); const char *func_name, *ref_tname; const struct btf_type *t, *ref_t; const struct btf_param *args; @@ -5501,7 +5542,20 @@ static int btf_check_func_arg_match(struct bpf_verifier_env *env, ref_t = btf_type_skip_modifiers(btf, t->type, &ref_id); ref_tname = btf_name_by_offset(btf, ref_t->name_off); - if (btf_is_kernel(btf)) { + if (btf_get_prog_ctx_type(log, btf, t, + env->prog->type, i)) { + /* If function expects ctx type in BTF check that caller + * is passing PTR_TO_CTX. + */ + if (reg->type != PTR_TO_CTX) { + bpf_log(log, + "arg#%d expected pointer to ctx, but got %s\n", + i, btf_type_str(t)); + return -EINVAL; + } + if (check_ctx_reg(env, reg, regno)) + return -EINVAL; + } else if (is_kfunc && (reg->type == PTR_TO_BTF_ID || reg2btf_ids[reg->type])) { const struct btf_type *reg_ref_t; const struct btf *reg_btf; const char *reg_ref_tname; @@ -5517,14 +5571,9 @@ static int btf_check_func_arg_match(struct bpf_verifier_env *env, if (reg->type == PTR_TO_BTF_ID) { reg_btf = reg->btf; reg_ref_id = reg->btf_id; - } else if (reg2btf_ids[base_type(reg->type)]) { + } else { reg_btf = btf_vmlinux; reg_ref_id = *reg2btf_ids[base_type(reg->type)]; - } else { - bpf_log(log, "kernel function %s args#%d expected pointer to %s %s but R%d is not a pointer to btf_id\n", - func_name, i, - btf_type_str(ref_t), ref_tname, regno); - return -EINVAL; } reg_ref_t = btf_type_skip_modifiers(reg_btf, reg_ref_id, @@ -5540,22 +5589,24 @@ static int btf_check_func_arg_match(struct bpf_verifier_env *env, reg_ref_tname); return -EINVAL; } - } else if (btf_get_prog_ctx_type(log, btf, t, prog_type, i)) { - /* If function expects ctx type in BTF check that caller - * is passing PTR_TO_CTX. - */ - if (reg->type != PTR_TO_CTX) { - bpf_log(log, - "arg#%d expected pointer to ctx, but got %s\n", - i, btf_type_str(t)); - return -EINVAL; - } - if (check_ctx_reg(env, reg, regno)) - return -EINVAL; } else if (ptr_to_mem_ok) { const struct btf_type *resolve_ret; u32 type_size; + if (is_kfunc) { + /* Permit pointer to mem, but only when argument + * type is pointer to scalar, or struct composed + * (recursively) of scalars. + */ + if (!btf_type_is_scalar(ref_t) && + !__btf_type_is_scalar_struct(log, btf, ref_t, 0)) { + bpf_log(log, + "arg#%d pointer type %s %s must point to scalar or struct with scalar\n", + i, btf_type_str(ref_t), ref_tname); + return -EINVAL; + } + } + resolve_ret = btf_resolve_size(btf, ref_t, &type_size); if (IS_ERR(resolve_ret)) { bpf_log(log, @@ -5568,6 +5619,8 @@ static int btf_check_func_arg_match(struct bpf_verifier_env *env, if (check_mem_reg(env, reg, regno, type_size)) return -EINVAL; } else { + bpf_log(log, "reg type unsupported for arg#%d %sfunction %s#%d\n", i, + is_kfunc ? "kernel " : "", func_name, func_id); return -EINVAL; } } @@ -5617,7 +5670,7 @@ int btf_check_kfunc_arg_match(struct bpf_verifier_env *env, const struct btf *btf, u32 func_id, struct bpf_reg_state *regs) { - return btf_check_func_arg_match(env, btf, func_id, regs, false); + return btf_check_func_arg_match(env, btf, func_id, regs, true); } /* Convert BTF of a function into bpf_reg_state if possible -- 2.44.0.769.g3c40516874-goog