Received: by 2002:a25:1985:0:0:0:0:0 with SMTP id 127csp942108ybz; Wed, 22 Apr 2020 10:38:18 -0700 (PDT) X-Google-Smtp-Source: APiQypKZ23oZ66nlMhPXSRgrdel8jhkyZ9F77CLdDlP1fQQbnYWH4lXu9q24xB1//yX7rbKnClsg X-Received: by 2002:a05:6402:b99:: with SMTP id cf25mr24073780edb.372.1587577098764; Wed, 22 Apr 2020 10:38:18 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1587577098; cv=none; d=google.com; s=arc-20160816; b=fXSdqsF/aU6JCLHWmNWDcW5xMLdy6ay0nTx/atzPNBzmzrrKLY+XHcEmQCV5AINeRJ 20CLlgDqnwO8PZrfZJGxroBYcz6qeo7eSRvYT/SLkneom7FZjWUjhUhUq0AkLsZpmjhn apz7h2gFkW5oDXQF9SODM4z+bsNO7acTTB7CoUVvEbji9f7RsxEH7x8IPV3wIotYa0Ct HRd+9nHv34YGNJ6kKZqnPd57Co9oPAMdnKViiyL91tSiL4bhbOwqRfybc20XBu06gs1n e56RMU8phLlsFO35YD5s90iylH3uU/uK1d7wCa5I/4NIlFUxQ5zcboqjaG48P08JgIoK X2DA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:references:in-reply-to:message-id:date :subject:cc:to:from:dkim-signature; bh=upttJD2FlVOwQ9TcHJ5acrg3a8ThasRlmqF+H/glYss=; b=OwBdFzY5zNw66pA3l02T5piRZJMGJrXDPctxbdBMXRKTiKlItw+D0xT0DPkLk5JTNS L2W5ezAmAGut8Y3MaZp4jhd6y1tFGu/GpVcAqXLhYmJCEntouKToAe3iiXmbHXzP6R1U q0+rEkqubguNa4cFfzoB243T8XW+YHNytcebvRW/hXTXZvhfGX9YjYQTTSl+9Kg/Or7H U32Eo6vxzij8qUiumDY5VvyUfzS79dL0alXMoUt5D1VujTY75EZ4pggrjsj3eu1EI+a5 V2ng8p5+J3CRmco/5kQqfDuBMIYFULd9LZgjwMJ+yfVh4fdKDk1q0BJvQB/nlPfxbwnq AKAQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@cs.washington.edu header.s=goo201206 header.b=NBfIrE2N; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=cs.washington.edu Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id c17si3816840ejn.336.2020.04.22.10.37.56; Wed, 22 Apr 2020 10:38:18 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@cs.washington.edu header.s=goo201206 header.b=NBfIrE2N; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=cs.washington.edu Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726750AbgDVRgz (ORCPT + 99 others); Wed, 22 Apr 2020 13:36:55 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:46732 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-FAIL-OK-FAIL) by vger.kernel.org with ESMTP id S1726057AbgDVRgy (ORCPT ); Wed, 22 Apr 2020 13:36:54 -0400 Received: from mail-pl1-x643.google.com (mail-pl1-x643.google.com [IPv6:2607:f8b0:4864:20::643]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 01D2CC03C1AA for ; Wed, 22 Apr 2020 10:36:54 -0700 (PDT) Received: by mail-pl1-x643.google.com with SMTP id n24so1201691plp.13 for ; Wed, 22 Apr 2020 10:36:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cs.washington.edu; s=goo201206; h=from:to:cc:subject:date:message-id:in-reply-to:references; bh=upttJD2FlVOwQ9TcHJ5acrg3a8ThasRlmqF+H/glYss=; b=NBfIrE2NjATpSGVDPNE+eakCKhcK491SMXS/kR2TKZL8ND/4YKdgiho0fYch+YM0x3 XKtxnoC3m7J4rsHW0IJSKDqWhhsUHzLRXNRQ+dXmwE7HM4hPbnbD9SG3pq+bonaFUv1N OZsmFi2XvW6HsoLuZg3mj5gSfzRVJyzs3/4LY= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references; bh=upttJD2FlVOwQ9TcHJ5acrg3a8ThasRlmqF+H/glYss=; b=IDGI5Ol8kN0XA2HbGi2wBj2flG2+kzAaBRVQVtf/MSGO8FIKIFsze6skNib5/IYwzN LsakAd20AijjnmhCGBg+qNXCKEZVYx1GozrlFaxVXdOnHb8cPRsNrBgK3rb91IwBqlkA EhcP0GPZbKOqzAJWGf4weqG1FGq6vomP1EiRqExCgHQs6hBXrJyaTEBQefvBD4Stl32n yPTu5e5IEDIOjSpCEcY8UYJkrOiLzDKMtm3E6QwWibIE/EW7b9DO/DzwTi7JVFKPT2jC 2qGdWzQS9STDPmGxYjMOtSGVk4oMMcWdluxACmZS3dtHBy9kgM87TbwWdqNkQ/wxZGXY X/xA== X-Gm-Message-State: AGi0PuZKYGUg3aA+QUy1vKqRTnlEDAaQKdC5ProK+sQ/rJb4XxehI+0Q mwPphL9X1IojMJI2jfOwgcdMqQ== X-Received: by 2002:a17:90a:b10f:: with SMTP id z15mr11890687pjq.188.1587577013353; Wed, 22 Apr 2020 10:36:53 -0700 (PDT) Received: from localhost.localdomain (c-73-53-94-119.hsd1.wa.comcast.net. [73.53.94.119]) by smtp.gmail.com with ESMTPSA id 1sm59514pff.151.2020.04.22.10.36.52 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 22 Apr 2020 10:36:52 -0700 (PDT) From: Luke Nelson X-Google-Original-From: Luke Nelson To: bpf@vger.kernel.org Cc: Brian Gerst , Luke Nelson , Xi Wang , "David S. Miller" , Alexey Kuznetsov , Hideaki YOSHIFUJI , Wang YanQing , Thomas Gleixner , Ingo Molnar , Borislav Petkov , x86@kernel.org, "H. Peter Anvin" , Alexei Starovoitov , Daniel Borkmann , Martin KaFai Lau , Song Liu , Yonghong Song , Andrii Nakryiko , John Fastabend , KP Singh , netdev@vger.kernel.org, linux-kernel@vger.kernel.org Subject: [PATCH bpf v2 2/2] bpf, x86_32: Fix clobbering of dst for BPF_JSET Date: Wed, 22 Apr 2020 10:36:30 -0700 Message-Id: <20200422173630.8351-2-luke.r.nels@gmail.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20200422173630.8351-1-luke.r.nels@gmail.com> References: <20200422173630.8351-1-luke.r.nels@gmail.com> Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org The current JIT clobbers the destination register for BPF_JSET BPF_X and BPF_K by using "and" and "or" instructions. This is fine when the destination register is a temporary loaded from a register stored on the stack but not otherwise. This patch fixes the problem (for both BPF_K and BPF_X) by always loading the destination register into temporaries since BPF_JSET should not modify the destination register. This bug may not be currently triggerable as BPF_REG_AX is the only register not stored on the stack and the verifier uses it in a limited way. Fixes: 03f5781be2c7b ("bpf, x86_32: add eBPF JIT compiler for ia32") Signed-off-by: Xi Wang Signed-off-by: Luke Nelson --- v1 -> v2: No changes. --- arch/x86/net/bpf_jit_comp32.c | 22 ++++++++++++++++++---- 1 file changed, 18 insertions(+), 4 deletions(-) diff --git a/arch/x86/net/bpf_jit_comp32.c b/arch/x86/net/bpf_jit_comp32.c index cc9ad3892ea6..ba7d9ccfc662 100644 --- a/arch/x86/net/bpf_jit_comp32.c +++ b/arch/x86/net/bpf_jit_comp32.c @@ -2015,8 +2015,8 @@ static int do_jit(struct bpf_prog *bpf_prog, int *addrs, u8 *image, case BPF_JMP | BPF_JSET | BPF_X: case BPF_JMP32 | BPF_JSET | BPF_X: { bool is_jmp64 = BPF_CLASS(insn->code) == BPF_JMP; - u8 dreg_lo = dstk ? IA32_EAX : dst_lo; - u8 dreg_hi = dstk ? IA32_EDX : dst_hi; + u8 dreg_lo = IA32_EAX; + u8 dreg_hi = IA32_EDX; u8 sreg_lo = sstk ? IA32_ECX : src_lo; u8 sreg_hi = sstk ? IA32_EBX : src_hi; @@ -2028,6 +2028,13 @@ static int do_jit(struct bpf_prog *bpf_prog, int *addrs, u8 *image, add_2reg(0x40, IA32_EBP, IA32_EDX), STACK_VAR(dst_hi)); + } else { + /* mov dreg_lo,dst_lo */ + EMIT2(0x89, add_2reg(0xC0, dreg_lo, dst_lo)); + if (is_jmp64) + /* mov dreg_hi,dst_hi */ + EMIT2(0x89, + add_2reg(0xC0, dreg_hi, dst_hi)); } if (sstk) { @@ -2052,8 +2059,8 @@ static int do_jit(struct bpf_prog *bpf_prog, int *addrs, u8 *image, case BPF_JMP | BPF_JSET | BPF_K: case BPF_JMP32 | BPF_JSET | BPF_K: { bool is_jmp64 = BPF_CLASS(insn->code) == BPF_JMP; - u8 dreg_lo = dstk ? IA32_EAX : dst_lo; - u8 dreg_hi = dstk ? IA32_EDX : dst_hi; + u8 dreg_lo = IA32_EAX; + u8 dreg_hi = IA32_EDX; u8 sreg_lo = IA32_ECX; u8 sreg_hi = IA32_EBX; u32 hi; @@ -2066,6 +2073,13 @@ static int do_jit(struct bpf_prog *bpf_prog, int *addrs, u8 *image, add_2reg(0x40, IA32_EBP, IA32_EDX), STACK_VAR(dst_hi)); + } else { + /* mov dreg_lo,dst_lo */ + EMIT2(0x89, add_2reg(0xC0, dreg_lo, dst_lo)); + if (is_jmp64) + /* mov dreg_hi,dst_hi */ + EMIT2(0x89, + add_2reg(0xC0, dreg_hi, dst_hi)); } /* mov ecx,imm32 */ -- 2.17.1