Received: by 2002:a05:6a10:5bc5:0:0:0:0 with SMTP id os5csp573935pxb; Wed, 3 Nov 2021 08:51:41 -0700 (PDT) X-Google-Smtp-Source: ABdhPJwmtaiv6nZx9iGhVRPH5D7cT9YNW7fleo9tNT60d54ZH4cfdUMHjWwZ1BFIJxvLZncM9vEf X-Received: by 2002:a05:6402:95b:: with SMTP id h27mr15847035edz.116.1635954701709; Wed, 03 Nov 2021 08:51:41 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1635954701; cv=none; d=google.com; s=arc-20160816; b=SEAKAEiGdGvgmN3mk9QTK+M35ovXt2S1r0NmK5XtFqMmRUfxSIgSZW3Aq6abtekuYD Skp9MueaRoWi6UPR8XDkr89745A+xYH6QBG7TQi7bCQPZ4XSYW6JxjB3pNVzgt9WPtqL kXt8Nsiv+EzkNqdVSH8qgS9zhBW9kitVQ6/cNJspcCfORxhLqZF41CmZ9L/JwFKqlQq6 1WSH3pKeSnJkVekSex49efw4mTuTcgmkGoB7leugTjGxofYzAGZekSljt/egpqhVA9FB 6/jZ04d9sLwkfrElONbE52iWAgb87r/ntYIkReoLTyRqHLLfBkRU9JCKprz3SaeJN+JP Beeg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from :dkim-signature; bh=Ges7q3BgScavtJ8d4Zd9sUgng8bmnzEVAy2FbAT0sY8=; b=VpPdY7bRhxIThJQ16CfXeXpCKZydBhjNiGuUkujnX/a5ssMjjHYQeshUqJKuvYvryz uSobElzpYFy7IW7jUzHFIgHoitV3PsUEdzu60q3l1NtOhcPg0C3+h5WW0f1ICPNBmXXP LCx1mOZBKbAHKPSCatAtEoeEK6OPLIldhBDkt7GYrgizsiBkYDAUv3ZGAxLqDpOx5fqA zFFDrTctgovjCgWxKK665SC/OBVhA5OVhIrmi29lXhLJKhHutPxiC2xP2lVncTG+2nl1 hXDYJQFiK2J7QxPiZgIkY4kB6bZ/9XVU15cqs4R54XYuF/Cc7948ZfRjetPCqpzPZoiN IjQw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@shutemov-name.20210112.gappssmtp.com header.s=20210112 header.b=3wF3eUlH; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id fy33si3033236ejc.697.2021.11.03.08.51.12; Wed, 03 Nov 2021 08:51:41 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@shutemov-name.20210112.gappssmtp.com header.s=20210112 header.b=3wF3eUlH; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232354AbhKCPtE (ORCPT + 99 others); Wed, 3 Nov 2021 11:49:04 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:47610 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S231837AbhKCPs7 (ORCPT ); Wed, 3 Nov 2021 11:48:59 -0400 Received: from mail-lf1-x135.google.com (mail-lf1-x135.google.com [IPv6:2a00:1450:4864:20::135]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id EF9DCC061714 for ; Wed, 3 Nov 2021 08:46:22 -0700 (PDT) Received: by mail-lf1-x135.google.com with SMTP id o18so5965653lfu.13 for ; Wed, 03 Nov 2021 08:46:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=shutemov-name.20210112.gappssmtp.com; s=20210112; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=Ges7q3BgScavtJ8d4Zd9sUgng8bmnzEVAy2FbAT0sY8=; b=3wF3eUlHNjCv9zjWE4OuFISMZ9IiYL6EUwB8MxCPSo3L9jbPDUgEI8SN9BEollXbjO 2lv2Y7ZH4bFXWzcXvi9myhskqrnnSRIkBLBCrbnUjAUAHfk0Kkr2ZPczXACk7AJqbO3v tevW0ui8ZbumfHKFePa14siFFXntABbYScqas/vfiCR/ywR/q12VggAIslMyrQAJpu9q UjY/5XzhY/Lwg8frAxzMuzaj/CkWykHiHRye5JzFblCs+TsAoSNe3hmU3aAF0np4ZfVJ qhhxT1n9rANT7plrmOYFdBUpjGIu6X1RXErb8J7ZlbAkAKqN2R6tbHS+6Pc7TnzzGvFk zOfQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=Ges7q3BgScavtJ8d4Zd9sUgng8bmnzEVAy2FbAT0sY8=; b=bwYsB0rhFiNfjPREjxzcRfQ6cfzarXt8yFIloZ7bId+LGYPVZ4tFBYcBUKI+AscyP3 4RkeBgjrm+c2wSYM8zhBZDW6Y8HODqs5c4lwRR24rFk7VV4KWu7/G9MzQRuTLl3mGbfQ GmWT436FApapssPQinXL1clvC62eQseEtSSdg271IHHoxYHCObqMqNA2L5L8B0JcDJ09 Y/gQbxbghlFMdOE7KU8r7Eier5zYgzo+Lo/BS7ZZAPVFFI0gWWHy2+1gtZF1SOwme7w2 GaEB30awLf9ULZlT4+4rwY1EeiVvVFJBJVO2y7zUjCenilu1bCh51w/EGGwp0g3Q68zh iUaA== X-Gm-Message-State: AOAM533Ura/DBFVIeMYmUCcaFwmIPYltFKHPPcUNqScUeZ+EJaF7o3jq NjHDV9CFMD3jzKP6yGoFaup9Ug== X-Received: by 2002:a19:690f:: with SMTP id e15mr19218266lfc.419.1635954381346; Wed, 03 Nov 2021 08:46:21 -0700 (PDT) Received: from box.localdomain ([86.57.175.117]) by smtp.gmail.com with ESMTPSA id c4sm207966lfb.259.2021.11.03.08.46.18 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 03 Nov 2021 08:46:19 -0700 (PDT) From: "Kirill A. Shutemov" X-Google-Original-From: "Kirill A. Shutemov" Received: by box.localdomain (Postfix, from userid 1000) id A91671033EF; Wed, 3 Nov 2021 18:46:18 +0300 (+03) To: Thomas Gleixner , Ingo Molnar , Borislav Petkov , Tom Lendacky , Joerg Roedel Cc: Kuppuswamy Sathyanarayanan , Andi Kleen , Dave Hansen , Sean Christopherson , Peter Zijlstra , x86@kernel.org, linux-kernel@vger.kernel.org, "Kirill A. Shutemov" , "Kirill A . Shutemov" , Tony Luck Subject: [PATCHv3 4/4] x86/sev-es: Use insn_decode_mmio() for MMIO implementation Date: Wed, 3 Nov 2021 18:45:55 +0300 Message-Id: <20211103154555.23729-5-kirill.shutemov@linux.intel.com> X-Mailer: git-send-email 2.32.0 In-Reply-To: <20211103154555.23729-1-kirill.shutemov@linux.intel.com> References: <20211103154555.23729-1-kirill.shutemov@linux.intel.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org From: "Kirill A. Shutemov" Switch SEV implementation to insn_decode_mmio(). The helper is going to be used by TDX too. No functional changes. It is only build-tested. Cc: Tom Lendacky Cc: Joerg Roedel Signed-off-by: Kirill A. Shutemov Reviewed-by: Andi Kleen Reviewed-by: Tony Luck --- arch/x86/kernel/sev.c | 171 ++++++++++-------------------------------- 1 file changed, 40 insertions(+), 131 deletions(-) diff --git a/arch/x86/kernel/sev.c b/arch/x86/kernel/sev.c index a6895e440bc3..8fea7ea67c67 100644 --- a/arch/x86/kernel/sev.c +++ b/arch/x86/kernel/sev.c @@ -807,22 +807,6 @@ static void __init vc_early_forward_exception(struct es_em_ctxt *ctxt) do_early_exception(ctxt->regs, trapnr); } -static long *vc_insn_get_reg(struct es_em_ctxt *ctxt) -{ - long *reg_array; - int offset; - - reg_array = (long *)ctxt->regs; - offset = insn_get_modrm_reg_off(&ctxt->insn, ctxt->regs); - - if (offset < 0) - return NULL; - - offset /= sizeof(long); - - return reg_array + offset; -} - static long *vc_insn_get_rm(struct es_em_ctxt *ctxt) { long *reg_array; @@ -870,76 +854,6 @@ static enum es_result vc_do_mmio(struct ghcb *ghcb, struct es_em_ctxt *ctxt, return sev_es_ghcb_hv_call(ghcb, ctxt, exit_code, exit_info_1, exit_info_2); } -static enum es_result vc_handle_mmio_twobyte_ops(struct ghcb *ghcb, - struct es_em_ctxt *ctxt) -{ - struct insn *insn = &ctxt->insn; - unsigned int bytes = 0; - enum es_result ret; - int sign_byte; - long *reg_data; - - switch (insn->opcode.bytes[1]) { - /* MMIO Read w/ zero-extension */ - case 0xb6: - bytes = 1; - fallthrough; - case 0xb7: - if (!bytes) - bytes = 2; - - ret = vc_do_mmio(ghcb, ctxt, bytes, true); - if (ret) - break; - - /* Zero extend based on operand size */ - reg_data = vc_insn_get_reg(ctxt); - if (!reg_data) - return ES_DECODE_FAILED; - - memset(reg_data, 0, insn->opnd_bytes); - - memcpy(reg_data, ghcb->shared_buffer, bytes); - break; - - /* MMIO Read w/ sign-extension */ - case 0xbe: - bytes = 1; - fallthrough; - case 0xbf: - if (!bytes) - bytes = 2; - - ret = vc_do_mmio(ghcb, ctxt, bytes, true); - if (ret) - break; - - /* Sign extend based on operand size */ - reg_data = vc_insn_get_reg(ctxt); - if (!reg_data) - return ES_DECODE_FAILED; - - if (bytes == 1) { - u8 *val = (u8 *)ghcb->shared_buffer; - - sign_byte = (*val & 0x80) ? 0xff : 0x00; - } else { - u16 *val = (u16 *)ghcb->shared_buffer; - - sign_byte = (*val & 0x8000) ? 0xff : 0x00; - } - memset(reg_data, sign_byte, insn->opnd_bytes); - - memcpy(reg_data, ghcb->shared_buffer, bytes); - break; - - default: - ret = ES_UNSUPPORTED; - } - - return ret; -} - /* * The MOVS instruction has two memory operands, which raises the * problem that it is not known whether the access to the source or the @@ -1007,83 +921,78 @@ static enum es_result vc_handle_mmio_movs(struct es_em_ctxt *ctxt, return ES_RETRY; } -static enum es_result vc_handle_mmio(struct ghcb *ghcb, - struct es_em_ctxt *ctxt) +static enum es_result vc_handle_mmio(struct ghcb *ghcb, struct es_em_ctxt *ctxt) { struct insn *insn = &ctxt->insn; unsigned int bytes = 0; + enum mmio_type mmio; enum es_result ret; + u8 sign_byte; long *reg_data; - switch (insn->opcode.bytes[0]) { - /* MMIO Write */ - case 0x88: - bytes = 1; - fallthrough; - case 0x89: - if (!bytes) - bytes = insn->opnd_bytes; + mmio = insn_decode_mmio(insn, &bytes); + if (mmio == MMIO_DECODE_FAILED) + return ES_DECODE_FAILED; - reg_data = vc_insn_get_reg(ctxt); + if (mmio != MMIO_WRITE_IMM && mmio != MMIO_MOVS) { + reg_data = insn_get_modrm_reg_ptr(insn, ctxt->regs); if (!reg_data) return ES_DECODE_FAILED; + } + switch (mmio) { + case MMIO_WRITE: memcpy(ghcb->shared_buffer, reg_data, bytes); - ret = vc_do_mmio(ghcb, ctxt, bytes, false); break; - - case 0xc6: - bytes = 1; - fallthrough; - case 0xc7: - if (!bytes) - bytes = insn->opnd_bytes; - + case MMIO_WRITE_IMM: memcpy(ghcb->shared_buffer, insn->immediate1.bytes, bytes); - ret = vc_do_mmio(ghcb, ctxt, bytes, false); break; - - /* MMIO Read */ - case 0x8a: - bytes = 1; - fallthrough; - case 0x8b: - if (!bytes) - bytes = insn->opnd_bytes; - + case MMIO_READ: ret = vc_do_mmio(ghcb, ctxt, bytes, true); if (ret) break; - reg_data = vc_insn_get_reg(ctxt); - if (!reg_data) - return ES_DECODE_FAILED; - /* Zero-extend for 32-bit operation */ if (bytes == 4) *reg_data = 0; memcpy(reg_data, ghcb->shared_buffer, bytes); break; + case MMIO_READ_ZERO_EXTEND: + ret = vc_do_mmio(ghcb, ctxt, bytes, true); + if (ret) + break; + + memset(reg_data, 0, insn->opnd_bytes); + memcpy(reg_data, ghcb->shared_buffer, bytes); + break; + case MMIO_READ_SIGN_EXTEND: + ret = vc_do_mmio(ghcb, ctxt, bytes, true); + if (ret) + break; - /* MOVS instruction */ - case 0xa4: - bytes = 1; - fallthrough; - case 0xa5: - if (!bytes) - bytes = insn->opnd_bytes; + if (bytes == 1) { + u8 *val = (u8 *)ghcb->shared_buffer; - ret = vc_handle_mmio_movs(ctxt, bytes); + sign_byte = (*val & 0x80) ? 0xff : 0x00; + } else { + u16 *val = (u16 *)ghcb->shared_buffer; + + sign_byte = (*val & 0x8000) ? 0xff : 0x00; + } + + /* Sign extend based on operand size */ + memset(reg_data, sign_byte, insn->opnd_bytes); + memcpy(reg_data, ghcb->shared_buffer, bytes); break; - /* Two-Byte Opcodes */ - case 0x0f: - ret = vc_handle_mmio_twobyte_ops(ghcb, ctxt); + case MMIO_MOVS: + ret = vc_handle_mmio_movs(ctxt, bytes); break; default: ret = ES_UNSUPPORTED; + break; } return ret; -- 2.32.0