Received: by 2002:a25:6193:0:0:0:0:0 with SMTP id v141csp123461ybb; Tue, 7 Apr 2020 18:28:46 -0700 (PDT) X-Google-Smtp-Source: APiQypL7BfsvcLiYRSANIlwVrlXfNlC/gjOO3FJpMjFOz54qzJt9stJ8JxK4+ThYIk7lAdZZtMMV X-Received: by 2002:aca:5191:: with SMTP id f139mr773210oib.140.1586309325961; Tue, 07 Apr 2020 18:28:45 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1586309325; cv=none; d=google.com; s=arc-20160816; b=hLksHYFr5+IBL2fls4kD/b3DFGf33RzTolzLgzQrHkJJv27HXa3piuNjM2KfKvA/+o HNxiuw0dPVtk4aZDQ7Bq4BfwgZerwri1AkMDJ7ZZsVvpyjFf0RHjvockNhN8F9wf9wug raZpfKFV6i2GneUB9eb73ii4acYSl8Wan2tKs55iwLTh5v69pXuRAJoFja/ywyTxW+7D LPmJxoL9LGP+cNhwR4iOrQyFqyuhTE97dPlBfa/83dYZkjXy1r7uLeltuiZuhX1AaFGw ja8xT+6jBLnzm7L5cC/LBOEPNsxVK+euV4VD3SOw6Jc3F+PzsHuDLlHlnJf4zY4eqFo6 cRZw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:dkim-signature; bh=XlzDmBeqdYgRXLQPAzyDPVcU/1FTfROFyX1Ur4A01Ds=; b=nhdwmWcQ5whFMNdYl418JdY4gnau4st3Rr704kNKnvrAzl9itAZLAoiSYDcasfHzj3 fQZ6tf1a/h3n4AIwK/NnTGkxw7l5eD1FOk+1y0t1Gy5PqensPaOVUD/KkvEjH6RYVS5z QgGZop7QU5OnrgX01875UvjUAYieGdHyBbDF9y+aA/RlzPWD7SFwq/g1p/PEwhe4IniP AS0cCxLkTSNCm+khvpx3Z4dMbizg2IUDh2Gm7RsZ03FbP8OzqVEQMCGDI/ognlBsCntS fE3wuMlHscobWFeymgwlr/KXTl6sQ91R8j/smavufTrhB/jfSrF+Sm2DuJHR16uKc3VW FTpg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@google.com header.s=20161025 header.b=cEopgmxq; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id m2si1922912oof.17.2020.04.07.18.28.31; Tue, 07 Apr 2020 18:28:45 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@google.com header.s=20161025 header.b=cEopgmxq; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726549AbgDHB0a (ORCPT + 99 others); Tue, 7 Apr 2020 21:26:30 -0400 Received: from mail-lj1-f195.google.com ([209.85.208.195]:46838 "EHLO mail-lj1-f195.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726407AbgDHB0a (ORCPT ); Tue, 7 Apr 2020 21:26:30 -0400 Received: by mail-lj1-f195.google.com with SMTP id r7so5784814ljg.13 for ; Tue, 07 Apr 2020 18:26:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=XlzDmBeqdYgRXLQPAzyDPVcU/1FTfROFyX1Ur4A01Ds=; b=cEopgmxqQb1bo3jG7QS7u1WahFNuN0hJS0pw82KojLkmV364xeSFDSAL8hOxD3DA3S QprXIbjiokFPxb4uEvWRMDOcP46rydyA7y6lJh5jDBaTvW8EN+DRYmwhxBb3Ordltomd 1MAioiDWLl7/et0Wy7l4gk26SYeNBjanGeE+Qu0XO9gVPduTPRR+k6+UU4kW/gdMoZdb CJ/eTc8cCR4aCSTsTyxYQdYx6gdFuTxuyzPFERgoHnfzFS+zD5tvupktXPkfcFC/TnC0 epWsChOfvx7U/d9ecQ9MbOU7FQOCW039m4WIIEmAcRMj08OQ+PVHAHi8dynCeYhkEVvO kbnQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=XlzDmBeqdYgRXLQPAzyDPVcU/1FTfROFyX1Ur4A01Ds=; b=iCwlsMiQjLppBEDrPlyUoIiP6mxqyD7VGdsAbOT74RemdHqJy6jdTUX53rCHQdrBNr nMmEktwsXWHqz89xUJP5RfDp2sUpUW5qXrMmYn3Go9z5tXaNITedZvHz+7OqDXUpM5ex SxugA43n1KgJG1p8V/o3vcKNp2IP5lROMpVerIGsWWhdicFWqr+7uT7WLjdWHhM7URhk z8iujU17XfcCE3uLvgggCgZrGP7SayawIPQxooRpNwcEk2XUoh1g8o9t6AyYCveRIo9Q CbUoLvB7rERiPG2EgdhfamNeNy+k5y928w/0kUBZer9VFZM5QZCX32bHRXZJafACnXpU vSCA== X-Gm-Message-State: AGi0PubA7o8Y3ZjQMvw6XuODF7qR2xI7LpCAQwkQ5Mdt24qF6OMQTYXk vJRFzuGhuf4ZCbTdJh/ogg/JlKz2shrmSageqYlFJw== X-Received: by 2002:a2e:9a54:: with SMTP id k20mr3276630ljj.272.1586309187964; Tue, 07 Apr 2020 18:26:27 -0700 (PDT) MIME-Version: 1.0 References: <9e959ee134ad77f62c9881b8c54cd27e35055072.1585548051.git.ashish.kalra@amd.com> <20200403214559.GB28747@ashkalra_ubuntu_server> <65c09963-2027-22c1-e04d-4c8c3658b2c3@oracle.com> In-Reply-To: <65c09963-2027-22c1-e04d-4c8c3658b2c3@oracle.com> From: Steve Rutherford Date: Tue, 7 Apr 2020 18:25:51 -0700 Message-ID: Subject: Re: [PATCH v6 12/14] KVM: x86: Introduce KVM_PAGE_ENC_BITMAP_RESET ioctl To: Krish Sadhukhan Cc: Ashish Kalra , Paolo Bonzini , Thomas Gleixner , Ingo Molnar , "H. Peter Anvin" , Joerg Roedel , Borislav Petkov , Tom Lendacky , X86 ML , KVM list , LKML , David Rientjes , Andy Lutomirski , Brijesh Singh Content-Type: text/plain; charset="UTF-8" Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Mon, Apr 6, 2020 at 11:53 AM Krish Sadhukhan wrote: > > > On 4/3/20 2:45 PM, Ashish Kalra wrote: > > On Fri, Apr 03, 2020 at 02:14:23PM -0700, Krish Sadhukhan wrote: > >> On 3/29/20 11:23 PM, Ashish Kalra wrote: > >>> From: Ashish Kalra > >>> > >>> This ioctl can be used by the application to reset the page > >>> encryption bitmap managed by the KVM driver. A typical usage > >>> for this ioctl is on VM reboot, on reboot, we must reinitialize > >>> the bitmap. > >>> > >>> Signed-off-by: Ashish Kalra > >>> --- > >>> Documentation/virt/kvm/api.rst | 13 +++++++++++++ > >>> arch/x86/include/asm/kvm_host.h | 1 + > >>> arch/x86/kvm/svm.c | 16 ++++++++++++++++ > >>> arch/x86/kvm/x86.c | 6 ++++++ > >>> include/uapi/linux/kvm.h | 1 + > >>> 5 files changed, 37 insertions(+) > >>> > >>> diff --git a/Documentation/virt/kvm/api.rst b/Documentation/virt/kvm/api.rst > >>> index 4d1004a154f6..a11326ccc51d 100644 > >>> --- a/Documentation/virt/kvm/api.rst > >>> +++ b/Documentation/virt/kvm/api.rst > >>> @@ -4698,6 +4698,19 @@ During the guest live migration the outgoing guest exports its page encryption > >>> bitmap, the KVM_SET_PAGE_ENC_BITMAP can be used to build the page encryption > >>> bitmap for an incoming guest. > >>> +4.127 KVM_PAGE_ENC_BITMAP_RESET (vm ioctl) > >>> +----------------------------------------- > >>> + > >>> +:Capability: basic > >>> +:Architectures: x86 > >>> +:Type: vm ioctl > >>> +:Parameters: none > >>> +:Returns: 0 on success, -1 on error > >>> + > >>> +The KVM_PAGE_ENC_BITMAP_RESET is used to reset the guest's page encryption > >>> +bitmap during guest reboot and this is only done on the guest's boot vCPU. > >>> + > >>> + > >>> 5. The kvm_run structure > >>> ======================== > >>> diff --git a/arch/x86/include/asm/kvm_host.h b/arch/x86/include/asm/kvm_host.h > >>> index d30f770aaaea..a96ef6338cd2 100644 > >>> --- a/arch/x86/include/asm/kvm_host.h > >>> +++ b/arch/x86/include/asm/kvm_host.h > >>> @@ -1273,6 +1273,7 @@ struct kvm_x86_ops { > >>> struct kvm_page_enc_bitmap *bmap); > >>> int (*set_page_enc_bitmap)(struct kvm *kvm, > >>> struct kvm_page_enc_bitmap *bmap); > >>> + int (*reset_page_enc_bitmap)(struct kvm *kvm); > >>> }; > >>> struct kvm_arch_async_pf { > >>> diff --git a/arch/x86/kvm/svm.c b/arch/x86/kvm/svm.c > >>> index 313343a43045..c99b0207a443 100644 > >>> --- a/arch/x86/kvm/svm.c > >>> +++ b/arch/x86/kvm/svm.c > >>> @@ -7797,6 +7797,21 @@ static int svm_set_page_enc_bitmap(struct kvm *kvm, > >>> return ret; > >>> } > >>> +static int svm_reset_page_enc_bitmap(struct kvm *kvm) > >>> +{ > >>> + struct kvm_sev_info *sev = &to_kvm_svm(kvm)->sev_info; > >>> + > >>> + if (!sev_guest(kvm)) > >>> + return -ENOTTY; > >>> + > >>> + mutex_lock(&kvm->lock); > >>> + /* by default all pages should be marked encrypted */ > >>> + if (sev->page_enc_bmap_size) > >>> + bitmap_fill(sev->page_enc_bmap, sev->page_enc_bmap_size); > >>> + mutex_unlock(&kvm->lock); > >>> + return 0; > >>> +} > >>> + > >>> static int svm_mem_enc_op(struct kvm *kvm, void __user *argp) > >>> { > >>> struct kvm_sev_cmd sev_cmd; > >>> @@ -8203,6 +8218,7 @@ static struct kvm_x86_ops svm_x86_ops __ro_after_init = { > >>> .page_enc_status_hc = svm_page_enc_status_hc, > >>> .get_page_enc_bitmap = svm_get_page_enc_bitmap, > >>> .set_page_enc_bitmap = svm_set_page_enc_bitmap, > >>> + .reset_page_enc_bitmap = svm_reset_page_enc_bitmap, > >> > >> We don't need to initialize the intel ops to NULL ? It's not initialized in > >> the previous patch either. > >> > >>> }; > > This struct is declared as "static storage", so won't the non-initialized > > members be 0 ? > > > Correct. Although, I see that 'nested_enable_evmcs' is explicitly > initialized. We should maintain the convention, perhaps. > > > > >>> static int __init svm_init(void) > >>> diff --git a/arch/x86/kvm/x86.c b/arch/x86/kvm/x86.c > >>> index 05e953b2ec61..2127ed937f53 100644 > >>> --- a/arch/x86/kvm/x86.c > >>> +++ b/arch/x86/kvm/x86.c > >>> @@ -5250,6 +5250,12 @@ long kvm_arch_vm_ioctl(struct file *filp, > >>> r = kvm_x86_ops->set_page_enc_bitmap(kvm, &bitmap); > >>> break; > >>> } > >>> + case KVM_PAGE_ENC_BITMAP_RESET: { > >>> + r = -ENOTTY; > >>> + if (kvm_x86_ops->reset_page_enc_bitmap) > >>> + r = kvm_x86_ops->reset_page_enc_bitmap(kvm); > >>> + break; > >>> + } > >>> default: > >>> r = -ENOTTY; > >>> } > >>> diff --git a/include/uapi/linux/kvm.h b/include/uapi/linux/kvm.h > >>> index b4b01d47e568..0884a581fc37 100644 > >>> --- a/include/uapi/linux/kvm.h > >>> +++ b/include/uapi/linux/kvm.h > >>> @@ -1490,6 +1490,7 @@ struct kvm_enc_region { > >>> #define KVM_GET_PAGE_ENC_BITMAP _IOW(KVMIO, 0xc5, struct kvm_page_enc_bitmap) > >>> #define KVM_SET_PAGE_ENC_BITMAP _IOW(KVMIO, 0xc6, struct kvm_page_enc_bitmap) > >>> +#define KVM_PAGE_ENC_BITMAP_RESET _IO(KVMIO, 0xc7) > >>> /* Secure Encrypted Virtualization command */ > >>> enum sev_cmd_id { > >> Reviewed-by: Krish Sadhukhan Doesn't this overlap with the set ioctl? Yes, obviously, you have to copy the new value down and do a bit more work, but I don't think resetting the bitmap is going to be the bottleneck on reboot. Seems excessive to add another ioctl for this.