Received: by 2002:a25:6193:0:0:0:0:0 with SMTP id v141csp4336710ybb; Tue, 7 Apr 2020 05:37:17 -0700 (PDT) X-Google-Smtp-Source: APiQypIrY+hklHKw/Lbju2tspubvppPZ/ODpn5hNeOvHMkj1Ubjk6LqFZCMlNeX1xttvj8TbWqh4 X-Received: by 2002:aca:4e08:: with SMTP id c8mr1497575oib.143.1586263037458; Tue, 07 Apr 2020 05:37:17 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1586263037; cv=none; d=google.com; s=arc-20160816; b=Yd/9OQrJSH/q6KJRbdfMS8zVBtvQ2MMJh69JjU1HcAmyeThOY5TeI6xKqBTQrx2jeD lj15wzfS4W2SLtM1S6hJwE9pBnBmBtVOnUghPax2oN4ezpAage0XWDBHfz8LZSr7bncN jbhXGy2U07/HoAjqqT3PM+wsznyGzGK3cvA3BKDkqN8ZE6TQ9t841NC6rA9NvpVe8szC BQ+iH7B5/jtzK9uhm1Y0mGeZk4UGZiI55pwWfXcKny+SfCILO4TaSg8UXq95yKSg/nVo yvAVEuNC9Fyfdf/H5iY+U5CoQ7mNIXUFmO2Z8Sx+2BhjpztzLpHgXZwV/w1AUVB3c/la kxww== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:from:references:cc:to:subject:dkim-signature; bh=Qj/NCHNTy8cKBQLrOFei5N4fXMJmrkSwVdyGWxnI98o=; b=gWZJNDCtardh0JjkBGAjI+DqS8u4yg1qTGWQWvm0QTsXYdni1BQ3J0qIia8a5e0pkd SSBnVKsB5ttr9CGNj8K9DDmSWRoFKeI/MYSKiuVfxuqsekuRvxbt+qZBiuJRcCFbUkIT cBQMxnuW+vh+aF7eA4bO0UYvNyroP8rNe8jWVw494EdIGwJMltN6cUbq2EYrqvHueOCc JZgeTZgM96A4YUOi28a0zZtSpAFGuVj5iJHrrLCSdUuhTpKPxfcycew51D0P4hAMMhgP 6Fc5l/abuiiA3qeKafsMggRxKZ8JK/hsFMMcjYZ7voVYq0tCzAt0jrUURTvuEPWI6M2u ZAHA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=fdAVkdZH; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id v16si1268248otn.295.2020.04.07.05.37.04; Tue, 07 Apr 2020 05:37:17 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=fdAVkdZH; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728146AbgDGMfY (ORCPT + 99 others); Tue, 7 Apr 2020 08:35:24 -0400 Received: from us-smtp-delivery-1.mimecast.com ([205.139.110.120]:31073 "EHLO us-smtp-1.mimecast.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1728447AbgDGMfY (ORCPT ); Tue, 7 Apr 2020 08:35:24 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1586262923; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Qj/NCHNTy8cKBQLrOFei5N4fXMJmrkSwVdyGWxnI98o=; b=fdAVkdZHggSIqrSDUjpbbS/xXC4yKtpJiWA7z6Qrun7nmRcPo0bSPLI5CKHgUDSgUM56OE y4lWiAcbq/V8Cgmo08pRUtyjSpS8YmvyvSbomWYezpcJIXxBbqI0r4fK/Y71r4KzI6BGOG H756abaY8HU5QqJ3K+7O9GNiUZcuqAU= Received: from mail-wr1-f69.google.com (mail-wr1-f69.google.com [209.85.221.69]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-186-meKj4tUhP_qrewzk8yUyMA-1; Tue, 07 Apr 2020 08:35:21 -0400 X-MC-Unique: meKj4tUhP_qrewzk8yUyMA-1 Received: by mail-wr1-f69.google.com with SMTP id w12so1687895wrl.23 for ; Tue, 07 Apr 2020 05:35:21 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=Qj/NCHNTy8cKBQLrOFei5N4fXMJmrkSwVdyGWxnI98o=; b=mVGRqWG7eWo7RuybDMhPu/m6zUNdMkjaAAjWs0PCPJmdcMZFlK9PfwiRMDMxYUAEPI ONAue5LU0BucpaiOrtHPWXF/ouQgKraNb7E8Xzjhzd7zozHfYsVyy/aIG3qQyOIPiSOs kpk6+9F2/Ez9XjjX3fl2m4IG7Pkx6LkjVUW2z86ZQlOBHolzMh8Sk+gszUxM5GEG7GQG zE36jTdU99Xa4bFVkk4kKtQUFR79I5A5PaxfS5ura84Yu/BtOv2OxgtedNfoZmdfnIKy /eaDBJ8yZxJUK5Ue1GPCba2Ji4gHnMjEDHWghijO1QapQI4t/vw3K8zXAiZsh0hft4/0 XYdQ== X-Gm-Message-State: AGi0PubAsRi7xA4ltlu4217Fv++DHw4NhM9mghMSR6lcOUrWmYNMDTP2 HL224egDhv1HeJB0h68deIU5gOdP3ge5AiyxeKY9ZIy1y9i83Jtzkn1OOtwUxNivi+LhGsSxPDE 6zYZvcm5iDKXwosSjtlSxuCbY X-Received: by 2002:a7b:cf02:: with SMTP id l2mr2224569wmg.4.1586262920073; Tue, 07 Apr 2020 05:35:20 -0700 (PDT) X-Received: by 2002:a7b:cf02:: with SMTP id l2mr2224546wmg.4.1586262919855; Tue, 07 Apr 2020 05:35:19 -0700 (PDT) Received: from ?IPv6:2001:b07:6468:f312:bd61:914:5c2f:2580? ([2001:b07:6468:f312:bd61:914:5c2f:2580]) by smtp.gmail.com with ESMTPSA id f1sm32628821wrv.37.2020.04.07.05.35.19 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Tue, 07 Apr 2020 05:35:19 -0700 (PDT) Subject: Re: [PATCH] KVM: VMX: fix crash cleanup when KVM wasn't used To: Vitaly Kuznetsov , Sean Christopherson Cc: Jim Mattson , Wanpeng Li , kvm@vger.kernel.org, linux-kernel@vger.kernel.org References: <20200401081348.1345307-1-vkuznets@redhat.com> From: Paolo Bonzini Message-ID: <0c2504c0-8dac-4bbf-bd50-a503be755d3f@redhat.com> Date: Tue, 7 Apr 2020 14:35:18 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.5.0 MIME-Version: 1.0 In-Reply-To: <20200401081348.1345307-1-vkuznets@redhat.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 01/04/20 10:13, Vitaly Kuznetsov wrote: > If KVM wasn't used at all before we crash the cleanup procedure fails with > BUG: unable to handle page fault for address: ffffffffffffffc8 > #PF: supervisor read access in kernel mode > #PF: error_code(0x0000) - not-present page > PGD 23215067 P4D 23215067 PUD 23217067 PMD 0 > Oops: 0000 [#8] SMP PTI > CPU: 0 PID: 3542 Comm: bash Kdump: loaded Tainted: G D 5.6.0-rc2+ #823 > RIP: 0010:crash_vmclear_local_loaded_vmcss.cold+0x19/0x51 [kvm_intel] > > The root cause is that loaded_vmcss_on_cpu list is not yet initialized, > we initialize it in hardware_enable() but this only happens when we start > a VM. > > Previously, we used to have a bitmap with enabled CPUs and that was > preventing [masking] the issue. > > Initialized loaded_vmcss_on_cpu list earlier, right before we assign > crash_vmclear_loaded_vmcss pointer. blocked_vcpu_on_cpu list and > blocked_vcpu_on_cpu_lock are moved altogether for consistency. > > Fixes: 31603d4fc2bb ("KVM: VMX: Always VMCLEAR in-use VMCSes during crash with kexec support") > Signed-off-by: Vitaly Kuznetsov > --- > arch/x86/kvm/vmx/vmx.c | 12 +++++++----- > 1 file changed, 7 insertions(+), 5 deletions(-) > > diff --git a/arch/x86/kvm/vmx/vmx.c b/arch/x86/kvm/vmx/vmx.c > index 3aba51d782e2..39a5dde12b79 100644 > --- a/arch/x86/kvm/vmx/vmx.c > +++ b/arch/x86/kvm/vmx/vmx.c > @@ -2257,10 +2257,6 @@ static int hardware_enable(void) > !hv_get_vp_assist_page(cpu)) > return -EFAULT; > > - INIT_LIST_HEAD(&per_cpu(loaded_vmcss_on_cpu, cpu)); > - INIT_LIST_HEAD(&per_cpu(blocked_vcpu_on_cpu, cpu)); > - spin_lock_init(&per_cpu(blocked_vcpu_on_cpu_lock, cpu)); > - > r = kvm_cpu_vmxon(phys_addr); > if (r) > return r; > @@ -8006,7 +8002,7 @@ module_exit(vmx_exit); > > static int __init vmx_init(void) > { > - int r; > + int r, cpu; > > #if IS_ENABLED(CONFIG_HYPERV) > /* > @@ -8060,6 +8056,12 @@ static int __init vmx_init(void) > return r; > } > > + for_each_possible_cpu(cpu) { > + INIT_LIST_HEAD(&per_cpu(loaded_vmcss_on_cpu, cpu)); > + INIT_LIST_HEAD(&per_cpu(blocked_vcpu_on_cpu, cpu)); > + spin_lock_init(&per_cpu(blocked_vcpu_on_cpu_lock, cpu)); > + } > + > #ifdef CONFIG_KEXEC_CORE > rcu_assign_pointer(crash_vmclear_loaded_vmcss, > crash_vmclear_local_loaded_vmcss); > Queued, thanks. Paolo