Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Date:   Thu, 8 Jun 2023 13:10:54 -0700
From:   Isaku Yamahata <isaku.yamahata@gmail.com>
To:     "Wang, Wei W" <wei.w.wang@intel.com>
Cc:     Isaku Yamahata <isaku.yamahata@gmail.com>,
        "Yamahata, Isaku" <isaku.yamahata@intel.com>,
        "kvm@vger.kernel.org" <kvm@vger.kernel.org>,
        "linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
        Paolo Bonzini <pbonzini@redhat.com>,
        "Aktas, Erdem" <erdemaktas@google.com>,
        "Christopherson,, Sean" <seanjc@google.com>,
        "Shahar, Sagi" <sagis@google.com>,
        David Matlack <dmatlack@google.com>,
        "Huang, Kai" <kai.huang@intel.com>,
        Zhi Wang <zhi.wang.linux@gmail.com>,
        "Chen, Bo2" <chen.bo@intel.com>,
        Sean Christopherson <sean.j.christopherson@intel.com>
Subject: Re: [PATCH v14 011/113] KVM: TDX: Add C wrapper functions for
 SEAMCALLs to the TDX module
Message-ID: <20230608201054.GK2244082@ls.amr.corp.intel.com>
References: <cover.1685333727.git.isaku.yamahata@intel.com>
 <37b118268ccf73d8e9cc1ef8f9fb7376fb732d60.1685333727.git.isaku.yamahata@intel.com>
 <DS0PR11MB6373872D1536D6469B29159CDC4DA@DS0PR11MB6373.namprd11.prod.outlook.com>
 <20230607181537.GG2244082@ls.amr.corp.intel.com>
 <DS0PR11MB63733FFA02B4A5C04561A1BFDC50A@DS0PR11MB6373.namprd11.prod.outlook.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Disposition: inline
Content-Transfer-Encoding: 8bit
In-Reply-To: <DS0PR11MB63733FFA02B4A5C04561A1BFDC50A@DS0PR11MB6373.namprd11.prod.outlook.com>
Precedence: bulk

On Thu, Jun 08, 2023 at 01:43:27AM +0000,
"Wang, Wei W" <wei.w.wang@intel.com> wrote:

> On Thursday, June 8, 2023 2:16 AM, Isaku Yamahata wrote:
> > On Mon, Jun 05, 2023 at 03:20:19PM +0000, "Wang, Wei W"
> > <wei.w.wang@intel.com> wrote:
> > > > +static inline u64 kvm_seamcall(u64 op, u64 rcx, u64 rdx, u64 r8, u64 r9,
> > > > +			       struct tdx_module_output *out) {
> > > > +	u64 ret;
> > > > +
> > > > +	ret = __seamcall(op, rcx, rdx, r8, r9, out);
> > > > +	if (unlikely(ret == TDX_SEAMCALL_UD)) {
> > > > +		/*
> > > > +		 * TDX requires VMXON or #UD.  In the case of reboot or
> > > > kexec,
> > > > +		 * VMX is made off (VMXOFF) by kvm reboot notifier,
> > > > +		 * kvm_reboot(), while TDs are still running.  The callers
> > > > check
> > > > +		 * the returned error and complain.  Suppress it by returning 0.
> > > > +		 */
> > >
> > > Curious how do the callers check the returned error when " Suppress it
> > > by returning 0" here.
> > 
> > It doesn't make sense for the caller to check the error and warn when
> > kvm_rebooting = true.
> > Let's make it "return kvm_rebooting ? 0 : ret;" instread of "return 0;".
> > Does it make sense?
> 
> Seems no need. The comments look confusing, and not aligned to what
> the code achieves. From what I read:
> - if kvm_rebooting=true there: return 0 to caller and no error or warning happens
> - if kvm_rebooting=false there: crash the system via kvm_spurious_fault.
> In this non-rebooting case, I think the callers don’t get a chance to read the 
> returned value and complain.

How about this comment?

	if (unlikely(ret == TDX_SEAMCALL_UD)) {
		/*
		 * TDX requires VMXON or #UD.  In the case of reboot or kexec,
		 * kvm shutdown notifier, kvm_shutdown(), makes VMX off (VMXOFF)
		 * while TDs can be still running to invoke SEAMCALL.  It
		 * results in superfluous errors or warnings.
		 * If rebooting, return 0 to suppress superfluous messages.
		 * If not rebooting, panic by kvm_spurious_fault().
		 */
		kvm_spurious_fault();
		return 0;
	}

> Another thing is, have you double-checked that invocation of seamcalls
> indeed returns TDX_SEAMCALL_UD when VMX=off?

I observed it several times during testing tdx module initialization. Here is
the example I dug out from my debug logs.

  tdx: SEAMCALL failed: CPU 162 is not in VMX operation.
  tdx: TDX module initialization failed (-22)
  kvm_intel: Failed to initialize TDX module.

-- 
Isaku Yamahata <isaku.yamahata@gmail.com>