Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Message-ID: <9e69158f-1e67-344b-fea9-85bb5e21183f@quicinc.com>
Date:   Wed, 12 Jul 2023 10:47:55 +0800
MIME-Version: 1.0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101
 Thunderbird/102.11.2
Subject: Re: [PATCH] arm64: Add the arm64.nolse_atomics command line option
To:     Marc Zyngier <maz@kernel.org>
CC:     <will@kernel.org>, <corbet@lwn.net>, <catalin.marinas@arm.com>,
        <quic_pkondeti@quicinc.com>, <quic_kaushalk@quicinc.com>,
        <quic_satyap@quicinc.com>, <quic_shashim@quicinc.com>,
        <quic_songxue@quicinc.com>, <linux-doc@vger.kernel.org>,
        <linux-kernel@vger.kernel.org>,
        <linux-arm-kernel@lists.infradead.org>
References: <20230710055955.36551-1-quic_aiquny@quicinc.com>
 <875y6s8bwb.wl-maz@kernel.org>
 <32f442e3-3d5c-4cec-9791-0da039f88287@quicinc.com>
 <874jmc8654.wl-maz@kernel.org>
 <6e07ad52-2629-346e-6217-ec07777ebc5b@quicinc.com>
 <86lefnvsto.wl-maz@kernel.org>
 <8a950aa5-fdd8-f983-0411-4b39ade596f4@quicinc.com>
 <86cz0ywx5p.wl-maz@kernel.org>
From:   "Aiqun(Maria) Yu" <quic_aiquny@quicinc.com>
In-Reply-To: <86cz0ywx5p.wl-maz@kernel.org>
Content-Type: text/plain; charset="UTF-8"; format=flowed
Content-Transfer-Encoding: 7bit
Precedence: bulk

On 7/11/2023 6:38 PM, Marc Zyngier wrote:
> On Tue, 11 Jul 2023 11:12:48 +0100,
> "Aiqun(Maria) Yu" <quic_aiquny@quicinc.com> wrote:
>>
>> For the KVM part, per my understanding, as long as the current feature
>> id being overriden, the KVM system also get the current vcpu without
>> the lse atomic feature enabled.
>> KVM vcpu will read the sys reg from host arm64_ftr_regs which is
>> already been controled by the idreg_overrides.
> 
> You're completely missing the point.
> 
> The guest is free to map memory as non-cacheable *and* to use LSE
> atomics even if the idregs pretend this is not available. At which
The guest also can have the current linux kernel mechanism of LSE ATOMIC 
way.

+----------------------------+ 
 

|                            | 
 

| Read the cpu feature IDs   | 
 

+----------------------------+ 
 

              v 
 

+----------------------------+         +-------------------+ 
 

|                            |  Y      | Use lse atomic ins| 
 

| if lse atomic supported    |  --     |                   | 
 

+----------------------------+         +-------------------+ 
 

              v   N 
 

+----------------------------+ 
 

| Use    r/stxr + atomic ins | 
 

|                            | 
 

+----------------------------+ 
 

Just like other KVM vcpu cpu features, lse atomic can be a feature 
inherit from the pysical cpu features for the KVM vcpus.

> point the HW throws a fit and the system is dead. Is that acceptable?
> Of course not.
> 

The current patchset is try to have the ability to *kind of free* to not 
make system dead. Since currently linux kernel already have the runtime 
patching of lse atomic ops, we are trying to have user have option to 
re-use the switch of system_uses_lse_atomics().

#define __lse_ll_sc_body(op, ...)					\
({									\
	system_uses_lse_atomics() ?					\
		__lse_##op(__VA_ARGS__) :				\
		__ll_sc_##op(__VA_ARGS__);				\
})

> So there are two aspects to your problem:
> 
> - for Linux, there is nothing to do: the kernel will correctly behave,
>    and as long as you don't expose non-cacheable memory to userspace.
>    Out of tree drivers are none of our concern here.
> 

For Linux kernel, we have provide the In-line patching at runtime, and 
all third party kernel modules are built with those in-line patching as 
well.
if we can have an option, the current system can still run those third 
party kernel modules without system crash.

/* In-line patching at runtime */
#define ARM64_LSE_ATOMIC_INSN(llsc, lse)				\
	ALTERNATIVE(llsc, __LSE_PREAMBLE lse, ARM64_HAS_LSE_ATOMICS)

static __always_inline bool system_uses_lse_atomics(void)
{
	return alternative_has_cap_likely(ARM64_HAS_LSE_ATOMICS);
}
> - for guests, it looks like the HW doesn't provide the basic
>    requirements for virtualisation, and you should always disable KVM
>    on this HW (or even better, enter the kernel at EL1).
> 
I can see that KVM can still be supported even if current phisical cpu 
don't have emulated vcpu features. We can only disable the current vcpu 
feature which exposed to KVM guest.
> In both cases, nothing to do in the kernel, which is good news.
> 
> 	M.
> 

-- 
Thx and BRs,
Aiqun(Maria) Yu