Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:3 as permitted sender) client-ip=2620:137:e000::3:3;
Message-ID: <b867fba0-ccdd-7020-7bf9-6572aa9dd408@intel.com>
Date:   Wed, 25 Oct 2023 21:49:45 +0800
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101
 Thunderbird/102.15.1
Subject: Re: [PATCH v6 02/25] x86/fpu/xstate: Fix guest fpstate allocation
 size calculation
To:     Sean Christopherson <seanjc@google.com>
CC:     <pbonzini@redhat.com>, <kvm@vger.kernel.org>,
        <linux-kernel@vger.kernel.org>, <dave.hansen@intel.com>,
        <peterz@infradead.org>, <chao.gao@intel.com>,
        <rick.p.edgecombe@intel.com>, <john.allen@amd.com>
References: <20230914063325.85503-1-weijiang.yang@intel.com>
 <20230914063325.85503-3-weijiang.yang@intel.com>
 <ZTMdyR8e63sCTKWc@google.com>
 <e02b39c1-96aa-faf9-5750-4c53b5a5fb46@intel.com>
 <ZTfxly8573xdnruS@google.com>
Content-Language: en-US
From:   "Yang, Weijiang" <weijiang.yang@intel.com>
In-Reply-To: <ZTfxly8573xdnruS@google.com>
Content-Type: text/plain; charset="UTF-8"; format=flowed
Content-Transfer-Encoding: 7bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?VGdpSVlqZWRVT3V2RGJWL3dpT0FMa3VPZ2U0MDYrbGVvWHRTVXFsajBaRGly?=
 =?utf-8?B?elNBQ25mblBNaFhSL0NCSklCRkUzeWxodWpQbVRVc3ZKQWNGZWJFV2hHNnBk?=
 =?utf-8?B?S3BQWm5kcWJEU1BIK1NKQVJNbVV2WndSTlVuRnNDenNYd2hnT1ZOa1JhZWpT?=
 =?utf-8?B?Z09VNnNRQUtvMWxBL25ibEd6T3FaUHpFR0FZRG9Fdk95L1QvVkZOVnlqTTRJ?=
 =?utf-8?B?LzFFTmFlNWYzdFhsbFhMNHBLUVNXZ1AzZU9ZelNtMTdVZWtCdWFLR0c2djMx?=
 =?utf-8?B?ZnRzWXFDRlh3SjdtdHZ3RHBJZzFUOU5ISGlWd0Z6SDFjc2hsdE9OeVR1cjhy?=
 =?utf-8?B?RERSdFE4RisvUnB6ZFhCQTY4QjJ4YjcrVzZGK0lZMk5vQ1V0UEMraFJJY3k4?=
 =?utf-8?B?VHE5MXlYOFZMUDVlRGJ6clpuckJNczJFTTZTMUkzZkwvaVhITGszTHUvenRV?=
 =?utf-8?B?anByZEZ4dWdTL0xkRm1PVmNMcytrZVk5TURKQ0daZWUzZEdvd2xXcVhXUUln?=
 =?utf-8?B?TVRJMGM4ZE83WVpxQVZFbjVlQTJHUUlYcGpSSVNtUkMxNFdPM25PblN6U3Uv?=
 =?utf-8?B?RWdRb1BkZ2VJZW9UWUY1V0tKL2hiZ2lIWmdzcXlFNmxZOVdDK2x0QVZneWxE?=
 =?utf-8?B?VVZPZ3hSQU5NMHpDQ1cvSjdBWitmQ2ZVVUUwYTE4bEZtb09uM0Zlc3ByWk9T?=
 =?utf-8?B?RGs0RHdEb3k3Tnhxd3BhTCtEL2RJK1FlcUhQczFnYXlRT1lodi9NcXE1dTNp?=
 =?utf-8?B?eDVLQkRtK3NyK202U1ZCWmgyZENzWXVFNkNCejdhMVdvY0JyYk1hZ0swSnRo?=
 =?utf-8?B?ZDhjODlRT2oxOHJ2ZFgyWGpWOHdVancvQjR3TFVwN1RpaDgxV1NMVUtCQnI4?=
 =?utf-8?B?WWRrZzZKcE5DZHlUd2lHazZyL3B4L3d3UEJjSmhOcHUyOHcvZ2RzTlVPRlkr?=
 =?utf-8?B?UEZUV3Y4dnphQUJ6a0c3aWpiWE90dzl1b1lSdWZIcEpRYjl0Mjg5RWJtUDhh?=
 =?utf-8?B?VDI2Y1Buc2Y0Z21kV1hmakZLclltV200UFNVM2VvMUpuTW1lZEk4a1lTUUpq?=
 =?utf-8?B?cmg0SWZjSmYxbDBEN0ljem5EbmxDVS9wMWQ1K1RSRjg1U1RsY3JHa0VWT2xO?=
 =?utf-8?B?T1F5NnBxNEFJVnRzZmpLelJnN1VNNXFQZmtSMHRNUjEybFNDQmhwT0xBcFdI?=
 =?utf-8?B?dTFvbEJkc29JTE1PTjVUK002WWdNWWRFUGhJYmIxV1hiaEg0MTNyNUk3ZEFU?=
 =?utf-8?B?MkJ5b2c0bGNHa3JDQk15R0tEbW01OFkvTWFkNXB4Y0RXR2YrR29CVHBzdnNl?=
 =?utf-8?B?R2Fhd0Zad2NkVkdOTlF6ellWTHhwQjVqTVpmcUs3bEJLaUgrUk9kdFhaQXNS?=
 =?utf-8?B?OWVSdmFkWkZwZWFzYzQ2Wi84b0RPL0pxKzVLNGpzNmo0M1k0RDBHNG9lV3Ez?=
 =?utf-8?B?WjJZcWhvWENjMzFqZnZKOUwyVEVpWFhpdWFSQ2xwTmJIZGFkSFYyNEZqeHJD?=
 =?utf-8?B?bE5jSUYvL3lDMTNlbVlKTENYMTdsZUZwcjdzTlluNWJEUUYvdmFqemdTK3Bw?=
 =?utf-8?B?YzBGMzAzbm96UnJadUJJeFF3VDhra2N3MGVvWStmaXpxN2EzLzdaTW5QMTE4?=
 =?utf-8?B?b2k5UjlpSHl5c045eWtydWxNemh6a3FYanVCNnRNbm1RZ3BabzNadUlxcTlv?=
 =?utf-8?B?b3p6UDBSbnVKaFVDL0NEUTFQTVNRbnQ0bjE3NlpYWTYzWDR6eDZQNWpGQ0pi?=
 =?utf-8?B?ekU3Q0dLQW4yVFZ0djIxbHFzdXhQLzVJb0pxS1JjcXNHK1BGK1BxbGVOR3ZP?=
 =?utf-8?B?aVNwUVgyS3JuRG1HdVd1eGdyOWtLWjZucmh5SkhDYTZhbjNJamdOWUtlbmY1?=
 =?utf-8?B?eWlvSUd1c3ZXazg5QTlvQTArcnhYWVlvSG11aG9QTHJOYk5BYjVIOTN2S0tN?=
 =?utf-8?B?dGIyTFl0bzhtZXdXWW1EQmQwSFU0cTRnTGI3V0N1cjY3ZW9pMEh5U1k4WXVs?=
 =?utf-8?B?U1NBeXNrZlNacW41Z3BRL25nSzFSY0NWTld5T3pxQ3czMG5HQ2xDbHpGMWtr?=
 =?utf-8?B?a3lCcVJmQ211TW5YcjJRVUx0ZHRtUXJ1YWsya1B5Y0hPcmFVeWJYZ21LaXdS?=
 =?utf-8?B?aXdhcDNIcjBURDVHN2VvV1ByM01Tb0FvVGZ2NXo5Q0tBYmdNWTZOL05qQW9R?=
 =?utf-8?B?anc9PQ==?=
X-MS-Exchange-CrossTenant-Network-Message-Id: 6a2b32d4-792b-4c5f-9d65-08dbd5614531
X-MS-Exchange-CrossTenant-AuthSource: PH0PR11MB4965.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 25 Oct 2023 13:49:55.6874
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: vyimz4qSjmAGlLaIq/OHeQhnFFXfUseVLHe1zmgBcrH6t2yCjmj8anEh1MWsZmlY1wbkOx4pTyuc0mUbCM14pA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SJ0PR11MB6816
X-OriginatorOrg: intel.com
X-Spam-Status: No, score=-4.2 required=5.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED,
	DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,
	MAILING_LIST_MULTI,NICE_REPLY_A,SPF_HELO_NONE,SPF_PASS
	autolearn=unavailable autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lipwig.vger.email
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org
X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (lipwig.vger.email [0.0.0.0]); Wed, 25 Oct 2023 06:50:37 -0700 (PDT)

On 10/25/2023 12:32 AM, Sean Christopherson wrote:
> On Tue, Oct 24, 2023, Weijiang Yang wrote:
>> On 10/21/2023 8:39 AM, Sean Christopherson wrote:
>>> On Thu, Sep 14, 2023, Yang Weijiang wrote:
>>>> Fix guest xsave area allocation size from fpu_user_cfg.default_size to
>>>> fpu_kernel_cfg.default_size so that the xsave area size is consistent
>>>> with fpstate->size set in __fpstate_reset().
>>>>
>>>> With the fix, guest fpstate size is sufficient for KVM supported guest
>>>> xfeatures.
>>>>
>>>> Signed-off-by: Yang Weijiang <weijiang.yang@intel.com>
>>>> ---
>>>>    arch/x86/kernel/fpu/core.c | 4 +++-
>>>>    1 file changed, 3 insertions(+), 1 deletion(-)
>>>>
>>>> diff --git a/arch/x86/kernel/fpu/core.c b/arch/x86/kernel/fpu/core.c
>>>> index a86d37052a64..a42d8ad26ce6 100644
>>>> --- a/arch/x86/kernel/fpu/core.c
>>>> +++ b/arch/x86/kernel/fpu/core.c
>>>> @@ -220,7 +220,9 @@ bool fpu_alloc_guest_fpstate(struct fpu_guest *gfpu)
>>>>    	struct fpstate *fpstate;
>>>>    	unsigned int size;
>>>> -	size = fpu_user_cfg.default_size + ALIGN(offsetof(struct fpstate, regs), 64);
>>>> +	size = fpu_kernel_cfg.default_size +
>>>> +	       ALIGN(offsetof(struct fpstate, regs), 64);
>>> Shouldn't all the other calculations in this function also switch to fpu_kernel_cfg?
>>> At the very least, this looks wrong when paired with the above:
>>>
>>> 	gfpu->uabi_size		= sizeof(struct kvm_xsave);
>>> 	if (WARN_ON_ONCE(fpu_user_cfg.default_size > gfpu->uabi_size))
>>> 		gfpu->uabi_size = fpu_user_cfg.default_size;
>> Hi, Sean,
>> Not sure what's your concerns.
>>  From my understanding fpu_kernel_cfg.default_size should include all enabled
>> xfeatures in host (XCR0 | XSS), this is also expected for supporting all
>> guest enabled xfeatures. gfpu->uabi_size only includes enabled user xfeatures
>> which are operated via KVM uABIs(KVM_GET_XSAVE/KVM_SET_XSAVE/KVM_GET_XSAVE2),
>> so the two sizes are relatively independent since guest supervisor xfeatures
>> are saved/restored via GET/SET_MSRS interfaces.
> Ah, right, I keep forgetting that KVM's ABI can't use XRSTOR because it forces
> the compacted format.
>
> This part still looks odd to me:
>
> 	gfpu->xfeatures		= fpu_user_cfg.default_features;
> 	gfpu->perm		= fpu_user_cfg.default_features;

I guess when the kernel FPU code was overhauled, the supervisor xstates were not taken into
account for guest supported xfeaures, so the first line looks reasonable until supervisor xfeatures
are landing. And for the second line, per current design, the user mode can only control user
xfeatures via arch_prctl() kernel uAPI, so it also makes sense to initialize perm with
fpu_user_cfg.default_features too.

But in this CET KVM series I'd like to expand the former to support all guest enabled xfeatures, i.e.,
both user and supervisor xfeaures, and keep the latter as-is since there seems no reason
to allow userspace to alter supervisor xfeatures.

> but I'm probably just not understanding something in the other patches changes yet.