Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:7 as permitted sender) client-ip=2620:137:e000::3:7;
Message-ID: <1347cf03-4598-f923-74e4-a3d193d9d2e9@intel.com>
Date:   Fri, 15 Sep 2023 10:22:42 +0800
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101
 Thunderbird/102.15.0
Subject: Re: [PATCH v6 06/25] x86/fpu/xstate: Opt-in kernel dynamic bits when
 calculate guest xstate size
Content-Language: en-US
To:     Dave Hansen <dave.hansen@intel.com>, <seanjc@google.com>,
        <pbonzini@redhat.com>, <kvm@vger.kernel.org>,
        <linux-kernel@vger.kernel.org>
CC:     <peterz@infradead.org>, <chao.gao@intel.com>,
        <rick.p.edgecombe@intel.com>, <john.allen@amd.com>
References: <20230914063325.85503-1-weijiang.yang@intel.com>
 <20230914063325.85503-7-weijiang.yang@intel.com>
 <e0db6ffd-5d92-2a1a-bdfb-a190fe1ccd25@intel.com>
From:   "Yang, Weijiang" <weijiang.yang@intel.com>
In-Reply-To: <e0db6ffd-5d92-2a1a-bdfb-a190fe1ccd25@intel.com>
Content-Type: text/plain; charset="UTF-8"; format=flowed
Content-Transfer-Encoding: 8bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?cndPdVlIR04zMTQ4UjlvWDF2RXY2V0FmYTZJaEk4NkszSFNuWXV5NlZDbjcr?=
 =?utf-8?B?YU1Fay9zUUJKRlYzaU42dCtiaHR6ZzllTEhadHJtUjU4K3h3dnVmN3JGMkpS?=
 =?utf-8?B?UjlZTnlEc0FGZE1tbUNJdE9QbllKWWJCOW9ZSEtUcGpJRnl5cS9Da1pHM0FF?=
 =?utf-8?B?K2ROVk0wRDdEdU5rYW9XZEZGMnFlN1UzUWVSWU9JdDErNmxNSmF1UDArdGRJ?=
 =?utf-8?B?MlNIU25POUlrRW4vZmQxL2tHcVl6RVlwWDEzbldOQjVFV2wxc25JK01JVmV6?=
 =?utf-8?B?WW14dWl5c1NPVytsNkhYZHVjdk5hOGRpdUZzV29wejNDSUZONStlc2U3eS9C?=
 =?utf-8?B?Z3E1a2E3RUNhaVRQam5CZFlacVgrYXl5RmZZMUtnNStIVUlMbDNtZU5sbDhy?=
 =?utf-8?B?cmo3MG9hRW9UN1M1OVpKM0c4S2hmaFNsZ3ZhNVp4WEp1cHRMaFkrWElSMmVi?=
 =?utf-8?B?U3FmTTFVRjFoLzh3eXZVditacnh3d2tiSTRTRFpmVm1tMTdCQjNDczVJTWRt?=
 =?utf-8?B?MnVLWHdtODQ0aHVLcGpRbkVwUTlyNjhVTkdvbGtUbmVjajc0QlBUQkY4VTJC?=
 =?utf-8?B?cVZvV28yNitnVlFGNnR0VENzOERYUDJCT0wybHdtajB4SVZmWDRIdGxscUJw?=
 =?utf-8?B?UGZCdzlUZ3k0M1pINUVpV2R5YTlHU0UwdXkxVlI5Y29IQU5HeVQ2a2h1STk5?=
 =?utf-8?B?WFpMd0dmNHpVU3lxay8rbUNVM2NKWVBXaXZBeVllRDgxUDdxRUJnSHV1TDVL?=
 =?utf-8?B?Tms4V1dVNE5selNVOFNPdWk4Smo3TjNONjAwMkZHNkhjVUJTVXNNTjNIKys0?=
 =?utf-8?B?WVlVZHpIYXVsdytEd2hJQ1BQa0pKaGx0WDZLZVYxRWg3UEl5dUJDTnowMnI4?=
 =?utf-8?B?WkVWa1dpWEhYTVBTak1OR3dOTXE3Qzd0UEpIaVhwWktCMlZ0b2xsZHd0eDNW?=
 =?utf-8?B?WHBIYmJzY3RncVhoV0ZwSmNyS2xidGd4K3NYUDZwaXgzWWN2d2tKOTVFU28x?=
 =?utf-8?B?RmNiekNlbHRldnlSNkp2OTZ0cExyc1BkNW9sNVZwbk1YTmpKeVdXODhrQXVO?=
 =?utf-8?B?bng2NkFuVVhBTUk1ZEowU0k0Z2JkMzNWVEo3YUFzc2pXVjdCRGdkQjR4c2tu?=
 =?utf-8?B?MkNNQXdwUDJQUVJiejEwb0JYN2xsT1B4OVdmalh6V2xRNjFGTXc4QmFFL0kv?=
 =?utf-8?B?NWMrMVBGOXNaZ29SaFVkaEFoS1pGSnlXU3JJUmRtMkh3blJXS3REMjhBYUU5?=
 =?utf-8?B?ZVZYV0QvMHFxVS92NCtCbml0TE9POHgyMWFiRlRJUHdPRzlBNWhYQ3pPNGpy?=
 =?utf-8?B?WHNoUUZqbHpyYXFmNi9WdUtiQUlHanlPS3JnUnVCbVl4bzhCcFF4RHNORFRZ?=
 =?utf-8?B?Y2lVTVA4bXV2SWpkRnFmNm9CZng5c2NTc3JoN1Z0SEtleW8weFZxR1BrVkdD?=
 =?utf-8?B?b05iV2JadXIxNStoNkQzcXY1NUR3V0xwZ1JxT2NNK0VGRmlzZ2JOSVBrR0ZF?=
 =?utf-8?B?dHNZUzdyWXJCMHlYOVBGSXJDQVBMRW9mdGZIWW1oL0dCMlkwejMzMU5iL3hy?=
 =?utf-8?B?ZXlXNWpSbnIyY21LQVRRaGkveDJjc2dvcjlJT0JNTmsrRHdLYTFGdk52Y1Vn?=
 =?utf-8?B?RmRHMFh5Tm5vM3NZQ0w4VEszeUN3OFFWeEZRK2IrYnV2Y3hwUFI4bHRoSHls?=
 =?utf-8?B?N2Y2bnZmbTVtM0hpQ29OZ3l2YmpsSFVuaHhwWWdwdmRCOExveWpOblFFQ2lu?=
 =?utf-8?B?NXNoOVJVei8vcUYrWGY0TlF5blF5Y2JiK1NBZlFqcUFFWEVpTUdRWUFMQ1Y5?=
 =?utf-8?B?R3FqS3dURjR5S05zNkZsa3pXeGk4Vk1MYUNyUXdvbHp6K1V0Wlk2MzNnbXdO?=
 =?utf-8?B?dTNPUmRXdzQ2WGRvUkJyWjUveVFMcXprVE5rSUNBYkVOK0Eybnoyc2dseEhU?=
 =?utf-8?B?N2ZNckZoRExiTERQcUlOdGhybEt3aGFFR3BUMmJjUUNqQTh4Y0hmcXZOdGxM?=
 =?utf-8?B?TzFERDZYdnd0SlJna3A0QVNMbklMV0NuMnFyamdkSHFXNGVxNGlMSk9IaEI1?=
 =?utf-8?B?SDRSMW5RYnBRK01IQy9vYWdOQ2V5WHpneUd1cEw5R2VqRENiWkdoTjBsL0wy?=
 =?utf-8?B?dkpvdXpsMlBkM1NGQUZrSUF4Y1UyWDMvRStVSDJsVEI4QmYxNHl5bnRxRjBy?=
 =?utf-8?B?a3c9PQ==?=
X-MS-Exchange-CrossTenant-Network-Message-Id: 574679d7-a698-44ee-3c37-08dbb592aa44
X-MS-Exchange-CrossTenant-AuthSource: PH0PR11MB4965.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 15 Sep 2023 02:22:53.1189
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: NR13/7SSp5TInxdH+aZMQbxmEnZbTMm9KLPdvg2LPMrcq2/sI7z8uqBCIl3gZrtAwWpJ7Ma4VR1aK2OFOD5+xA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH7PR11MB5887
X-OriginatorOrg: intel.com
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org
X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (snail.vger.email [0.0.0.0]); Thu, 14 Sep 2023 19:23:08 -0700 (PDT)

On 9/15/2023 1:40 AM, Dave Hansen wrote:
> On 9/13/23 23:33, Yang Weijiang wrote:
>> --- a/arch/x86/kernel/fpu/xstate.c
>> +++ b/arch/x86/kernel/fpu/xstate.c
>> @@ -1636,9 +1636,17 @@ static int __xstate_request_perm(u64 permitted, u64 requested, bool guest)
>>   
>>   	/* Calculate the resulting kernel state size */
>>   	mask = permitted | requested;
>> -	/* Take supervisor states into account on the host */
>> +	/*
>> +	 * Take supervisor states into account on the host. And add
>> +	 * kernel dynamic xfeatures to guest since guest kernel may
>> +	 * enable corresponding CPU feaures and the xstate registers
>> +	 * need to be saved/restored properly.
>> +	 */
>>   	if (!guest)
>>   		mask |= xfeatures_mask_supervisor();
>> +	else
>> +		mask |= fpu_kernel_dynamic_xfeatures;
>> +
>>   	ksize = xstate_calculate_size(mask, compacted);
> Heh, you changed the "guest" naming in "fpu_kernel_dynamic_xfeatures"
> but didn't change the logic.
>
> As it's coded at the moment *ALL* "fpu_kernel_dynamic_xfeatures" are
> guest xfeatures.  So, they're different in name only.
>
> If you want to change the rules for guests, we have *ONE* place that's
> done: fpstate_reset().  It establishes the permissions and the sizes for
> the default guest FPU.  Start there.  If you want to make the guest
> defaults include XFEATURE_CET_USER, then you need to put the bit in *there*.

Yeah, fpstate_reset() is the right place to hold the guest init permits and  propagate
them here, thanks for the suggestion!

Nit, did you actually mean XFEATURE_CET_KERNEL instead of XFEATURE_CET_USER above?
because the latter is already supported by upstream kernel.

> The other option is to have the KVM code actually go and "request" that
> the dynamic states get added to 'fpu->guest_perm'.

Yes, compared with above option, it will change current userspace handling logic, i.e.,
only user xstates are dynamically requested. So I'd try above option first.

>   Would there ever be
> any reason for KVM to be on a system which supports a dynamic kernel
> feature but where it doesn't get enabled for guest use, or at least
> shouldn't have the FPU space allocated?

I haven't heard of that kind of usage for other features so far, CET supervisor xstate is the
only dynamic kernel feature now,  not sure whether other CPU features having supervisor
xstate would share the handling logic like CET does one day.