Received-SPF: pass (google.com: domain of linux-kernel+bounces-180487-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) client-ip=147.75.80.249;
Message-ID: <eb98d0e7-8fbd-40d2-a6b3-0bf98edb77f9@intel.com>
Date: Thu, 16 May 2024 11:31:19 +1200
User-Agent: Mozilla Thunderbird
Subject: Re: [PATCH 04/16] KVM: x86/mmu: Add address conversion functions for
 TDX shared bit of GPA
To: "Edgecombe, Rick P" <rick.p.edgecombe@intel.com>, "kvm@vger.kernel.org"
	<kvm@vger.kernel.org>, "pbonzini@redhat.com" <pbonzini@redhat.com>,
	"seanjc@google.com" <seanjc@google.com>
CC: "sagis@google.com" <sagis@google.com>, "dmatlack@google.com"
	<dmatlack@google.com>, "linux-kernel@vger.kernel.org"
	<linux-kernel@vger.kernel.org>, "isaku.yamahata@gmail.com"
	<isaku.yamahata@gmail.com>, "Zhao, Yan Y" <yan.y.zhao@intel.com>, "Aktas,
 Erdem" <erdemaktas@google.com>
References: <20240515005952.3410568-1-rick.p.edgecombe@intel.com>
 <20240515005952.3410568-5-rick.p.edgecombe@intel.com>
 <9f315b56-7da8-428d-bc19-224e19f557e0@intel.com>
 <307f2360707e5c7377a898b544fabc7d72421572.camel@intel.com>
Content-Language: en-US
From: "Huang, Kai" <kai.huang@intel.com>
In-Reply-To: <307f2360707e5c7377a898b544fabc7d72421572.camel@intel.com>
Content-Type: text/plain; charset="UTF-8"; format=flowed
Content-Transfer-Encoding: 8bit
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?a083YVh6TVZsUU9XYUZEcmhNR1UwT3V0RGgrQ0VIQ3NrT3BBWjdvVTBNaGJG?=
 =?utf-8?B?NExleFcwbzh0WmMzbTZJWjIyNlZIV2pZMUVwczIvbmpaS2ROcURUUjZlQlZW?=
 =?utf-8?B?WHB5MmtQTE40ZFZ4QmZBS1RGME5Wak82Yy9KcUt3dHd3VHUyeXhnQnF3SzBl?=
 =?utf-8?B?LytHK3hXdnk0d2o3ZzlKakR2UFltTGw3SVVRVExTdmdFSUZSR3h2MHVhdmpj?=
 =?utf-8?B?SDIveEVOWnFqSFJ2aldCYlczMTVoVlpKMkZSWFBZUTNIaHlYTkw4VVR0a25R?=
 =?utf-8?B?cmRqWlhRZ2lYYzJzdDdkTVh1YXpUMXc5a2tsaExFL0NPZG5zcGdmR3pRS0NL?=
 =?utf-8?B?Q3hoMU1JdHVNYmZtNTE3aVFxOG1OYk1IT1g2a2dpTHdyYitLUE54cjZ4U25r?=
 =?utf-8?B?VmZQU1g5OVE2U2xNbWV1aXNrb0JvSGpzQmFlNkZhSGtOOUppcEdjeHJtRkc4?=
 =?utf-8?B?M0hBbFJscEJtWUNldjJtRkFwNmc3dTVyb2REQjcwdXFtU2dubEJ1U1pSMFY0?=
 =?utf-8?B?NWdPWHVIZm13VU80NlkrZnhXZEVMMHR2aEtRYjRoMUhEME42aVVCRkdBMUJu?=
 =?utf-8?B?ZUJoeDNENUJDcE1XNjdydmlwTjdPTzZoamVZcW5KLzlHQ25pK2NEeFdJSDdZ?=
 =?utf-8?B?NE1oMEFrTmhiZ2VFeXlnZjBvT0ZDZEc3OUFMeElQazRJc2x3NDhqa0cvaUFD?=
 =?utf-8?B?RXdWeEYrTmhIYk1RN3VDZlZRMUw4QTNzNitqM2dQK29EaTM3UjJ0Z2M4cms2?=
 =?utf-8?B?VllzSUU0NURJNlduTDRzNENyYllFZll1aWU4ekxNUTEwUWxkdW51cjYzWnFN?=
 =?utf-8?B?TkFUWnZ0bFFCTklUaEtyS1NLZ0xVTU8yUmVuNlRiQVNRS0NsZDQyNHdqMGlW?=
 =?utf-8?B?M1NpMlVWYm1WTVBNNUg3L3R3OGpZdE1vZkZaVXZzMnFIQ3FwMFdpVUZ6QzZp?=
 =?utf-8?B?TVlxSmlPd3dIVlJ5b2VidVNqbzdXVmR3WGRENWRkUVlQcXluWW5iYjlFVWlz?=
 =?utf-8?B?NVRmOWpBcGFXV0NpMzBLbGZ6dGZxWGY1RlRmSlpPcjMxTnROdTlsYjJaUzFX?=
 =?utf-8?B?dFBVYVc2dDB2dzBLQld6TWVhZ2d0dDMxY0NrWlZvUXNEc1NIeWxaU2FGWnZW?=
 =?utf-8?B?RVN6cHpEbFQvRlZPTmxLaW9EdTVXSHludEZrQnZ1bHoxR3FET0d1Zno5azEy?=
 =?utf-8?B?V25XSkdEWnlCakNLeVpQWGE3b2d6VlROb2RhMHVPUnNMbDJYYXpTSjByLzU2?=
 =?utf-8?B?dGVTMHUwTEVmNGM4b2NYMldDQmpxS0Y3akUwSUQ5TzA4cHMwVm4zN3F5QmpG?=
 =?utf-8?B?a0lUdmhoMXBOZ0xpczZKclEvOGxjU3hid1dzME9FUG5NK1lLN0J3UER6bHpo?=
 =?utf-8?B?YkdPRUZsWlhXQzJEZTRuWGpabW1OZHRXTVBENVhORnJuZ3ZYdXBJQ3dYcDlr?=
 =?utf-8?B?TDFOaE91Z250KytOY0dSUnhVaVNFNGtUKzJLNjVNQWtXK3Vlc3M3Q1U5MjdU?=
 =?utf-8?B?dFhlMmlBWGNzTmQrcCthalhPWDUzTWJaZkQ1ZzI4b3NvL3hLZzB2cUZ0UXl4?=
 =?utf-8?B?OFQ0c0U3RTVsNHZTWG1lVjlqWWN1VDJlNUJFbEFHSlU3UFk2c21USk9yNmZV?=
 =?utf-8?B?ZWhybHIxOWMxTlBiYmRJaEYwKzhROWN6RUM5RGdLbkR3Z2RwMVJWOHJyY2hr?=
 =?utf-8?B?dmwxenRnRW9HOElFN2ZlSzU1enEzQlRZWUxabmxYM3NzU0JHaHI1WUxZYldQ?=
 =?utf-8?B?djQ2UStMMjZ0WmFURTZvRGdpZ2k3akpITS9WZjBLME1ROSt4dmp0WGtEQWFr?=
 =?utf-8?B?dnh1YkhVREI5SkdNUDFVT0NLUCt5SmpkWERIUmtreUE2SnpyeW9EV3AzcnZn?=
 =?utf-8?B?Nkx6R3dpTlNwS3FFVlV0KzhhN0dDdDdRS2dyVDNpekJRVWZoTERqVUxQbEdY?=
 =?utf-8?B?UnZsZGxyUjdDdWhIUjFnYVo0TkhsN2tXSzBKdGdud0pseXNoZWFZNWxvTXdq?=
 =?utf-8?B?OTNUU0oyV3NwTTF4cnFLL1FNQ0FXQ3FEc1VLYnkyY2VsdXpKZ2R2bGxNeDdM?=
 =?utf-8?B?b1dzN2wrbEFRZkJ4RW9UczAyc2tpSE9MbXRzcWFic2FtdGo0bzc5SjVDR2NI?=
 =?utf-8?Q?5NCap0IAklHZzhIhe5aHetYkb?=
X-MS-Exchange-CrossTenant-Network-Message-Id: 6ced0953-30cc-41d0-8171-08dc75372403
X-MS-Exchange-CrossTenant-AuthSource: BL1PR11MB5978.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 15 May 2024 23:31:26.9366
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: Xe884WwIZIQmhVmQJZaslSe1vqo85h5eeXtDi84w4o7KgLOD3GcMIEG7GUAF/TOWTzg7A16/y+2Gd1qHqKuUjA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH0PR11MB7562
X-OriginatorOrg: intel.com


On 16/05/2024 11:21 am, Edgecombe, Rick P wrote:
> On Thu, 2024-05-16 at 10:34 +1200, Huang, Kai wrote:
>>
>>
>> On 15/05/2024 12:59 pm, Rick Edgecombe wrote:
>>> From: Isaku Yamahata <isaku.yamahata@intel.com>
>>>
>>> Introduce a "gfn_shared_mask" field in the kvm_arch structure to record GPA
>>> shared bit and provide address conversion helpers for TDX shared bit of
>>> GPA.
>>>
>>> TDX designates a specific GPA bit as the shared bit, which can be either
>>> bit 51 or bit 47 based on configuration.
>>>
>>> This GPA shared bit indicates whether the corresponding physical page is
>>> shared (if shared bit set) or private (if shared bit cleared).
>>>
>>> - GPAs with shared bit set will be mapped by VMM into conventional EPT,
>>>      which is pointed by shared EPTP in TDVMCS, resides in host VMM memory
>>>      and is managed by VMM.
>>> - GPAs with shared bit cleared will be mapped by VMM firstly into a
>>>      mirrored EPT, which resides in host VMM memory. Changes of the mirrored
>>>      EPT are then propagated into a private EPT, which resides outside of
>>> host
>>>      VMM memory and is managed by TDX module.
>>>
>>> Add the "gfn_shared_mask" field to the kvm_arch structure for each VM with
>>> a default value of 0. It will be set to the position of the GPA shared bit
>>> in GFN through TD specific initialization code.
>>>
>>> Provide helpers to utilize the gfn_shared_mask to determine whether a GPA
>>> is shared or private, retrieve the GPA shared bit value, and insert/strip
>>> shared bit to/from a GPA.
>>
>> I am seriously thinking whether we should just abandon this whole
>> kvm_gfn_shared_mask() thing.
>>
>> We already have enough mechanisms around private memory and the mapping
>> of it:
>>
>> 1) Xarray to query whether a given GFN is private or shared;
>> 2) fault->is_private to indicate whether a faulting address is private
>> or shared;
>> 3) sp->is_private to indicate whether a "page table" is only for private
>> mapping;
> 
> You mean drop the helpers, or the struct kvm member? I think we still need the
> shared bit position stored somewhere. memslots, Xarray, etc need to operate on
> the GFN without the shared it.

The struct member, and the whole thing.  The shared bit is only included 
in the faulting address, and we can strip that away upon 
handle_ept_violation().

One thing I can think of is we still need to append the shared bit to 
the actual GFN when we setup the shared page table mapping.  For that I 
am thinking whether we can do in TDX specific code.

Anyway, I don't think the 'gfn_shared_mask' is necessarily good at this 
stage.