Received-SPF: pass (google.com: domain of linux-kernel+bounces-181658-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) client-ip=147.75.80.249;
Message-ID: <d9c2a9b4-a6b8-4d29-9c22-ebdce77f3606@intel.com>
Date: Fri, 17 May 2024 12:37:49 +1200
User-Agent: Mozilla Thunderbird
Subject: Re: [PATCH 04/16] KVM: x86/mmu: Add address conversion functions for
 TDX shared bit of GPA
To: "Edgecombe, Rick P" <rick.p.edgecombe@intel.com>, "kvm@vger.kernel.org"
	<kvm@vger.kernel.org>, "pbonzini@redhat.com" <pbonzini@redhat.com>,
	"seanjc@google.com" <seanjc@google.com>
CC: "Zhao, Yan Y" <yan.y.zhao@intel.com>, "sagis@google.com"
	<sagis@google.com>, "linux-kernel@vger.kernel.org"
	<linux-kernel@vger.kernel.org>, "Aktas, Erdem" <erdemaktas@google.com>,
	"isaku.yamahata@gmail.com" <isaku.yamahata@gmail.com>, "dmatlack@google.com"
	<dmatlack@google.com>
References: <20240515005952.3410568-1-rick.p.edgecombe@intel.com>
 <20240515005952.3410568-5-rick.p.edgecombe@intel.com>
 <9f315b56-7da8-428d-bc19-224e19f557e0@intel.com>
 <307f2360707e5c7377a898b544fabc7d72421572.camel@intel.com>
 <eb98d0e7-8fbd-40d2-a6b3-0bf98edb77f9@intel.com>
 <fe9687d5f17fa04e5e15fdfd7021fa6e882d5e37.camel@intel.com>
 <465b8cb0-4ce1-4c9b-8c31-64e4a503e5f2@intel.com>
 <bf1038ae56693014e62984af671af52a5f30faba.camel@intel.com>
 <4e0968ae-11db-426a-b3a4-afbd4b8e9a49@intel.com>
 <0a168cbcd8e500452f3b6603cc53d088b5073535.camel@intel.com>
 <6df62046-aa3b-42bd-b5d6-e44349332c73@intel.com>
 <1270d9237ba8891098fb52f7abe61b0f5d02c8ad.camel@intel.com>
 <d5c37fcc-e457-43b0-8905-c6e230cf7dda@intel.com>
 <0a1afee57c955775bef99d6cf34fd70a18edb869.camel@intel.com>
 <9556a9a426af155ee12533166ed3b8ee86fa88fe.camel@intel.com>
Content-Language: en-US
From: "Huang, Kai" <kai.huang@intel.com>
In-Reply-To: <9556a9a426af155ee12533166ed3b8ee86fa88fe.camel@intel.com>
Content-Type: text/plain; charset="UTF-8"; format=flowed
Content-Transfer-Encoding: 8bit
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?Y3h6VmhNWk55ZHplcm5FN1UvQkRsYVRpaW1VZWZmR1haa2FQTk9PSW0xYXl5?=
 =?utf-8?B?U2w0Mko0anRXR0V4bTdNSW84SnhjMHVROFpoKzdxVFRqVVdsZ2h0VXlNK091?=
 =?utf-8?B?M3lYQXVhY25ERThhVzloYUQ2WWExeENzNFhJd1N6N3cxVUJMamtVRUlCVzg3?=
 =?utf-8?B?TTdPSVJGdk1CQjV2MmpBYWlNQnducjBPMWJDVTdvQll6ZUg1WnJiQjd2VmI5?=
 =?utf-8?B?SEJ0cUdOYjdybnNUd2tMaXlGc0JmeXB5WXIzQzQrOVdlZnRpRnA1UUc3QkE5?=
 =?utf-8?B?MFJLSHhjRW45UUp5RVA2U3NjeUN6Z2NwelJHWmpvWndtdEg3Y05nSFJ1OENM?=
 =?utf-8?B?NlVXWFk2RklHU25wa0hmcnZUa3M3QmNvRW9SYlV1STZPL2JIK0I2YzZJeDd0?=
 =?utf-8?B?TGt1MVVQV3ZzTG9Ib2NIeG1DQmRQTTZQaDJEc2hxYkd1dE5URHV2UHBOK2hS?=
 =?utf-8?B?TzBpeFZaSXBwQUFpSVFVdklOallXK0ZPSGsyS1M1WWVPSERFRWVSRG1HSVQ4?=
 =?utf-8?B?ejhlRkU3QTFzeE5mU0FLREZTNCt2VUoxcTJTQ3BGUzlha0ZTWmRrOGhSbWk3?=
 =?utf-8?B?RDgxWnJjRy84eDJEb0djaHg5cGluTURlT3ZYR3ZKREpDeEtaS1V4TE5ZbzRr?=
 =?utf-8?B?NWtJSENOVmRaQ1hHRlNYQXlVV3dPZHlCQzFsOFllZnM0b0l4VUtUbTNtSlE2?=
 =?utf-8?B?bVpUUGxCd01hSlEwQzM2bFA3NGo4OGZONXlGenRJbXVsWGswVGZ3VERLSnhP?=
 =?utf-8?B?RFA1UVBYeGJYZ3pQNlZCMGoycTNyYmkxUzRwSDlFZ0dFTzFzNlBSbjJaVFV5?=
 =?utf-8?B?K3F2enkzc0xGUXJrSys3dVdvZUVQV1FobXpQbk9BYS9EaDhqallPQnlUM2Fh?=
 =?utf-8?B?ZklKS1Y1NDM2dCt2VjRuaXR0blJ3aW1iRkNHQjdWM0U2QkhyY1p1QjBoYmUr?=
 =?utf-8?B?ZEtGbmFQdW5xcXcyM0NhK0lGbEs5MnlwZ3JNNVZlUFlsS24rS0ZVZmpmRFV3?=
 =?utf-8?B?VE1CZWtLY1RkTGRpOTIreW5FT0VJWWFBK2kwOFY2Vm00U2ZvNnhaNHNYRjIy?=
 =?utf-8?B?YldaZ0h1c1lKdUFQTWpJQ0RQQ3NiUG1YczkrWWpjYmFSZzBKcS9XcXNJWHAy?=
 =?utf-8?B?RjVhOGtwYVB3Nk1PaDIzT2c3V0gzNUM0SjgyemlqV2U3SHFGRFBmVnJMRHVN?=
 =?utf-8?B?VURhYmw2QThzb3NGM0VWSnBBMjBnUDlyMUc0b3lVckU4dldHMFRSNzZ2ZXhX?=
 =?utf-8?B?VXV5dW5tQTNXOXRpZHp0NGVNTmhXOXlOWXJXUStOWXdXelNVWFptTGE2ZFF4?=
 =?utf-8?B?SE1tWHRoMk1IYzFpRkF3WExQUUxKYW9wVTE1UEJ6TFVGTzRTNVJ5eFk5RVp3?=
 =?utf-8?B?OEVTQlIvNVNyODk5UGdQaVBacmVFN1k3T3Bia0phODZscnRYVk4xSG44TnhT?=
 =?utf-8?B?ZkZwVEpIQTU2QWljRVhGRng1QUZtS1NDdXhOZUFXT3ZSdXpIT1VWNUVlTnRC?=
 =?utf-8?B?WlVEbW52eW5NUFpVV2FnNXh1bThoYjlYZTA5VTZOZmp6K3dwS2huNkI4Qkox?=
 =?utf-8?B?NlhCaWpaOFJwbUNlZVcxMGh0ZDdOZjJPTnFScXk0V25BTjFNRHJzaCtIeXZp?=
 =?utf-8?B?THR4TFE0eWtERWFuYnhnNVRwRHkwZzdYMnBGR01EVVFRQi84YVR6RVBGS0NR?=
 =?utf-8?B?dGQzSjRMNmZsNDJjTktpRnR1bkJ1VWxrUHNMc2FOMlNSSWhmQkRXNGZvNFNM?=
 =?utf-8?B?YllzT3NFWGt6Smphc2VEUXZoVERjT1hYd3FKOVBNME9wMSs3K24xR3VFcG4v?=
 =?utf-8?B?USsvdkhSN1Vwb3JnelVYSGlBVXNNQkxEdFJkVmFleSs2YmpLdElUTW9VT3VF?=
 =?utf-8?B?U1lCYVhXM2d4aFBweWVHRFlWd0wxQ3FxNlo0UmQxT2J2SWlNQ21BejVZOUJR?=
 =?utf-8?B?ZVhQVG02VkxtL29zNGRGK0FLTGpBcHlsTUdvdnlhOXZwUTh2bmhtNEN0NDhF?=
 =?utf-8?B?bWRkUU0zcmdNMDVHeHRVNjQ5WFBtTFZ6bUtXZm9DaWhtSDB5bmJaVHdhV1hH?=
 =?utf-8?B?WGdBZ1hmSjJlOG5PYllwZTN1NmJrbWJTVzQxR1BXWmRUQ28wSzFvTW9pMHpH?=
 =?utf-8?Q?AmI5G2tcfGBKcpHqtH0GqvBDj?=
X-MS-Exchange-CrossTenant-Network-Message-Id: cccbfab0-f0bb-4305-1697-08dc76099a7e
X-MS-Exchange-CrossTenant-AuthSource: BL1PR11MB5978.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 17 May 2024 00:37:59.9584
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: ocFyCJdgOcgVzT9hO52lUo5+1KMvT3p1G241wkM2EcWUZvxheKcsr5d6Jd7rWmK2dgcr5FcQsKR4FzlV3JSSgQ==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW4PR11MB6763
X-OriginatorOrg: intel.com


On 17/05/2024 11:08 am, Edgecombe, Rick P wrote:
> On Wed, 2024-05-15 at 18:20 -0700, Rick Edgecombe wrote:
>> On Thu, 2024-05-16 at 13:04 +1200, Huang, Kai wrote:
>>>
>>> I really don't see difference between ...
>>>
>>>          is_private_mem(gpa)
>>>
>>> ... and
>>>
>>>          is_private_gpa(gpa)
>>>
>>> If it confuses me, it can confuses other people.
>>
>> Again, point taken. I'll try to think of a better name. Please share if you
>> do.
> 
> What about:
> bool kvm_on_private_root(const struct kvm *kvm, gpa_t gpa);
> 
> Since SNP doesn't have a private root, it can't get confused for SNP. For TDX
> it's a little weirder. We usually want to know if the GPA is to the private
> half. Whether it's on a separate root or not is not really important to the
> callers. But they could infer that if it's on a private root it must be a
> private GPA.
> 
> 
> Otherwise:
> bool kvm_is_private_gpa_bits(const struct kvm *kvm, gpa_t gpa);
> 
> The bits indicates it's checking actual bits in the GPA and not the
> private/shared state of the GFN.

The kvm_on_private_root() is better to me, assuming this helper wants to 
achieve two goals:

   1) whether a given GPA is private;
   2) and when it is, whether to use private table;

And AFAICT we still want this implementation:

+	gfn_t mask = kvm_gfn_shared_mask(kvm);
+
+	return mask && !(gpa_to_gfn(gpa) & mask);

What I don't quite like is we use ...

	!(gpa_to_gfn(gpa) & mask);

.. to tell whether a GPA is private, because it is TDX specific logic 
cause it doesn't tell on SNP whether the GPA is private.

But as you said it certainly makes sense to say "we won't use a private 
table for this GPA" when the VM doesn't have a private table at all.  So 
it's also fine to me.

But my question is "why we need this helper at all".

As I expressed before, my concern is we already have too many mechanisms 
around private/shared memory/mapping, and I am wondering whether we can 
get rid of kvm_gfn_shared_mask() completely.

E.g,  why we cannot do:

	static bool kvm_use_private_root(struct kvm *kvm)
	{
		return kvm->arch.vm_type == VM_TYPE_TDX;
	}

Or,
	static bool kvm_use_private_root(struct kvm *kvm)
	{
		return kvm->arch.use_private_root;
	}

Or, assuming we would love to keep the kvm_gfn_shared_mask():

	static bool kvm_use_private_root(struct kvm *kvm)
	{
		return !!kvm_gfn_shared_mask(kvm);
	}

And then:

In fault handler:

	if (fault->is_private && kvm_use_private_root(kvm))
		// use private root
	else
		// use shared/normal root

When you zap:

	bool private_gpa = kvm_mem_is_private(kvm, gfn);
	
	if (private_gpa && kvm_use_private_root(kvm))
		// zap private root
	else
		// zap shared/normal root.

The benefit of this is we can clearly split the logic of:

   1) whether a GPN is private, and
   2) whether to use private table for private GFN

But it's certainly possible that I am missing something, though.

Do you see any problem of above?

Again, my main concern is whether we should just get rid of the 
kvm_gfn_shared_mask() completely (so we won't be able to abuse to use 
it) due to we already having so many mechanisms around private/shared 
memory/mapping here.

But I also understand we anyway will need to add the shared bit back 
when we setup page table or teardown of it, but for this purpose we can 
also use:

	kvm_x86_ops->get_shared_gfn_mask(kvm)

So to me the kvm_shared_gfn_mask() is at least not mandatory.

Anyway, it's not a very strong opinion from me that we should remove the 
kvm_shared_gfn_mask(), assuming we won't abuse to use it just for 
convenience in common code.

I hope I have expressed my view clearly.

And consider this as just my 2 cents.