Received-SPF: pass (google.com: domain of linux-kernel+bounces-103805-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45d1:ec00::1 as permitted sender) client-ip=2604:1380:45d1:ec00::1;
Message-ID: <bfde1328-2d1c-4b75-970f-69c74f3a74f9@intel.com>
Date: Fri, 15 Mar 2024 10:23:35 +1300
User-Agent: Mozilla Thunderbird
Subject: Re: [PATCH v19 058/130] KVM: x86/mmu: Add a private pointer to struct
 kvm_mmu_page
Content-Language: en-US
To: Isaku Yamahata <isaku.yamahata@intel.com>, "Edgecombe, Rick P"
	<rick.p.edgecombe@intel.com>
CC: "kvm@vger.kernel.org" <kvm@vger.kernel.org>,
	"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>, "Zhang, Tina"
	<tina.zhang@intel.com>, "seanjc@google.com" <seanjc@google.com>, "Yuan, Hang"
	<hang.yuan@intel.com>, "Chen, Bo2" <chen.bo@intel.com>, "sagis@google.com"
	<sagis@google.com>, "isaku.yamahata@gmail.com" <isaku.yamahata@gmail.com>,
	"Aktas, Erdem" <erdemaktas@google.com>, "pbonzini@redhat.com"
	<pbonzini@redhat.com>, "binbin.wu@linux.intel.com"
	<binbin.wu@linux.intel.com>, <isaku.yamahata@linux.intel.com>
References: <cover.1708933498.git.isaku.yamahata@intel.com>
 <9d86b5a2787d20ffb5a58f86e43601a660521f16.1708933498.git.isaku.yamahata@intel.com>
 <50dc7be78be29bbf412e1d6a330d97b29adadb76.camel@intel.com>
 <20240314181000.GC1258280@ls.amr.corp.intel.com>
From: "Huang, Kai" <kai.huang@intel.com>
In-Reply-To: <20240314181000.GC1258280@ls.amr.corp.intel.com>
Content-Type: text/plain; charset="UTF-8"; format=flowed
Content-Transfer-Encoding: 8bit
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?RGtQV1k2UFdUNWx5SzJZNWczY2lZS2tPckkxZG56bHQ2UHlhTmdwbDkya3h3?=
 =?utf-8?B?V0c0OFVYY01BemM4Uyt1M2p2OW5GeWFYbzJJNHdnUmU0MThyNjJVRit2WVc2?=
 =?utf-8?B?azZEdFBkaEpuVW9QVG1TWUJ6U01lQnBqcVdyZ2ZrWklUOFFFYi9VYXdNV3Mw?=
 =?utf-8?B?NVAzTWVONm1UejRHN3FPdms3STRPZ3NWNGtrM241aVBEbm9wN3E1eGxGYS9O?=
 =?utf-8?B?OTYrVkMyYzVGdFNKWDdnUjRPQ1pFOXhxRGlvaFlsZVhlc3pLekdSSy9XOTgz?=
 =?utf-8?B?S3V4dFhpM1gxRExFOWpLRzI2RmNVSHdqY2VrODk1cTdOQlMvRHNYTHZxdXd0?=
 =?utf-8?B?UTBvcXdXVHI5Z3NOSEFpU28weDZQRlIxYUZLUEtaSDdKZGcwYnVYU1pkb1F3?=
 =?utf-8?B?YzlrT0M0Y2Y4NTFTYWtvamtvWFlQSHd1bEt0YzFqdERDbENBcFBNK0FVaW5O?=
 =?utf-8?B?cVEzT1RiS2xVdEFnVm1QQzZIS240aEpWUGhnb3Rac3c1RTB2MXh1ZlRESnhO?=
 =?utf-8?B?UTJQb2gzMFJYakM3ZXF1dkRtcGoyem5xbWNpRi9LUUxyazZDZzNWWFBzM3po?=
 =?utf-8?B?cllaN3FvWWVSdjZETE5LU1ZGakpHd1BrOVAxb2tHQTdDVzZYK3V0QyszVjF3?=
 =?utf-8?B?YkNGVTRNc3BxemROaVl5dGhMZWtOTFYxR1pYeWw3VGlXVUtIMDAvMUdoRStL?=
 =?utf-8?B?eEN5dXdHVDJubW1rN09XOWxpaXVQMHR2My9WUHJBeW80T0kzMmJ4d0dZMzh1?=
 =?utf-8?B?NlJnYTV3ZzdaRWViclZvUEcxM3RRaG5oSkNwTXQzMkZ2bXVNUGU1TkJDR0dD?=
 =?utf-8?B?UlJTQms5ZndoVE90c3VqQmVVR3NTR0RiNkZpLzFlcnEvd1dFQjFkNFovRHM1?=
 =?utf-8?B?OXF5OVd0NDRxZ2g4cnRzc2JUakZIK3Z6WXBjQTNwQUhoOWpMc3BER1d4QXk5?=
 =?utf-8?B?WkswSzZFK21jZTNncTJpWnNoazc2d1M1MzVsRitOUFU0b3l1a0tkdzdjUmZi?=
 =?utf-8?B?enFUdmJYYkx2MFRWT2lpZ0Z3MFYrMEVQR3Uvb2lzZGpoek8wNW5sMCs3L3Av?=
 =?utf-8?B?RmwrNGlGQ3RGN0svblNTenJpYUZhTzhGb212aHdRQ0c3SzZUbGpKME9pRGRN?=
 =?utf-8?B?UVhyOVU2M2pJVFBaTGN0cFd0MmZncEVoeFdTNTF4MFdUd3piNktjYXRkRURj?=
 =?utf-8?B?VXJMUzJhRm9wNWZjQ3dmNVc2YXRaNDlQbzFqSTRETlZRVVArb2R2eE90UTBP?=
 =?utf-8?B?c214eVd3WlB1WERVOVlyN3M2WDIrN04wZzZBeENXSkhBM3RPbnJwVGR6SXJr?=
 =?utf-8?B?MjdrMGNlQ3kzVDVBMGlzR3Ricno0WC9LbHZTUzFRNEx6Wm1OUWQyYk9YWGRZ?=
 =?utf-8?B?OGRHb0VSTEJkZ2ZlejN0QU1qTzBzbUcxV3FzNzczYUxqOG5vTTFZa0ttazV6?=
 =?utf-8?B?OXF6N0NBcm1aMEZ2bzBnazV5TC9DVThYWmhVUDFmaDRFeldNVEliMHc4b2JG?=
 =?utf-8?B?NE45eFZHKzQ3UmpGV0ZJdFNqSWxVUFVjaS9qZHNMdjVMMUxXUDQ3Y0FHb0sx?=
 =?utf-8?B?L1lNR2Fpak9PNVdnZ0p0T2Y4YUNkeDR1MWxnUDRhL083MG44cSt2WlJxRHpi?=
 =?utf-8?B?UUZzenU5V285KzRPM2Vybis4MDFUMmJIRUFqY2d0RXE3T3Y3QU01UlIrQzMx?=
 =?utf-8?B?V2F2QTdGYS91a05uWVlBRXhHczlYRWRTZFRQZ2F0eUtiMkl2R3JmNTg2MFFG?=
 =?utf-8?B?b3ZVWWQwTVRUc01PcklVOElJUzlHL0xFUHBNVmRJbTU4QzYzTFlpK1BvM2ZG?=
 =?utf-8?B?Z1RwRnUzenVTeU03eUFGemdxWGV5b3ZLZS9uUDdiTWY1YTFjenpXaExWUDdn?=
 =?utf-8?B?YWdsQXBuUi9oY3ZHaTBzcERKZi9uL1BFODZkZ0JkcXV2SlphVmd6cVFzeDZs?=
 =?utf-8?B?RG4zWUFCWXNSQ0xGTVljU0dtVlhDMEdRRVJlNFZYYWRhamdXb2RKZlVEbUlu?=
 =?utf-8?B?bjJVczBPKy9VQld3MElhZWlnVnNBWS9LenNtMk5WcDZTZ0lveFVuMVhyTmZF?=
 =?utf-8?B?QnAxd1JGV2tPZjVLbkVGL2VwREhaMzhkZjJ1VWFUTEYzS2FoeStQazBITk5B?=
 =?utf-8?Q?2q0rqnJ4vPyYFmhSck5UxmLwF?=
X-MS-Exchange-CrossTenant-Network-Message-Id: ccd077df-a240-4195-1e18-08dc446d08a3
X-MS-Exchange-CrossTenant-AuthSource: BL1PR11MB5978.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 14 Mar 2024 21:23:46.8685
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: otxABHsfth0uaGNpqEpCjtmF8GB0UZ9MtibZgLaQyHAYvOlkyfNeI+dPmdOAZ2IKmDDx3oLP7Az2Sr/zgaRwTg==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY5PR11MB6534
X-OriginatorOrg: intel.com


On 15/03/2024 7:10 am, Isaku Yamahata wrote:
> On Wed, Mar 13, 2024 at 08:51:53PM +0000,
> "Edgecombe, Rick P" <rick.p.edgecombe@intel.com> wrote:
> 
>> On Mon, 2024-02-26 at 00:26 -0800, isaku.yamahata@intel.com wrote:
>>> From: Isaku Yamahata <isaku.yamahata@intel.com>
>>>
>>> For private GPA, CPU refers a private page table whose contents are
>>> encrypted.  The dedicated APIs to operate on it (e.g.
>>> updating/reading its
>>> PTE entry) are used and their cost is expensive.
>>>
>>> When KVM resolves KVM page fault, it walks the page tables.  To reuse
>>> the
>>> existing KVM MMU code and mitigate the heavy cost to directly walk
>>> private
>>> page table, allocate one more page to copy the dummy page table for
>>> KVM MMU
>>> code to directly walk.  Resolve KVM page fault with the existing
>>> code, and
>>> do additional operations necessary for the private page table.
>>
>>>   To
>>> distinguish such cases, the existing KVM page table is called a
>>> shared page
>>> table (i.e. not associated with private page table), and the page
>>> table
>>> with private page table is called a private page table.
>>
>> This makes it sound like the dummy page table for the private alias is
>> also called a shared page table, but in the drawing below it looks like
>> only the shared alias is called "shared PT".
> 
> How about this,
> Call the existing KVM page table associated with shared GPA as shared page table. > Call the KVM page table associate with private GPA as private page table.
> 

For the second one, are you talking about the *true* secure/private EPT 
page table used by hardware, or the one visible to KVM but not used by 
hardware?

We have 3 page tables as you mentioned:

PT: page table
- Shared PT is visible to KVM and it is used by CPU.
- Private PT is used by CPU but it is invisible to KVM.
- Dummy PT is visible to KVM but not used by CPU.  It is used to
   propagate PT change to the actual private PT which is used by CPU.

If I recall correctly, we used to call the last one "mirrored (private) 
page table".

I lost the tracking when we changed to use "dummy page table", but it 
seems to me "mirrored" is better than "dummy" because the latter means 
it is useless but in fact it is used to propagate changes to the real 
private page table used by hardware.

Btw, one nit, perhaps:

"Shared PT is visible to KVM and it is used by CPU." -> "Shared PT is 
visible to KVM and it is used by CPU for shared mappings".

To make it more clearer it is used for "shared mappings".

But this may be unnecessary to others, so up to you.