Received-SPF: pass (google.com: domain of linux-kernel+bounces-120165-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:40f1:3f00::1 as permitted sender) client-ip=2604:1380:40f1:3f00::1;
Message-ID: <8f7735aa-517f-4bb3-8e33-d58a27c2a822@intel.com>
Date: Wed, 27 Mar 2024 08:53:50 +0800
User-Agent: Mozilla Thunderbird
Subject: Re: [PATCH v8 00/14] KVM TDX: TDP MMU: large page support
To: <isaku.yamahata@intel.com>, <kvm@vger.kernel.org>,
	<linux-kernel@vger.kernel.org>
CC: <isaku.yamahata@gmail.com>, Paolo Bonzini <pbonzini@redhat.com>,
	<erdemaktas@google.com>, Sean Christopherson <seanjc@google.com>, Sagi Shahar
	<sagis@google.com>, Kai Huang <kai.huang@intel.com>, <chen.bo@intel.com>,
	<hang.yuan@intel.com>, <tina.zhang@intel.com>, "Li, Xiaoyao"
	<xiaoyao.li@intel.com>
References: <cover.1708933624.git.isaku.yamahata@intel.com>
Content-Language: en-US
From: "Yin, Fengwei" <fengwei.yin@intel.com>
In-Reply-To: <cover.1708933624.git.isaku.yamahata@intel.com>
Content-Type: text/plain; charset="UTF-8"; format=flowed
Content-Transfer-Encoding: 7bit
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?NlNjOElFRW5lMHRBS0QrMmh3V1NjM2NaUEswWlczMk9MRjJNaE04eXNVaXFT?=
 =?utf-8?B?Q1d5cDNoam1CU0RPUFkyQ21pVHZ2SFk4aXZkbmlKRjRFbHd5Lzd3T2NOaGFS?=
 =?utf-8?B?YytXcUM5SFNIQXlLV2R1aU9tSjBoVDB6bmFCb0JITFgxT0RBMjJzOXpNU2lS?=
 =?utf-8?B?K2lQMEpyWHpmeU96eHl2eHIrSks2NGFNSzVIYWZiNGNINSt4em9aSjNMV1Bk?=
 =?utf-8?B?amt1a1dFeHhZa1NyL1FxZHJjNWhVNXFDYmc3VTNRMGJrdlhXemEwK21zVWRF?=
 =?utf-8?B?alFPRC9Rb2tpN0lJUklua2QvZm40UndLbWZ2NjB0cG5qSk5XMDdSVnBkVnJl?=
 =?utf-8?B?Mkx6bFBxQTRhSTFlVndzVkF6eFkzTytNbjI3V2V1TmRBLzBSbStOQk5KTWNM?=
 =?utf-8?B?WEFOQTFHT29TRVVzMVc3NFdkVnc3TVdnbVNTY0ZUbEt6eDZmaTQva25PSzB3?=
 =?utf-8?B?WnBpcE5ac3Q5QjJCRmU0MlZONkdXRGVMWElyM2VRRFdHR3oxcU1pckMvOXps?=
 =?utf-8?B?SUQ5dUNPaFgrcHNTVnJ0YXloZ2VhaFZYZnpRSjRHdHl5bDFwNUtwSEk2a3J1?=
 =?utf-8?B?QVdhclRoU2hQR1JNT2F0QjhKUjZReGozcGlXVjBucnd5RjVlTldMbzAza0tO?=
 =?utf-8?B?QTRzZ1k1MnFreWh0a0pwaEg0MElJbDd6UDd2N1JTdE5Xd2xMTHdjeGZDZzdr?=
 =?utf-8?B?ZmFnL1A3MHdYMi9Qa1JheWx2S0ZLeTFGY2hRdHlRMFlLMFBzMDBFSHBTT0F2?=
 =?utf-8?B?QmRNMnh0bVJaWHNPcnJpQ1FCQVZ2Qkx3Ni9pRzl0QUtSeTJ4eW0xOWFSMkhO?=
 =?utf-8?B?d1pRdVliNGkwV2tlek1Zc2NPbG4xcWpQYmxmY09hdHlWd1Bya1QxUk9rcVIx?=
 =?utf-8?B?NTNub3NHeDB4d3Y1NzFjNmtTNEUzM1VhTThOZk9DQ1l3VVIxWFZGZW0vWWty?=
 =?utf-8?B?Zk1pWUVGNUZMengrZXdxc0ZCVHFhQzZEVmdZcXc4QUpsOWUwL0Z2dWFudUc4?=
 =?utf-8?B?M2hzR2N3QWVDQnFCanBkSjNLRTRqNGlXOGlmeG90bHpsMjJCZmM3N2pzNGs5?=
 =?utf-8?B?TEJucWxwOUtBekRvb1lMa1ZLbnB0YjgvbndQMWQ4N011RVdCb3RuM1hTTllu?=
 =?utf-8?B?eHEwQXh3dWZYOTlBQ1lMaXlKSlNtV1lFWVA5QnJTaUpiSFVsTGp4OTZ3N2Z1?=
 =?utf-8?B?NStieVNnYS9ncVhKY1kzaTdmZS9oUUFWbVVGNmJRcTBlN2ZxOVJYWnQrREdS?=
 =?utf-8?B?MGZnQkJxRTIwYlliRlZ4Q2t4MklwRFIwZnBLRzlxNVEwdk9HTFR4VGxDSWJw?=
 =?utf-8?B?bDZMWTFvdm0rZDAzY3ZGSDNQNlFMWTFWUnYrc1JubnROVy9HSW1FZXhTbHBZ?=
 =?utf-8?B?aEpCWTBqK0syZXVkNG1rRGNLZzg0NExCdHp5dzF6UXBGZUJBSFdsSDFxNnlt?=
 =?utf-8?B?SHdTZy9QUnprYXZxNzZVRVQycW1oY3RYb0FVRk0wWXBablJtLzVWOU1VUWp1?=
 =?utf-8?B?Y1FlNXU1STJJVFZvMitUUGJxUmRhSDdVcUlpWmd3UVZiK0pqZXYzTHhtS3hR?=
 =?utf-8?B?aUNaODEwdGZFa1ladGI1WXRzZSs1Rlo2Qk9xcDlDMlVndUx2ZURaaUJXZUJB?=
 =?utf-8?B?V2dWeXE4cGdOTjZyeWxzT21hY2Urcm9pc2FlekMyV0tjNEJaeTcrNVVvVWNm?=
 =?utf-8?B?eUtYMFpnaXlUaUd1d0dlaWIwU0JMZ0t1SzEzSDl6WkJ2c3VCQW51QUY2SXRl?=
 =?utf-8?B?cnRHaW1lTUJQdk9QT3hncnZGYU10WmFibU1RTE9Hc3ZWQUttUTNEUWNZWEtD?=
 =?utf-8?B?K3ljUlNOVE1nQnJSemlvb2VEV2tLRmlXRWx0K0taYkFmWWJOYkJqYVpkZWRP?=
 =?utf-8?B?bDZBdUNaRkRKL2IwY055OGE2azJjQlFKM3BUbURiT3FhdURIemlNOThqMUNN?=
 =?utf-8?B?Skk5NjcyREI0SzRCdEp3ZkwvL3ZpVjkvc0M2L0hNYml6ZkdOMFBkSUozWC9z?=
 =?utf-8?B?VmdJYjVTUFhDUDRzZ2xxTEFyWSthVWcwbnMrTjF0WWtuelZQL2k5Z2ZPZnNv?=
 =?utf-8?B?c0d0TkpJTW1FWnM5SlErbEZhTStyRlFMNlNpZW1FbzhFUUtzUW5YbGRRMUdt?=
 =?utf-8?Q?RS4fdVDrideg/9Ojqx2v2baio?=
X-MS-Exchange-CrossTenant-Network-Message-Id: b597c825-b101-4e22-6564-08dc4df86236
X-MS-Exchange-CrossTenant-AuthSource: CO1PR11MB4820.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 27 Mar 2024 00:53:57.7687
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: 92O5C9cKe6ouneRTHXclpfaPjWfC4INg99nF19bOVOFix9BEv25H/z6Bjjs5ajFv2PdVb3x5aF6W+1haZWpkNQ==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SJ0PR11MB5133
X-OriginatorOrg: intel.com

Hi Isaku,

On 2/26/2024 4:29 PM, isaku.yamahata@intel.com wrote:
> From: Isaku Yamahata <isaku.yamahata@intel.com>
> 
> This patch series is based on "v19 KVM TDX: basic feature support".  It
> implements large page support for TDP MMU by allowing populating of the large
> page and splitting it when necessary.
To test the hugepage for TDX guest, we need to apply Qemu patch
from Xiaoyao:
https://lore.kernel.org/qemu-devel/20231115071519.2864957-4-xiaoyao.li@intel.com/

According to Xiaoyao, it's still under discussion. So he didn't
send updated version patch. For folks want to try this series,
it may be better to mention above link in this cover letter?

Test in my side showed several benchmarks got 10+% performance
gain which is really nice. So:
Tested-by: Yin Fengwei <fengwei.yin@intel.com>


Regards
Yin, Fengwei

> 
> No major changes from v7 instead of rebasing.
> 
> Thanks,
> 
> Changes from v7:
> - Rebased to v19 TDX KVM v6.8-rc5 based patch series
> 
> Changes from v6:
> - Rebased to v18 TDX KVM v6.8-rc1 based patch series
> - use struct tdx_module_args
> - minor improve on comment, commit message
> 
> Changes from v5:
> - Switched to TDX module 1.5 base.
> 
> Chnages from v4:
> - Rebased to v16 TDX KVM v6.6-rc2 base
> 
> Changes from v3:
> - Rebased to v15 TDX KVM v6.5-rc1 base
> 
> Changes from v2:
> - implemented page merging path
> - rebased to TDX KVM v11
> 
> Changes from v1:
> - implemented page merging path
> - rebased to UPM v10
> - rebased to TDX KVM v10
> - rebased to kvm.git queue + v6.1-rc8
> 
> Isaku Yamahata (4):
>    KVM: x86/tdp_mmu: Allocate private page table for large page split
>    KVM: x86/tdp_mmu: Try to merge pages into a large page
>    KVM: TDX: Implement merge pages into a large page
>    KVM: x86/mmu: Make kvm fault handler aware of large page of private
>      memslot
> 
> Sean Christopherson (1):
>    KVM: Add transparent hugepage support for dedicated guest memory
> 
> Xiaoyao Li (9):
>    KVM: TDX: Flush cache based on page size before TDX SEAMCALL
>    KVM: TDX: Pass KVM page level to tdh_mem_page_aug()
>    KVM: TDX: Pass size to reclaim_page()
>    KVM: TDX: Update tdx_sept_{set,drop}_private_spte() to support large
>      page
>    KVM: MMU: Introduce level info in PFERR code
>    KVM: TDX: Pass desired page level in err code for page fault handler
>    KVM: x86/tdp_mmu: Split the large page when zap leaf
>    KVM: x86/tdp_mmu, TDX: Split a large page when 4KB page within it
>      converted to shared
>    KVM: TDX: Allow 2MB large page for TD GUEST
> 
>   Documentation/virt/kvm/api.rst     |   7 +
>   arch/x86/include/asm/kvm-x86-ops.h |   3 +
>   arch/x86/include/asm/kvm_host.h    |  11 ++
>   arch/x86/kvm/mmu/mmu.c             |  38 ++--
>   arch/x86/kvm/mmu/mmu_internal.h    |  30 +++-
>   arch/x86/kvm/mmu/tdp_iter.c        |  37 +++-
>   arch/x86/kvm/mmu/tdp_iter.h        |   2 +
>   arch/x86/kvm/mmu/tdp_mmu.c         | 276 ++++++++++++++++++++++++++---
>   arch/x86/kvm/vmx/common.h          |   6 +-
>   arch/x86/kvm/vmx/tdx.c             | 221 +++++++++++++++++------
>   arch/x86/kvm/vmx/tdx_arch.h        |  21 +++
>   arch/x86/kvm/vmx/tdx_errno.h       |   3 +
>   arch/x86/kvm/vmx/tdx_ops.h         |  56 ++++--
>   arch/x86/kvm/vmx/vmx.c             |   2 +-
>   include/uapi/linux/kvm.h           |   2 +
>   virt/kvm/guest_memfd.c             |  73 +++++++-
>   16 files changed, 672 insertions(+), 116 deletions(-)
>