Received: by 2002:a6b:500f:0:0:0:0:0 with SMTP id e15csp1230233iob; Fri, 29 Apr 2022 00:03:26 -0700 (PDT) X-Google-Smtp-Source: ABdhPJy/NGosm/Oh9vO4IWAjx3z/30TW0sDeJJZ7LNB3LoUaVWbnvy0Fw3dA8ZYtUDCHmjQ6NI1K X-Received: by 2002:a17:902:e012:b0:15d:53:61ff with SMTP id o18-20020a170902e01200b0015d005361ffmr26463276plo.73.1651215806386; Fri, 29 Apr 2022 00:03:26 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1651215806; cv=none; d=google.com; s=arc-20160816; b=FpN/VPaOkZShWPMmbUSgs7fQKzzQ2V3baIcA63rhl2lgpMTzPDgrDUKBLV0r25TY9M alOaX/meh4N/0KKLmW4M+B53l7K0R+ceRZjQA6eOMzwSuFGi4qr08gYxww64QLTUFZe+ YRm6hp/+4kH2/amZTrbDnkWxxDpNsP14raTs+y/RWD69YCkK6yF9MnyjBkU8M4B2cYiG lD/MIaruWfH5HD3gTf9RhSRyhBhMa7ahw6yU2tzzDsgVBtn88Os56FziKaq+mzafAoqE 5+pRqEvaGMZgJA82qCrkiz20kEggA6M3QRxATJHqnWJuDvcCO1nzI/ie7G98L8BT9wap Xctw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:in-reply-to:content-disposition:mime-version :references:reply-to:message-id:subject:cc:to:from:date :dkim-signature; bh=hSYnrVJDLGYanuq5CCBc3HRvgyi4o4+cpbgVkHsOecM=; b=eC1maeHSwA6It3bP9mJW+8QdMhzr0f+DRuXhCUQkwF49KtnFyAoJ8TAbGS7XKVZvDQ 88cMpjwPBMXF77y4ls6+nlbWj0Cs5CmDpse7d/HKZUe6Cf8yuI1BVxP3hqTs1Lh7w+eg PoMpELN/a66++/tcNlMmkEsGRoqnX6uHu+aJOiH636Dn+/tX4pYEyo9CgfacZO0yZPzn /S/of9/IELyK5Z4+W2gUcTA5ISPaQObqzv2Tz+nOCR2a0QuMbUMXjsR+i8KWOCytHG4I Xgd99aa7mHXcwyNGfNOpzoXv9jGejnQDXmiLdvXx8duArDQ6TAqs416BYmsj0qwzUVhG Q4Ng== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@intel.com header.s=Intel header.b=mTcux2E7; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=intel.com Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id d14-20020aa78e4e000000b0050a72d68775si5365409pfr.28.2022.04.29.00.03.11; Fri, 29 Apr 2022 00:03:26 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@intel.com header.s=Intel header.b=mTcux2E7; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=intel.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1346463AbiD1Mo7 (ORCPT + 99 others); Thu, 28 Apr 2022 08:44:59 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:49794 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1346554AbiD1Mot (ORCPT ); Thu, 28 Apr 2022 08:44:49 -0400 Received: from mga05.intel.com (mga05.intel.com [192.55.52.43]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id A36F710FC5; Thu, 28 Apr 2022 05:41:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1651149690; x=1682685690; h=date:from:to:cc:subject:message-id:reply-to:references: mime-version:in-reply-to; bh=jDaoso8XSbsD6Q5i89/pk/Xi3K1DdLaMWFukTg8hKeQ=; b=mTcux2E7ZLul7MpCZLIMfoDriwNJqnMz08/1yY6N7lUQOdpSzQlRi2CR XjwiKL17tL2EoGizi8SGPBxtO5mwy0vXEILR3KOD3OmuKa5T60/aArtms uoKLMaoga72Lyl3+fDW2KsCAjYd7U4rmVIIEHhzAoHIPema68eVdxNhWf +EGhhHkh36orMeUZUh7VvGllZ7CcIkvOj2hY2N+zN10NIGL9Shb2TMz5C ejMydCXr/rM8xB/dmkTC2CprTYklu+G+84dySdNZtXcEj09+ItL2k4VJJ bSSXlAcsEIlKlDltX+qXwtzF5b0WrCyygI6s5wc1q0gCQztlSeeOQk0KC g==; X-IronPort-AV: E=McAfee;i="6400,9594,10330"; a="352710663" X-IronPort-AV: E=Sophos;i="5.91,295,1647327600"; d="scan'208";a="352710663" Received: from fmsmga001.fm.intel.com ([10.253.24.23]) by fmsmga105.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 28 Apr 2022 05:41:30 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.91,295,1647327600"; d="scan'208";a="706039981" Received: from chaop.bj.intel.com (HELO localhost) ([10.240.192.101]) by fmsmga001.fm.intel.com with ESMTP; 28 Apr 2022 05:41:23 -0700 Date: Thu, 28 Apr 2022 20:37:51 +0800 From: Chao Peng To: Sean Christopherson Cc: kvm@vger.kernel.org, linux-kernel@vger.kernel.org, linux-mm@kvack.org, linux-fsdevel@vger.kernel.org, linux-api@vger.kernel.org, qemu-devel@nongnu.org, Paolo Bonzini , Jonathan Corbet , Vitaly Kuznetsov , Wanpeng Li , Jim Mattson , Joerg Roedel , Thomas Gleixner , Ingo Molnar , Borislav Petkov , x86@kernel.org, "H . Peter Anvin" , Hugh Dickins , Jeff Layton , "J . Bruce Fields" , Andrew Morton , Mike Rapoport , Steven Price , "Maciej S . Szmigiero" , Vlastimil Babka , Vishal Annapurve , Yu Zhang , "Kirill A . Shutemov" , luto@kernel.org, jun.nakajima@intel.com, dave.hansen@intel.com, ak@linux.intel.com, david@redhat.com Subject: Re: [PATCH v5 08/13] KVM: Use memfile_pfn_ops to obtain pfn for private pages Message-ID: <20220428123751.GB10508@chaop.bj.intel.com> Reply-To: Chao Peng References: <20220310140911.50924-1-chao.p.peng@linux.intel.com> <20220310140911.50924-9-chao.p.peng@linux.intel.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Spam-Status: No, score=-4.9 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_EF,RCVD_IN_DNSWL_MED,SPF_HELO_NONE, SPF_NONE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Mon, Mar 28, 2022 at 11:56:06PM +0000, Sean Christopherson wrote: > On Thu, Mar 10, 2022, Chao Peng wrote: > > @@ -2217,4 +2220,34 @@ static inline void kvm_handle_signal_exit(struct kvm_vcpu *vcpu) > > /* Max number of entries allowed for each kvm dirty ring */ > > #define KVM_DIRTY_RING_MAX_ENTRIES 65536 > > > > +#ifdef CONFIG_MEMFILE_NOTIFIER > > +static inline long kvm_memfile_get_pfn(struct kvm_memory_slot *slot, gfn_t gfn, > > + int *order) > > +{ > > + pgoff_t index = gfn - slot->base_gfn + > > + (slot->private_offset >> PAGE_SHIFT); > > This is broken for 32-bit kernels, where gfn_t is a 64-bit value but pgoff_t is a > 32-bit value. There's no reason to support this for 32-bit kernels, so... > > The easiest fix, and likely most maintainable for other code too, would be to > add a dedicated CONFIG for private memory, and then have KVM check that for all > the memfile stuff. x86 can then select it only for 64-bit kernels, and in turn > select MEMFILE_NOTIFIER iff private memory is supported. > > diff --git a/arch/x86/kvm/Kconfig b/arch/x86/kvm/Kconfig > index ca7b2a6a452a..ee9c8c155300 100644 > --- a/arch/x86/kvm/Kconfig > +++ b/arch/x86/kvm/Kconfig > @@ -48,7 +48,9 @@ config KVM > select SRCU > select INTERVAL_TREE > select HAVE_KVM_PM_NOTIFIER if PM > - select MEMFILE_NOTIFIER > + select HAVE_KVM_PRIVATE_MEM if X86_64 > + select MEMFILE_NOTIFIER if HAVE_KVM_PRIVATE_MEM > + > help > Support hosting fully virtualized guest machines using hardware > virtualization extensions. You will need a fairly recent > > And in addition to replacing checks on CONFIG_MEMFILE_NOTIFIER, the probing of > whether or not KVM_MEM_PRIVATE is allowed can be: > > @@ -1499,23 +1499,19 @@ static void kvm_replace_memslot(struct kvm *kvm, > } > } > > -bool __weak kvm_arch_private_memory_supported(struct kvm *kvm) > -{ > - return false; > -} > - > static int check_memory_region_flags(struct kvm *kvm, > const struct kvm_userspace_memory_region *mem) > { > u32 valid_flags = KVM_MEM_LOG_DIRTY_PAGES; > > - if (kvm_arch_private_memory_supported(kvm)) > - valid_flags |= KVM_MEM_PRIVATE; > - > #ifdef __KVM_HAVE_READONLY_MEM > valid_flags |= KVM_MEM_READONLY; > #endif > > +#ifdef CONFIG_KVM_HAVE_PRIVATE_MEM > + valid_flags |= KVM_MEM_PRIVATE; > +#endif One thing to mention is CONFIG_KVM_HAVE_PRIVATE_MEM is build-time thing. Do you think we should or not do that for runtime? E.g. expose by vm_type so only when TDX is enabled KVM_MEM_PRIVATE is exposed. Chao