Received-SPF: pass (google.com: domain of linux-kernel+bounces-101306-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) client-ip=147.75.80.249;
Message-ID: <72285e50-6ffc-4f24-b97b-8c381b1ddf8e@amd.com>
Date: Wed, 13 Mar 2024 10:55:35 +0100
User-Agent: Mozilla Thunderbird
Subject: Re: [PATCH v11 0/8] KVM: allow mapping non-refcounted pages
Content-Language: en-US
To: David Stevens <stevensd@chromium.org>,
 Christoph Hellwig <hch@infradead.org>
Cc: Sean Christopherson <seanjc@google.com>,
 Paolo Bonzini <pbonzini@redhat.com>, Yu Zhang <yu.c.zhang@linux.intel.com>,
 Isaku Yamahata <isaku.yamahata@gmail.com>,
 Zhi Wang <zhi.wang.linux@gmail.com>, Maxim Levitsky <mlevitsk@redhat.com>,
 kvmarm@lists.linux.dev, linux-kernel@vger.kernel.org, kvm@vger.kernel.org
References: <20240229025759.1187910-1-stevensd@google.com>
 <ZeCIX5Aw5s1L0YEh@infradead.org>
 <CAD=HUj7fT2CVXLfi5mty0rSzpG_jK9fhcKYGQnTf_H8Hg-541Q@mail.gmail.com>
From: =?UTF-8?Q?Christian_K=C3=B6nig?= <christian.koenig@amd.com>
In-Reply-To: <CAD=HUj7fT2CVXLfi5mty0rSzpG_jK9fhcKYGQnTf_H8Hg-541Q@mail.gmail.com>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0:
	=?utf-8?B?SHRiaHRjTytkcWdjMXplcVg4QzNSTUVBaC9EdWJOWSswTGUvNDJ2NXA3WXZG?=
 =?utf-8?B?NlN1L0JlV1ZuZ2k3ZFlpMFRDQWdzdGR0clpCdmYvOVdtZHE2bEpHZTlLbXVJ?=
 =?utf-8?B?bUxmc0Jsdm80TEZRUUwreWtlK3NnL0NObm1WV3Fzbkk2eGx2NGlMOUZJUzY3?=
 =?utf-8?B?aG40OUNtL3dxWDRZT1UxVU9uODR2R3llUkVIZkZHYkRpc0pTcHcwLzQ0UG4x?=
 =?utf-8?B?WnpHdncxNm8rK3dpK1pUOG9MMEhTcW1hM3NncllObmI2N1JEVlJZdlRJZUYw?=
 =?utf-8?B?SHo3OFY2WXpOTFovbGpQYWFyWEpPNFE5YXV1UVd2ZmZBMnhnM0xXcTJTVnlN?=
 =?utf-8?B?YjhjQzcvVjVndUVEN2VIak5mV0RwTDlMbDNsTlkrRmhvZFVGY1pVbk02Y2xu?=
 =?utf-8?B?WVFvUmZ1NSs5K0R2MHFmNjYxZ0JsSVBMUGpBOUg1c1NzbnBXU2o5blh6cTFF?=
 =?utf-8?B?WGxQTzVBODNtelkzSWtBdjRCcGVMWlI2cm5Dd2pIK1c2Y29vTXBPbHNUSEpl?=
 =?utf-8?B?VloxR2VOQk82eTgvT3lLYVVLWTRuWEVrUXFISWJ4T0dvUi9SZEh4c0VNb2Q0?=
 =?utf-8?B?bVMrem5DZUFrUXlqdmsrK0ZUY1pDenc5amNZeHErOC9rWlF3YWU2VXl1M0VJ?=
 =?utf-8?B?R1BNaG1ocCsxSUtHOVRTMzRHRmhMMEoxa29sdTZqSXdYNW9rdmhUdUJBdzJr?=
 =?utf-8?B?VFpHSzY4SE9SaXVRY1RyZnljSFBkc0d1L3g1S2NVVkVnT2l0cHFud1JXUjYr?=
 =?utf-8?B?SlI4TDVGeGFscGx0eVNQejJtRWJiY3dmNjJlV2RxaldFS0QzMzJQTTVCZGVK?=
 =?utf-8?B?VEJGSGE1VlBZbCs3dUpnTk82N0dDOWpSYVVkNjQ0d3MzTFF4MVNwaU1aeGhq?=
 =?utf-8?B?d0p6UHl0dUZUd0FmOCt3M3kwdW02SVdHdXJYR3lNd1pLVktRTHZIa2xMZDVV?=
 =?utf-8?B?K3NteXUvNmtRNGkxU1dsZzV4Y21NMFdzSURSWlhMbmFScUlDWk9LVUVlQ0gr?=
 =?utf-8?B?ak1OTVpoTHpjYW1QOWphZFdaUWc4Zm10SjhFUm9NYWJaaVA1QSttZ1J5cERL?=
 =?utf-8?B?RGN5eEdjL29nT0VRODNPdU1ld2xLTGNYL2FaNTJkdDd0b054SXBZODVKVlF1?=
 =?utf-8?B?T1lKaWdPeDhGL0xVQXJFNUZzV3ZyRGFlVUxSa203L055b3orT2NaTnVTVXBY?=
 =?utf-8?B?TzI3SUhHYVRERmp4bVhyd081NGNGZm5DbURlejRxeU8rRTB5ZitTV1FOMmNh?=
 =?utf-8?B?bEk1SnR3c0M1Y1RaTmtwNCtlMVpYNU9Wa29kRG0vOUxaWlIwZGF3dlFtcFBy?=
 =?utf-8?B?cGpxZXFjYjJnVW9kODJLSUZ4a1huV1hBR2JQWHlFK3hzZ1JFWUZQL0xjNWUr?=
 =?utf-8?B?bDd3OWpsVk51N1VXVUxOSVcvUzNrU0ptRVBITHY4eVdHdDEzSmNwQlJnWFhS?=
 =?utf-8?B?a0RpTzdQQldvczdDeHRGeGR6am1yVzJkZnFERFRtK3BYdVBMT3FZVzBSRXVK?=
 =?utf-8?B?NWJOTnJSb1BpeTN0TmJMZ1RjN2Yyd2lUYmZ6Q1BteUNTOGVtTCtWNjNKZzFl?=
 =?utf-8?B?QllMT0pLdTFwK3VScUpaazdnRkpkZHBSYkhZZTYxZ3Q1c2Q2L0tNK3pqYUsz?=
 =?utf-8?B?TFBaK0dHS2NydEJLZ3duWUZwWFlEcHJIbGdIWFJWZG1pTVNrU0NtS3VEMEhz?=
 =?utf-8?B?VmNqejUvTnFjbEMwcXgxb0swUlVGcjBpRFVHRDJ2anBieWNoQVNjemNBWFRK?=
 =?utf-8?B?VEdZNDhDY2ZNVm5ZVjBOUHlKdHdSc09zQW1KSzhHY1lRN2poOE1wLytOSDdu?=
 =?utf-8?B?YVl3R00vS1JRTkc5UkxPTFpMRmVudi9UUXpmR1V1dEdWd21iM29FZDhZV3JH?=
 =?utf-8?B?c09pUUNSSDNvTDVtVnl4L0VwNG5KbDF4M0t0K3llUC9HcklKVnRrMm5DYzJQ?=
 =?utf-8?B?NG14Y3ErMEpmV21VaU40R2xoUXJmbE90WHpxbVFWSlB4dmEzNDFESUwwdGdE?=
 =?utf-8?B?QW9lZ29HejI5czMxT21CTTZhZStwK250QTd4UEtYbWp1WGcwQ2kvbkRodWZQ?=
 =?utf-8?B?UU9RTHhhNUNrdXg1NFFCNzJuQkFvMFR3S0MrWkZwSWdIRjd5KzIzTnROelh0?=
 =?utf-8?Q?j1L2ioa5DD5iqwy56tDJUx0Ix?=
X-OriginatorOrg: amd.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 958297a2-cca4-4905-74d9-08dc4343bf69
X-MS-Exchange-CrossTenant-AuthSource: PH7PR12MB5685.namprd12.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 13 Mar 2024 09:55:43.5386
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: y6pLEz/Y8P1swhmWPx0Ho3jN4AZfbBwluX9hxWWSDAVxW3jrZCrKgIxeQ9tiEX93
X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH0PR12MB7959

Am 13.03.24 um 05:55 schrieb David Stevens:
> On Thu, Feb 29, 2024 at 10:36 PM Christoph Hellwig <hch@infradead.org> wrote:
>> On Thu, Feb 29, 2024 at 11:57:51AM +0900, David Stevens wrote:
>>> Our use case is virtio-gpu blob resources [1], which directly map host
>>> graphics buffers into the guest as "vram" for the virtio-gpu device.
>>> This feature currently does not work on systems using the amdgpu driver,
>>> as that driver allocates non-compound higher order pages via
>>> ttm_pool_alloc_page().
>> .. and just as last time around that is still the problem that needs
>> to be fixed instead of creating a monster like this to map
>> non-refcounted pages.
>>
> Patches to amdgpu to have been NAKed [1] with the justification that
> using non-refcounted pages is working as intended and KVM is in the
> wrong for wanting to take references to pages mapped with VM_PFNMAP
> [2].
>
> The existence of the VM_PFNMAP implies that the existence of
> non-refcounted pages is working as designed. We can argue about
> whether or not VM_PFNMAP should exist, but until VM_PFNMAP is removed,
> KVM should be able to handle it. Also note that this is not adding a
> new source of non-refcounted pages, so it doesn't make removing
> non-refcounted pages more difficult, if the kernel does decide to go
> in that direction.

Well, the meaning of VM_PFNMAP is that you should not touch the 
underlying struct page the PTE is pointing to. As far as I can see this 
includes grabbing a reference count.

But that isn't really the problem here. The issue is rather that KVM 
assumes that by grabbing a reference count to the page that the driver 
won't change the PTE to point somewhere else.. And that is simply not true.

So what KVM needs to do is to either have an MMU notifier installed so 
that updates to the PTEs on the host side are reflected immediately to 
the PTEs on the guest side.

Or (even better) you use hardware functionality like nested page tables 
so that we don't actually need to update the guest PTEs when the host 
PTEs change.

And when you have either of those two functionalities the requirement to 
add a long term reference to the struct page goes away completely. So 
when this is done right you don't need to grab a reference in the first 
place.

Regards,
Christian.

>
> -David
>
> [1] https://lore.kernel.org/lkml/8230a356-be38-f228-4a8e-95124e8e8db6@amd.com/
> [2] https://lore.kernel.org/lkml/594f1013-b925-3c75-be61-2d649f5ca54e@amd.com/