Received: by 2002:a05:7412:d1aa:b0:fc:a2b0:25d7 with SMTP id ba42csp875022rdb; Tue, 30 Jan 2024 00:46:15 -0800 (PST) X-Google-Smtp-Source: AGHT+IFBwo2OB86XapJiYakeErc4XiRkQW2eL+yi1G71sces9uIxAeW7CwpZ/nlU7eN3TBWaJuig X-Received: by 2002:a05:6512:3d26:b0:511:1dff:f605 with SMTP id d38-20020a0565123d2600b005111dfff605mr678884lfv.46.1706604375050; Tue, 30 Jan 2024 00:46:15 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1706604375; cv=pass; d=google.com; s=arc-20160816; b=oMIe++lcj9QxS1B/38VHGt86hOKyiLFqitmj1yAeggS21dg+EeSUWH1fZ8crtxF5e3 7tAt74mgDdl05aeDW29c6dhUSFtoL9WPgmrW5ieZpxNac74ye1csvOOi9vWHcVWqh9+G Xx/oO0IZZuI84l+mRDUpurRHqe4NSwbIhQSmTfx04esD4TaHpch9zSzZW2LtZvUWGLEy 14K73qcRqK2rMil6j73HtL+xYgtpbpSHKMSoujyNTXEu5CBZiTOgdFozwUQj6zrfJh1s XrKkMflBGsB2yRQ+lHUdIada5JIokRWmLvmKABICiOHk55lVOD08QXsdR6bLRO5QBuIW nnEg== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:in-reply-to:organization:autocrypt:from :content-language:references:cc:to:subject:user-agent:mime-version :list-unsubscribe:list-subscribe:list-id:precedence:date:message-id :dkim-signature; bh=U45Fxm/MtG50A3gtC61QWpZLcXQoY54GjgFxR/yi5IE=; fh=aZsIZS1QRMgD09PjQUJNHtCJPWazDQGobiQ+RnsVRSk=; b=zK6uez6yOWde7GD9OeO3TvylTSdLlqDwVpll6aruy3gbyJ7RTERwT0+/I8u/ZkZPWN eZ1dYeNEc7Iuv0l6jipa9SqQAAnnIs12G4uaTW1C+uQ8/xp5fYoFXooExJ8sgDUWi5J5 WWWCL+JMTxvR9ofPbq5Vb43U0AjTfOX6NkX5DwBipp2RipqKy6Upyqifa1kt6Ksn23hN PIiyizsafJbPTj+SEtRgv1wufBtMiO+cRoN3HMPX462AaArwpGaIz39zQFYmlupnlTNw uFuiT3kJbDeB0G6l4U9VcvFAXX7EccL5J7LijHYughzHrwkJ54UeDhzysoDQ1qZwLPVv CjWg== ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=BtwQkysi; arc=pass (i=1 spf=pass spfdomain=redhat.com dkim=pass dkdomain=redhat.com dmarc=pass fromdomain=redhat.com); spf=pass (google.com: domain of linux-kernel+bounces-44149-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) smtp.mailfrom="linux-kernel+bounces-44149-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from am.mirrors.kernel.org (am.mirrors.kernel.org. [147.75.80.249]) by mx.google.com with ESMTPS id fj27-20020a0564022b9b00b0055d3d05be30si4237799edb.450.2024.01.30.00.46.14 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 30 Jan 2024 00:46:15 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel+bounces-44149-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) client-ip=147.75.80.249; Authentication-Results: mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=BtwQkysi; arc=pass (i=1 spf=pass spfdomain=redhat.com dkim=pass dkdomain=redhat.com dmarc=pass fromdomain=redhat.com); spf=pass (google.com: domain of linux-kernel+bounces-44149-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) smtp.mailfrom="linux-kernel+bounces-44149-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by am.mirrors.kernel.org (Postfix) with ESMTPS id A3F2C1F2BEFF for ; Tue, 30 Jan 2024 08:37:29 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 33CEC57302; Tue, 30 Jan 2024 08:37:21 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=redhat.com header.i=@redhat.com header.b="BtwQkysi" Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 82D9956469 for ; Tue, 30 Jan 2024 08:37:18 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=170.10.133.124 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1706603840; cv=none; b=P9t3Scewkwk02yDTlzCeH0vtX6AvHSOxKOZrNXlKWgUEJMBC57YMewXjCZ6NdAEmGgTOJczFLdt36t0dX78VWT+ymGfKpqfm5lkG+va7TF8njRDMOnPwmvKopgJLUF3VnijaUxlmNBuORJSn50JMbbYSG1o1/HbX5pwq+qWG/6Y= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1706603840; c=relaxed/simple; bh=rRCDx8F5nmgLM5cjCxTr9xnfQAB0YxXlchlGAA6H5XY=; h=Message-ID:Date:MIME-Version:Subject:To:Cc:References:From: In-Reply-To:Content-Type; b=nULMOCnbR4zWXsAb4u7sKJKcTex0BtfSuMDoNvPqCL9pvLZbeW2/2raD50HvYh3yd9wOI8lqJR0s5rJXhmWGEshiLYNGa/klP80ZvQXQ4bSb/mGJBv/yIOesesvF1hObfrfLlPlZtKqGtHUXiCkouxrS7uGyfnFrx5m29pzyuJA= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=redhat.com; spf=pass smtp.mailfrom=redhat.com; dkim=pass (1024-bit key) header.d=redhat.com header.i=@redhat.com header.b=BtwQkysi; arc=none smtp.client-ip=170.10.133.124 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=redhat.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=redhat.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1706603837; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:autocrypt:autocrypt; bh=U45Fxm/MtG50A3gtC61QWpZLcXQoY54GjgFxR/yi5IE=; b=BtwQkysiV73coCUuVJmS2sut9C47L8Idk+Ks8CJsU8mgrhP4Ppmi1AzrhQvR5qLKC9jFrb mhNA4y8HlWBqCWvB+cThfucF1LRGN2/Jvp78ELr+ZESnDMTSNAu+EggSsnKHRgn9OERBZ5 qX6G+e9b7WoTzzBV3qM6+tqrmRT+WQM= Received: from mail-wm1-f72.google.com (mail-wm1-f72.google.com [209.85.128.72]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-130-ZGOtJGmRNoi_SYi-kjCfxw-1; Tue, 30 Jan 2024 03:37:15 -0500 X-MC-Unique: ZGOtJGmRNoi_SYi-kjCfxw-1 Received: by mail-wm1-f72.google.com with SMTP id 5b1f17b1804b1-40e530b7596so28770565e9.1 for ; Tue, 30 Jan 2024 00:37:15 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1706603834; x=1707208634; h=content-transfer-encoding:in-reply-to:organization:autocrypt:from :content-language:references:cc:to:subject:user-agent:mime-version :date:message-id:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=U45Fxm/MtG50A3gtC61QWpZLcXQoY54GjgFxR/yi5IE=; b=jNU2wJ8/LzFB77/8gzKrKCFhuD5yJIVCUhF3V422/MtvT04zTNUVLVUuOo7/PhZ4Ic nZAIsYTIg0XGWBKc5pRBopDpyoC4YKrM6WIEEdV0KsNdKIcGMjsEpakzEdQUCTfaOcy7 kM5CBa8ej2v/DSe7u6Sv4PJwa7o0vbLSfd84Uc1HDYPzdgOCi+RVRCd3gvFilCMeZCBR SJBucZWtKyHS5BJAiwK18GDla0hOrqGcTnPimqB0AgJC/HMJdWr2E4Mc5CZ/9cXpFs/g MsX2oXh0kiBqueu0piDnjhN5vAEo7xBmgkRkFkYDQUOQZNSrEBlqsNQFAfZIMEVB17ZH uoYQ== X-Gm-Message-State: AOJu0YyECL7sq5TpUATwiXw4ihuKwQ0jbpqNtdQgN7j887u3saNXqQlK LErn98dDX9517QXn1iOZTNveGcbgYIaAJ1q+CuxHkf+BX7JGonFvcqwOCdbSm1n0LvtNEdZcvDa CjN9B4NhWnHibNuOvklhuDgNNHj3Q1sctyR6modu2Do6Ow5PUWF2FC4xKT2SqCQ== X-Received: by 2002:a05:600c:190f:b0:40e:b93e:4a0f with SMTP id j15-20020a05600c190f00b0040eb93e4a0fmr7482825wmq.19.1706603834527; Tue, 30 Jan 2024 00:37:14 -0800 (PST) X-Received: by 2002:a05:600c:190f:b0:40e:b93e:4a0f with SMTP id j15-20020a05600c190f00b0040eb93e4a0fmr7482804wmq.19.1706603834118; Tue, 30 Jan 2024 00:37:14 -0800 (PST) Received: from ?IPV6:2003:cb:c708:2700:bdf6:739b:9f9d:862f? (p200300cbc7082700bdf6739b9f9d862f.dip0.t-ipconnect.de. [2003:cb:c708:2700:bdf6:739b:9f9d:862f]) by smtp.gmail.com with ESMTPSA id h9-20020a05600c350900b0040fa661ee82sm262267wmq.44.2024.01.30.00.37.12 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Tue, 30 Jan 2024 00:37:13 -0800 (PST) Message-ID: Date: Tue, 30 Jan 2024 09:37:12 +0100 Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [PATCH v1 3/9] mm/memory: further separate anon and pagecache folio handling in zap_present_pte() To: Ryan Roberts , linux-kernel@vger.kernel.org Cc: linux-mm@kvack.org, Andrew Morton , Matthew Wilcox , Catalin Marinas , Will Deacon , "Aneesh Kumar K.V" , Nick Piggin , Peter Zijlstra , Michael Ellerman , Christophe Leroy , "Naveen N. Rao" , Heiko Carstens , Vasily Gorbik , Alexander Gordeev , Christian Borntraeger , Sven Schnelle , Arnd Bergmann , linux-arch@vger.kernel.org, linuxppc-dev@lists.ozlabs.org, linux-s390@vger.kernel.org References: <20240129143221.263763-1-david@redhat.com> <20240129143221.263763-4-david@redhat.com> <40cfb242-ceb0-44c6-afe7-c1744825dc62@arm.com> Content-Language: en-US From: David Hildenbrand Autocrypt: addr=david@redhat.com; keydata= xsFNBFXLn5EBEAC+zYvAFJxCBY9Tr1xZgcESmxVNI/0ffzE/ZQOiHJl6mGkmA1R7/uUpiCjJ dBrn+lhhOYjjNefFQou6478faXE6o2AhmebqT4KiQoUQFV4R7y1KMEKoSyy8hQaK1umALTdL QZLQMzNE74ap+GDK0wnacPQFpcG1AE9RMq3aeErY5tujekBS32jfC/7AnH7I0v1v1TbbK3Gp XNeiN4QroO+5qaSr0ID2sz5jtBLRb15RMre27E1ImpaIv2Jw8NJgW0k/D1RyKCwaTsgRdwuK Kx/Y91XuSBdz0uOyU/S8kM1+ag0wvsGlpBVxRR/xw/E8M7TEwuCZQArqqTCmkG6HGcXFT0V9 PXFNNgV5jXMQRwU0O/ztJIQqsE5LsUomE//bLwzj9IVsaQpKDqW6TAPjcdBDPLHvriq7kGjt WhVhdl0qEYB8lkBEU7V2Yb+SYhmhpDrti9Fq1EsmhiHSkxJcGREoMK/63r9WLZYI3+4W2rAc UucZa4OT27U5ZISjNg3Ev0rxU5UH2/pT4wJCfxwocmqaRr6UYmrtZmND89X0KigoFD/XSeVv jwBRNjPAubK9/k5NoRrYqztM9W6sJqrH8+UWZ1Idd/DdmogJh0gNC0+N42Za9yBRURfIdKSb B3JfpUqcWwE7vUaYrHG1nw54pLUoPG6sAA7Mehl3nd4pZUALHwARAQABzSREYXZpZCBIaWxk ZW5icmFuZCA8ZGF2aWRAcmVkaGF0LmNvbT7CwZgEEwEIAEICGwMGCwkIBwMCBhUIAgkKCwQW AgMBAh4BAheAAhkBFiEEG9nKrXNcTDpGDfzKTd4Q9wD/g1oFAl8Ox4kFCRKpKXgACgkQTd4Q 9wD/g1oHcA//a6Tj7SBNjFNM1iNhWUo1lxAja0lpSodSnB2g4FCZ4R61SBR4l/psBL73xktp rDHrx4aSpwkRP6Epu6mLvhlfjmkRG4OynJ5HG1gfv7RJJfnUdUM1z5kdS8JBrOhMJS2c/gPf wv1TGRq2XdMPnfY2o0CxRqpcLkx4vBODvJGl2mQyJF/gPepdDfcT8/PY9BJ7FL6Hrq1gnAo4 3Iv9qV0JiT2wmZciNyYQhmA1V6dyTRiQ4YAc31zOo2IM+xisPzeSHgw3ONY/XhYvfZ9r7W1l pNQdc2G+o4Di9NPFHQQhDw3YTRR1opJaTlRDzxYxzU6ZnUUBghxt9cwUWTpfCktkMZiPSDGd KgQBjnweV2jw9UOTxjb4LXqDjmSNkjDdQUOU69jGMUXgihvo4zhYcMX8F5gWdRtMR7DzW/YE BgVcyxNkMIXoY1aYj6npHYiNQesQlqjU6azjbH70/SXKM5tNRplgW8TNprMDuntdvV9wNkFs 9TyM02V5aWxFfI42+aivc4KEw69SE9KXwC7FSf5wXzuTot97N9Phj/Z3+jx443jo2NR34XgF 89cct7wJMjOF7bBefo0fPPZQuIma0Zym71cP61OP/i11ahNye6HGKfxGCOcs5wW9kRQEk8P9 M/k2wt3mt/fCQnuP/mWutNPt95w9wSsUyATLmtNrwccz63XOwU0EVcufkQEQAOfX3n0g0fZz Bgm/S2zF/kxQKCEKP8ID+Vz8sy2GpDvveBq4H2Y34XWsT1zLJdvqPI4af4ZSMxuerWjXbVWb T6d4odQIG0fKx4F8NccDqbgHeZRNajXeeJ3R7gAzvWvQNLz4piHrO/B4tf8svmRBL0ZB5P5A 2uhdwLU3NZuK22zpNn4is87BPWF8HhY0L5fafgDMOqnf4guJVJPYNPhUFzXUbPqOKOkL8ojk CXxkOFHAbjstSK5Ca3fKquY3rdX3DNo+EL7FvAiw1mUtS+5GeYE+RMnDCsVFm/C7kY8c2d0G NWkB9pJM5+mnIoFNxy7YBcldYATVeOHoY4LyaUWNnAvFYWp08dHWfZo9WCiJMuTfgtH9tc75 7QanMVdPt6fDK8UUXIBLQ2TWr/sQKE9xtFuEmoQGlE1l6bGaDnnMLcYu+Asp3kDT0w4zYGsx 5r6XQVRH4+5N6eHZiaeYtFOujp5n+pjBaQK7wUUjDilPQ5QMzIuCL4YjVoylWiBNknvQWBXS lQCWmavOT9sttGQXdPCC5ynI+1ymZC1ORZKANLnRAb0NH/UCzcsstw2TAkFnMEbo9Zu9w7Kv AxBQXWeXhJI9XQssfrf4Gusdqx8nPEpfOqCtbbwJMATbHyqLt7/oz/5deGuwxgb65pWIzufa N7eop7uh+6bezi+rugUI+w6DABEBAAHCwXwEGAEIACYCGwwWIQQb2cqtc1xMOkYN/MpN3hD3 AP+DWgUCXw7HsgUJEqkpoQAKCRBN3hD3AP+DWrrpD/4qS3dyVRxDcDHIlmguXjC1Q5tZTwNB boaBTPHSy/Nksu0eY7x6HfQJ3xajVH32Ms6t1trDQmPx2iP5+7iDsb7OKAb5eOS8h+BEBDeq 3ecsQDv0fFJOA9ag5O3LLNk+3x3q7e0uo06XMaY7UHS341ozXUUI7wC7iKfoUTv03iO9El5f XpNMx/YrIMduZ2+nd9Di7o5+KIwlb2mAB9sTNHdMrXesX8eBL6T9b+MZJk+mZuPxKNVfEQMQ a5SxUEADIPQTPNvBewdeI80yeOCrN+Zzwy/Mrx9EPeu59Y5vSJOx/z6OUImD/GhX7Xvkt3kq Er5KTrJz3++B6SH9pum9PuoE/k+nntJkNMmQpR4MCBaV/J9gIOPGodDKnjdng+mXliF3Ptu6 3oxc2RCyGzTlxyMwuc2U5Q7KtUNTdDe8T0uE+9b8BLMVQDDfJjqY0VVqSUwImzTDLX9S4g/8 kC4HRcclk8hpyhY2jKGluZO0awwTIMgVEzmTyBphDg/Gx7dZU1Xf8HFuE+UZ5UDHDTnwgv7E th6RC9+WrhDNspZ9fJjKWRbveQgUFCpe1sa77LAw+XFrKmBHXp9ZVIe90RMe2tRL06BGiRZr jPrnvUsUUsjRoRNJjKKA/REq+sAnhkNPPZ/NNMjaZ5b8Tovi8C0tmxiCHaQYqj7G2rgnT0kt WNyWQQ== Organization: Red Hat In-Reply-To: <40cfb242-ceb0-44c6-afe7-c1744825dc62@arm.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit On 30.01.24 09:31, Ryan Roberts wrote: > On 29/01/2024 14:32, David Hildenbrand wrote: >> We don't need up-to-date accessed-dirty information for anon folios and can >> simply work with the ptent we already have. Also, we know the RSS counter >> we want to update. >> >> We can safely move arch_check_zapped_pte() + tlb_remove_tlb_entry() + >> zap_install_uffd_wp_if_needed() after updating the folio and RSS. >> >> While at it, only call zap_install_uffd_wp_if_needed() if there is even >> any chance that pte_install_uffd_wp_if_needed() would do *something*. >> That is, just don't bother if uffd-wp does not apply. >> >> Signed-off-by: David Hildenbrand >> --- >> mm/memory.c | 16 +++++++++++----- >> 1 file changed, 11 insertions(+), 5 deletions(-) >> >> diff --git a/mm/memory.c b/mm/memory.c >> index 69502cdc0a7d..20bc13ab8db2 100644 >> --- a/mm/memory.c >> +++ b/mm/memory.c >> @@ -1552,12 +1552,9 @@ static inline void zap_present_pte(struct mmu_gather *tlb, >> folio = page_folio(page); >> if (unlikely(!should_zap_folio(details, folio))) >> return; >> - ptent = ptep_get_and_clear_full(mm, addr, pte, tlb->fullmm); >> - arch_check_zapped_pte(vma, ptent); >> - tlb_remove_tlb_entry(tlb, pte, addr); >> - zap_install_uffd_wp_if_needed(vma, addr, pte, details, ptent); >> >> if (!folio_test_anon(folio)) { >> + ptent = ptep_get_and_clear_full(mm, addr, pte, tlb->fullmm); >> if (pte_dirty(ptent)) { >> folio_mark_dirty(folio); >> if (tlb_delay_rmap(tlb)) { >> @@ -1567,8 +1564,17 @@ static inline void zap_present_pte(struct mmu_gather *tlb, >> } >> if (pte_young(ptent) && likely(vma_has_recency(vma))) >> folio_mark_accessed(folio); >> + rss[mm_counter(folio)]--; >> + } else { >> + /* We don't need up-to-date accessed/dirty bits. */ >> + ptep_get_and_clear_full(mm, addr, pte, tlb->fullmm); >> + rss[MM_ANONPAGES]--; >> } >> - rss[mm_counter(folio)]--; >> + arch_check_zapped_pte(vma, ptent); > > Isn't the x86 (only) implementation of this relying on the dirty bit? So doesn't > that imply you still need get_and_clear for anon? (And in hindsight I think that > logic would apply to the previous patch too?) x86 uses the encoding !writable && dirty to indicate special shadow stacks. That is, the hw dirty bit is set by software (to create that combination), not by hardware. So you don't have to sync against any hw changes of the hw dirty bit. What you had in the original PTE you read is sufficient. -- Cheers, David / dhildenb