Received: by 2002:a05:7412:8d10:b0:f3:1519:9f41 with SMTP id bj16csp290953rdb; Tue, 5 Dec 2023 05:45:35 -0800 (PST) X-Google-Smtp-Source: AGHT+IGaDRuzyL77KfouMNlhc4fMH1GRBFaZkhXzy+rPlgLt7k+OEKcHl7cj33HYzhEEAMNVm8og X-Received: by 2002:a05:6358:2612:b0:170:8db:96a with SMTP id l18-20020a056358261200b0017008db096amr8215647rwc.16.1701783935374; Tue, 05 Dec 2023 05:45:35 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1701783935; cv=none; d=google.com; s=arc-20160816; b=oNr3esZOaf1FEsmg65uSjD1jcMAKHAnkEtH8kJxYSo0bQqGJV2cBJsqWz0H0XtF5JM OGJitS7oS5pqMQ1tV9lvb+dbx4QROIT3OymWHyZ/1cdRTPcOl9IVeJDQwbC9ytEGPkZz AYyM7UCUlXy5vkDFxR+o55Z0J1861PhsiAEUsVa8Xo3FxM8gmR8yZwZptPMm9KzHDCHl vDWmrM/5OHlzJ4/ufn0zeum5ypU9Jceyp6NkPHN8Q22dhH9vsQRomdvYc4mK8Nw0ey2G EdqUlVI4zjwbDpUadlgzjqFW9CNRE/lGTm2dd2wJo4WI751sGnggYA1pGEJRFpp17liX z6IA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:in-reply-to:from :references:cc:to:content-language:subject:user-agent:mime-version :date:message-id; bh=tLyxRisahd4WqLto8RRIovBsxmK4RRcoB32eDMSGr7c=; fh=GlLzLBhqF07GE0FJUf82nnkBDPyXS9iIZ0BDzvPX32s=; b=Qbsz2R6Vm9zW6GwRHj10pClsCM/zBskApjRtISkNFIqsCe8hc16rE0HNSKzkHIv/B7 mE2EFdkg5gB/QFfkMtZ2kxpW7L75D79gyYdxr3qbmzwVhPrplQP4knko3Di9bfHL4JW7 OuQEJiBkS5fb9pAxLjg12vX9bCwjF7WBFMiOxBr3Fq+8W5zYswWyCBZLgx0mr6zo4270 xQfSuTNIwJtb7/H5IRqFpHRtO/L4Tp/l2a4jTdbmG4KT+yGVRjCTcSn5MqRsJtspFeba vUOe6B/B266L9DvkYtWNp21IKP1O/x+URspMj/JawFkBiLsjVSecfeK0MAFqsrGPu8rN g5aw== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.34 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=arm.com Return-Path: Received: from howler.vger.email (howler.vger.email. [23.128.96.34]) by mx.google.com with ESMTPS id r28-20020a635d1c000000b005c219415020si9366678pgb.262.2023.12.05.05.45.34 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 05 Dec 2023 05:45:35 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.34 as permitted sender) client-ip=23.128.96.34; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.34 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=arm.com Received: from out1.vger.email (depot.vger.email [IPv6:2620:137:e000::3:0]) by howler.vger.email (Postfix) with ESMTP id 1576F807AFC0; Tue, 5 Dec 2023 05:45:11 -0800 (PST) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.11 at howler.vger.email Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1345461AbjLENox (ORCPT + 99 others); Tue, 5 Dec 2023 08:44:53 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:52392 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1345584AbjLENks (ORCPT ); Tue, 5 Dec 2023 08:40:48 -0500 Received: from foss.arm.com (foss.arm.com [217.140.110.172]) by lindbergh.monkeyblade.net (Postfix) with ESMTP id 9E627199 for ; Tue, 5 Dec 2023 05:40:53 -0800 (PST) Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id EB08A139F; Tue, 5 Dec 2023 05:41:39 -0800 (PST) Received: from [10.57.73.130] (unknown [10.57.73.130]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPSA id AA65A3F5A1; Tue, 5 Dec 2023 05:40:51 -0800 (PST) Message-ID: <183cf38c-476e-44c4-a8c7-22ed43122b41@arm.com> Date: Tue, 5 Dec 2023 13:40:51 +0000 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [PATCH RFC 34/39] mm/rmap: introduce folio_try_dup_anon_rmap_[pte|ptes|pmd]() Content-Language: en-GB To: David Hildenbrand , linux-kernel@vger.kernel.org Cc: linux-mm@kvack.org, Andrew Morton , "Matthew Wilcox (Oracle)" , Hugh Dickins , Yin Fengwei , Mike Kravetz , Muchun Song , Peter Xu References: <20231204142146.91437-1-david@redhat.com> <20231204142146.91437-35-david@redhat.com> <88a341bf-0b6a-454a-aeb1-0699233eb37c@redhat.com> From: Ryan Roberts In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-0.8 required=5.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on howler.vger.email Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (howler.vger.email [0.0.0.0]); Tue, 05 Dec 2023 05:45:11 -0800 (PST) On 05/12/2023 13:32, David Hildenbrand wrote: > On 05.12.23 14:17, David Hildenbrand wrote: >> On 05.12.23 14:12, Ryan Roberts wrote: >>> On 04/12/2023 14:21, David Hildenbrand wrote: >>>> The last user of page_needs_cow_for_dma() and __page_dup_rmap() are gone, >>>> remove them. >>>> >>>> Add folio_try_dup_anon_rmap_ptes() right away, we want to perform rmap >>>> baching during fork() soon. >>>> >>>> Signed-off-by: David Hildenbrand >>>> --- >>>>    include/linux/mm.h   |   6 -- >>>>    include/linux/rmap.h | 145 +++++++++++++++++++++++++++++-------------- >>>>    2 files changed, 100 insertions(+), 51 deletions(-) >>>> >>>> diff --git a/include/linux/mm.h b/include/linux/mm.h >>>> index 24c1c7c5a99c0..f7565b35ae931 100644 >>>> --- a/include/linux/mm.h >>>> +++ b/include/linux/mm.h >>>> @@ -1964,12 +1964,6 @@ static inline bool folio_needs_cow_for_dma(struct >>>> vm_area_struct *vma, >>>>        return folio_maybe_dma_pinned(folio); >>>>    } >>>>    -static inline bool page_needs_cow_for_dma(struct vm_area_struct *vma, >>>> -                      struct page *page) >>>> -{ >>>> -    return folio_needs_cow_for_dma(vma, page_folio(page)); >>>> -} >>>> - >>>>    /** >>>>     * is_zero_page - Query if a page is a zero page >>>>     * @page: The page to query >>>> diff --git a/include/linux/rmap.h b/include/linux/rmap.h >>>> index 21d72cc602adc..84439f7720c62 100644 >>>> --- a/include/linux/rmap.h >>>> +++ b/include/linux/rmap.h >>>> @@ -354,68 +354,123 @@ static inline void folio_dup_file_rmap_pmd(struct >>>> folio *folio, >>>>    #endif >>>>    } >>>>    -static inline void __page_dup_rmap(struct page *page, bool compound) >>>> +static inline int __folio_try_dup_anon_rmap(struct folio *folio, >>> >>> __always_inline? >> >> Yes. >> >>> >>>> +        struct page *page, unsigned int nr_pages, >>>> +        struct vm_area_struct *src_vma, enum rmap_mode mode) >>>>    { >>>> -    VM_WARN_ON(folio_test_hugetlb(page_folio(page))); >>>> +    int i; >>>>    -    if (compound) { >>>> -        struct folio *folio = (struct folio *)page; >>>> +    VM_WARN_ON_FOLIO(!folio_test_anon(folio), folio); >>>>    -        VM_BUG_ON_PAGE(compound && !PageHead(page), page); >>>> -        atomic_inc(&folio->_entire_mapcount); >>>> -    } else { >>>> -        atomic_inc(&page->_mapcount); >>>> +    /* >>>> +     * No need to check+clear for already shared PTEs/PMDs of the folio. >>>> +     * This includes PTE mappings of (order-0) KSM folios. >>>> +     */ >>>> +    if (likely(mode == RMAP_MODE_PTE)) { >>> >>> Presumbly if __always_inline then the compiler will remove this if/else and just >>> keep the part indicated by mode? In which case "likely" is pretty useless? Same >>> for all similar sites in the other patches. >> >> Yes, also had this in mind. As long as we use __always_inline it >> shouldn't ever matter. > > It seems to be cleanest to just do: > > switch (mode) { > case RMAP_MODE_PTE: >     ... >     break; > case RMAP_MODE_PMD: >     ... >     break; > } > Agreed.