Received: by 2002:a05:6a10:413:0:0:0:0 with SMTP id 19csp3470530pxp; Tue, 8 Mar 2022 15:17:58 -0800 (PST) X-Google-Smtp-Source: ABdhPJzZ02OAUUu70nG+5Nx6hSoCII3QgAj4Dyx2Ie7eO7r2vrthxE7NazccpjXtzbOlaADFrbMN X-Received: by 2002:a17:90b:1e05:b0:1bf:92c8:6f80 with SMTP id pg5-20020a17090b1e0500b001bf92c86f80mr4564673pjb.107.1646781477867; Tue, 08 Mar 2022 15:17:57 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1646781477; cv=none; d=google.com; s=arc-20160816; b=QwZ1o1bmMc7tLeJzEK/kdgxUnn2WKRYkHk5K3YsS8dXtDNhhibmnqJ9cETZPU/8YsE embtWXuGiBpUrmx0DQo63HHwuWCPjLmX21dg3zA/Az+Fqaf/mAZ4GcBkZVzClgDfotNq /uivVenGuNqu/a64D3AVxbbQPqu3fVg7IlY60SLKqH5wqEMhdnUeCvyhJ89/rrceQehf bcIJLk/4BvBSm49wxjawuDzNJLJnONh6rNV72z2v7lomiqkK21pwB01URgfgxJhg1hPp Nhkjb5imFZ5mUwEHkfFfUB7qfYY0+awwGiq3u/W9SeZk0/23nqvEyuWLy3LrTOKpX7o7 Mspg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:cc:to:subject:message-id:date:from:in-reply-to :references:mime-version:dkim-signature; bh=D9wbXIRTldTtmuQubha8O7jdPMIdPkNXtDtnMlsvwSo=; b=tMhnq0s8nMDY3Egc9TX/FfB83w4/9VuBqsp2z9da/RJMNu/1Y9WiolO+D/viD9tshS AT+Fva3PnYXvdfSKoiJw10c56lPBUu6YBfQjCtqyGvL8nimHxOK7bWaZBPvUlxOyEvqZ NHqpaC9fvuc+9shTFYNhktvtegtl+3nCXjx2HTKUk0xDJfKH9g/PioXoyziTzlOqG7i5 nhQ8EyKdCWkE9cP+U5yToBNa5Pe4ZtxO5BAynrMRPZ69j0nSHRelBXjMDXDLJWZr1CJs pLhbJwSg7AyZjNPUNcLHFD5EY4acJOm7YtsQpXdtW651xsCb8QSW9hPkZvxq9sC9nEU6 fhrQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20210112 header.b=D87M53al; spf=softfail (google.com: domain of transitioning linux-kernel-owner@vger.kernel.org does not designate 23.128.96.19 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from lindbergh.monkeyblade.net (lindbergh.monkeyblade.net. [23.128.96.19]) by mx.google.com with ESMTPS id s7-20020a056a0008c700b004f13ac64653si210139pfu.109.2022.03.08.15.17.57 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 08 Mar 2022 15:17:57 -0800 (PST) Received-SPF: softfail (google.com: domain of transitioning linux-kernel-owner@vger.kernel.org does not designate 23.128.96.19 as permitted sender) client-ip=23.128.96.19; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20210112 header.b=D87M53al; spf=softfail (google.com: domain of transitioning linux-kernel-owner@vger.kernel.org does not designate 23.128.96.19 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by lindbergh.monkeyblade.net (Postfix) with ESMTP id 7034B7E0BB; Tue, 8 Mar 2022 15:12:18 -0800 (PST) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S245714AbiCHAE2 (ORCPT + 99 others); Mon, 7 Mar 2022 19:04:28 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:37102 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1343994AbiCHAEU (ORCPT ); Mon, 7 Mar 2022 19:04:20 -0500 Received: from mail-pj1-x102d.google.com (mail-pj1-x102d.google.com [IPv6:2607:f8b0:4864:20::102d]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 62F4934B82 for ; Mon, 7 Mar 2022 16:03:25 -0800 (PST) Received: by mail-pj1-x102d.google.com with SMTP id p3-20020a17090a680300b001bbfb9d760eso682899pjj.2 for ; Mon, 07 Mar 2022 16:03:25 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=D9wbXIRTldTtmuQubha8O7jdPMIdPkNXtDtnMlsvwSo=; b=D87M53alQtZEnb5Nxh9tl58QMmIVaYCGTYKkPrxRZrPG7KU8lZ6S7NFZEl9Y5UlqQ3 wfqcXLvzegMv2kSU1R73uRWogrDub/0B5FB3xfcj4XZl24WzcaJGozDjnQOrQSU0dOrI XeE5XP3DU6bLdgmupoAm88xQDEkS/q41h1LGnJbHMM5x4rphyxpKec6Fj0PTuuEDB5qW 8LFuKEQ46MF66Ww926o4sZrhjDoCGFIzN1a4SqMy67RhBfIzIKRsggz7l1JAABjWV6+6 7i+ldoimjRVb0IE69i0V4Ijg9pD7Tec6ErcALewNunmmvEOSlnPwBUf4wzvS7Gdc1Wuk wJCQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=D9wbXIRTldTtmuQubha8O7jdPMIdPkNXtDtnMlsvwSo=; b=KjJdQ1kjgnlj9egnYwuvXb4fOWhwZRrBixfYiEnrPizvOjwe9MszytU7+xtPR3Vw7j /oIo31goc70JIUqliuFfFQmjbvvjTU8c9q0VI1TjBxlS2xY8OP5pobc2HukhhDmMjCKo ECy/zbk1ehPcKLBYdAb3NaMAGk2o3bNjEsVdiK9G5/UmQx23piLYuvBdR4LxsHuZL0h1 RrvKr2yfpUgebzYyhECa/sSgw4TsEs0XwIoDhvtubQd/3ufbaGaKgWh80Gmot+l4SDLd 5eg14tTjl5vgCrf7v5nrwqbfgcSUHxXg5N7eb908OO1Wfoc/H9GoHHvMumFwFRC77RU3 jhyQ== X-Gm-Message-State: AOAM530apxzAhafYGOWY1MlbTshd+N/odcWsTVGI0qPYNxuZMUlKQtyM 4mCwbctPdCBPHBhhQEXL6vcWmh4J7vOM2mupbSE= X-Received: by 2002:a17:903:124a:b0:151:99fe:1a10 with SMTP id u10-20020a170903124a00b0015199fe1a10mr14660065plh.87.1646697804764; Mon, 07 Mar 2022 16:03:24 -0800 (PST) MIME-Version: 1.0 References: <20220303222014.517033-1-shy828301@gmail.com> <13ad4ba1-2a88-9459-3995-70af36aba33e@redhat.com> <20220306180718.6d4e6233130b94fdad98df88@linux-foundation.org> <84a6c9c1-d18f-6955-2666-0a2d7bce6094@redhat.com> <20220307154326.6494f7fca7def491a23e5df1@linux-foundation.org> In-Reply-To: <20220307154326.6494f7fca7def491a23e5df1@linux-foundation.org> From: Yang Shi Date: Mon, 7 Mar 2022 16:03:12 -0800 Message-ID: Subject: Re: [PATCH] mm: thp: don't have to lock page anymore when splitting PMD To: Andrew Morton Cc: David Hildenbrand , Andrea Arcangeli , Hugh Dickins , "Kirill A. Shutemov" , Linux Kernel Mailing List , Linux MM , Matthew Wilcox Content-Type: text/plain; charset="UTF-8" X-Spam-Status: No, score=-1.7 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,RDNS_NONE, SPF_HELO_NONE,T_SCC_BODY_TEXT_LINE autolearn=no autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Mon, Mar 7, 2022 at 3:43 PM Andrew Morton wrote: > > On Mon, 7 Mar 2022 09:24:58 +0100 David Hildenbrand wrote: > > > On 07.03.22 03:07, Andrew Morton wrote: > > > On Fri, 4 Mar 2022 19:50:08 +0100 David Hildenbrand wrote: > > > > > >> @Andrew, the last mail I received was > > >> > > >> + mm-huge_memory-remove-stale-locking-logic-from-__split_huge_pmd.patch > > >> added to -mm tree > > >> > > >> The patch shows up in mmotm as > > >> > > >> #[merged]mm-huge_memory-remove-stale-locking-logic-from-__split_huge_pmd.patch > > >> > > >> ... which shouldn't be true. > > > > > > I guess I mislabelled the reason for dropping it. Should have been to-be-updated, > > > due to https://lkml.kernel.org/r/CAHbLzkpbnQyHRckoRtbZoaLvANu92MY4kEsbKudaQ8MDUA3nVg@mail.gmail.com > > > > > > > Let me clarify. > > > > 1. I sent [1] (9 patches) > > > > 2. You queued the 9 patches > > > > E.g., in "mmotm 2022-02-15-20-22 uploaded" > > > > * mm-optimize-do_wp_page-for-exclusive-pages-in-the-swapcache.patch > > * mm-optimize-do_wp_page-for-fresh-pages-in-local-lru-pagevecs.patch > > * mm-slightly-clarify-ksm-logic-in-do_swap_page.patch > > * mm-streamline-cow-logic-in-do_swap_page.patch > > * mm-huge_memory-streamline-cow-logic-in-do_huge_pmd_wp_page.patch > > * mm-khugepaged-remove-reuse_swap_page-usage.patch > > * mm-swapfile-remove-stale-reuse_swap_page.patch > > * mm-huge_memory-remove-stale-page_trans_huge_mapcount.patch > > * mm-huge_memory-remove-stale-locking-logic-from-__split_huge_pmd.patch > > > > 3. The last patch in the series was dropped. What remains are 8 patches. > > > > E.g., in "mmotm 2022-02-24-22-38 uploaded" > > > > * mm-optimize-do_wp_page-for-exclusive-pages-in-the-swapcache.patch > > * mm-optimize-do_wp_page-for-fresh-pages-in-local-lru-pagevecs.patch > > * mm-slightly-clarify-ksm-logic-in-do_swap_page.patch > > * mm-streamline-cow-logic-in-do_swap_page.patch > > * mm-huge_memory-streamline-cow-logic-in-do_huge_pmd_wp_page.patch > > * mm-khugepaged-remove-reuse_swap_page-usage.patch > > * mm-swapfile-remove-stale-reuse_swap_page.patch > > * mm-huge_memory-remove-stale-page_trans_huge_mapcount.patch > > > > 4. Yang Shi sent his patch (the one we're replying to) > > > > 5. You picked his patch and dropped it again due to [2] > > > > > > I'm wondering why 3 happened and why > > https://www.ozlabs.org/~akpm/mmotm/series contains: > > > > > > mm-optimize-do_wp_page-for-exclusive-pages-in-the-swapcache.patch > > mm-optimize-do_wp_page-for-fresh-pages-in-local-lru-pagevecs.patch > > mm-slightly-clarify-ksm-logic-in-do_swap_page.patch > > mm-streamline-cow-logic-in-do_swap_page.patch > > mm-huge_memory-streamline-cow-logic-in-do_huge_pmd_wp_page.patch > > mm-khugepaged-remove-reuse_swap_page-usage.patch > > mm-swapfile-remove-stale-reuse_swap_page.patch > > mm-huge_memory-remove-stale-page_trans_huge_mapcount.patch > > ... > > #[merged]mm-huge_memory-remove-stale-locking-logic-from-__split_huge_pmd.patch > > OK, thanks. I guess it was me seeing 100% rejects when merging onto > the folio changes then incorrectly deciding the patch was now in > linux-next via some other tree. > > I restored it and fixed things up. Please check. Thanks, Andrew. I think we could clean it up a little bit further. > > > --- a/mm/huge_memory.c~mm-huge_memory-remove-stale-locking-logic-from-__split_huge_pmd > +++ a/mm/huge_memory.c > @@ -2133,8 +2133,6 @@ void __split_huge_pmd(struct vm_area_str > { > spinlock_t *ptl; > struct mmu_notifier_range range; > - bool do_unlock_folio = false; > - pmd_t _pmd; > > mmu_notifier_range_init(&range, MMU_NOTIFY_CLEAR, 0, vma, vma->vm_mm, > address & HPAGE_PMD_MASK, > @@ -2153,42 +2151,14 @@ void __split_huge_pmd(struct vm_area_str > goto out; > } > > -repeat: > if (pmd_trans_huge(*pmd)) { > - if (!folio) { > + if (!folio) > folio = page_folio(pmd_page(*pmd)); We could remove the "if (pmd_trans_huge(*pmd))" section since folio is actually not used afterward at all. > - /* > - * An anonymous page must be locked, to ensure that a > - * concurrent reuse_swap_page() sees stable mapcount; > - * but reuse_swap_page() is not used on shmem or file, > - * and page lock must not be taken when zap_pmd_range() > - * calls __split_huge_pmd() while i_mmap_lock is held. > - */ > - if (folio_test_anon(folio)) { > - if (unlikely(!folio_trylock(folio))) { > - folio_get(folio); > - _pmd = *pmd; > - spin_unlock(ptl); > - folio_lock(folio); > - spin_lock(ptl); > - if (unlikely(!pmd_same(*pmd, _pmd))) { > - folio_unlock(folio); > - folio_put(folio); > - folio = NULL; > - goto repeat; > - } > - folio_put(folio); > - } > - do_unlock_folio = true; > - } > - } > } else if (!(pmd_devmap(*pmd) || is_pmd_migration_entry(*pmd))) > goto out; > __split_huge_pmd_locked(vma, pmd, range.start, freeze); With the above if removed, this could be changed to: if (pmd_trans_huge(*pmd) || pmd_devmap(*pmd) || is_pmd_migration_entry(*pmd)) __split_huge_pmd_locked(vma, pmd, range.start, freeze); > out: > spin_unlock(ptl); > - if (do_unlock_folio) > - folio_unlock(folio); > /* > * No need to double call mmu_notifier->invalidate_range() callback. > * They are 3 cases to consider inside __split_huge_pmd_locked(): > _ >