Received: by 2002:a25:6193:0:0:0:0:0 with SMTP id v141csp565087ybb; Sat, 28 Mar 2020 05:28:31 -0700 (PDT) X-Google-Smtp-Source: ADFU+vtpZYN1wcFav5XfF2ZE5Gg8M69QKQZsO9eV0V5Kn1GBP0sMk95RSoGKLmkI6YL8XOapd+0M X-Received: by 2002:a4a:a60a:: with SMTP id e10mr3281090oom.34.1585398511382; Sat, 28 Mar 2020 05:28:31 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1585398511; cv=none; d=google.com; s=arc-20160816; b=vF4Ly65Fo0VIOBkQX5X1GYvXXzC7UG3Dl1J143kghEqm5rKKmHHHpUe22HW8aHo97o ZrZesrSKED7/srrj7kzTqUW98+88ADUzlBKlDl9VHDpHfwfoQcBt33luqvGMLnyRfkrh WKUFGdWG/oWmyew3Lh5WkA6YBxXYOmc9sogV3mjFQjEd8coWILjgGYoMtZCfYhqmngEa 2lw/Md/lx/nvLdzExdnf3RMN3V465xomX9Jyt0amQIONmk5i7off1lGPrV2c0cI3UZct XtqGnk+sYpnMDlbIw8A3TOUu5fIdHou68dOqM0xmunsWl+x+Yf7gHliq2dNVAuRd2Vqh 9+Hg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:in-reply-to:content-disposition :mime-version:references:message-id:subject:cc:to:from:date :dkim-signature; bh=4ZefhR0E03euYQPplWgD/MUqgsa6Q0Ji04STFlWdgEg=; b=oIRvsKUkcPyXD++AclKaoutEN4COe+13Pk+hSbnUWC19lvlxKR0begHTf+jnaods44 mTL3C8OkRfZf1Dhti1dNYty1ZerczYT/Z1fV1YN4Er3aUchLXkWopW5bDNcIqTpNXOtF YwC4DBvoKpK6+F9Ndpgkl9Gs32svE11TzvjSMXmZIX/Hu7nqSE5u8r+iv+ieSe5JBHPI t46M8DmVF3cE2CGtPijNeUulnyHzotjB/VoYtehsTVQzqRzTNEVBkkGPjdN+oUKWoIfw XNJyLCTNKRx3VBm6TdZ1RLdSF/xF6U8IAl5oXK32WlBcHs7pMg7RsGdPfvw3/g4dCEQq O/iw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@shutemov-name.20150623.gappssmtp.com header.s=20150623 header.b=SmmEE0YZ; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id r21si3896665oth.185.2020.03.28.05.28.19; Sat, 28 Mar 2020 05:28:31 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@shutemov-name.20150623.gappssmtp.com header.s=20150623 header.b=SmmEE0YZ; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726449AbgC1M1e (ORCPT + 99 others); Sat, 28 Mar 2020 08:27:34 -0400 Received: from mail-lj1-f194.google.com ([209.85.208.194]:44588 "EHLO mail-lj1-f194.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726268AbgC1M1e (ORCPT ); Sat, 28 Mar 2020 08:27:34 -0400 Received: by mail-lj1-f194.google.com with SMTP id p14so12925589lji.11 for ; Sat, 28 Mar 2020 05:27:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=shutemov-name.20150623.gappssmtp.com; s=20150623; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=4ZefhR0E03euYQPplWgD/MUqgsa6Q0Ji04STFlWdgEg=; b=SmmEE0YZ9QIPA1i1pTx1mo30QLVV0objMkhszcqncFCexP7nncxpgMgGnDfUdx8kCv f0B+w2oFRISBJCGCr+SVj0JGc/caxnIS73dhvz2W1zNF457USDmnmPnuiK3ubCeKNrxv 7z2rmPK7I67ZZf2Op923oFsB7ff2GX0/jnIHB7HDxyQOi9wd64VV0rGt/kaNp9qzCpb/ NKFu31NQuKHp0cXjW5TZTroWn/J6JH5AF1WnXl2IQ7CmKpjCk33uBoT+/u1Bvazut1XI /7sZg37kfRIYIizcnNfW5/8T3ThcEOwtGBpWvoP0mu4iujU21fpn5XwuKYGBmLci2HTn h1uA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=4ZefhR0E03euYQPplWgD/MUqgsa6Q0Ji04STFlWdgEg=; b=B/8d3vgahKHrr9kdcAWVUc/RdQX3G00rc6Rx4Cadq/+TkeMNYipmBPs/B8se6Z5369 vell4Eynsnq98MM7rzgP7Cxj7mgjtb+v68GEGf037IqV/N2UpG4armu72blvDiP6aUIh lJvh7M+qyX8USO8LCDq1fu6SWspF3R+GruE9w8RnDycQWj+d9yUcows336w8YTIPzMZ8 /1KTxMgOnrH01Oy9kCiULjCVnlOLBL3zpqNzMROoDkq33gtlP/BGm9+VZSpZvbAkHwvb A2u28jW9bZSKaRku+ushGT5sHGkkkeF/UehC3jCUTkLGEaWANgVtsMBbDSWpC9amMyhi dohg== X-Gm-Message-State: AGi0PuZhrMmuDRrV5vKCEasmtPyT0SRiWK2GVKWjs5SjINDpnovBy2c4 bBQqBHmLhtwuiY/R/473OBI0rQ== X-Received: by 2002:a2e:9c9:: with SMTP id 192mr1956710ljj.77.1585398451693; Sat, 28 Mar 2020 05:27:31 -0700 (PDT) Received: from box.localdomain ([86.57.175.117]) by smtp.gmail.com with ESMTPSA id i11sm4337022lfo.84.2020.03.28.05.27.30 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 28 Mar 2020 05:27:31 -0700 (PDT) Received: by box.localdomain (Postfix, from userid 1000) id 16BD0100D25; Sat, 28 Mar 2020 15:27:35 +0300 (+03) Date: Sat, 28 Mar 2020 15:27:35 +0300 From: "Kirill A. Shutemov" To: Yang Shi Cc: Andrew Morton , Andrea Arcangeli , Linux MM , Linux Kernel Mailing List , "Kirill A. Shutemov" Subject: Re: [PATCH 5/7] khugepaged: Allow to collapse PTE-mapped compound pages Message-ID: <20200328122735.nzius2ikvnyvpf2f@box> References: <20200327170601.18563-1-kirill.shutemov@linux.intel.com> <20200327170601.18563-6-kirill.shutemov@linux.intel.com> <20200328003424.kusu2xnhnlbmnfzl@box> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Fri, Mar 27, 2020 at 06:09:38PM -0700, Yang Shi wrote: > On Fri, Mar 27, 2020 at 5:34 PM Kirill A. Shutemov wrote: > > > > On Fri, Mar 27, 2020 at 11:53:57AM -0700, Yang Shi wrote: > > > On Fri, Mar 27, 2020 at 10:06 AM Kirill A. Shutemov > > > wrote: > > > > > > > > We can collapse PTE-mapped compound pages. We only need to avoid > > > > handling them more than once: lock/unlock page only once if it's present > > > > in the PMD range multiple times as it handled on compound level. The > > > > same goes for LRU isolation and putpack. > > > > > > > > Signed-off-by: Kirill A. Shutemov > > > > --- > > > > mm/khugepaged.c | 41 +++++++++++++++++++++++++++++++---------- > > > > 1 file changed, 31 insertions(+), 10 deletions(-) > > > > > > > > diff --git a/mm/khugepaged.c b/mm/khugepaged.c > > > > index b47edfe57f7b..c8c2c463095c 100644 > > > > --- a/mm/khugepaged.c > > > > +++ b/mm/khugepaged.c > > > > @@ -515,6 +515,17 @@ void __khugepaged_exit(struct mm_struct *mm) > > > > > > > > static void release_pte_page(struct page *page) > > > > { > > > > + /* > > > > + * We need to unlock and put compound page on LRU only once. > > > > + * The rest of the pages have to be locked and not on LRU here. > > > > + */ > > > > + VM_BUG_ON_PAGE(!PageCompound(page) && > > > > + (!PageLocked(page) && PageLRU(page)), page); > > > > + > > > > + if (!PageLocked(page)) > > > > + return; > > > > + > > > > + page = compound_head(page); > > > > dec_node_page_state(page, NR_ISOLATED_ANON + page_is_file_cache(page)); > > > > > > We need count in the number of base pages. The same counter is > > > modified by vmscan in base page unit. > > > > Is it though? Where? > > __mod_node_page_state(pgdat, NR_ISOLATED_ANON + file, nr_taken) in > vmscan.c, here nr_taken is nr_compound(page), so if it is THP the > number would be 512. Could you point a particular codepath? > So in both inc and dec path of collapse PTE mapped THP, we should mod > nr_compound(page) too. I disagree. Compound page is represented by single entry on LRU, so it has to be counted once. -- Kirill A. Shutemov