Received: by 2002:a25:4158:0:0:0:0:0 with SMTP id o85csp3332477yba;
        Tue, 16 Apr 2019 09:13:45 -0700 (PDT)
X-Google-Smtp-Source: APXvYqyiPQu3+PnhY2OY2iFPHJMtvV/tZPuvjvJZjymMDGUHOSvnE38v8D0fF6jr1RUXTreLowFg
X-Received: by 2002:a63:6a43:: with SMTP id f64mr44732926pgc.366.1555431225838;
        Tue, 16 Apr 2019 09:13:45 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; t=1555431225; cv=none;
        d=google.com; s=arc-20160816;
        b=XC6HjWkfHMlUYeJKHUsT7FM8y3UOm3THmub4QJpSeLDePvM9Vv49wKgCYarbX1VdcS
         2dHKymVHNmQnbnpoydHnSJt/6GP/B+JNvn6RKX0LlFV+TuJR3+h3OCGVLCyexyVH8I+c
         j1DDcBN7KPjkYyB0onulPDZruMIv8fnjumSLYitGlUH+YSJ/7Au3t2yFeas5kXI2CrI+
         yJol3W14GCB3KaVY0gJSTayjkcLUhgjHAlTrbJkCPLoBoGjW5FawQUrAAqqlATmagtcR
         XjtWTC++ZBjWjdNZEgvIKbytq3jULHf/4yeOGQORFb/ZWYoQj8y6LK1LotcoDmPcL5/C
         FW5A==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816;
        h=list-id:precedence:sender:dkim-signature:mime-version:references
         :in-reply-to:message-id:date:subject:cc:to:from;
        bh=0qG+gTlRQll235954BIuhS7cER94zkwgbFGR8CUs9fc=;
        b=vfgqZloCxK6UMMGos0of7zPVzRLzVIosoBEeMOww0sLEVNpr2H1sOvDlB3FAPKQ+65
         NiA1ycZYs5d2bVFwcPo2oAlr2ZVq4VKZNUNvhF3qXmGN3v9TjFAjkk/3BxCFgh2uLXaB
         /iMavEWYBdBiH1bdjEH+rtm2DfS1HQBIrmDzshKJhbdxhfqKLJerygZZU1VPZTL67hhn
         W7TqUc/CqiNI4Lcz7ZbyxKlCu4iSNEl0WxFPWQrf4Lq+P44+97WC63YmBPOr4WzZ0GJX
         glYmVtYwNbx6DwuU2NWu+3T9mSOjZh8gw/gCrFf9WRXUC6Eer7Qv266metGF9WY2k4cp
         Dgjw==
ARC-Authentication-Results: i=1; mx.google.com;
       dkim=pass header.i=@nvidia.com header.s=n1 header.b=Jytk2YQA;
       spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org;
       dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=nvidia.com
Return-Path: <linux-kernel-owner@vger.kernel.org>
Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67])
        by mx.google.com with ESMTP id t11si52291636pfa.110.2019.04.16.09.13.29;
        Tue, 16 Apr 2019 09:13:45 -0700 (PDT)
Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67;
Authentication-Results: mx.google.com;
       dkim=pass header.i=@nvidia.com header.s=n1 header.b=Jytk2YQA;
       spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org;
       dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=nvidia.com
Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand
        id S1728667AbfDPQMi (ORCPT <rfc822;rruigrok1@gmail.com> + 99 others);
        Tue, 16 Apr 2019 12:12:38 -0400
Received: from hqemgate15.nvidia.com ([216.228.121.64]:13037 "EHLO
        hqemgate15.nvidia.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org
        with ESMTP id S1726037AbfDPQMi (ORCPT
        <rfc822;linux-kernel@vger.kernel.org>);
        Tue, 16 Apr 2019 12:12:38 -0400
Received: from hqpgpgate101.nvidia.com (Not Verified[216.228.121.13]) by hqemgate15.nvidia.com (using TLS: TLSv1.2, DES-CBC3-SHA)
        id <B5cb5fee20000>; Tue, 16 Apr 2019 09:12:18 -0700
Received: from hqmail.nvidia.com ([172.20.161.6])
  by hqpgpgate101.nvidia.com (PGP Universal service);
  Tue, 16 Apr 2019 09:12:37 -0700
X-PGP-Universal: processed;
        by hqpgpgate101.nvidia.com on Tue, 16 Apr 2019 09:12:37 -0700
Received: from [10.2.164.200] (10.124.1.5) by HQMAIL101.nvidia.com
 (172.20.187.10) with Microsoft SMTP Server (TLS) id 15.0.1473.3; Tue, 16 Apr
 2019 16:12:35 +0000
From:   Zi Yan <ziy@nvidia.com>
To:     Dave Hansen <dave.hansen@intel.com>
CC:     Michal Hocko <mhocko@kernel.org>,
        Yang Shi <yang.shi@linux.alibaba.com>,
        <mgorman@techsingularity.net>, <riel@surriel.com>,
        <hannes@cmpxchg.org>, <akpm@linux-foundation.org>,
        <keith.busch@intel.com>, <dan.j.williams@intel.com>,
        <fengguang.wu@intel.com>, <fan.du@intel.com>,
        <ying.huang@intel.com>, <linux-mm@kvack.org>,
        <linux-kernel@vger.kernel.org>
Subject: Re: [v2 RFC PATCH 0/9] Another Approach to Use PMEM as NUMA Node
Date:   Tue, 16 Apr 2019 12:12:33 -0400
X-Mailer: MailMate (1.12.4r5622)
Message-ID: <027AE219-8C81-47DC-A241-4209C3F656A0@nvidia.com>
In-Reply-To: <63514bdd-313b-d42f-e582-f8cb350d0b35@intel.com>
References: <1554955019-29472-1-git-send-email-yang.shi@linux.alibaba.com>
 <20190412084702.GD13373@dhcp22.suse.cz>
 <a68137bb-dcd8-4e4a-b3a9-69a66f9dccaf@linux.alibaba.com>
 <20190416074714.GD11561@dhcp22.suse.cz>
 <b9b40585-cb59-3d42-bcf8-e59bff77c663@intel.com>
 <960F3918-7D2C-463C-A911-9B62CD7E5D83@nvidia.com>
 <63514bdd-313b-d42f-e582-f8cb350d0b35@intel.com>
MIME-Version: 1.0
X-Originating-IP: [10.124.1.5]
X-ClientProxiedBy: HQMAIL104.nvidia.com (172.18.146.11) To
 HQMAIL101.nvidia.com (172.20.187.10)
Content-Type: multipart/signed;
        boundary="=_MailMate_D57647AE-4DA1-4C9B-AEDB-C24F26D9FE9B_=";
        micalg=pgp-sha1; protocol="application/pgp-signature"
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nvidia.com; s=n1;
        t=1555431138; bh=0qG+gTlRQll235954BIuhS7cER94zkwgbFGR8CUs9fc=;
        h=X-PGP-Universal:From:To:CC:Subject:Date:X-Mailer:Message-ID:
         In-Reply-To:References:MIME-Version:X-Originating-IP:
         X-ClientProxiedBy:Content-Type;
        b=Jytk2YQA8nNJaUP8MgkVSmxdjPUeN9yqd1byaO9hk5gSDhMap8lTMNVOHtgdc1t4A
         tdw0Ew8E0ETmE3zhpdhDUURSrICP3fjpQnG+16DTk75JmSVaUMlrgKFXdpbRMPo6fu
         JxU3y7l9J3B8fFCNUgzpHhHUIg3oWhWwmmncSpoStJUmfg87NzfyByFXbbPMG1qJNy
         2/JtTWTVQrpqC/6vbuArQjJX4nl2VCGdILF8gjxMdqzEoQBPLkIHfbW0MsbN7tqzp9
         YS52pK3hp/dC5Cs8PTS2pnVOuGfmzhZCcsVRg5aV35F/qYhCrNy0apuKbAvguz24wV
         CFrezbmidOTcw==
Sender: linux-kernel-owner@vger.kernel.org
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

--=_MailMate_D57647AE-4DA1-4C9B-AEDB-C24F26D9FE9B_=
Content-Type: text/plain; markup=markdown

On 16 Apr 2019, at 11:55, Dave Hansen wrote:

> On 4/16/19 8:33 AM, Zi Yan wrote:
>>> We have a reasonable argument that demotion is better than
>>> swapping. So, we could say that even if a VMA has a strict NUMA
>>> policy, demoting pages mapped there pages still beats swapping
>>> them or tossing the page cache.  It's doing them a favor to
>>> demote them.
>> I just wonder whether page migration is always better than
>> swapping, since SSD write throughput keeps improving but page
>> migration throughput is still low. For example, my machine has a
>> SSD with 2GB/s writing throughput but the throughput of 4KB page
>> migration is less than 1GB/s, why do we want to use page migration
>> for demotion instead of swapping?
>
> Just because we observe that page migration apparently has lower
> throughput today doesn't mean that we should consider it a dead end.

I definitely agree. I also want to make the point that we might
want to improve page migration as well to show that demotion via
page migration will work. Since most of proposed demotion approaches
use the same page replacement policy as swapping, if we do not have
high-throughput page migration, we might draw false conclusions that
demotion is no better than swapping but demotion can actually do
much better. :)

--
Best Regards,
Yan Zi

--=_MailMate_D57647AE-4DA1-4C9B-AEDB-C24F26D9FE9B_=
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----

iQJDBAEBAgAtFiEEh7yFAW3gwjwQ4C9anbJR82th+ooFAly1/vEPHHppeUBudmlk
aWEuY29tAAoJEJ2yUfNrYfqKz9gP/13w9KgpJ81vf8ZHTOonc/BRsQrT+aFB48qF
eFtTeeHBW7Rr5NWBjbAzFb9SkQyWCCRHMjf6wv0qqy0NWAzAGZISf5nQDfz/++vh
j9hC7Auj8moROyrh2uXoyUGfYiRQozS2xP0idz+EGGT5G2UKRdSFLLEW4KxrAqYO
rXezQTPLeHv4exlslF/eXuod6miV1Sq6NOSy/FbrgV6CHDPwM4NL6mBeQZHfM3Xa
mF0CtvRhYjDR+dO/SRQkpJYs1+GbADzH23BT0wx7nUQ3mUciO2rgdizHePQllx9I
AmDxgjjkiFjWObnkWHx5hKZ3i1Uiu9nislABm7oPsAK5qa4TvXsjHthuet5l4vc6
s4m9aMI0ehz0yI4hGKUUYnRoWTPcbfvni8NuFfdmBxmpIgAmaBd6LS7WSbIF9Df2
V/w0aVSI8mDHVl/9Fa+pVZQ4HJTymPD7BkNphTF692VukYVMDMaQCne3rmXotEe3
T4Bs1MYY13ezs3VuXKymzXjjiGpML+nGBzvzj9s/Itwhk2jQXIUw2sJDaTlD6fL3
/kbavQFu/jmpi6BF76CVSMbScnGO0hGZ+Gxhp/L55BO35cbLI/eBzbaNDNqe0z2O
Cm4PhLlV7cOVUdaVGkkWmJ/t/NEfPtuXP85m8Suww6hfSmGBT/G/idOFIDylWBqs
YORU6ksO
=Car9
-----END PGP SIGNATURE-----

--=_MailMate_D57647AE-4DA1-4C9B-AEDB-C24F26D9FE9B_=--