Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Date:   Mon, 31 Oct 2022 22:09:15 +0800
From:   Feng Tang <feng.tang@intel.com>
To:     Michal Hocko <mhocko@suse.com>
CC:     "Huang, Ying" <ying.huang@intel.com>,
        Aneesh Kumar K V <aneesh.kumar@linux.ibm.com>,
        Andrew Morton <akpm@linux-foundation.org>,
        Johannes Weiner <hannes@cmpxchg.org>,
        Tejun Heo <tj@kernel.org>, Zefan Li <lizefan.x@bytedance.com>,
        Waiman Long <longman@redhat.com>,
        "linux-mm@kvack.org" <linux-mm@kvack.org>,
        "cgroups@vger.kernel.org" <cgroups@vger.kernel.org>,
        "linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
        "Hansen, Dave" <dave.hansen@intel.com>,
        "Chen, Tim C" <tim.c.chen@intel.com>,
        "Yin, Fengwei" <fengwei.yin@intel.com>
Subject: Re: [PATCH] mm/vmscan: respect cpuset policy during page demotion
Message-ID: <Y1/XC+witPxFj04T@feng-clx>
References: <Y1kl8VbPE0RYdyEB@feng-clx>
 <Y1lZV6qHp3gIINGc@dhcp22.suse.cz>
 <87wn8lkbk5.fsf@yhuang6-desk2.ccr.corp.intel.com>
 <Y1ou5DGHrEsKnhri@dhcp22.suse.cz>
 <87o7txk963.fsf@yhuang6-desk2.ccr.corp.intel.com>
 <Y1o63SWD2KmQkT3v@dhcp22.suse.cz>
 <87fsf9k3yg.fsf@yhuang6-desk2.ccr.corp.intel.com>
 <Y1p5vaN1AWhpNWZx@dhcp22.suse.cz>
 <87bkpwkg24.fsf@yhuang6-desk2.ccr.corp.intel.com>
 <Y1+J7+1V1nJXF+3b@dhcp22.suse.cz>
Content-Type: text/plain; charset="us-ascii"
Content-Disposition: inline
In-Reply-To: <Y1+J7+1V1nJXF+3b@dhcp22.suse.cz>
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?KK2Ye9MwkHaKyk3N1OOY1fBMYeUfy+bQxiNP/gavvB5r2pbKwgVpvoLyb/wt?=
 =?us-ascii?Q?Wi2x523lLdfC+m970OoOuqCECd2wUmiSrWtRBc3QFIlHVKxXzjAJ1KEDRj1t?=
 =?us-ascii?Q?FTfMqSG4gCPh/q3EjIXqbZj5XzPEnZP+xmzjHkqJrleKPDMokHOvfFBoZNgB?=
 =?us-ascii?Q?PPTH55i3N2w6PRdEh59t5boEHsI/uiEK5t7jNT29OkTnHCLROCvssHc8Kk5L?=
 =?us-ascii?Q?4n+5GLRPQtSoTiWXAoIzwKoV+sHMrkA0oLiH8ZVH6QItWdhWFrPQbMcWYQQo?=
 =?us-ascii?Q?50Sj0OipV5bH2STRjuMjWsrE5gFn2pKrNgOGuMP9UNLs/Jcm18NftoNzWxas?=
 =?us-ascii?Q?0AJHtACzuJtRg9XZ2M4n8igPnRQr1o+4uF9C/F8jVI4UKgY1h3suWrySdKdw?=
 =?us-ascii?Q?hCF4LY5MHTf/o1CZ3bo89XA+XIA4A1ygZuLjdWu7HPiHPLLRYhIAIzMX4mRT?=
 =?us-ascii?Q?X7gS7YmwvhzjPkZU5YKTnM0djUumPjpEfGyDUPxgZUPt5iI8OxPw6nQ7cSAi?=
 =?us-ascii?Q?gz+F8UuYcG2a6G+boerlcedJ3jdsx3x4UuJfzOWSyC53xqNi+NDH7n114hBg?=
 =?us-ascii?Q?TUbFB/iHenS+7O6WAES1MPrzfc2eGb/k3vjMdR5PtcfJNC2G+J3OObHFe8KK?=
 =?us-ascii?Q?b72cIoztkjUAItprdZmhkZmH162ekL8+TxLuJnQ88tqNIYNib+d/Z2dYKrWp?=
 =?us-ascii?Q?tNkkVJ1/u4Z5GxqOcNHRjvGrToar6SWbhHTPGhB7lciOUhR+EPzkIiOXGe35?=
 =?us-ascii?Q?rUEEvGG21hnRpxAzTXeVNnQSbVwMfxCD/F/hlJ4cLy2tChhJBi6XuD4S2hZy?=
 =?us-ascii?Q?DJhaE/NotybYlD3GfcgYzjADwCa1+b2NZ5ANizEnCvDHfhHoaJP4D4uRA31+?=
 =?us-ascii?Q?BBxoj5DZGSJmSm2QSUweiMEWN3EXXXQ+b7z5eqz+LLJGGvBOTGSwC+MLiJxM?=
 =?us-ascii?Q?wgb1TZcIuTIpGH50YUu8Y9Tuhv6zR90yGc/YXsmpplSgvkFRlUiMswokg+kd?=
 =?us-ascii?Q?7KMQ2J5H6qbAuldtUaUXVns6C1nQDdbyscQyfX5fSehWAtamEkcrfvquDM+5?=
 =?us-ascii?Q?6YcFBW2FJ2UFes7fSFReHsEKvWX3NDgI6OQx9Dt/eL8cvbEv+N2JZmyLuh3q?=
 =?us-ascii?Q?C+qYVGvhbQndqQzfaIOJMX1FqzP1R71DQALAWkt73ohvwkv0Z+ikToZ5vI/V?=
 =?us-ascii?Q?EOlvg/Vr6mkO7Go+idtR1COaQxXmKpUX3DkCmDK9GvAufRvbBz6Wdq2JXlNh?=
 =?us-ascii?Q?v7vEp/9KdPmJkyTxifDmtZTyWyaBot5nHjauSsu/UFX2YN5FNlJOG4qpPihC?=
 =?us-ascii?Q?C+v1Af7HyCLwNE2j0qeUGluFh6UC9QOiJrCFVpKb50MEsXafowvt3WS3v+W+?=
 =?us-ascii?Q?Q1IZPrKzakt4NA17PQ59zLqto9S5yAVGxmWgNEqmUcE8wqWoDTvLPfWY+/C1?=
 =?us-ascii?Q?30IdaHDm3gwv88hJ9igzfTSmGdrxmTlF7+d7wh7TQDpGX2NA22WMELjbvY7V?=
 =?us-ascii?Q?bxyL86ZXawTv0zckRYvbdIIQYClwoHRXUMQfw6LakLf8NYt7gEvD/+BbM316?=
 =?us-ascii?Q?qPyYrjaUMkt+bK+hNfzh4ywBTrojVA0ol49WTVK9?=
X-MS-Exchange-CrossTenant-Network-Message-Id: 3fc2b8e0-0a2a-4cd5-eae2-08dabb498743
X-MS-Exchange-CrossTenant-AuthSource: CY5PR11MB6308.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 31 Oct 2022 14:09:30.4591
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: lN+EBwq1r1dmuPLsjQFI+KjjUcC5bS3CtIIbuIEUkVm8fPq2v37ifss20YjU1238aw4zeReBVBSqHDhBO+acIg==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW4PR11MB5800
X-OriginatorOrg: intel.com
X-Spam-Status: No, score=-8.1 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH,
        DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_HI,
        RCVD_IN_MSPIKE_H3,RCVD_IN_MSPIKE_WL,SPF_HELO_NONE,SPF_NONE
        autolearn=ham autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

On Mon, Oct 31, 2022 at 04:40:15PM +0800, Michal Hocko wrote:
> On Fri 28-10-22 07:22:27, Huang, Ying wrote:
> > Michal Hocko <mhocko@suse.com> writes:
> > 
> > > On Thu 27-10-22 17:31:35, Huang, Ying wrote:
> [...]
> > >> I think that it's possible for different processes have different
> > >> requirements.
> > >> 
> > >> - Some processes don't care about where the memory is placed, prefer
> > >>   local, then fall back to remote if no free space.
> > >> 
> > >> - Some processes want to avoid cross-socket traffic, bind to nodes of
> > >>   local socket.
> > >> 
> > >> - Some processes want to avoid to use slow memory, bind to fast memory
> > >>   node only.
> > >
> > > Yes, I do understand that. Do you have any specific examples in mind?
> > > [...]
> > 
> > Sorry, I don't have specific examples.
> 
> OK, then let's stop any complicated solution right here then. Let's
> start simple with a per-mm flag to disable demotion of an address space.
> Should there ever be a real demand for a more fine grained solution
> let's go further but I do not think we want a half baked solution
> without real usecases.

Yes, the concern about the high cost for mempolicy from you and Yang is
valid. 

How about the cpuset part? We've got bug reports from different channels
about using cpuset+docker to control meomry placement in memory tiering
system, leading to 2 commits solving them:

2685027fca38 ("cgroup/cpuset: Remove cpus_allowed/mems_allowed setup in
cpuset_init_smp()") 
https://lore.kernel.org/all/20220419020958.40419-1-feng.tang@intel.com/

8ca1b5a49885 ("mm/page_alloc: detect allocation forbidden by cpuset and
bail out early")
https://lore.kernel.org/all/1632481657-68112-1-git-send-email-feng.tang@intel.com/

From these bug reports, I think it's reasonable to say there are quite
some real world users using cpuset+docker+memory-tiering-system. So
I plan to refine the original cpuset patch with some optimizations
discussed (like checking once for kswapd based shrink_folio_list()).

Thanks,
Feng

> -- 
> Michal Hocko
> SUSE Labs
>