Received: by 2002:a25:7ec1:0:0:0:0:0 with SMTP id z184csp1825014ybc; Wed, 20 Nov 2019 04:48:32 -0800 (PST) X-Google-Smtp-Source: APXvYqx7jYLsiT1jMVUoeEuErvZthb6vg516e60NeIHaZAXYJ6of2TpgfO/3lRieTEphBY2uTMuG X-Received: by 2002:a1c:e915:: with SMTP id q21mr2811430wmc.148.1574254112212; Wed, 20 Nov 2019 04:48:32 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1574254112; cv=none; d=google.com; s=arc-20160816; b=DcNXvXRon8nwTG/s7d1TOG+QLCkamAa5XPahVl3j1VsO2uQCz9r7a58dx9MhuN8cWs JR4qpM6G6SGGJ3GFqp7TUdOkFhXbe1SeoueRxqmBZc5Iwgem98LWOO/KlWxmQQn7lDVj wozU5yQ3y1w27u6VirDB7vC8Lbwk+W6AvhIR2kEpfv9vTFLB5zDyogsH6Asp8mdQaJFp hTaclVs0A1f+IsA9/0gYT6PS2TuyroSYRYMzRiuGc+JaaTso28BqrHW+yLjrcN/zNBHi QnOdId8EDk80MAz6tlUHPrgkdIdLt5PaRjIHf9RK3ftJHY58IsspTbfKbPqQ4qvwYHg0 +Ztw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:references:to:from:subject; bh=xGJcplzD4koU2RPbErIUqTmS5OuM/oz+Cr/Hd4NbCgs=; b=xXFjd6bi/mPEvpt/9acJlid0QA2oK+x+Mze4MsgpaRlIAutl0n4ZqK6JEIYZq02yFR 88sKBJjGHaa5K2lzhddleNYfkpatl1jmuQ2xzF1KcZGsTK/D+Fz3zlLTkhuziRH4ZFik jjADcnoRG9+zR2KDWEcv86TQtitWiemvrBA+BuuzfQXqQDZL3iGU/m24wIOh3ikYv1Mw UmYLXqPEclxwNpcOhUG2HhV6I9y+Lm+lirRenV+RQdKh3brZh+/4lr5/KY4CI7ADnYR4 MBYwu/1WRk0GR+2NtMnLIU9tatcyuoS8sk5hG/cQVajfBmqtJdqHAbhwHCofiwOixL1A w52w== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=alibaba.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id w3si17157189edt.196.2019.11.20.04.48.07; Wed, 20 Nov 2019 04:48:32 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=alibaba.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727783AbfKTJpS (ORCPT + 99 others); Wed, 20 Nov 2019 04:45:18 -0500 Received: from out30-131.freemail.mail.aliyun.com ([115.124.30.131]:34402 "EHLO out30-131.freemail.mail.aliyun.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727259AbfKTJpR (ORCPT ); Wed, 20 Nov 2019 04:45:17 -0500 X-Alimail-AntiSpam: AC=PASS;BC=-1|-1;BR=01201311R641e4;CH=green;DM=||false|;FP=0|-1|-1|-1|0|-1|-1|-1;HT=e01e04423;MF=yun.wang@linux.alibaba.com;NM=1;PH=DS;RN=16;SR=0;TI=SMTPD_---0TidAYKW_1574243111; Received: from testdeMacBook-Pro.local(mailfrom:yun.wang@linux.alibaba.com fp:SMTPD_---0TidAYKW_1574243111) by smtp.aliyun-inc.com(127.0.0.1); Wed, 20 Nov 2019 17:45:13 +0800 Subject: Re: [PATCH 0/3] sched/numa: introduce advanced numa statistic From: =?UTF-8?B?546L6LSH?= To: Ingo Molnar , Peter Zijlstra , Juri Lelli , Vincent Guittot , Dietmar Eggemann , Steven Rostedt , Ben Segall , Mel Gorman , Luis Chamberlain , Kees Cook , Iurii Zaikin , =?UTF-8?Q?Michal_Koutn=c3=bd?= , linux-fsdevel@vger.kernel.org, linux-kernel@vger.kernel.org, linux-doc@vger.kernel.org, "Paul E. McKenney" References: <743eecad-9556-a241-546b-c8a66339840e@linux.alibaba.com> Message-ID: Date: Wed, 20 Nov 2019 17:45:11 +0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.13; rv:60.0) Gecko/20100101 Thunderbird/60.9.0 MIME-Version: 1.0 In-Reply-To: <743eecad-9556-a241-546b-c8a66339840e@linux.alibaba.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hi, Mel I hope this version has addressed the issues you mentioned :-) Does it looks better now? Regards, Michael Wang On 2019/11/13 上午11:43, 王贇 wrote: > Modern production environment could use hundreds of cgroup to control > the resources for different workloads, along with the complicated > resource binding. > > On NUMA platforms where we have multiple nodes, things become even more > complicated, we hope there are more local memory access to improve the > performance, and NUMA Balancing keep working hard to achieve that, > however, wrong memory policy or node binding could easily waste the > effort, result a lot of remote page accessing. > > We need to perceive such problems, then we got chance to fix it before > there are too much damages, however, there are no good approach yet to > help catch the mouse who introduced the remote access. > > This patch set is trying to fill in the missing pieces, by introduce > the per-cgroup NUMA locality/exectime statistics, and expose the per-task > page migration failure counter, with these statistics, we could achieve > the daily monitoring on NUMA efficiency, to give warning when things going > too wrong. > > Please check the third patch for more details. > > Thanks to Peter, Mel and Michal for the good advices :-) > > Michael Wang (3): > sched/numa: advanced per-cgroup numa statistic > sched/numa: expose per-task pages-migration-failure counter > sched/numa: documentation for per-cgroup numa stat > > Documentation/admin-guide/cg-numa-stat.rst | 161 ++++++++++++++++++++++++ > Documentation/admin-guide/kernel-parameters.txt | 4 + > Documentation/admin-guide/sysctl/kernel.rst | 9 ++ > include/linux/sched.h | 18 ++- > include/linux/sched/sysctl.h | 6 + > init/Kconfig | 9 ++ > kernel/sched/core.c | 91 ++++++++++++++ > kernel/sched/debug.c | 1 + > kernel/sched/fair.c | 33 +++++ > kernel/sched/sched.h | 17 +++ > kernel/sysctl.c | 11 ++ > 11 files changed, 359 insertions(+), 1 deletion(-) > create mode 100644 Documentation/admin-guide/cg-numa-stat.rst > >