Received: by 2002:a25:7ec1:0:0:0:0:0 with SMTP id z184csp2288389ybc; Sun, 24 Nov 2019 17:37:57 -0800 (PST) X-Google-Smtp-Source: APXvYqxOvG/D3zE6zCeIshdLNr4Wy8da4MOKP1He96+7XGNpfMr8e7zqGE+RoNUNaSdBrnbvKrsk X-Received: by 2002:a17:906:4409:: with SMTP id x9mr34650067ejo.236.1574645877190; Sun, 24 Nov 2019 17:37:57 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1574645877; cv=none; d=google.com; s=arc-20160816; b=SJs8wIND5MewYkdEXlmTFcBPtiQlyit72azgR1WKM01IZfIbe2R3wo5G4H4FtdcUCY +iRjFibf1ozfgqKzIdFtUnpcsdGSk55FpyWBwBj3KP1vEPwdHoDu5j8hnXG4uaCCo2UK VO5rpUpol9dPyn5CvInUA035vNuDp/YdqNZOLV4c1usM81dh5yS73Kk+XXaUR2urueda DVHlbJxldT2Siq0TT2dBJkBK/hRQ3WF9VVCo9g9nxRCmL1odFUVZYkFrx7XXp/fmxKql H1PWMgBEwKQcFdP8VUAuq8HT0GRly5Z7kZzCxU1T1cLrZeJwhvf0vMY25qdfvjkiKiiu 8n5Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:references:to:from:subject; bh=aILZVGl8mBsuYoGk/yHUMNt02daRFIoWZE6zIk3224I=; b=wZH18P5Miem4hImnR/A766LvT6dap6XUF3l7O4b8W8f9C/pQDl2/TtuLP6F/EkZfi3 lKHVgY75IabFnwzyW+XUywjoxEuizlJQAKlvn/lRVPJ4K3bAMw0a7SNtI6x3T3+PSSwW 9gUanxiHd7mo8Fr2v2tlhLW3zxcvPWvKgQBk74eAydqS9jbLN91iyS0y45WdH6OMujOS yr0xR1c4cMbTPXq1390qU0hKjj/ppNinsxTiyxk6delyk5NLxHl3fMaiy1Ddzcf1ic8I 0mq150NZNFy75oWYNBWvnKnt/UUq2afu1LrZyggnGMyZIYyGm9O6AMlPuDo0q5HEetH5 ElzQ== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=alibaba.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id w26si3686958ejn.212.2019.11.24.17.37.34; Sun, 24 Nov 2019 17:37:57 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=alibaba.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727231AbfKYBgb (ORCPT + 99 others); Sun, 24 Nov 2019 20:36:31 -0500 Received: from out30-131.freemail.mail.aliyun.com ([115.124.30.131]:45359 "EHLO out30-131.freemail.mail.aliyun.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727072AbfKYBgb (ORCPT ); Sun, 24 Nov 2019 20:36:31 -0500 X-Alimail-AntiSpam: AC=PASS;BC=-1|-1;BR=01201311R171e4;CH=green;DM=||false|;FP=0|-1|-1|-1|0|-1|-1|-1;HT=e01e07488;MF=yun.wang@linux.alibaba.com;NM=1;PH=DS;RN=16;SR=0;TI=SMTPD_---0Tiyc3wU_1574645775; Received: from testdeMacBook-Pro.local(mailfrom:yun.wang@linux.alibaba.com fp:SMTPD_---0Tiyc3wU_1574645775) by smtp.aliyun-inc.com(127.0.0.1); Mon, 25 Nov 2019 09:36:16 +0800 Subject: Re: [PATCH 0/3] sched/numa: introduce advanced numa statistic From: =?UTF-8?B?546L6LSH?= To: Ingo Molnar , Peter Zijlstra , Juri Lelli , Vincent Guittot , Dietmar Eggemann , Steven Rostedt , Ben Segall , Mel Gorman , Luis Chamberlain , Kees Cook , Iurii Zaikin , =?UTF-8?Q?Michal_Koutn=c3=bd?= , linux-fsdevel@vger.kernel.org, linux-kernel@vger.kernel.org, linux-doc@vger.kernel.org, "Paul E. McKenney" References: <743eecad-9556-a241-546b-c8a66339840e@linux.alibaba.com> Message-ID: <50f167ed-12b5-24b7-a2f7-38d32bf6647a@linux.alibaba.com> Date: Mon, 25 Nov 2019 09:35:30 +0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.13; rv:60.0) Gecko/20100101 Thunderbird/60.9.0 MIME-Version: 1.0 In-Reply-To: <743eecad-9556-a241-546b-c8a66339840e@linux.alibaba.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hi, Peter How do you think about this version, does it looks fine to you? Regards, Michael Wang On 2019/11/13 上午11:43, 王贇 wrote: > Modern production environment could use hundreds of cgroup to control > the resources for different workloads, along with the complicated > resource binding. > > On NUMA platforms where we have multiple nodes, things become even more > complicated, we hope there are more local memory access to improve the > performance, and NUMA Balancing keep working hard to achieve that, > however, wrong memory policy or node binding could easily waste the > effort, result a lot of remote page accessing. > > We need to perceive such problems, then we got chance to fix it before > there are too much damages, however, there are no good approach yet to > help catch the mouse who introduced the remote access. > > This patch set is trying to fill in the missing pieces, by introduce > the per-cgroup NUMA locality/exectime statistics, and expose the per-task > page migration failure counter, with these statistics, we could achieve > the daily monitoring on NUMA efficiency, to give warning when things going > too wrong. > > Please check the third patch for more details. > > Thanks to Peter, Mel and Michal for the good advices :-) > > Michael Wang (3): > sched/numa: advanced per-cgroup numa statistic > sched/numa: expose per-task pages-migration-failure counter > sched/numa: documentation for per-cgroup numa stat > > Documentation/admin-guide/cg-numa-stat.rst | 161 ++++++++++++++++++++++++ > Documentation/admin-guide/kernel-parameters.txt | 4 + > Documentation/admin-guide/sysctl/kernel.rst | 9 ++ > include/linux/sched.h | 18 ++- > include/linux/sched/sysctl.h | 6 + > init/Kconfig | 9 ++ > kernel/sched/core.c | 91 ++++++++++++++ > kernel/sched/debug.c | 1 + > kernel/sched/fair.c | 33 +++++ > kernel/sched/sched.h | 17 +++ > kernel/sysctl.c | 11 ++ > 11 files changed, 359 insertions(+), 1 deletion(-) > create mode 100644 Documentation/admin-guide/cg-numa-stat.rst > >