Received: by 2002:a25:8b91:0:0:0:0:0 with SMTP id j17csp4856889ybl; Mon, 9 Dec 2019 18:22:47 -0800 (PST) X-Google-Smtp-Source: APXvYqznQhwD+bRVMIueRCxLcRQbyt5GqGoFA3ItcOEXf7TSun/IVa1KcknfW/ekhdbPM2UZW47s X-Received: by 2002:a05:6830:1689:: with SMTP id k9mr1777793otr.311.1575944567850; Mon, 09 Dec 2019 18:22:47 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1575944567; cv=none; d=google.com; s=arc-20160816; b=zRZoEVTiewOpSXGWXokqu6FzXAQFBmc9J/pQcAxDTPRF7n0NzOfIFQ13l18mukuA32 pOHVf1IoxyG0KwzDmfcfOAsQ7K/XewxTl354U6G54Go0OyaJO8JymQg0dWL3f096Uz0Z +VtyWIARrXVx7tg9bbCArGFkxIc+gWW3wk444snx4cQUWujpDS7tOnftvOTbk6bI0716 9vLONhnR7E8K2tnbCpPknANcaLkPL5nrAscSfYxPp9Ah1m3QDRMcux+9Pm/073j6xeM3 STUrT0FJMhcyOtsUbl8O88KwLBmytDHWDJtkhSO1yPqTOWCkYztzGVRwvrPTgtNwlrP3 IgUw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:references:to:from:subject; bh=6To6unw7vUKo2ZwVf1F+HQEITMeuEPP5sO1Lz6xRa2U=; b=dqEYIz9J1BroG6bHs+PCopJqOZP8QI2drsBnZK69b4XNS3Py2S40c1fC7mB5aZ1Al7 pb9Al4IWk8lzwwM2qwz5pjdy3rIhLJoukhebm6IDEbU71SCfBuTkR7rnz0f1jQwK4RZ8 qszz1fTc9NBFhXWtrP64XYadGoyZds3YUPPQYR2e546EGSXu0YBikV5cUyuvuw4FRvsP ELWnJ6zFciCIb9LP4jv9kFvAA55wgNFDm225UPzsgNrpPuB3eX0eBRo5oZ7ZMjQds27b aUDICbPCem7MEIO4LONv314keXIuLyomELEgtAVAYHjN5ZHJmEikQv9JHXIGrtvbxssm 4y5g== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=alibaba.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id f65si1116424oib.0.2019.12.09.18.22.32; Mon, 09 Dec 2019 18:22:47 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=alibaba.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726708AbfLJCWD (ORCPT + 99 others); Mon, 9 Dec 2019 21:22:03 -0500 Received: from out30-56.freemail.mail.aliyun.com ([115.124.30.56]:50650 "EHLO out30-56.freemail.mail.aliyun.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726598AbfLJCWD (ORCPT ); Mon, 9 Dec 2019 21:22:03 -0500 X-Alimail-AntiSpam: AC=PASS;BC=-1|-1;BR=01201311R191e4;CH=green;DM=||false|;DS=||;FP=0|-1|-1|-1|0|-1|-1|-1;HT=e01e07486;MF=yun.wang@linux.alibaba.com;NM=1;PH=DS;RN=18;SR=0;TI=SMTPD_---0TkUheNY_1575944515; Received: from testdeMacBook-Pro.local(mailfrom:yun.wang@linux.alibaba.com fp:SMTPD_---0TkUheNY_1575944515) by smtp.aliyun-inc.com(127.0.0.1); Tue, 10 Dec 2019 10:21:58 +0800 Subject: Re: [PATCH v5 0/2] sched/numa: introduce numa locality From: =?UTF-8?B?546L6LSH?= To: Ingo Molnar , Peter Zijlstra , Juri Lelli , Vincent Guittot , Dietmar Eggemann , Steven Rostedt , Ben Segall , Mel Gorman , Luis Chamberlain , Kees Cook , Iurii Zaikin , =?UTF-8?Q?Michal_Koutn=c3=bd?= , linux-fsdevel@vger.kernel.org, linux-kernel@vger.kernel.org, linux-doc@vger.kernel.org, "Paul E. McKenney" , Randy Dunlap , Jonathan Corbet References: <743eecad-9556-a241-546b-c8a66339840e@linux.alibaba.com> <207ef46c-672c-27c8-2012-735bd692a6de@linux.alibaba.com> <040def80-9c38-4bcc-e4a8-8a0d10f131ed@linux.alibaba.com> <25cf7ef5-e37e-7578-eea7-29ad0b76c4ea@linux.alibaba.com> <443641e7-f968-0954-5ff6-3b7e7fed0e83@linux.alibaba.com> Message-ID: <96342524-142e-c616-1e7e-ce05dfd9ca09@linux.alibaba.com> Date: Tue, 10 Dec 2019 10:19:58 +0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.13; rv:60.0) Gecko/20100101 Thunderbird/60.9.0 MIME-Version: 1.0 In-Reply-To: <443641e7-f968-0954-5ff6-3b7e7fed0e83@linux.alibaba.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hi Peter, Ingo We have reformed the implementation for several times, now it's very simple and easy to use, there are also a document to guide admin on how to use not only the NUMA locality, but also other per-cgroup NUMA statistics, we hope this could make things easier for other NUMA users. As now there are no more comments, would you please take a look at this patch set, see if it's good enough to be picked? Regards, Michael Wang On 2019/12/5 下午2:53, 王贇 wrote: > Since v4: > * improved documentation > Since v3: > * fix comments and improved documentation > Since v2: > * simplified the locality concept & implementation > Since v1: > * improved documentation > > Modern production environment could use hundreds of cgroup to control > the resources for different workloads, along with the complicated > resource binding. > > On NUMA platforms where we have multiple nodes, things become even more > complicated, we hope there are more local memory access to improve the > performance, and NUMA Balancing keep working hard to achieve that, > however, wrong memory policy or node binding could easily waste the > effort, result a lot of remote page accessing. > > We need to notice such problems, then we got chance to fix it before > there are too much damages, however, there are no good monitoring > approach yet to help catch the mouse who introduced the remote access. > > This patch set is trying to fill in the missing pieces, by introduce > the per-cgroup NUMA locality info, with this new statistics, we could > achieve the daily monitoring on NUMA efficiency, to give warning when > things going too wrong. > > Please check the second patch for more details. > > Michael Wang (2): > sched/numa: introduce per-cgroup NUMA locality info > sched/numa: documentation for per-cgroup numa statistics > > Documentation/admin-guide/cg-numa-stat.rst | 178 ++++++++++++++++++++++++ > Documentation/admin-guide/index.rst | 1 + > Documentation/admin-guide/kernel-parameters.txt | 4 + > Documentation/admin-guide/sysctl/kernel.rst | 9 ++ > include/linux/sched.h | 15 ++ > include/linux/sched/sysctl.h | 6 + > init/Kconfig | 11 ++ > kernel/sched/core.c | 75 ++++++++++ > kernel/sched/fair.c | 62 +++++++++ > kernel/sched/sched.h | 12 ++ > kernel/sysctl.c | 11 ++ > 11 files changed, 384 insertions(+) > create mode 100644 Documentation/admin-guide/cg-numa-stat.rst >