Received: by 2002:a25:7ec1:0:0:0:0:0 with SMTP id z184csp4941967ybc; Tue, 26 Nov 2019 17:51:39 -0800 (PST) X-Google-Smtp-Source: APXvYqwSOvxwlOG6IuNa9z9ThTj0X2IouqcfX556peBseeR+r8Q/Y1GUG66SxrSTAC3Mb4LX7J16 X-Received: by 2002:a05:6402:1543:: with SMTP id p3mr29820879edx.304.1574819499872; Tue, 26 Nov 2019 17:51:39 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1574819499; cv=none; d=google.com; s=arc-20160816; b=VWmCypLTY+M/IWz7SeOtUAl7L4/74PUMS/Hhtn0zbPLY1VTv4nNoQfUhiOTa/h7QB+ uCvSieDLonSaJ0K0plOgl0bILyWIQicbX0yRC83btCKmTs+VynFUpJ9wbv58mdUPKOk6 15m5a3ojX1d14CP9/RqwVUoOmsY5r/1TFIcGHEVh3xLZ5aRjwqHwuuLJnm17xnMYjoM4 9JyJJbAYM+OPrst2oJPKD/FyL5Rp0pQ37yMOKjJRXRgKOIyHbJAMFXubcc7XWIweRnZZ pcQL71nzEAl9pg64CPA4Lu7pYcm0XxqKRapJ5zuIMq+Yxhy0G6RX8Ca7EgQ5XcC+oAet 7HrQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:references:to:from:subject; bh=XjrQnyiUxwjq946+90y1iJuCH2I4GeEq0OY8iYfKMFQ=; b=rPc7rG2h1YP7ftgDRk+LMI+qD8mVFTypq0kPf+O+OYtYR+Xw2JBHCWRF1EUCn/obcA MCbWAB+MRJx3W5YfprElbsdmYIYzl4W45FjR7j6xOjpDEeN1SkD591WheJBjCTehqN0q TZ9sJrJ5s/NRbYfOngbWwfUMLLq3O8FJ/yoEPL0ydY7wdZy0YlzC4edz3xoiP7qBiyFw 2sklIDC8tcfNPS6bUcSlRnkQ+fs8+j5OiKQYYMKjarPnNMv/vf5uoIO6C2KQNTv9T1N2 g45tJ87OokALZFUGlg036anmusKkGkuTrQazSMFgaCqZv2kglEGQFcv3EzVAXyCjpE4T iSlg== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=alibaba.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id d5si9002333edv.385.2019.11.26.17.51.15; Tue, 26 Nov 2019 17:51:39 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=alibaba.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726526AbfK0BuU (ORCPT + 99 others); Tue, 26 Nov 2019 20:50:20 -0500 Received: from out30-132.freemail.mail.aliyun.com ([115.124.30.132]:47305 "EHLO out30-132.freemail.mail.aliyun.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1725871AbfK0BuU (ORCPT ); Tue, 26 Nov 2019 20:50:20 -0500 X-Alimail-AntiSpam: AC=PASS;BC=-1|-1;BR=01201311R121e4;CH=green;DM=||false|;DS=||;FP=0|-1|-1|-1|0|-1|-1|-1;HT=e01e07486;MF=yun.wang@linux.alibaba.com;NM=1;PH=DS;RN=16;SR=0;TI=SMTPD_---0TjBDJPF_1574819411; Received: from testdeMacBook-Pro.local(mailfrom:yun.wang@linux.alibaba.com fp:SMTPD_---0TjBDJPF_1574819411) by smtp.aliyun-inc.com(127.0.0.1); Wed, 27 Nov 2019 09:50:12 +0800 Subject: [PATCH v2 0/3] sched/numa: introduce advanced numa statistic From: =?UTF-8?B?546L6LSH?= To: Ingo Molnar , Peter Zijlstra , Juri Lelli , Vincent Guittot , Dietmar Eggemann , Steven Rostedt , Ben Segall , Mel Gorman , Luis Chamberlain , Kees Cook , Iurii Zaikin , =?UTF-8?Q?Michal_Koutn=c3=bd?= , linux-fsdevel@vger.kernel.org, linux-kernel@vger.kernel.org, linux-doc@vger.kernel.org, "Paul E. McKenney" References: <743eecad-9556-a241-546b-c8a66339840e@linux.alibaba.com> Message-ID: <207ef46c-672c-27c8-2012-735bd692a6de@linux.alibaba.com> Date: Wed, 27 Nov 2019 09:48:44 +0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.13; rv:60.0) Gecko/20100101 Thunderbird/60.9.0 MIME-Version: 1.0 In-Reply-To: <743eecad-9556-a241-546b-c8a66339840e@linux.alibaba.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Since v1: * Improved documentation Modern production environment could use hundreds of cgroup to control the resources for different workloads, along with the complicated resource binding. On NUMA platforms where we have multiple nodes, things become even more complicated, we hope there are more local memory access to improve the performance, and NUMA Balancing keep working hard to achieve that, however, wrong memory policy or node binding could easily waste the effort, result a lot of remote page accessing. We need to perceive such problems, then we got chance to fix it before there are too much damages, however, there are no good approach yet to help catch the mouse who introduced the remote access. This patch set is trying to fill in the missing pieces, by introduce the per-cgroup NUMA locality/exectime statistics, and expose the per-task page migration failure counter, with these statistics, we could achieve the daily monitoring on NUMA efficiency, to give warning when things going too wrong. Please check the third patch for more details. Thanks to Peter, Mel and Michal for the good advice. Michael Wang (3): sched/numa: advanced per-cgroup numa statistic sched/numa: expose per-task pages-migration-failure counter sched/numa: documentation for per-cgroup numa stat Documentation/admin-guide/cg-numa-stat.rst | 163 ++++++++++++++++++++++++ Documentation/admin-guide/index.rst | 1 + Documentation/admin-guide/kernel-parameters.txt | 4 + Documentation/admin-guide/sysctl/kernel.rst | 9 ++ include/linux/sched.h | 18 ++- include/linux/sched/sysctl.h | 6 + init/Kconfig | 9 ++ kernel/sched/core.c | 91 +++++++++++++ kernel/sched/debug.c | 1 + kernel/sched/fair.c | 33 +++++ kernel/sched/sched.h | 17 +++ kernel/sysctl.c | 11 ++ 12 files changed, 362 insertions(+), 1 deletion(-) create mode 100644 Documentation/admin-guide/cg-numa-stat.rst -- 2.14.4.44.g2045bb6