Received: by 2002:a25:8b91:0:0:0:0:0 with SMTP id j17csp1333668ybl; Wed, 4 Dec 2019 22:54:02 -0800 (PST) X-Google-Smtp-Source: APXvYqwd+jP8QR9mYHM8ZLhkDCEK2mJ2UrLV+flycVqm7l2+o2B2V7Dx6Epl0cA6eqjBO5k8J0G4 X-Received: by 2002:aca:4c15:: with SMTP id z21mr323616oia.12.1575528842523; Wed, 04 Dec 2019 22:54:02 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1575528842; cv=none; d=google.com; s=arc-20160816; b=twnUyqAFgm8gsmQ0UEYwcTI2chV8qo5PTTDgzW2bU3bpx07sMZBKF8TqDdRuadw34g 6CVPDBjSXE4tQbpQ4sZ/l4/vxPeJSlOh4+JifbeCOcOkUKFeOLcgYhAOEYTtrZoBX86J cZVbVrkI7rAcYyWlgMa5jMW36lfMK3+NOftKVODpy8O6d38wswepRMTOQ2ffHMaVAkMx ERIiOhULCtGb/pIo5DURDCj4cKJ5RapY7B8YfAHcrIBVZNNy9+xuVdkOrt6zKgkXcGYE lY+EHE/lwsXA1yLvbF10KvBVQpDE6wETUWgXssnnEjkxDkSjA/kIjsU9WhfqdmvqoIkE ZeeA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:references:to:from:subject; bh=HFMVfeaaCPtuin5KLlpKjhI1gKxA/+rmNZrb2B0xhcc=; b=x2W/N/wPIObUyEQTsD/8hs0zQrmWhR6yMGfCGlalUMBQ0nlSafzJHa9J4S4pSH9j81 a4N5ECx6GB4ZIrrHSt6gZe/CT7yEs4UWIycvCRYv+iNvyANo4D1mSLoJvmuNnqVHJ1Sz bpVqe1SRyH7XcRu3YhYX7yLPMcsC2x4DsXQZ6Qv78MxNeYs9HppXCdWzbqPFBxOSOL46 HjMYbxKNmg/D1axFInxAojtSleKE+0jG829SG0DrGqwk5XYOPrAiyKoCPLRToBuW5AGx HrADxQVC1P4GTN5w0aF2hZ7GB9tmiMCihqZ1lLZcAq+o/zP8Amk0PCJ9VZKZaiKWQxoD H5eg== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=alibaba.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id s128si4360274oib.249.2019.12.04.22.53.49; Wed, 04 Dec 2019 22:54:02 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=alibaba.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726096AbfLEGxZ (ORCPT + 99 others); Thu, 5 Dec 2019 01:53:25 -0500 Received: from out30-132.freemail.mail.aliyun.com ([115.124.30.132]:36856 "EHLO out30-132.freemail.mail.aliyun.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1725909AbfLEGxZ (ORCPT ); Thu, 5 Dec 2019 01:53:25 -0500 X-Alimail-AntiSpam: AC=PASS;BC=-1|-1;BR=01201311R191e4;CH=green;DM=||false|;DS=||;FP=0|-1|-1|-1|0|-1|-1|-1;HT=e01e07488;MF=yun.wang@linux.alibaba.com;NM=1;PH=DS;RN=18;SR=0;TI=SMTPD_---0Tk0sC2w_1575528794; Received: from testdeMacBook-Pro.local(mailfrom:yun.wang@linux.alibaba.com fp:SMTPD_---0Tk0sC2w_1575528794) by smtp.aliyun-inc.com(127.0.0.1); Thu, 05 Dec 2019 14:53:15 +0800 Subject: [PATCH v5 0/2] sched/numa: introduce numa locality From: =?UTF-8?B?546L6LSH?= To: Ingo Molnar , Peter Zijlstra , Juri Lelli , Vincent Guittot , Dietmar Eggemann , Steven Rostedt , Ben Segall , Mel Gorman , Luis Chamberlain , Kees Cook , Iurii Zaikin , =?UTF-8?Q?Michal_Koutn=c3=bd?= , linux-fsdevel@vger.kernel.org, linux-kernel@vger.kernel.org, linux-doc@vger.kernel.org, "Paul E. McKenney" , Randy Dunlap , Jonathan Corbet References: <743eecad-9556-a241-546b-c8a66339840e@linux.alibaba.com> <207ef46c-672c-27c8-2012-735bd692a6de@linux.alibaba.com> <040def80-9c38-4bcc-e4a8-8a0d10f131ed@linux.alibaba.com> <25cf7ef5-e37e-7578-eea7-29ad0b76c4ea@linux.alibaba.com> Message-ID: <443641e7-f968-0954-5ff6-3b7e7fed0e83@linux.alibaba.com> Date: Thu, 5 Dec 2019 14:53:14 +0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.13; rv:60.0) Gecko/20100101 Thunderbird/60.9.0 MIME-Version: 1.0 In-Reply-To: <25cf7ef5-e37e-7578-eea7-29ad0b76c4ea@linux.alibaba.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Since v4: * improved documentation Since v3: * fix comments and improved documentation Since v2: * simplified the locality concept & implementation Since v1: * improved documentation Modern production environment could use hundreds of cgroup to control the resources for different workloads, along with the complicated resource binding. On NUMA platforms where we have multiple nodes, things become even more complicated, we hope there are more local memory access to improve the performance, and NUMA Balancing keep working hard to achieve that, however, wrong memory policy or node binding could easily waste the effort, result a lot of remote page accessing. We need to notice such problems, then we got chance to fix it before there are too much damages, however, there are no good monitoring approach yet to help catch the mouse who introduced the remote access. This patch set is trying to fill in the missing pieces, by introduce the per-cgroup NUMA locality info, with this new statistics, we could achieve the daily monitoring on NUMA efficiency, to give warning when things going too wrong. Please check the second patch for more details. Michael Wang (2): sched/numa: introduce per-cgroup NUMA locality info sched/numa: documentation for per-cgroup numa statistics Documentation/admin-guide/cg-numa-stat.rst | 178 ++++++++++++++++++++++++ Documentation/admin-guide/index.rst | 1 + Documentation/admin-guide/kernel-parameters.txt | 4 + Documentation/admin-guide/sysctl/kernel.rst | 9 ++ include/linux/sched.h | 15 ++ include/linux/sched/sysctl.h | 6 + init/Kconfig | 11 ++ kernel/sched/core.c | 75 ++++++++++ kernel/sched/fair.c | 62 +++++++++ kernel/sched/sched.h | 12 ++ kernel/sysctl.c | 11 ++ 11 files changed, 384 insertions(+) create mode 100644 Documentation/admin-guide/cg-numa-stat.rst -- 2.14.4.44.g2045bb6