Received: by 2002:a25:8b91:0:0:0:0:0 with SMTP id j17csp3185820ybl; Mon, 20 Jan 2020 17:57:51 -0800 (PST) X-Google-Smtp-Source: APXvYqznBZ563Gbgdlbfa1BilhkzMhzr94soMVepEW3dZYvTffDyElgrRHvgsiWCS1m058Ms1Aik X-Received: by 2002:aca:f1c6:: with SMTP id p189mr1304358oih.159.1579571870964; Mon, 20 Jan 2020 17:57:50 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1579571870; cv=none; d=google.com; s=arc-20160816; b=SQtnebBqMPr5soXTDx8mCzNxyCfTRuEuBX+bLEkyQCMLyk1+IHryKdyPoagDhw3vE9 YIcIDEx4iOpGWlhnj2qcVDw9qIDh6Mj8RfSXuOSVmUS65TvK5ExNMKkIZJzY8V7Guxxh VynKVwf+Fhi/5HfSFYRwrMwTuYiJ9RyD2/swUcYophy/hdNavdV/AuVhOIdK7BXKGjfL I1oxlMKH9dZ32xPDdS/GOzJyC0t/3aKmXtd1AWoVUBHVnhl2thGF/pyQx+pP1A1L5Zqy MLqCTN6lHu2CYH6R1PxOmf8MwcfVoqCowyAxuw/JhUBUjLOcj3d3Vqh4lmDnkmENOeml 27Ew== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:references:to:from:subject; bh=2yyAU/k1md2Tj+Y51oP+MrgkCtRpGardKghUeqjm8Qg=; b=KO+FTeNs3G1vQlMQ8pKPa48e0GqsFU4L9V/B5bGOnJ9VNZ9V44oSK5qAfJfYoUmpsb CnzU+i16kbXOPTQ0Xei3ur/msEczLVT8Gk0aBu4JRbrnkC/2rPElFb7YP9R83kezlhaH vOQ1kGmqsT+YNWMWx5nCEuuvh211n6/CbsVb0ePXxCMyGThJ8vdzcCQZ1FpVa27zrJkg +3zje42G4VZqrdclcaCM9tdTt82tYfCBS4xNR0bs4ht6bHJxXrEM4TeoT735YqLVxgmp JntTmgamIwzT9WJW1Z3koEvKKRuX12153rE6Xo6qDCYmyccjmI0f0JtJ+/AUR7oeRsEr QTEQ== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=alibaba.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id f25si20520531otl.36.2020.01.20.17.57.38; Mon, 20 Jan 2020 17:57:50 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=alibaba.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728794AbgAUB4q (ORCPT + 99 others); Mon, 20 Jan 2020 20:56:46 -0500 Received: from out30-131.freemail.mail.aliyun.com ([115.124.30.131]:45722 "EHLO out30-131.freemail.mail.aliyun.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726935AbgAUB4q (ORCPT ); Mon, 20 Jan 2020 20:56:46 -0500 X-Alimail-AntiSpam: AC=PASS;BC=-1|-1;BR=01201311R101e4;CH=green;DM=||false|;DS=||;FP=0|-1|-1|-1|0|-1|-1|-1;HT=e01f04428;MF=yun.wang@linux.alibaba.com;NM=1;PH=DS;RN=18;SR=0;TI=SMTPD_---0ToGEFrG_1579571799; Received: from testdeMacBook-Pro.local(mailfrom:yun.wang@linux.alibaba.com fp:SMTPD_---0ToGEFrG_1579571799) by smtp.aliyun-inc.com(127.0.0.1); Tue, 21 Jan 2020 09:56:40 +0800 Subject: [PATCH v8 0/2] sched/numa: introduce numa locality From: =?UTF-8?B?546L6LSH?= To: Ingo Molnar , Peter Zijlstra , Juri Lelli , Vincent Guittot , Dietmar Eggemann , Steven Rostedt , Ben Segall , Mel Gorman , Luis Chamberlain , Kees Cook , Iurii Zaikin , =?UTF-8?Q?Michal_Koutn=c3=bd?= , linux-fsdevel@vger.kernel.org, linux-kernel@vger.kernel.org, linux-doc@vger.kernel.org, "Paul E. McKenney" , Randy Dunlap , Jonathan Corbet References: <743eecad-9556-a241-546b-c8a66339840e@linux.alibaba.com> <207ef46c-672c-27c8-2012-735bd692a6de@linux.alibaba.com> <040def80-9c38-4bcc-e4a8-8a0d10f131ed@linux.alibaba.com> <25cf7ef5-e37e-7578-eea7-29ad0b76c4ea@linux.alibaba.com> <443641e7-f968-0954-5ff6-3b7e7fed0e83@linux.alibaba.com> Message-ID: Date: Tue, 21 Jan 2020 09:56:39 +0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.13; rv:60.0) Gecko/20100101 Thunderbird/60.9.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org v8: * document edited v7: * rebased on latest linux-next v6: * fix compile failure when NUMA disabled v5: * improved documentation v4: * fix comments and improved documentation v3: * simplified the locality concept & implementation v2: * improved documentation Modern production environment could use hundreds of cgroup to control the resources for different workloads, along with the complicated resource binding. On NUMA platforms where we have multiple nodes, things become even more complicated, we hope there are more local memory access to improve the performance, and NUMA Balancing keep working hard to achieve that, however, wrong memory policy or node binding could easily waste the effort, result a lot of remote page accessing. We need to notice such problems, then we got chance to fix it before there are too much damages, however, there are no good monitoring approach yet to help catch the mouse who introduced the remote access. This patch set is trying to fill in the missing pieces, by introduce the per-cgroup NUMA locality info, with this new statistics, we could achieve the daily monitoring on NUMA efficiency, to give warning when things going too wrong. Please check the second patch for more details. Michael Wang (2): sched/numa: introduce per-cgroup NUMA locality info sched/numa: documentation for per-cgroup numa statistics Documentation/admin-guide/cg-numa-stat.rst | 178 ++++++++++++++++++++++++ Documentation/admin-guide/index.rst | 1 + Documentation/admin-guide/kernel-parameters.txt | 4 + Documentation/admin-guide/sysctl/kernel.rst | 9 ++ include/linux/sched.h | 15 ++ include/linux/sched/sysctl.h | 6 + init/Kconfig | 11 ++ kernel/sched/core.c | 75 ++++++++++ kernel/sched/fair.c | 62 +++++++++ kernel/sched/sched.h | 12 ++ kernel/sysctl.c | 11 ++ 11 files changed, 384 insertions(+) create mode 100644 Documentation/admin-guide/cg-numa-stat.rst -- 2.14.4.44.g2045bb6