Received: by 2002:a25:1506:0:0:0:0:0 with SMTP id 6csp1949090ybv; Sun, 23 Feb 2020 19:09:34 -0800 (PST) X-Google-Smtp-Source: APXvYqwubPvL8rza9WAB2nYD4Qf6euzBWCfv498HT+HKAyMaXjEnmrw+B4Jc9BpEsX9yfO9KGeRw X-Received: by 2002:a9d:12a8:: with SMTP id g37mr38885731otg.261.1582513774666; Sun, 23 Feb 2020 19:09:34 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1582513774; cv=none; d=google.com; s=arc-20160816; b=pLBS2k0s+hC8DJQ3Q1EwGCopcPjZJe04TZ5aLd6ffK5McN9WL3GMPfGEiMfTT9Vw// 1Ysw+axSlBfivemt25U3UtTtkT6iGXZQTyMKU6rqgAXt5QGeQ4WEoIrYXR+yyLUHPEz8 KLM/ckBtHhUIwaUj3FQQ8voJ++GSjf18czyKqIers36IM1JdQ02tjI53L18aSC60x7Zr 6qM/swnnEwx1vsBAbiS4A53rrtPPExa/ZwuhSIAAgx0/6XVxRGumYZLsU3RpOvtiYgby 1XSJFRV/Anc9w31a+ZUGwMOnm6j//SNxxDaEEgd/dL7kQOudEygia/mtACWfr7k7jokM 9REQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:from:references:cc:to:subject; bh=5bcO4/VbVBnNfaKLUiG0MhEKFKQIIcE7zmrrPPsguok=; b=kH4xgtF+hsfZALpIB1O2ARiGfQRvPkJ8Ye2pCqVQyvxBxpbLrF2ImtGpXkC0JvcKRd NDveHSiGaC9KKRyXn5qNpTSr8PUmwkIahGHZ20ajQUqV0KCRpz4naUQ/3VvPG0SdLrPj beBJTHKzZqcl4z35T3ayceJ9QrC9lO8n8R5ZZWMBH/QXY8H8m9Sb1zAk5GCSnxINRtgQ Jh23IMFduks3BshJVXtOYaVocCJcYOvF0Dhz/0noLBKx3dtFHC3zC+b3znZWoXBP4xY4 MwNSv2fKZvKX5NLDJfYejoAZmRDT/NRYxsn4YgL7nV6U9KVizrC4t4yZLJ+wlxtfYSNL cK9Q== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=alibaba.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id l83si4277824oih.58.2020.02.23.19.09.21; Sun, 23 Feb 2020 19:09:34 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=alibaba.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727197AbgBXDJL (ORCPT + 99 others); Sun, 23 Feb 2020 22:09:11 -0500 Received: from out30-56.freemail.mail.aliyun.com ([115.124.30.56]:47240 "EHLO out30-56.freemail.mail.aliyun.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727156AbgBXDJL (ORCPT ); Sun, 23 Feb 2020 22:09:11 -0500 X-Alimail-AntiSpam: AC=PASS;BC=-1|-1;BR=01201311R231e4;CH=green;DM=||false|;DS=||;FP=0|-1|-1|-1|0|-1|-1|-1;HT=e01f04455;MF=yun.wang@linux.alibaba.com;NM=1;PH=DS;RN=18;SR=0;TI=SMTPD_---0Tqhg-oW_1582513746; Received: from testdeMacBook-Pro.local(mailfrom:yun.wang@linux.alibaba.com fp:SMTPD_---0Tqhg-oW_1582513746) by smtp.aliyun-inc.com(127.0.0.1); Mon, 24 Feb 2020 11:09:08 +0800 Subject: Re: [PATCH RESEND v8 1/2] sched/numa: introduce per-cgroup NUMA locality info To: Peter Zijlstra Cc: Mel Gorman , Ingo Molnar , Juri Lelli , Vincent Guittot , Dietmar Eggemann , Steven Rostedt , Ben Segall , Luis Chamberlain , Kees Cook , Iurii Zaikin , Michal Koutn? , linux-fsdevel@vger.kernel.org, linux-kernel@vger.kernel.org, linux-doc@vger.kernel.org, "Paul E. McKenney" , Randy Dunlap , Jonathan Corbet References: <20200214151048.GL14914@hirez.programming.kicks-ass.net> <20200217115810.GA3420@suse.de> <881deb50-163e-442a-41ec-b375cc445e4d@linux.alibaba.com> <20200221152824.GH18400@hirez.programming.kicks-ass.net> From: =?UTF-8?B?546L6LSH?= Message-ID: <3bd3f4d0-2504-a48c-adea-a28227a81d7a@linux.alibaba.com> Date: Mon, 24 Feb 2020 11:09:06 +0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.13; rv:68.0) Gecko/20100101 Thunderbird/68.4.1 MIME-Version: 1.0 In-Reply-To: <20200221152824.GH18400@hirez.programming.kicks-ass.net> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 2020/2/21 δΈ‹εˆ11:28, Peter Zijlstra wrote: > On Mon, Feb 17, 2020 at 09:23:52PM +0800, ηŽ‹θ΄‡ wrote: >> FYI, by monitoring locality, we found that the kvm vcpu thread is not >> covered by NUMA Balancing, whatever how many maximum period passed, the >> counters are not increasing, or very slowly, although inside guest we are >> copying memory. >> >> Later we found such task rarely exit to user space to trigger task >> work callbacks, and NUMA Balancing scan depends on that, which help us >> realize the importance to enable NUMA Balancing inside guest, with the >> correct NUMA topo, a big performance risk I'll say :-P > > That's a bug in KVM, see: > > https://lkml.kernel.org/r/20190801143657.785902257@linutronix.de > https://lkml.kernel.org/r/20190801143657.887648487@linutronix.de > > ISTR there being newer versions of that patch-set, but I can't seem to > find them in a hurry. Aha, that's exactly the problem we saw, will check~ Regards, Michael Wang >