Received: by 10.223.164.202 with SMTP id h10csp388901wrb; Wed, 22 Nov 2017 08:44:34 -0800 (PST) X-Google-Smtp-Source: AGs4zMYg6QkcTdjS1KqKUbNgPpfB33thayVNU7gOHKnFwAyoFBBmrtfHsQGSWnMI2Te6ZRZDMw+x X-Received: by 10.84.176.3 with SMTP id u3mr8915343plb.242.1511369074636; Wed, 22 Nov 2017 08:44:34 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1511369074; cv=none; d=google.com; s=arc-20160816; b=Yz/w2AS/Boy8zcYWEX/5PAVNlCpV1x7/p//X6cbuB22FTMNvzDrdcvG+aCIV5Vht63 9Bc1gS1fy3f1VrG3XVSrfdS5XB4Oz+VLnGsmzT+EeRgtFuQwULBdC8c+EVNbJ3W3SvHb NIYUSsvrmw9BK9aIqjim/BrOYE0DCqUdBa51svKPWDW0qRLsUCuTD9dN0ueDlbIKuia3 SkfsoqulQ96OvDCbeiCp6+DuOArYO4yOqEVqnXvusSQxAaLkXSCaF2+6hKLWG+evOa5Y mQlebcG554pgUnBSR4Rb3afbinNPfzkkKTdYvtZLNUWCK0iO+RbnlvfAmbcoYQHI9jRV 6Cog== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:message-id:date:subject:cc:to:from :arc-authentication-results; bh=Y21zzue6fZuoTy4l4xgoguKmjsR+pKMYm81jMxayJ+o=; b=YcpzSp3Dcl774OAFDcTMjU5dfooyI8TcDuORDWW24EDFndeNJvAY4ETioqFeAX4U57 zIUUjn31AMkHxDoWb9RVkV9CCbEGGiP+qwfX0RZ9KMCmJTewylEkNXvjsqVKLBCxcqWq 72o4GIuVvO6xn1zKc0y5fMm3TFCFFVZE2WfETt7/tpPp4Te4w6mMdQ6PgMNRYig/jMzb kqJd8KOnmp0tIn7TOCxutdyBn3jk6M776tCVv9+7APaeDAAFSERtzBkq/BdmzkuHqSaz qdE4iyUltdqbrrTl2IX74UmVgYwH0JJSAJwPwbY8gC4Bd3TO2YfKJn3I4Dt1z86x/3o0 mUOg== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=ibm.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id u13si14331659plq.361.2017.11.22.08.44.22; Wed, 22 Nov 2017 08:44:34 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=ibm.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1751946AbdKVQn2 (ORCPT + 77 others); Wed, 22 Nov 2017 11:43:28 -0500 Received: from mx0a-001b2d01.pphosted.com ([148.163.156.1]:57320 "EHLO mx0a-001b2d01.pphosted.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751458AbdKVQn1 (ORCPT ); Wed, 22 Nov 2017 11:43:27 -0500 Received: from pps.filterd (m0098399.ppops.net [127.0.0.1]) by mx0a-001b2d01.pphosted.com (8.16.0.21/8.16.0.21) with SMTP id vAMGeqCU122679 for ; Wed, 22 Nov 2017 11:43:26 -0500 Received: from e06smtp13.uk.ibm.com (e06smtp13.uk.ibm.com [195.75.94.109]) by mx0a-001b2d01.pphosted.com with ESMTP id 2edcwu89ce-1 (version=TLSv1.2 cipher=AES256-SHA bits=256 verify=NOT) for ; Wed, 22 Nov 2017 11:43:24 -0500 Received: from localhost by e06smtp13.uk.ibm.com with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted for from ; Wed, 22 Nov 2017 16:43:22 -0000 Received: from b06cxnps4074.portsmouth.uk.ibm.com (9.149.109.196) by e06smtp13.uk.ibm.com (192.168.101.143) with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted; Wed, 22 Nov 2017 16:43:19 -0000 Received: from d06av22.portsmouth.uk.ibm.com (d06av22.portsmouth.uk.ibm.com [9.149.105.58]) by b06cxnps4074.portsmouth.uk.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id vAMGhIGH35323936; Wed, 22 Nov 2017 16:43:18 GMT Received: from d06av22.portsmouth.uk.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 7156C4C050; Wed, 22 Nov 2017 16:38:22 +0000 (GMT) Received: from d06av22.portsmouth.uk.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id B81964C044; Wed, 22 Nov 2017 16:38:19 +0000 (GMT) Received: from satheesh-ThinkPad-T450.in.ibm.com (unknown [9.77.198.0]) by d06av22.portsmouth.uk.ibm.com (Postfix) with ESMTP; Wed, 22 Nov 2017 16:38:19 +0000 (GMT) From: sathnaga@linux.vnet.ibm.com To: acme@kernel.org, linux-kernel@vger.kernel.org, linux-perf-users@vger.kernel.org, mingo@kernel.org Cc: bala24@linux.vnet.ibm.com, srikar@linux.vnet.ibm.com, naveen.n.rao@linux.vnet.ibm.com, Satheesh Rajendran Subject: [PATCH v5 0/1] Fixup for discontiguous/sparse numa nodes Date: Wed, 22 Nov 2017 22:13:11 +0530 X-Mailer: git-send-email 2.7.4 X-TM-AS-GCONF: 00 x-cbid: 17112216-0012-0000-0000-00000590728E X-IBM-AV-DETECTION: SAVI=unused REMOTE=unused XFE=unused x-cbparentid: 17112216-0013-0000-0000-0000190B4734 Message-Id: X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:,, definitions=2017-11-22_05:,, signatures=0 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 priorityscore=1501 malwarescore=0 suspectscore=2 phishscore=0 bulkscore=0 spamscore=0 clxscore=1015 lowpriorityscore=0 impostorscore=0 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1709140000 definitions=main-1711220222 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org From: Satheesh Rajendran Certain systems would have sparse/discontinguous numa nodes. perf bench numa doesnt work well on such nodes. 1. It shows wrong values. 2. It can hang. 3. It can show redundant information for non-existant nodes. #numactl -H available: 2 nodes (0,8) node 0 cpus: 0 1 2 3 4 5 6 7 node 0 size: 61352 MB node 0 free: 57168 MB node 8 cpus: 8 9 10 11 12 13 14 15 node 8 size: 65416 MB node 8 free: 36593 MB node distances: node 0 8 0: 10 40 8: 40 10 Scenario 1: Before Fix: # perf bench numa mem --no-data_rand_walk -p 2 -t 20 -G 0 -P 3072 -T 0 -l 50 -c -s 1000 ... ... # 40 tasks will execute (on 9 nodes, 16 CPUs): ----> Wrong number of nodes ... # 2.0% [0.2 mins] 1/1 0/0 0/0 0/0 0/0 0/0 0/0 0/0 4/1 [ 4/2 ] l: 0-0 ( 0) ----> Shows info on non-existant nodes. After Fix: # ./perf bench numa mem --no-data_rand_walk -p 2 -t 20 -G 0 -P 3072 -T 0 -l 50 -c -s 1000 ... ... # 40 tasks will execute (on 2 nodes, 16 CPUs): ... # 2.0% [0.2 mins] 9/1 0/0 [ 9/1 ] l: 0-0 ( 0) # 4.0% [0.4 mins] 21/2 19/1 [ 2/3 ] l: 0-1 ( 1) {1-2} Scenario 2: Before Fix: # perf bench numa all # Running numa/mem benchmark... .... ... # Running RAM-bw-remote, "perf bench numa mem -p 1 -t 1 -P 1024 -C 0 -M 1 -s 20 -zZq --thp 1 --no-data_rand_walk" perf: bench/numa.c:306: bind_to_memnode: Assertion `!(ret)' failed. ------------> Got hung After Fix: # ./perf bench numa all # Running numa/mem benchmark... .... ... # Running RAM-bw-remote, "perf bench numa mem -p 1 -t 1 -P 1024 -C 0 -M 1 -s 20 -zZq --thp 1 --no-data_rand_walk" # NOTE: ignoring bind NODEs starting at NODE#1 # NOTE: 0 tasks mem-bound, 1 tasks unbound 20.017 secs slowest (max) thread-runtime 20.000 secs fastest (min) thread-runtime 20.006 secs average thread-runtime 0.043 % difference between max/avg runtime 413.794 GB data processed, per thread 413.794 GB data processed, total 0.048 nsecs/byte/thread runtime 20.672 GB/sec/thread speed 20.672 GB/sec total speed Changes in v2: Fixed review comments for function names and alloc failure handle Changes in v3: Coding Style fixes. Changes in v4: Address review comments from Naveen and Arnaldo. Merge two commits into single. Changes in v5: Removed a unwanted change and Added Acked-by. Satheesh Rajendran (1): perf/bench/numa: Fixup discontiguous/sparse numa nodes tools/perf/bench/numa.c | 56 ++++++++++++++++++++++++++++++++++++++++++++----- 1 file changed, 51 insertions(+), 5 deletions(-) -- 2.7.4 From 1584751409568686856@xxx Wed Nov 22 07:45:17 +0000 2017 X-GM-THRID: 1584751409568686856 X-Gmail-Labels: Inbox,Category Forums,HistoricalUnread