Received: by 10.223.185.116 with SMTP id b49csp1077925wrg; Sat, 3 Mar 2018 14:57:15 -0800 (PST) X-Google-Smtp-Source: AG47ELv8fHhee0IDbFLnYpLjc5EQ0KdpxbAAFzRSRAjL/A3cX98w6v+uSOsTFVDmnktOp9z5ddUe X-Received: by 10.99.123.12 with SMTP id w12mr8055291pgc.405.1520117835471; Sat, 03 Mar 2018 14:57:15 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1520117835; cv=none; d=google.com; s=arc-20160816; b=deeFmz6QPddSF3H4iP/gkRddmavbjpN42ymOAK7KNMVe5V7XZOj6EKRtyYbe4O5i1F PovbngKjKAfS6uRINaOHa0gCzTpepe4GFNZUaXYKDt0PANC73YG99huYUcc1k+JbXsRj JudezVwknHxhBcKs4j01Z1a1CIbXkK4Lt2/IH7tW6lQbJHPntjl9jiWd3TAlqoJiHe8s pxrCXmBr4/VCHngvoaYSXv4i8JFkDWIDWjkL4dgP19v/8ZdpFuLq+eI2sL48d3hZ8dOz XhaWMtdDCOu6TYvV2pgTVsBxfwfY7uKfprXysddm8gtkfnZxrMFUtc9eMKsBfBG4dDmb SaAQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:mime-version:content-transfer-encoding :spamdiagnosticmetadata:spamdiagnosticoutput:content-language :accept-language:in-reply-to:references:message-id:date:thread-index :thread-topic:subject:cc:to:from:dkim-signature :arc-authentication-results; bh=ufzXbvFGAq0Sj0rJDYcLyvw/TH4Zq6wSx99csCR5HtQ=; b=C0CAaGq9CTeAgJ7PnIqQOpCcAM5lHgHa0zJPrA5o3pE1R/ciT7ysMmWKPC5pCy1O31 iQS2dB8Rtxal5gI3TzM6bYTt03ZN1sZxG+5+tAl0YLWuAaShr50RM6T0E7d0YBfSR6F2 4S5n7XYc/QJSQkIaldrUZTJ86j6C3c1axfyK8P8PF8EAQQgqw3ObpnWF4I+b4ZCUxAuG Lt2Z24sBMYXb4e8DgSu5suvd5XNY281g8f/QG1MxcHZNXPJvsQb38IXwsbqsw4M3dndI 4fYpsJSsiyS8KOepAvl4LtFMQGyM1iUL22BxKWyt6j6uBs6E3kDtFr6CQ2kEXM9RSGTI XG6A== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@microsoft.com header.s=selector1 header.b=VeJGmaPO; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=microsoft.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id x13si6117195pgc.75.2018.03.03.14.57.01; Sat, 03 Mar 2018 14:57:15 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@microsoft.com header.s=selector1 header.b=VeJGmaPO; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=microsoft.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S935427AbeCCWzT (ORCPT + 99 others); Sat, 3 Mar 2018 17:55:19 -0500 Received: from mail-cys01nam02on0110.outbound.protection.outlook.com ([104.47.37.110]:31968 "EHLO NAM02-CY1-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S935369AbeCCWlB (ORCPT ); Sat, 3 Mar 2018 17:41:01 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=ufzXbvFGAq0Sj0rJDYcLyvw/TH4Zq6wSx99csCR5HtQ=; b=VeJGmaPOzXzVvdcO3Ak4d1WdFwfn9cdx+g1Fxeehe2dq3zAYw73rQQECilpXh+A6FsxrRTHAfhnCXRiXbaWHFcvjK4zAEYSUISsbjrHLG5KyJVTbk1NhMokAdFqhVxqHvvRmiKVZ63J3JbTtlYlsVgRyVHfIij4t4XWAYgcE6No= Received: from MW2PR2101MB1034.namprd21.prod.outlook.com (52.132.149.10) by MWHSPR01MB344.namprd21.prod.outlook.com (10.174.251.167) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.567.3; Sat, 3 Mar 2018 22:40:57 +0000 Received: from MW2PR2101MB1034.namprd21.prod.outlook.com ([fe80::1d56:338f:e2b:cec0]) by MW2PR2101MB1034.namprd21.prod.outlook.com ([fe80::1d56:338f:e2b:cec0%3]) with mapi id 15.20.0567.006; Sat, 3 Mar 2018 22:40:57 +0000 From: Sasha Levin To: "linux-kernel@vger.kernel.org" , "stable@vger.kernel.org" CC: Stephane Eranian , Andy Lutomirski , Namhyung Kim , Peter Zijlstra , Arnaldo Carvalho de Melo , Sasha Levin Subject: [PATCH AUTOSEL for 3.18 07/63] perf tools: Make perf_event__synthesize_mmap_events() scale Thread-Topic: [PATCH AUTOSEL for 3.18 07/63] perf tools: Make perf_event__synthesize_mmap_events() scale Thread-Index: AQHTsz+d9sXlFwJkgECAJDe7OVrSnA== Date: Sat, 3 Mar 2018 22:33:12 +0000 Message-ID: <20180303223228.27323-7-alexander.levin@microsoft.com> References: <20180303223228.27323-1-alexander.levin@microsoft.com> In-Reply-To: <20180303223228.27323-1-alexander.levin@microsoft.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [52.168.54.252] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1;MWHSPR01MB344;7:pqqAlDvM06WiuPmLLyNDTyC+bWjUBMq7RTZemFVjNIaigc9a+1yC18+zX2PTrPYugIwKwn8mAa0jNgA4TwIRiwI7aCESWBLZdVQa/JX8YXgXqbJvJX0jUtQ9yREHsw5iUWBgeNcbPpAVIAINO5i+w1uwIY/5zb/A4ZgT+0UpxthFePFqRjLqyEXtcRrJf/WhaO3CXsQyulTjSoKN0dQxokLjRctakIC3bAoc1aFNxuJv3dK7VwXQgo97AF51E3pS x-ms-office365-filtering-ht: Tenant x-ms-office365-filtering-correlation-id: 275d7690-3e34-4863-309a-08d58157d4af x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:(7020095)(4652020)(4534165)(4627221)(201703031133081)(201702281549075)(48565401081)(5600026)(4604075)(3008032)(2017052603307)(7193020);SRVR:MWHSPR01MB344; x-ms-traffictypediagnostic: MWHSPR01MB344: authentication-results: spf=none (sender IP is ) smtp.mailfrom=Alexander.Levin@microsoft.com; x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(28532068793085)(89211679590171)(211936372134217)(42068640409301)(153496737603132); x-exchange-antispam-report-cfa-test: BCL:0;PCL:0;RULEID:(8211001083)(61425038)(6040501)(2401047)(5005006)(8121501046)(3231220)(944501244)(52105095)(93006095)(93001095)(3002001)(10201501046)(6055026)(61426038)(61427038)(6041288)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123560045)(20161123564045)(20161123562045)(20161123558120)(6072148)(201708071742011);SRVR:MWHSPR01MB344;BCL:0;PCL:0;RULEID:;SRVR:MWHSPR01MB344; x-forefront-prvs: 0600F93FE1 x-forefront-antispam-report: SFV:NSPM;SFS:(10019020)(396003)(376002)(346002)(39860400002)(366004)(39380400002)(189003)(199004)(59450400001)(8676002)(5660300001)(5250100002)(2501003)(6506007)(575784001)(7736002)(36756003)(25786009)(3846002)(6116002)(966005)(97736004)(305945005)(2900100001)(76176011)(6436002)(10090500001)(26005)(8936002)(186003)(81166006)(102836004)(81156014)(106356001)(86362001)(10290500003)(3660700001)(2906002)(99286004)(14454004)(86612001)(105586002)(478600001)(4326008)(6486002)(53936002)(107886003)(68736007)(316002)(54906003)(110136005)(6512007)(72206003)(3280700002)(22452003)(2950100002)(1076002)(6306002)(6666003)(66066001)(22906009)(101420200001)(217873001);DIR:OUT;SFP:1102;SCL:1;SRVR:MWHSPR01MB344;H:MW2PR2101MB1034.namprd21.prod.outlook.com;FPR:;SPF:None;PTR:InfoNoRecords;MX:1;A:1;LANG:en; received-spf: None (protection.outlook.com: microsoft.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: ALXg62kJh/OJewc76F79nq3G8A2IPK2kEGTvQMO9G1vCKZp9qeFnNXyKQRBeDP8/rbE6eo0t1ndKi7g20k8HV4AYlzAqrf4UmvvTGRmsPcOcjUhvc6JxK/Q+oLs8H0IJz9xs2QO9pX8ian0TacNqBAKG3VWuDr/bb5ylblxonog= spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: microsoft.com X-MS-Exchange-CrossTenant-Network-Message-Id: 275d7690-3e34-4863-309a-08d58157d4af X-MS-Exchange-CrossTenant-originalarrivaltime: 03 Mar 2018 22:33:12.8878 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 72f988bf-86f1-41af-91ab-2d7cd011db47 X-MS-Exchange-Transport-CrossTenantHeadersStamped: MWHSPR01MB344 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org From: Stephane Eranian [ Upstream commit 88b897a30c525c2eee6e7f16e1e8d0f18830845e ] This patch significantly improves the execution time of perf_event__synthesize_mmap_events() when running perf record on systems where processes have lots of threads. It just happens that cat /proc/pid/maps support uses a O(N^2) algorithm to generate each map line in the maps file. If you have 1000 threads, then yo= u have necessarily 1000 stacks. For each vma, you need to check if it corresponds to a thread's stack. With a large number of threads, this can = take a very long time. I have seen latencies >> 10mn. As of today, perf does not use the fact that a mapping is a stack, therefor= e we can work around the issue by using /proc/pid/tasks/pid/maps. This entry do= es not try to map a vma to stack and is thus much faster with no loss of functonality. The proc-map-timeout logic is kept in case users still want some upper limi= t. In V2, we fix the file path from /proc/pid/tasks/pid/maps to actual /proc/pid/task/pid/maps, tasks -> task. Thanks Arnaldo for catching this. Committer note: This problem seems to have been elliminated in the kernel since commit : b18cb64ead40 ("fs/proc: Stop trying to report thread stacks"). Signed-off-by: Stephane Eranian Acked-by: Jiri Olsa Cc: Andy Lutomirski Cc: Namhyung Kim Cc: Peter Zijlstra Link: http://lkml.kernel.org/r/20170315135059.GC2177@redhat.com Link: http://lkml.kernel.org/r/1489598233-25586-1-git-send-email-eranian@go= ogle.com Signed-off-by: Arnaldo Carvalho de Melo Signed-off-by: Sasha Levin --- tools/perf/util/event.c | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/tools/perf/util/event.c b/tools/perf/util/event.c index da4c17cccb71..b9743621b2d0 100644 --- a/tools/perf/util/event.c +++ b/tools/perf/util/event.c @@ -167,8 +167,8 @@ int perf_event__synthesize_mmap_events(struct perf_tool= *tool, if (machine__is_default_guest(machine)) return 0; =20 - snprintf(filename, sizeof(filename), "%s/proc/%d/maps", - machine->root_dir, pid); + snprintf(filename, sizeof(filename), "%s/proc/%d/task/%d/maps", + machine->root_dir, pid, pid); =20 fp =3D fopen(filename, "r"); if (fp =3D=3D NULL) { --=20 2.14.1