Received: by 2002:a05:6a10:6744:0:0:0:0 with SMTP id w4csp676552pxu; Wed, 14 Oct 2020 10:46:29 -0700 (PDT) X-Google-Smtp-Source: ABdhPJxT70pX3UTz4ONDtwsWasIAHRjpF8act0J+koftAwKCiRnhQC64eqyWF75jxhw6ERbwECac X-Received: by 2002:a17:907:42a6:: with SMTP id nf6mr170918ejb.69.1602697588798; Wed, 14 Oct 2020 10:46:28 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1602697588; cv=none; d=google.com; s=arc-20160816; b=S8BO4GoLYiw7vsOULNOjSZk0m6Lxhc6PJro75qvZFD5Qmx+3uA2/wcCbW4mv4pcF1y RzKLskTH2TaCDvriYaKx4fdHH+z+F67YJkHX86zKolLsoWz09UuMxrr+uLsavbaEnEJo C63WXEqOFzQIa8/j1ySmyj1mLwvV9P0MJFngVUIgqy2g2z3v/fEh7EGhbSGc7mDePDKG f4RP5jNcyuQFetN0MrfA3KRJwrub/bLjlVVpr+uER+aKCjH/MiLqmidJAteEnrVmmdXu vrf/sjMa70VQktqauE5yyf1Hr6NZ8D1rCtnPXw64oQX5Cp5FouGnyM7nUYB6yHpK7x6x Zu6Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:in-reply-to:content-disposition:mime-version :references:message-id:subject:cc:to:from:date:sender:dkim-signature; bh=IMqbIe+mRlbJqVmn4jLKuZAagD2wd8VSkTOeSKBklkc=; b=irWpawR/MMicEM4HsqhxD4uA1c3lf8yoKIHJNLidoSXLufL+GB4RQsCnpGUkkVAiqJ OmFNZ3Br7eL0uruFtAkSzOzUkylMiupRqB74NkyLVLLfx0Mr3rtpWzRLi0mTQxdXxdoU 1lVU5besRDPPIYS+rtYVkBAo/CBSHpCCsSrzCt9s4z8tIG0XtHk7Bz3yBgJSnjsWrJIT y5W7HrgSEThb2MzepkYoyFWEUvDigEppZqrXu0sTdOUJYNB5qbagQmBlKfBF2U8Sutwr 6ao2aw5Xf0f2tBv8wrEVvRrS6+C6AqfksYqNAX4/7X7y0OuJdS1fF6c7kZTKY/yD/A0q BnoQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=hV8O+PlE; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id x18si309498ejd.43.2020.10.14.10.46.06; Wed, 14 Oct 2020 10:46:28 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=hV8O+PlE; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1732062AbgJNR1F (ORCPT + 99 others); Wed, 14 Oct 2020 13:27:05 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:58986 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726057AbgJNR1F (ORCPT ); Wed, 14 Oct 2020 13:27:05 -0400 Received: from mail-ej1-x644.google.com (mail-ej1-x644.google.com [IPv6:2a00:1450:4864:20::644]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id CBAB5C061755 for ; Wed, 14 Oct 2020 10:27:03 -0700 (PDT) Received: by mail-ej1-x644.google.com with SMTP id a3so5924642ejy.11 for ; Wed, 14 Oct 2020 10:27:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=IMqbIe+mRlbJqVmn4jLKuZAagD2wd8VSkTOeSKBklkc=; b=hV8O+PlEsf4AkEsIk1Kd2NA86+Y2rTSlTZfxqzMEk4It3CmJ1C+np1XJz85Z66n/uy 1YwHX1rpGAfH2ySSIIcNV+LDXHhtVC7ydyYmq2hhVVIkjMuk+G+wlAYiuU8ByUN/bQ9K H/mVkwvllPo9FQShEvlD1vFmuZ1eGCw7tesO8q/ffoAMU+e+5177tqZDJWPZKFDmxTGH Vwq+0SqQKp6sTHlLfoTw39MRTTYAT+3w81NJTPYG9gtVIRWcePY2g/M7/5AnhG6gEjKe Z0OlVUerYL5eRNM+KeGrqcN6cPRrApECGLRafRg0d2NrODSQTPdDyYsrMb+yEqWvWYmL uadA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition:in-reply-to; bh=IMqbIe+mRlbJqVmn4jLKuZAagD2wd8VSkTOeSKBklkc=; b=hUjCWmg7OTcXyWq5Hg2jTPzizxKM4de73+eey4v/KiySNeQ7YT/BPhQ/4vpTQYKHdH tLw8xXgKA4AEUK928Nz3tUXw/VQxqPNb8zSzljjBZYZpAQrqwWHkLgyL95E30jRyio8e xWEF6sE5rsZcH31TKb922BzQdPi1pDa6i5s39eZPqjJDRKV6ApY8GRFOIDwqiUYqZJoN 3zKFuujrEzSpGZiHUOMHnr2koTJqtUxk4V9LdC1WsIap/4sG/VEB/fo6uu7u/pta4kIJ 8BGXdDJM3DnfLdT9u/n3kuYJFX2bgQ2B0TMEyhCQercW3r9T+sPuOi4SHJ3pUBJW+npo WArQ== X-Gm-Message-State: AOAM5313PzGFt4uNVFT2uE5Q9t3FnPU8rGMtA0SDMCRe3lhOdz0qR04G AeYWCBt/ie4aTynLe4jyTgE= X-Received: by 2002:a17:907:3393:: with SMTP id zj19mr113551ejb.258.1602696422591; Wed, 14 Oct 2020 10:27:02 -0700 (PDT) Received: from gmail.com (563B81C8.dsl.pool.telekom.hu. [86.59.129.200]) by smtp.gmail.com with ESMTPSA id x2sm95032edr.65.2020.10.14.10.27.01 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 14 Oct 2020 10:27:01 -0700 (PDT) Sender: Ingo Molnar Date: Wed, 14 Oct 2020 19:27:00 +0200 From: Ingo Molnar To: Alexey Budankov Cc: Arnaldo Carvalho de Melo , Jiri Olsa , Namhyung Kim , Alexander Shishkin , Andi Kleen , Adrian Hunter , Peter Zijlstra , Ingo Molnar , linux-kernel Subject: Re: [PATCH v1 00/15] Introduce threaded trace streaming for basic perf record operation Message-ID: <20201014172700.GA3595702@gmail.com> References: <810f3a69-0004-9dff-a911-b7ff97220ae0@linux.intel.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <810f3a69-0004-9dff-a911-b7ff97220ae0@linux.intel.com> Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org * Alexey Budankov wrote: > > Patch set provides threaded trace streaming for base perf record > operation. Provided streaming mode (--threads) mitigates profiling > data losses and resolves scalability issues of serial and asynchronous > (--aio) trace streaming modes on multicore server systems. The patch > set is based on the prototype [1], [2] and the most closely relates > to mode 3) "mode that creates thread for every monitored memory map". > > The threaded mode executes one-to-one mapping of trace streaming threads > to mapped data buffers and streaming into per-CPU trace files located > at data directory. The data buffers and threads are affined to NUMA > nodes and monitored CPUs according to system topology. --cpu option > can be used to specify exact CPUs to be monitored. Yay! This should really be the default trace capture model everywhere possible. Can we do this for perf top too? It's really struggling with lots of cores. If on a 64-core system I run just a moderately higher frequency 'perf top' of 1 kHz: perf top -e cycles -F 1000 perf stays stuck forever in 'Collecting samples...', and I also get a lot of: [548112.871089] Uhhuh. NMI received for unknown reason 31 on CPU 25. [548112.871089] Do you have a strange power saving mode enabled? Thanks, Ingo