Received: by 2002:a05:7412:40d:b0:e2:908c:2ebd with SMTP id 13csp329748rdf; Tue, 21 Nov 2023 04:09:07 -0800 (PST) X-Google-Smtp-Source: AGHT+IHwkbC/DR1JoEsyFtzxHGBRN9uDrUdKwaOTmthCQurxfB/iPUdUbwoufJjALfDGExM2auFF X-Received: by 2002:a05:6a20:a103:b0:18a:e262:d15 with SMTP id q3-20020a056a20a10300b0018ae2620d15mr1642067pzk.54.1700568547204; Tue, 21 Nov 2023 04:09:07 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1700568547; cv=none; d=google.com; s=arc-20160816; b=LVUZ2w85AaJVdNoJkFxkFWwuify4AJ2vbSzONOvMniixmYizoW/93+rtKeLUT299Fm TzbExJblgmRyhfvHnef94GSXkon2n1rgkhTLV2kdvdPHJre7vMZoZf6tML4Z999t/45w fMhbyqakOJiUuJnLkRtTiUNrmEpq1AXDKCY1Z7pwD8OFFRQbtNSbCuriCnUOeMmzdUD2 pVtjY+VNt8U7m1gKgzUOvdUq4bE3j/+fizEfowYiiOr9NOxSj8BVqiYu/Cgiqq8TI8xn 84POmtOgRwPbvQmaD1aMCqfvauCyl0C4H5e4HfGxGJm3A3vd1UGH1Y8rYxp6AzO4I1mO /X7A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:cc:subject:from:to :content-language:user-agent:mime-version:date:message-id :dkim-signature; bh=fyprvdpWqGOhlbsOwrafSnIrWde8cx9cjhM85ME7esw=; fh=bsK/faqHGvoXWJZyiATKjVdQF9RxjQFCy8kjiQhW+tw=; b=wzeIanfjM8Hk0opXMOPxqeefDApCjqX+Kb3d571NJ021XReyv7aKfiRL9BTTw6URCi 4XmyuOEKbFGBn0MYKDgd0CNbp2TAryCP5Y2/1PB4nGUwPzPEzFB3/SF4eMJaIFrkF502 KN1I1Ai5WN1FJf1QG1z6PvOGl9XSYUppxEt7snyVhtGCm/cP76XOOVrbrNQpdCb4c9Wh H//+5e3ysDHJZmLF1kDFwLLsAsEnR3E5ouSeQiLV7WwbsPPJ/GKjpdXbFjkvIZI2IQoF 7StKNNGJCfjgvcSZs/VEemCSJaYpMpMH7rCaPOrRvk8FOR7/173G4Y9NaUi9Gs/YtF6s nKsw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@marcan.st header.s=default header.b=o3tsAP39; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.37 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=QUARANTINE sp=QUARANTINE dis=NONE) header.from=marcan.st Return-Path: Received: from snail.vger.email (snail.vger.email. [23.128.96.37]) by mx.google.com with ESMTPS id bt6-20020a17090af00600b0028525c8810esi4091486pjb.129.2023.11.21.04.09.06 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 21 Nov 2023 04:09:07 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.37 as permitted sender) client-ip=23.128.96.37; Authentication-Results: mx.google.com; dkim=pass header.i=@marcan.st header.s=default header.b=o3tsAP39; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.37 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=QUARANTINE sp=QUARANTINE dis=NONE) header.from=marcan.st Received: from out1.vger.email (depot.vger.email [IPv6:2620:137:e000::3:0]) by snail.vger.email (Postfix) with ESMTP id 032DE803E4BE; Tue, 21 Nov 2023 04:09:06 -0800 (PST) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.11 at snail.vger.email Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S233940AbjKUMJC (ORCPT + 99 others); Tue, 21 Nov 2023 07:09:02 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:37224 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S234198AbjKUMJB (ORCPT ); Tue, 21 Nov 2023 07:09:01 -0500 Received: from mail.marcansoft.com (marcansoft.com [212.63.210.85]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id A71C3185 for ; Tue, 21 Nov 2023 04:08:55 -0800 (PST) Received: from [127.0.0.1] (localhost [127.0.0.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) (Authenticated sender: marcan@marcan.st) by mail.marcansoft.com (Postfix) with ESMTPSA id 42BE542118; Tue, 21 Nov 2023 12:08:52 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=marcan.st; s=default; t=1700568533; bh=izpovA0XHb89VRrGlum7I7YsipyerFuXhLb0jEFlzB4=; h=Date:To:From:Subject:Cc; b=o3tsAP39aOWCf2InCItbLug8RNYooAAn10p4t1Uiq4fCQxp3UcnqgJoU3XuEb8frn pGWdSs8OVwDZAlJy68MEs6p/W4cfxudO1LppS5ET7Nmi7uQVWSDfwk/0tu3Fec59at 4pN1uJ8uijvfztdmQNmWRIDctx2BtjAVN0qCpFEVbC0ISw/SCK+ctX5Jg2Aa1ma+aN +I/fACBQJE5HBd+J4V1kZIfGKA9jfM0+Os9M4hlIdy68mTYe/Ti4p+rAKpdfj2MlhU H3Wh+bSDZWP8qopJxkHcHkt6hf2CIFt3v5zKs1X0NAOBWHYrRwSgA6pW5AzeScdFQ4 lHVsG8gD6Fs7g== Message-ID: <08f1f185-e259-4014-9ca4-6411d5c1bc65@marcan.st> Date: Tue, 21 Nov 2023 21:08:48 +0900 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Content-Language: en-US To: linux-perf-users@vger.kernel.org, LKML From: Hector Martin Subject: [REGRESSION] Perf (userspace) broken on big.LITTLE systems since v6.5 Cc: Marc Zyngier , Asahi Linux Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_BLOCKED, SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (snail.vger.email [0.0.0.0]); Tue, 21 Nov 2023 04:09:06 -0800 (PST) Perf broke on all Apple ARM64 systems (tested almost everything), and according to maz also on Juno (so, probably all big.LITTLE) since v6.5. Test command: sudo taskset -c 0 ./perf stat -e apple_icestorm_pmu/cycles/ -e apple_firestorm_pmu/cycles/ -e cycles ls Since this is taskset to CPU #0 (LITTLE core, icestorm), only events for icestorm are expected. I bisected the breakage to two distinct points: 5ea8f2ccffb is the first bad commit. With its parent, the output is as expected (same as v6.4): 3,297,462 apple_icestorm_pmu/cycles/ apple_firestorm_pmu/cycles/ (0.00%) cycles (0.00%) With 5ea8f2ccffb everything breaks: apple_icestorm_pmu/cycles/ apple_firestorm_pmu/cycles/ cycles (0.00%) Somewhere along the way to 82fe2e45cdb00 things get even worse (didn't bother bisecting this range). With its parent: apple_icestorm_pmu/cycles/ apple_firestorm_pmu/cycles/ apple_icestorm_pmu/cycles/ apple_firestorm_pmu/cycles/ Then 82fe2e45cdb00 leads to the current v6.5 behavior: apple_icestorm_pmu/cycles/ (0.00%) apple_firestorm_pmu/cycles/ (0.00%) cycles (0.00%) If I taskset the task to CPU#2 (big core, firestorm), I get events: 1,454,858 apple_icestorm_pmu/cycles/ 1,454,760 apple_firestorm_pmu/cycles/ 1,454,384 cycles So the current behavior is that all output seems to come from the firestorm PMU event counter, regardless of requested event. This is all unchanged and still broken in v6.7-rc2. - Hector