Received: by 2002:a05:7208:9594:b0:7e:5202:c8b4 with SMTP id gs20csp2084203rbb; Tue, 27 Feb 2024 10:05:08 -0800 (PST) X-Forwarded-Encrypted: i=3; AJvYcCUABAFjASSgQQQmgHJiY4MsktfdRgAnBn7Y6FjzmnVIGgzwzWAUujSGs4dJeY2l7V+l0zmvgbISsTdEUTqwT3wzSsyaDK3VHC86ke8dRg== X-Google-Smtp-Source: AGHT+IGDYOOBR8RxgP9SAGdAfZrBDDJgWpL/UG+89TAkLXa46XnVSpWr46++Rt7fBASiXbOdOpxZ X-Received: by 2002:a05:6a00:8e06:b0:6e5:a7d:c0b5 with SMTP id io6-20020a056a008e0600b006e50a7dc0b5mr7507509pfb.9.1709057108145; Tue, 27 Feb 2024 10:05:08 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1709057108; cv=pass; d=google.com; s=arc-20160816; b=s1oZupt+ugyDFXL5XeX4j4aoWBjYBeAe0ETFPPKz5nQbFvc4iFenvxz8Ykak50mWX8 canzeEeh6el2QGw5jWedeA+nnXpvB45P5Znlv/lBLGbil0jp+t50ME/8K1vqjv1znYPP RHsfwdxWVPI3j5vlTYSBmMpYpzNMo+IUarBSD+vSMMfkGNBEXux/vDnoTPS1O1fp/sM/ iwzbW0pr7Nw/Mq1f9l93sifjzzkHTIueXv5C9BPU0FNwPDzuOo+kqv8yd3D3BfA1OhX7 PL9ZykSr0wzdpYstP1lttstOGr7BN5uDsYzHmvftmSXnOHxB8oyc/wk4bPrnrtDlvFv+ Ulew== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:list-unsubscribe:list-subscribe:list-id:precedence :message-id:date:references:in-reply-to:subject:cc:to:dkim-signature :dkim-signature:from; bh=rTtdD3Xrcr26050qG/wJhYNywK18VvSVk9OIhhpRR5U=; fh=qAbHouCB7SbMrYq4rqaT/18ofZUGXjkIqF4knV8HFx0=; b=VEGyIYHk4O/46CUQIa2i1NaIE3z3Z1TrG1dXAuGXS/5A1KcdGUUSb3GY59VXQK1jB1 Pr8e4hSW6ZU0rvhteD9fSyhtPi9woA2C6EFoxS1GGr4QvqC0IYDM86K5N6HTTf7CPghe PLCqw0TavMtYkRO1P5P6MtqTB/jsLqMqiFRtv3EgfCfyBY5imLYjDblU/vgIV4gF1VdV 7fP0eUJY9vyypNqaLRkgLBuUdriOxWhABxhTzxtJB7dKB53Sb5v/Y2CnyDl/RH9o57/2 WTwyghNcBPhQBmGl6Z3kG8E+Jb5jAdlBiwC7sst5M83smTv/UQxF7f86OqSKFWCiVYKj kV7Q==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@linutronix.de header.s=2020 header.b=SUvVlJzc; dkim=neutral (no key) header.i=@linutronix.de header.s=2020e; arc=pass (i=1 spf=pass spfdomain=linutronix.de dkim=pass dkdomain=linutronix.de dmarc=pass fromdomain=linutronix.de); spf=pass (google.com: domain of linux-kernel+bounces-83712-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:40f1:3f00::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-83712-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=linutronix.de Return-Path: Received: from sy.mirrors.kernel.org (sy.mirrors.kernel.org. [2604:1380:40f1:3f00::1]) by mx.google.com with ESMTPS id a3-20020a62d403000000b006e116bcade4si5841356pfh.23.2024.02.27.10.05.07 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 27 Feb 2024 10:05:08 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel+bounces-83712-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:40f1:3f00::1 as permitted sender) client-ip=2604:1380:40f1:3f00::1; Authentication-Results: mx.google.com; dkim=pass header.i=@linutronix.de header.s=2020 header.b=SUvVlJzc; dkim=neutral (no key) header.i=@linutronix.de header.s=2020e; arc=pass (i=1 spf=pass spfdomain=linutronix.de dkim=pass dkdomain=linutronix.de dmarc=pass fromdomain=linutronix.de); spf=pass (google.com: domain of linux-kernel+bounces-83712-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:40f1:3f00::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-83712-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=linutronix.de Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by sy.mirrors.kernel.org (Postfix) with ESMTPS id 0B61EB30033 for ; Tue, 27 Feb 2024 17:28:30 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id C5CF3149DE7; Tue, 27 Feb 2024 17:23:55 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=linutronix.de header.i=@linutronix.de header.b="SUvVlJzc"; dkim=permerror (0-bit key) header.d=linutronix.de header.i=@linutronix.de header.b="UlmowWHr" Received: from galois.linutronix.de (Galois.linutronix.de [193.142.43.55]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 902FA14830F; Tue, 27 Feb 2024 17:23:53 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=193.142.43.55 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1709054635; cv=none; b=qQsAvIfCIpHFfpQ9Z4D5/Ron2BKDEqxMun+mEjvuwEtDcWtvJjhrfCu4z0aIQo6adl9uW9qNUg2yrYLz0cS7yw1bf53F8wSLxU5g1idUm8SYBDZHwaYkDfdlVbcjeOGR+VvO+Mr+pC9joC3AHjIe/xN19tYi1x0GkzmqwBhmCSQ= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1709054635; c=relaxed/simple; bh=xlZyVCMWEBnGE08Ta5ctgjEj5TmCCEbtRLDLkzlk01o=; h=From:To:Cc:Subject:In-Reply-To:References:Date:Message-ID: MIME-Version:Content-Type; b=V4TRKJltlN+0hdyzyAEdQfwZduo8E9O6JUEbI0UwuIvHcooYX5KdWPhNd5+fRSjS44leH6MRExSTqaGG7r3aHJsZFl73PLggZ2v8h9CzAAEOEGx/y353rwsiSVC0iYgphGKwBqFrsSOlBzmtEX43bEfDuwXa4Faow3PRMmWbFwg= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linutronix.de; spf=pass smtp.mailfrom=linutronix.de; dkim=pass (2048-bit key) header.d=linutronix.de header.i=@linutronix.de header.b=SUvVlJzc; dkim=permerror (0-bit key) header.d=linutronix.de header.i=@linutronix.de header.b=UlmowWHr; arc=none smtp.client-ip=193.142.43.55 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linutronix.de Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=linutronix.de From: Thomas Gleixner DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linutronix.de; s=2020; t=1709054632; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=rTtdD3Xrcr26050qG/wJhYNywK18VvSVk9OIhhpRR5U=; b=SUvVlJzcuaVjWbGSnWliEzygA3VxbmZ0H4NCvZ/rAZLBfErplr0sn7Jr3snH8lkQ0xqa8w 6IbOmh8InLS8dLpo0QjO2O0PIKuuzX4C3qUE3EU31jwHLQwD5pFB4DBNJmCxtT3fEOf9Cp DJaSWMW8HlAP8ytXJioapKPuHQkoa1A8Gui/VIkge0XKV1SQNFg/pMh7UfpDbvoOlokI56 wz5+oPh6eqvggEt1SchfB5TiKC2l7JTErf7k6b0rA9cYHRbD9wLC7KEeQ1Oj9+rBirKf/I cVJZ+44B6wFMYPyzb92qPHTxJlQIkZdHYYqbC5qWmSJAdGRBzw2ggVbAb3kHbg== DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=linutronix.de; s=2020e; t=1709054632; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=rTtdD3Xrcr26050qG/wJhYNywK18VvSVk9OIhhpRR5U=; b=UlmowWHraF9oHUzTRAnyGgarSO+vqPI8Xl6VoKziX0/l+ZfNBqgcsQDmPcA8PEISLLhYJZ G8kvs+J8SdcNzxCA== To: mikhail.v.gavrilov@gmail.com, Mathias Nyman , Linux regressions mailing list Cc: "Christian A. Ehrhardt" , niklas.neronin@linux.intel.com, Linux List Kernel Mailing , Greg KH , linux-usb@vger.kernel.org, x86@kernel.org, netdev@vger.kernel.org, Randy Dunlap Subject: Re: This is the fourth time I've tried to find what led to the regression of outgoing network speed and each time I find the merge commit 8c94ccc7cd691472461448f98e2372c75849406c In-Reply-To: <098670097a6fd59f3e254c5294882f3fa12e3c65.camel@gmail.com> References: <2d87509a-1515-520c-4b9e-bba4cd4fa2c6@linux.intel.com> <1126ed0a-bfc1-a752-1b5e-f1339d7a8aa5@linux.intel.com> <34d7ab1b-ab12-489d-a480-5e6ccc41bfc3@infradead.org> <10487018-49b8-4b27-98a1-07cee732290d@infradead.org> <4f34b6a8-4415-6ea4-8090-262847d606c6@linux.intel.com> <3ea25443-1275-4c67-90e0-b637212d32b5@leemhuis.info> <1e719367-01ae-565a-2199-0ff7e260422b@linux.intel.com> <410817b8-1cf9-4285-b20b-f1fa0513cee8@leemhuis.info> <87r0gz9jxp.ffs@tglx> <098670097a6fd59f3e254c5294882f3fa12e3c65.camel@gmail.com> Date: Tue, 27 Feb 2024 18:23:51 +0100 Message-ID: <87y1b595y0.ffs@tglx> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain On Tue, Feb 27 2024 at 22:08, mikhail.v.gavrilov@gmail.com wrote: > On Mon, 2024-02-26 at 19:09 +0100, Thomas Gleixner wrote: >> we don't have any information about the overall workload, > > During measurements nothing was running except iperf3 Ok. > I don't know how else to help you. What information to provide. If we want to understand why CPU0 is problematic, then you need to use tracing to capture what's going on on CPU0 vs. other CPUs. > About repeatability my "unlucky" scenario. > I have two MSI MPG B650I EDGE WIFI motherboards and this problem > happened both at the same time. Sure. The probe order and the number of interrupts are probably exactly the same. As the spreading algorithm is very basic, it will result in exactly the same setup for both. > It seems the problem has always been there, we just never noticed it. Exactly. Thanks, tglx