Received: by 2002:a05:7412:1e0b:b0:fc:a2b0:25d7 with SMTP id kr11csp916235rdb; Thu, 15 Feb 2024 22:16:03 -0800 (PST) X-Forwarded-Encrypted: i=3; AJvYcCUupgTp7A5qHyoyYNUb3RACq/Rw+Hz53BUBZ57bUMWMlzGgXAoBFh5KF/ZATgfkBqsr7FKa27C0UK1aXEYiK6kkHy9gDSA4PNM6OlkCTQ== X-Google-Smtp-Source: AGHT+IFlcDOKFIbF9KECOOljWj2AaAjRuywS5PVj4c0cHJP+uaPLsO7Ob2uvxFnvNo9Sk7YCgVZ7 X-Received: by 2002:ac2:528c:0:b0:512:55c8:da19 with SMTP id q12-20020ac2528c000000b0051255c8da19mr2563718lfm.46.1708064162988; Thu, 15 Feb 2024 22:16:02 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1708064162; cv=pass; d=google.com; s=arc-20160816; b=hVAdcg8yYuFEswv+52xjl3DkbFALJj8Osw9b6OVhuYLqFGypX9xDK90KY180/R1J2Y G+1lloGHuNwynalT7/eMDiXiUywUbIj8A74tJUhdAJHqWHIxZNOSbo6hR7uokWMAxMIT G9WqqsRP64qT/D2oaft5Q6l9oa8+Vlznw83TZF67sLkfBCKXb3p2pJPSDtHAeXDI6oi+ v8vU5Nb+3MXTPYIkDZfssnPhLEWU0/B90med/9gniZ0b4SPGk8er/8b5Mj3Us2D/8gRP 3BaGvu3XB021AZMJBdPHg6Lcyo9MnazPSwTF8szaVgaZriKQlzhZUzQiuGsCDPXl02r0 53sA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:reply-to:user-agent:mime-version :list-unsubscribe:list-subscribe:list-id:precedence:date:message-id; bh=4hC9/QEfTWdH8neekMmEjrPk6vEYuk1RDv+wRMt9Cz8=; fh=vslWVWPa7NlPAF0hILDXIsTQpxU9kj1bOi7li1ploeI=; b=KePPqCMuEe123PIvEVhTnJv6lkI7GxGKsYN9iuLO6MS8y5vZCG2PHh7lpiSVUyp7JI Jo9qkp4Tdfr3LzOBIJGsR1HmKOfhwuiggRnxAeaQRHOK4ajaOodnY18PVcePtonsWr4b EiBAU6Pf7g9vznkpG65i3yKuIICET+xlMuM84KtPC1POFs34IHnRZ+o+CXCdqYuwf099 2j7KHBIRrh6XGmyU3MEij250E0wkjbuulegeSH6P91XskDFQ3nbZzzyVRPP0+pGPsLoc R5TmSeR4Lhr3m3OrbAMZCznPTJdQ2WHw1uyEcrEn18RpQ/3wRD94nXiwQjo4uyMTroWk TAhA==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; arc=pass (i=1 spf=pass spfdomain=leemhuis.info); spf=pass (google.com: domain of linux-kernel+bounces-68092-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:4601:e00::3 as permitted sender) smtp.mailfrom="linux-kernel+bounces-68092-linux.lists.archive=gmail.com@vger.kernel.org" Return-Path: Received: from am.mirrors.kernel.org (am.mirrors.kernel.org. [2604:1380:4601:e00::3]) by mx.google.com with ESMTPS id w2-20020aa7da42000000b00560c674e301si1314850eds.667.2024.02.15.22.16.02 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 15 Feb 2024 22:16:02 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel+bounces-68092-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:4601:e00::3 as permitted sender) client-ip=2604:1380:4601:e00::3; Authentication-Results: mx.google.com; arc=pass (i=1 spf=pass spfdomain=leemhuis.info); spf=pass (google.com: domain of linux-kernel+bounces-68092-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:4601:e00::3 as permitted sender) smtp.mailfrom="linux-kernel+bounces-68092-linux.lists.archive=gmail.com@vger.kernel.org" Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by am.mirrors.kernel.org (Postfix) with ESMTPS id 9B5D81F254F1 for ; Fri, 16 Feb 2024 06:16:02 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 320C01426D; Fri, 16 Feb 2024 06:15:51 +0000 (UTC) Received: from wp530.webpack.hosteurope.de (wp530.webpack.hosteurope.de [80.237.130.52]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 768A6134A9; Fri, 16 Feb 2024 06:15:48 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=80.237.130.52 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1708064150; cv=none; b=oRY1RMBX75sn/5swBH3FqwORphsTilDQVtOtfo9DYgx3ESKPADhUkr1qADxOpt9GKeHlIQYSKbd1EwxJxyAIVpw3aw1efGfBXwaAVfJkuO4cxqYP+6TfeZCqsUbyP9bnpqSHU/4UogTq5FO8I6G2PIW8eh04psjG3s3El4VxAS4= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1708064150; c=relaxed/simple; bh=Ubc/MvalYUWkd+30i+jxBtN9hVIKtcmQjeQHCy0qO6g=; h=Message-ID:Date:MIME-Version:Subject:To:Cc:References:From: In-Reply-To:Content-Type; b=Ua9UQPCSkiKaf4BFcM5GdhwpYMvcuSc0Cons1RIQaJ0McrOMiamJY5V0BTvdXVHZ6iJiXaxvn9PMJdgA19WouOSD2GfZPvnGwNCGlmE2r3cS2g5wiClNJO7feUqhjYQLINdPYxaqlf7QTgiaNiiHYatSEDgnnR1+tvvjrDnfFSA= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=none (p=none dis=none) header.from=leemhuis.info; spf=pass smtp.mailfrom=leemhuis.info; arc=none smtp.client-ip=80.237.130.52 Authentication-Results: smtp.subspace.kernel.org; dmarc=none (p=none dis=none) header.from=leemhuis.info Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=leemhuis.info Received: from [2a02:8108:8980:2478:8cde:aa2c:f324:937e]; authenticated by wp530.webpack.hosteurope.de running ExIM with esmtpsa (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) id 1rarVh-00045P-0e; Fri, 16 Feb 2024 07:15:45 +0100 Message-ID: <379b81ae-b95e-4a55-ab42-597c58c3fe35@leemhuis.info> Date: Fri, 16 Feb 2024 07:15:44 +0100 Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Reply-To: Linux regressions mailing list Subject: =?UTF-8?Q?Re=3A_This_is_the_fourth_time_I=C3=A2ve_tried_to_find_wha?= =?UTF-8?Q?t_led_to_the_regression_of_outgoing_network_speed_and_each_time_I?= =?UTF-8?Q?_find_the_merge_commit_8c94ccc7cd691472461448f98e2372c75849406c?= Content-Language: en-US, de-DE To: Mathias Nyman , Mikhail Gavrilov Cc: "Christian A. Ehrhardt" , niklas.neronin@linux.intel.com, Linux List Kernel Mailing , Greg KH , linux-usb@vger.kernel.org, Linux kernel regressions list References: <2d87509a-1515-520c-4b9e-bba4cd4fa2c6@linux.intel.com> <1126ed0a-bfc1-a752-1b5e-f1339d7a8aa5@linux.intel.com> From: "Linux regression tracking (Thorsten Leemhuis)" In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-bounce-key: webpack.hosteurope.de;regressions@leemhuis.info;1708064148;76dc59d5; X-HE-SMSGID: 1rarVh-00045P-0e [CCing the regression list, as it should be in the loop for regressions: https://docs.kernel.org/admin-guide/reporting-regressions.html] On 08.02.24 16:43, Mathias Nyman wrote: > On 8.2.2024 12.32, Mikhail Gavrilov wrote: >> On Thu, Feb 8, 2024 at 2:23 PM Mathias Nyman >> wrote: >>> >>> My guess is that CPU0 spends more time with interrupts disabled than >>> other CPUs. >>> Either because it's handling interrupts from some other hardware, or >>> running >>> code that disables interrupts (for example kernel code inside >>> spin_lock_irq), >>> and thus not able to handle network adapter interrupts at the same >>> rate as CPU23 >> >> Can this be fixed? > > Not sure, I'm not that familiar with this area. > Maybe running irqbalance could help? Mikhail, what's the status of this? I wonder if I should track this as a regression to ensure Linus is aware of this. Ciao, Thorsten (wearing his 'the Linux kernel's regression tracker' hat) -- Everything you wanna know about Linux kernel regression tracking: https://linux-regtracking.leemhuis.info/about/#tldr If I did something stupid, please tell me, as explained on that page.