Received: by 2002:ab2:5c0e:0:b0:1ef:a325:1205 with SMTP id i14csp132917lqk; Wed, 13 Mar 2024 20:06:12 -0700 (PDT) X-Forwarded-Encrypted: i=3; AJvYcCUHr3uJ4PuwD9ssS6dcgYzj8kP9qDn1EeUAF1TIZ6A1gZcdR9hv/rRHvwX1zQMAByVrQNWDM/kabkTbBsN/twZuDGfrt6jnmpgLXr8BIw== X-Google-Smtp-Source: AGHT+IEO0x6qfFFL5UvialJaY8lr0YlxDWMvmv3kxvkkzvlmSyqjlbYhBSlA+2krZxRv175/6Q1I X-Received: by 2002:a05:6359:4c84:b0:17e:6ad8:15fc with SMTP id kk4-20020a0563594c8400b0017e6ad815fcmr796275rwc.23.1710385571889; Wed, 13 Mar 2024 20:06:11 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1710385571; cv=pass; d=google.com; s=arc-20160816; b=p+n8Jl+63SZJ5ih0eOpp/jzuUSF74+enErUiwhLOFCC3owsz4tkUKTwQiFH8Rd9XjR lK6bFi+ip/P3lBlznTSoDo1l40rXoRhrqQDQhLZkeXSWO+XKHi7M+n9uQmHTEnYpcneU +Itfn3miRHIJNVKynjkGt/GnwOoY+IyOPDfbeWMHnstewAQGzHO36sDANRYMk1no9rNE x7FimqkMFjINEjo0g2qiya1Paxi9TLJ62n/tEPuONFdaI+JYkCTF3EF3MDcgEqHQ7r3L DuRNfnpNfE2lpTYueNM51e1/a+zNqe4lo0NH7NWZVKr3jTBYuAAaT5nHq2+yqTYzPa/b nS2Q== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:references:in-reply-to:message-id :subject:cc:to:from:date:dkim-signature; bh=98hcDOBZvaroc2+oacr4ZrQ8unl3av3V7BSDIFqC1Do=; fh=kggsUnIwjIqdSlEhIz6ce3LtX9nJYeO6hCvrNr6HBWI=; b=nPJbgyD4rKSXerG+RUKNeaUIlwedgFJciOy6PLrK66USystPQXj3RwAseec0HfSF33 JYPjofXWudT2qgr845B7etUan4vObOyoSlolYEQ5u/3x2Fekob3euKWbW90hgreF8pZ3 X3t7n04RVmZOA5JFtFvGSV42nRGQvvZaQIZJYDdAjF3gjJubfxIoIwsNV0038AKCix3V astFq/clr7opJy0ftFOlM5wF1ObwvXm4HET7Lp8lR4O+/z8cs2PtNCqUQEEzSPeyaYB3 xVBWMWGVu7lxIs3r/CeBtBjCaV4UftyyhDAZ4/feHnDq3/Q+3gsg1z1WSU3DMES3UfUr 2wAw==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@networkplumber-org.20230601.gappssmtp.com header.s=20230601 header.b=2Vshv+GJ; arc=pass (i=1 spf=pass spfdomain=networkplumber.org dkim=pass dkdomain=networkplumber-org.20230601.gappssmtp.com dmarc=pass fromdomain=networkplumber.org); spf=pass (google.com: domain of linux-kernel+bounces-102737-linux.lists.archive=gmail.com@vger.kernel.org designates 139.178.88.99 as permitted sender) smtp.mailfrom="linux-kernel+bounces-102737-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=fail (p=QUARANTINE sp=QUARANTINE dis=NONE) header.from=networkplumber.org Return-Path: Received: from sv.mirrors.kernel.org (sv.mirrors.kernel.org. [139.178.88.99]) by mx.google.com with ESMTPS id 127-20020a630985000000b005dc1c316cf5si609083pgj.357.2024.03.13.20.06.11 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 13 Mar 2024 20:06:11 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel+bounces-102737-linux.lists.archive=gmail.com@vger.kernel.org designates 139.178.88.99 as permitted sender) client-ip=139.178.88.99; Authentication-Results: mx.google.com; dkim=pass header.i=@networkplumber-org.20230601.gappssmtp.com header.s=20230601 header.b=2Vshv+GJ; arc=pass (i=1 spf=pass spfdomain=networkplumber.org dkim=pass dkdomain=networkplumber-org.20230601.gappssmtp.com dmarc=pass fromdomain=networkplumber.org); spf=pass (google.com: domain of linux-kernel+bounces-102737-linux.lists.archive=gmail.com@vger.kernel.org designates 139.178.88.99 as permitted sender) smtp.mailfrom="linux-kernel+bounces-102737-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=fail (p=QUARANTINE sp=QUARANTINE dis=NONE) header.from=networkplumber.org Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by sv.mirrors.kernel.org (Postfix) with ESMTPS id 7B7A3285BF7 for ; Thu, 14 Mar 2024 03:06:11 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 4775B5398; Thu, 14 Mar 2024 03:05:51 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=networkplumber-org.20230601.gappssmtp.com header.i=@networkplumber-org.20230601.gappssmtp.com header.b="2Vshv+GJ" Received: from mail-oi1-f176.google.com (mail-oi1-f176.google.com [209.85.167.176]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id C1123BE5E for ; Thu, 14 Mar 2024 03:05:48 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.167.176 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1710385550; cv=none; b=p3dMD4P4faMRZWA/ituiSiDLSNjNG82D9D3/fzWKbeixeiMea5Y4TT4QmrYYnet4Ihi7VDlRZtC6nfxwPT2ngXPY7pKd9ozpzrbdIFvDMsJ0ig6zm4iBnXXaL8EKLvBN9c9Wv5/p3d1FQZISMyXk7xgnpNjTiIsUE+sOzZMk67s= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1710385550; c=relaxed/simple; bh=nzHsNFvD08F/Zbn2c2LaSTkT6hmpbR0tfRVGn4qDRZE=; h=Date:From:To:Cc:Subject:Message-ID:In-Reply-To:References: MIME-Version:Content-Type; b=q/CEuru44Czf/KjsHpeqFRXQ0yKItJy/F5PGj1t/GdSq+mqan6bUxID2mA0g/iN7HpPxmmoHkFwyz9YwdY7Im+MdP8NTLLi7C5x/e1AJ0C8fWtyOSYUV1Dcn52Np5hvFoavlaK1UNd1ceiOGQLmxDzEPHf3B2sImrlUXLuCWvOU= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=networkplumber.org; spf=pass smtp.mailfrom=networkplumber.org; dkim=pass (2048-bit key) header.d=networkplumber-org.20230601.gappssmtp.com header.i=@networkplumber-org.20230601.gappssmtp.com header.b=2Vshv+GJ; arc=none smtp.client-ip=209.85.167.176 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=networkplumber.org Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=networkplumber.org Received: by mail-oi1-f176.google.com with SMTP id 5614622812f47-3c19e18470aso428868b6e.1 for ; Wed, 13 Mar 2024 20:05:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=networkplumber-org.20230601.gappssmtp.com; s=20230601; t=1710385548; x=1710990348; darn=vger.kernel.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:subject:cc:to:from:date:from:to:cc:subject:date :message-id:reply-to; bh=98hcDOBZvaroc2+oacr4ZrQ8unl3av3V7BSDIFqC1Do=; b=2Vshv+GJWxLZ1eHZa0kp8b0uIQBQKArMYFafxYYKUKAG9oa7qIBZctluHpc5HKX1PS H1Aik0YpEypBpq0+l2q3IZdG17pet2ItYw7NKBGZZk1mpZEB0TSnrYthWc5e+9tLKai4 AjUG+70IRFoSEuKkHcngZjzy/ibAypTbmwJEDP4HWwLu73v+CqwtYkosLyxD6RQyTMyG i7STeaKb6r10Tu8NwCyygIxqoX8y/DQHxy5hTZl3yFGZqIbJJY4AbTfz2A6qHCMD03J/ PZVgQnzf637Jk8BmqN0JqGEzwv2LBXUwsxjpkYJ0mALLZ7mtgRFKR6kvEMYtU9eof/KI GoBg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1710385548; x=1710990348; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:subject:cc:to:from:date:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=98hcDOBZvaroc2+oacr4ZrQ8unl3av3V7BSDIFqC1Do=; b=EB0o00ZiSqY2XnqvXHT/TQeRC+SpMHt9s4B3bObNVyBrQe9zq1UkAs859CxqUPpeAP vqTgHUB5a5kLtCXTkqH718CquDc2CkLkJWQ5CoG2T+2WqfCMTgLQQZGC5RQ7dsZoSckO 5f1mAcY1ROBINkn5C034BK5+4rbM1Tk4it35EBX0x554CXt6m0KJ1l7TgB/f0h9x9PSB SWSdqCdTbG8CNfVGK7vnZvjmdjFe2yKnK0k8TKnfZnc5pvYhwa2MCgK0qHWwspT17Q4w eD5dsJ/rJLD1t+K+kKHk1qbwxx9+4Ot9dnrM56ikIA2PirR4v42z1A6jnt/RH6cAXZgz ZBdQ== X-Forwarded-Encrypted: i=1; AJvYcCVPjdYLxtNQiTkCY6/W7EKs8SQaWR9d3cG0Jfbit7LIJEDtmc9JtelOMG713/aApROV6wpGB9e51QMQMqGiOgx7ICk5C5CGjZCqUBmV X-Gm-Message-State: AOJu0YwXT012BbSmqJbigZCPSsi9q0rEkdeiPXHQL+k3QdgOWh85W4CT /3ytfNKBVbfq0qaVOneHEjP66ypwzlSOBRZ+GYGg2h3QUsfU3gbiqxtChAb3ehA= X-Received: by 2002:a54:480d:0:b0:3c2:1d9e:b7fe with SMTP id j13-20020a54480d000000b003c21d9eb7femr441294oij.30.1710385547828; Wed, 13 Mar 2024 20:05:47 -0700 (PDT) Received: from hermes.local (204-195-123-141.wavecable.com. [204.195.123.141]) by smtp.gmail.com with ESMTPSA id i4-20020aa787c4000000b006e6ab7cb10esm325263pfo.186.2024.03.13.20.05.47 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 13 Mar 2024 20:05:47 -0700 (PDT) Date: Wed, 13 Mar 2024 20:05:45 -0700 From: Stephen Hemminger To: Shradha Gupta Cc: Jakub Kicinski , Haiyang Zhang , Shradha Gupta , "linux-kernel@vger.kernel.org" , "linux-hyperv@vger.kernel.org" , "linux-rdma@vger.kernel.org" , "netdev@vger.kernel.org" , Eric Dumazet , Paolo Abeni , Ajay Sharma , Leon Romanovsky , Thomas Gleixner , Sebastian Andrzej Siewior , KY Srinivasan , Wei Liu , Dexuan Cui , Long Li , Michael Kelley Subject: Re: [PATCH] net :mana : Add per-cpu stats for MANA device Message-ID: <20240313200545.656f6dd6@hermes.local> In-Reply-To: <20240314025720.GA13853@linuxonhyperv3.guj3yctzbm1etfxqx2vob5hsef.xx.internal.cloudapp.net> References: <1709823132-22411-1-git-send-email-shradhagupta@linux.microsoft.com> <20240307072923.6cc8a2ba@kernel.org> <20240307090145.2fc7aa2e@kernel.org> <20240308112244.391b3779@kernel.org> <20240311041950.GA19647@linuxonhyperv3.guj3yctzbm1etfxqx2vob5hsef.xx.internal.cloudapp.net> <20240314025720.GA13853@linuxonhyperv3.guj3yctzbm1etfxqx2vob5hsef.xx.internal.cloudapp.net> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit On Wed, 13 Mar 2024 19:57:20 -0700 Shradha Gupta wrote: > Following is the data we can share: > > Default interrupts affinity for each queue: > > 25: 1 103 0 2989138 Hyper-V PCIe MSI 4138200989697-edge mana_q0@pci:7870:00:00.0 > 26: 0 1 4005360 0 Hyper-V PCIe MSI 4138200989698-edge mana_q1@pci:7870:00:00.0 > 27: 0 0 1 2997584 Hyper-V PCIe MSI 4138200989699-edge mana_q2@pci:7870:00:00.0 > 28: 3565461 0 0 1 Hyper-V PCIe MSI 4138200989700-edge mana_q3 > @pci:7870:00:00.0 > > As seen the CPU-queue mapping is not 1:1, Queue 0 and Queue 2 are both mapped > to cpu3. From this knowledge we can figure out the total RX stats processed by > each CPU by adding the values of mana_q0 and mana_q2 stats for cpu3. But if > this data changes dynamically using irqbalance or smp_affinity file edits, the > above assumption fails. irqbalance is often a bad idea. In the past, doing one shot balancing at startup was a better plan.