Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18;
IronPort-SDR: 7ew2Hb6n78lGQ3CqvJOe1JiPoVu193dtxB2v2OaHWgVNILDosVxvnq8P6UlKCEM2TqmkQaagiP
 nwN1OtBqaffQ==
IronPort-SDR: yYtdAPkiDQ4SILsHO3HluWV0SOgMmQfmPW+5nbU66OIMIbrUlVibSnpBqoEUSwT69RNxgFV7pi
 IBD6K8SdIkxw==
Date:   Thu, 17 Sep 2020 11:23:59 -0700
From:   Jesse Brandeburg <jesse.brandeburg@intel.com>
To:     Nitesh Narayan Lal <nitesh@redhat.com>
Cc:     <linux-kernel@vger.kernel.org>, <netdev@vger.kernel.org>,
        <linux-pci@vger.kernel.org>, <frederic@kernel.org>,
        <mtosatti@redhat.com>, <sassmann@redhat.com>,
        <jeffrey.t.kirsher@intel.com>, <jacob.e.keller@intel.com>,
        <jlelli@redhat.com>, <hch@infradead.org>, <bhelgaas@google.com>,
        <mike.marciniszyn@intel.com>, <dennis.dalessandro@intel.com>,
        <thomas.lendacky@amd.com>, <jerinj@marvell.com>,
        <mathias.nyman@intel.com>, <jiri@nvidia.com>
Subject: Re: [RFC][Patch v1 2/3] i40e: limit msix vectors based on
 housekeeping CPUs
Message-ID: <20200917112359.00006e10@intel.com>
In-Reply-To: <20200909150818.313699-3-nitesh@redhat.com>
References: <20200909150818.313699-1-nitesh@redhat.com>
        <20200909150818.313699-3-nitesh@redhat.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: 7bit
Precedence: bulk

Nitesh Narayan Lal wrote:

> In a realtime environment, it is essential to isolate unwanted IRQs from
> isolated CPUs to prevent latency overheads. Creating MSIX vectors only
> based on the online CPUs could lead to a potential issue on an RT setup
> that has several isolated CPUs but a very few housekeeping CPUs. This is
> because in these kinds of setups an attempt to move the IRQs to the
> limited housekeeping CPUs from isolated CPUs might fail due to the per
> CPU vector limit. This could eventually result in latency spikes because
> of the IRQ threads that we fail to move from isolated CPUs.
> 
> This patch prevents i40e to add vectors only based on available
> housekeeping CPUs by using num_housekeeping_cpus().
> 
> Signed-off-by: Nitesh Narayan Lal <nitesh@redhat.com>

The driver changes are straightforward, but this isn't the only driver
with this issue, right?  I'm sure ixgbe and ice both have this problem
too, you should fix them as well, at a minimum, and probably other
vendors drivers:

$ rg -c --stats num_online_cpus drivers/net/ethernet
...
50 files contained matches

for this patch i40e
Acked-by: Jesse Brandeburg <jesse.brandeburg@intel.com>