Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18;
From:   Thomas Gleixner <tglx@linutronix.de>
To:     Liu Chao <liuchao173@huawei.com>, linux-kernel@vger.kernel.org
Cc:     hushiyuan@huawei.com, hewenliang4@huawei.com,
        Ming Lei <ming.lei@redhat.com>, Marc Zyngier <maz@kernel.org>
Subject: Re: [PATCH] genirq: Limit irq_calc_affinity_vectors to housekeeping CPUs
In-Reply-To: <20210122084746.3407372-1-liuchao173@huawei.com>
References: <20210122084746.3407372-1-liuchao173@huawei.com>
Date:   Thu, 28 Jan 2021 01:06:20 +0100
Message-ID: <87ft2mdiwz.fsf@nanos.tec.linutronix.de>
MIME-Version: 1.0
Content-Type: text/plain
Precedence: bulk

Liu,

On Fri, Jan 22 2021 at 08:47, Liu Chao wrote:
> Replace the cpumask used in irq_calc_affinity_vectors from all possible
> CPUs to only housekeeping CPUs.
>
> When we have isolated CPUs used by real-time tasks, IRQs will be move to
> housekeeping CPUs.

No.

> If there are too many IRQ vectors, moving the all to housekeeping CPUs may
> exceed per-CPU vector limits. For example, when I only have two
> housekeeping CPUs, there are dozens of IRQs on two CPUs, but actually one
> IRQ per housekeeping CPU is enough.

This does not make any sense.

Assumed a system has 256 possible CPUs and the device allows 256 queues
then each possible CPU will have ONE queue and ONE associated
interrupt. Nothing will change the affinity of any of those interrupts
ever.

The only way how the housekeeping mask interacts with multiqueue
affinities is when there are less queues and therefore less interrupts
than CPUs which means that one queue and it's interrupt is associated to
multiple CPUs. So the resulting affinity mask might spawn housekeeping
and isolated CPUs. When the affinity is set up for the interrupt in
hardware then the selection logic which choses a target CPU based on the
interrupt affinity mask will prefer the housekeeping CPUs and avoid the
isolated ones. But that does not cause vector exhaustion except you have
more devices than vectors.

So for a single multiqueue device a housekeeping CPU will not have more
than one managed queue interrupt ever.

I'm not understanding which problem are you trying to solve.

Thanks,

        tglx