Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18;
From:   Thomas Gleixner <tglx@linutronix.de>
To:     xuyihang <xuyihang@huawei.com>, Ming Lei <ming.lei@redhat.com>
Cc:     Peter Xu <peterx@redhat.com>, Christoph Hellwig <hch@lst.de>,
        Jason Wang <jasowang@redhat.com>,
        Luiz Capitulino <lcapitulino@redhat.com>,
        Linux Kernel Mailing List <linux-kernel@vger.kernel.org>,
        "Michael S. Tsirkin" <mst@redhat.com>, minlei@redhat.com,
        liaochang1@huawei.com
Subject: Re: Virtio-scsi multiqueue irq affinity
In-Reply-To: <0f6c8a5f-ad33-1199-f313-53fe9187a672@huawei.com>
References: <20190318062150.GC6654@xz-x1> <alpine.DEB.2.21.1903231805310.1798@nanos.tec.linutronix.de> <20190325050213.GH9149@xz-x1> <20190325070616.GA9642@ming.t460p> <alpine.DEB.2.21.1903250948490.1798@nanos.tec.linutronix.de> <20190325095011.GA23225@ming.t460p> <0f6c8a5f-ad33-1199-f313-53fe9187a672@huawei.com>
Date:   Sat, 08 May 2021 14:26:35 +0200
Message-ID: <87zgx5l8ck.ffs@nanos.tec.linutronix.de>
MIME-Version: 1.0
Content-Type: text/plain
Precedence: bulk

Yihang,

On Sat, May 08 2021 at 15:52, xuyihang wrote:
>
> We are dealing with a scenario which may need to assign a default 
> irqaffinity for managed IRQ.
> 
> Assume we have a full CPU usage RT thread running binded to a specific
> CPU.
>
> In the mean while, interrupt handler registered by a device which is
> ksoftirqd may never have a chance to run. (And we don't want to use
> isolate CPU)

A device cannot register and interrupt handler in ksoftirqd.

> There could be a couple way to deal with this problem:
>
> 1. Adjust priority of ksoftirqd or RT thread, so the interrupt handler 
> could preempt
>
> RT thread. However, I am not sure whether it could have some side 
> effects or not.
>
> 2. Adjust interrupt CPU affinity or RT thread affinity. But managed IRQ 
> seems design to forbid user from manipulating interrupt affinity.
>
> It seems managed IRQ is coupled with user side application to me.
>
> Would you share your thoughts about this issue please?

Can you please provide a more detailed description of your system?

    - Number of CPUs

    - Kernel version
    - Is NOHZ full enabled?
    - Any isolation mechanisms enabled, and if so how are they
      configured (e.g. on the kernel command line)?

    - Number of queues in the multiqueue device
          
    - Is the RT thread issuing I/O to the multiqueue device?

Thanks,

        tglx