Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1755246AbbLPTPZ (ORCPT ); Wed, 16 Dec 2015 14:15:25 -0500 Received: from mx1.redhat.com ([209.132.183.28]:43656 "EHLO mx1.redhat.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1754639AbbLPTPY (ORCPT ); Wed, 16 Dec 2015 14:15:24 -0500 Message-ID: <1450293323.2674.37.camel@redhat.com> Subject: Re: [PATCH 0/5] Threaded MSI interrupt for VFIO PCI device From: Alex Williamson To: Paolo Bonzini , Yunhong Jiang Cc: kvm@vger.kernel.org, linux-kernel@vger.kernel.org Date: Wed, 16 Dec 2015 12:15:23 -0700 In-Reply-To: <5671A5DD.5060708@redhat.com> References: <1449166972-8894-1-git-send-email-yunhong.jiang@linux.intel.com> <5671A5DD.5060708@redhat.com> Content-Type: text/plain; charset="UTF-8" Mime-Version: 1.0 Content-Transfer-Encoding: 8bit Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 3174 Lines: 71 On Wed, 2015-12-16 at 18:56 +0100, Paolo Bonzini wrote: > Alex, > > can you take a look at the extension to the irq bypass interface in > patch 2?  I'm not sure I understand what is the case where you have > multiple consumers for the same token. The consumers would be, for instance, Intel PI + the threaded handler added in this series.  These run independently, the PI bypass simply makes the interrupt disappear from the host when it catches it, but if the vCPU isn't running in the right place at the time of the interrupt, it gets delivered to the host, in which case the secondary consumer implementing handle_irq() provides a lower latency injection than the eventfd path.  If PI isn't supported, only this latter consumer is registered. On the surface it seems like a reasonable solution, though having multiple consumers implementing handle_irq() seems problematic.  Do we get multiple injections if we call them all?  Should we have some way to prioritize one handler versus another?  Perhaps KVM should have a single unified consumer that can provide that sort of logic, though we still need the srcu code added here to protect against registration and irq_handler() races.  Thanks, Alex > On 03/12/2015 19:22, Yunhong Jiang wrote: > > When assigning a VFIO device to a KVM guest with low latency > > requirement, it   > > is better to handle the interrupt in the hard interrupt context, to > > reduce > > the context switch to/from the IRQ thread. > > > > Based on discussion on https://lkml.org/lkml/2015/10/26/764, the > > VFIO msi > > interrupt is changed to use request_threaded_irq(). The primary > > interrupt > > handler tries to set the guest interrupt atomically. If it fails to > > achieve > > it, a threaded interrupt handler will be invoked. > > > > The irq_bypass manager is extended for this purpose. The KVM > > eventfd will > > provide a irqbypass consumer to handle the interrupt at hard > > interrupt > > context. The producer will invoke the consumer's handler then. > > > > Yunhong Jiang (5): > >   Extract the irqfd_wakeup_pollin/irqfd_wakeup_pollup > >   Support runtime irq_bypass consumer > >   Support threaded interrupt handling on VFIO > >   Add the irq handling consumer > >   Expose x86 kvm_arch_set_irq_inatomic() > > > >  arch/x86/kvm/Kconfig              |   1 + > >  drivers/vfio/pci/vfio_pci_intrs.c |  39 ++++++++++-- > >  include/linux/irqbypass.h         |   8 +++ > >  include/linux/kvm_host.h          |  19 +++++- > >  include/linux/kvm_irqfd.h         |   1 + > >  virt/kvm/Kconfig                  |   3 + > >  virt/kvm/eventfd.c                | 131 > > ++++++++++++++++++++++++++------------ > >  virt/lib/irqbypass.c              |  82 ++++++++++++++++++------ > >  8 files changed, 214 insertions(+), 70 deletions(-) > > -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/