Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1754685AbYKHPiU (ORCPT ); Sat, 8 Nov 2008 10:38:20 -0500 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1753518AbYKHPiF (ORCPT ); Sat, 8 Nov 2008 10:38:05 -0500 Received: from mx.neterion.com ([72.1.205.142]:37275 "EHLO owa.neterion.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1753358AbYKHPiD convert rfc822-to-8bit (ORCPT ); Sat, 8 Nov 2008 10:38:03 -0500 X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 8BIT Subject: RE: [PATCH 0/16 v6] PCI: Linux kernel SR-IOV support Date: Sat, 8 Nov 2008 10:37:54 -0500 Message-ID: <78C9135A3D2ECE4B8162EBDCE82CAD77048C24C0@nekter> In-Reply-To: <0199E0D51A61344794750DC57738F58E5E26FF3237@GVW1118EXC.americas.hpqcorp.net> X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: [PATCH 0/16 v6] PCI: Linux kernel SR-IOV support Thread-Index: AclBFTb7qUtEL2p/QLi7p8D7C8ssfAAei3ywAAk7nSA= References: <20081106154351.GA30459@kroah.com> <894107.30288.qm@web45108.mail.sp1.yahoo.com> <20081106164919.GA4099@kroah.com> <0199E0D51A61344794750DC57738F58E5E26F996C4@GVW1118EXC.americas.hpqcorp.net> <20081106183630.GD11773@parisc-linux.org> <491371F0.7020805@codemonkey.ws> <20081106225854.GA15439@parisc-linux.org> <20081107061952.GF3860@kroah.com> <49145C14.1050409@uniscape.net> <20081107184825.GB2320@kroah.com> <0199E0D51A61344794750DC57738F58E5E26FF3237@GVW1118EXC.americas.hpqcorp.net> From: "Leonid Grossman" To: "Fischer, Anna" , "Greg KH" , "Yu Zhao" Cc: "Matthew Wilcox" , "Anthony Liguori" , "H L" , , , "Chiang, Alexander" , , , , , , , , , , , Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 2776 Lines: 70 > -----Original Message----- > From: Fischer, Anna [mailto:anna.fischer@hp.com] > Sent: Saturday, November 08, 2008 3:10 AM > To: Greg KH; Yu Zhao > Cc: Matthew Wilcox; Anthony Liguori; H L; randy.dunlap@oracle.com; > grundler@parisc-linux.org; Chiang, Alexander; linux-pci@vger.kernel.org; > rdreier@cisco.com; linux-kernel@vger.kernel.org; jbarnes@virtuousgeek.org; > virtualization@lists.linux-foundation.org; kvm@vger.kernel.org; > mingo@elte.hu; keir.fraser@eu.citrix.com; Leonid Grossman; > eddie.dong@intel.com; jun.nakajima@intel.com; avi@redhat.com > Subject: RE: [PATCH 0/16 v6] PCI: Linux kernel SR-IOV support > > > But would such an api really take advantage of the new IOV interfaces > > that are exposed by the new device type? > > I agree with what Yu says. The idea is to have hardware capabilities to > virtualize a PCI device in a way that those virtual devices can represent > full PCI devices. The advantage of that is that those virtual device can > then be used like any other standard PCI device, meaning we can use > existing > OS tools, configuration mechanism etc. to start working with them. Also, > when > using a virtualization-based system, e.g. Xen or KVM, we do not need > to introduce new mechanisms to make use of SR-IOV, because we can handle > VFs as full PCI devices. > > A virtual PCI device in hardware (a VF) can be as powerful or complex as > you like, or it can be very simple. But the big advantage of SR-IOV is > that hardware presents a complete PCI device to the OS - as opposed to > some resources, or queues, that need specific new configuration and > assignment mechanisms in order to use them with a guest OS (like, for > example, VMDq or similar technologies). > > Anna Ditto. Taking netdev interface as an example - a queue pair is a great way to scale across cpu cores in a single OS image, but it is just not a good way to share device across multiple OS images. The best unit of virtualization is a VF that is implemented as a complete netdev pci device (not a subset of a pci device). This way, native netdev device drivers can work for direct hw access to a VF "as is", and most/all Linux networking features (including VMQ) will work in a guest. Also, guest migration for netdev interfaces (both direct and virtual) can be supported via native Linux mechanism (bonding driver), while Dom0 can retain "veto power" over any guest direct interface operation it deems privileged (vlan, mac address, promisc mode, bandwidth allocation between VFs, etc.). Leonid -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/