Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1755960Ab3HWSwp (ORCPT ); Fri, 23 Aug 2013 14:52:45 -0400 Received: from mail-ie0-f181.google.com ([209.85.223.181]:53073 "EHLO mail-ie0-f181.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1755734Ab3HWSwn (ORCPT ); Fri, 23 Aug 2013 14:52:43 -0400 Date: Fri, 23 Aug 2013 12:52:40 -0600 From: Bjorn Helgaas To: "Skidmore, Donald C" Cc: "e1000-devel@lists.sourceforge.net" , "linux-pci@vger.kernel.org" , "linux-kernel@vger.kernel.org" , Don Dutile Subject: Re: [E1000-devel] 3.11-rc4 ixgbevf: endless "Last Request of type 00 to PF Nacked" messages Message-ID: <20130823185240.GA1507@google.com> References: MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 4170 Lines: 96 On Fri, Aug 23, 2013 at 06:25:06PM +0000, Skidmore, Donald C wrote: > > -----Original Message----- > > From: Bjorn Helgaas [mailto:bhelgaas@google.com] > > Sent: Friday, August 23, 2013 9:53 AM > > To: Skidmore, Donald C > > Cc: e1000-devel@lists.sourceforge.net; linux-pci@vger.kernel.org; linux- > > kernel@vger.kernel.org; Don Dutile > > Subject: Re: [E1000-devel] 3.11-rc4 ixgbevf: endless "Last Request of type 00 > > to PF Nacked" messages > > > > On Tue, Aug 20, 2013 at 5:37 PM, Bjorn Helgaas > > wrote: > > > On Tue, Aug 20, 2013 at 5:08 PM, Bjorn Helgaas > > wrote: > > >> On Tue, Aug 13, 2013 at 8:23 PM, Bjorn Helgaas > > wrote: > > > > > >>> I played with this a little more and found this: > > >>> > > >>> 1) Magma card in z420, connected to chassis containing X540: fails > > >>> (original report) > > >>> 2) X540 in z420, Magma card in z420, connected to empty chassis: > > >>> fails > > >>> 3) X540 in z420, Magma card in z420 but no cable to chassis: works > > > > > > For what it's worth, I tried config 3 again with v3.11-rc6, and it > > > failed the same way. I haven't bothered with config 2. It's not 100% > > > reproducible, but at least it doesn't seem related to the expansion > > > chassis. > > > > > > I attached the logs from config 3 to > > > https://bugzilla.kernel.org/show_bug.cgi?id=60776 > > > > Is there anything I can do to help debug this? Add instrumentation, etc.? It > > seems like I'm doing the simplest possible thing -- just writing to the sysfs > > sriov_num_vfs file to enable VFs. > > > > I almost think it must be related to my config somehow if nobody else is > > seeing this, but at the same time, my config also seems the simplest possible, > > so I don't know what I could be doing that's unusual. > > > > Bjorn > > Hey Bjorn, > > I'm may be little confused so bear with me. > > Option 1 = (your normal set up), Magma card plugged to chasis, X540 in chasis. > Option 2 = Magma card plugged to chasis, X540 in z420 system. > Option 3 = Magma card UNplugged from chasis, x540 in z420 system. > > Options 1 & 2 - always fail > Option 3 - sometimes fails (unsure at what rate failure occurs) > > Please correct me if I messed any of that up. :) Generally correct. ?I've seen failures in all three configs, so I'm only concerned with the simplest for now (config 3, no expansion chassis). > Another question I have relates to the lspci output you supplied in the bugzilla. I'm not seeing the VF devices (i.e. 08:10.0) did you run lspci before you created the VF's? If so could we see one while the failure was occurring? That's correct, I collected the lspci output before reproducing the problem. ?I can't easily collect lspci afterwards because the machine isn't responsive after the problem starts. > Also could you download the latest ixgbevf from source forge? > > https://sourceforge.net/projects/e1000/files/ixgbevf%20stable/ > > If we add debugging messages it will be easier to patch this driver and it contains our latest validated code base. I can do that if it turns out to be necessary. ?But John Haller gave me a good clue off-list: John wrote: > I assume you want the VFs to be instantiated in a VM. To do this, > you need to blacklist the ixgbevf driver in the host (or not > compile it into the host), or it will try to associate the driver > in the host, rather than in the VM where you want it. Then, the > VM needs the ixgbevf driver, which will hopefully do a better job > of talking to the mailbox in the host. There is some work to > assign the VF(s) to the VM, but I don't remember that offhand. I don't have any VMs (I started this whole thing because I was looking at a PCI hotplug issue related to SR-IOV, so I don't really care about VMs). So the ixgbevf driver on the *host* is claiming the new VFs, and it sounds like maybe it can't handle that? Bjorn -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/