Received: by 2002:a25:d7c1:0:0:0:0:0 with SMTP id o184csp4016228ybg; Fri, 25 Oct 2019 12:08:11 -0700 (PDT) X-Google-Smtp-Source: APXvYqx5whTAjd78yT7d4OKpY/Np1p02CrI5tMIFISrkbQ3jF6WWslGKK6AX3Dvdko5wzDpyTrp0 X-Received: by 2002:a17:906:5004:: with SMTP id s4mr5106293ejj.26.1572030491453; Fri, 25 Oct 2019 12:08:11 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1572030491; cv=none; d=google.com; s=arc-20160816; b=RWKc0a2muESbgyr8EBzOTZEWyRDEHCV2AxFm3Y5uE6xYkI15MBY5yPu+wsYo95abEd O9oE1vu0H8eQ2OTVRAKhqDOo9ipXKulu95NulLNEiPe0hd6gmMvj0U3FX5lczSqqQeMI 6pp3oBBpLqiUQq0GrmeoUqmupR8xBxp+DTQOt+PB2VU1Zk6HtnfRq04HFXIly9e5QgKz er4yy1G3VKDsuFzjZNLariR+WBx8Qhy0C5ru+rfJ4Y5vauMO2uvCtT5WcZLEiUvxu3cO 7IWoa+yfxzB0GotIUtKJeL0E3vsGJLax1SoCFKVlDh6zUyovoWpdJn89po0WIGLZO2v7 +48g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-transfer-encoding:content-disposition:mime-version :references:message-id:subject:cc:to:from:date; bh=Yobvz9/sObGXAPlPpS4GlsSXeVMjy/yespdB9lPMODY=; b=vCbVfgF8mlSRulSh34waBSms2LSPV4+LokAPCgHP2eu9+UsaPH/1vEHpvPMofaLSux kljYRqTWsNTANOJ9G3e5/kmEB9j8phSM220JrPeaM2xyaGtcEemniAeT54pcV/Kf0wvO oQm6htW75pe7g+NY8Xf54/jAg3iTjyzkjX0sBmIoKKLABwA/a978zkJN5p653RAJROZg nTGpM/jC2kLDsfizDb3EBCPFctObUcJlOkuAHwgfxKvI2tJgk/B7sDhGMYGVY3rqeHmT 9dtETYHgcg8gdCTm0K4gh0XE+vByouSFfr6rcDBL7eNpr9nKrrk1tgzHv1e9Q3+8JoCh e+sQ== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id f4si1814874ejc.218.2019.10.25.12.07.47; Fri, 25 Oct 2019 12:08:11 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728341AbfJXUm6 convert rfc822-to-8bit (ORCPT + 99 others); Thu, 24 Oct 2019 16:42:58 -0400 Received: from mx2.suse.de ([195.135.220.15]:33084 "EHLO mx1.suse.de" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1727008AbfJXUm5 (ORCPT ); Thu, 24 Oct 2019 16:42:57 -0400 X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay2.suse.de (unknown [195.135.220.254]) by mx1.suse.de (Postfix) with ESMTP id C1246AD7B; Thu, 24 Oct 2019 20:42:55 +0000 (UTC) Date: Thu, 24 Oct 2019 13:41:34 -0700 From: Davidlohr Bueso To: Vinicius Costa Gomes Cc: netdev@vger.kernel.org, linux-kernel@vger.kernel.org Subject: Re: WARNING: at net/sched/sch_generic.c:448 Message-ID: <20191024204134.egc5mdtz2o2tsxyz@linux-p48b> References: <20191024032105.xmewznsphltnrido@linux-p48b> <87mudpylcc.fsf@linux.intel.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline Content-Transfer-Encoding: 8BIT In-Reply-To: <87mudpylcc.fsf@linux.intel.com> User-Agent: NeoMutt/20180716 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, 24 Oct 2019, Vinicius Costa Gomes wrote: >Hi, > >Davidlohr Bueso writes: > >> Hi, >> >> I'm hitting the following in linux-next, and as far back as v5.2, ring any bells? >> >> [ 478.588144] NETDEV WATCHDOG: eth0 (igb): transmit queue 0 timed out >> [ 478.601994] WARNING: CPU: 10 PID: 74 at net/sched/sch_generic.c:448 dev_watchdog+0x253/0x260 >> [ 478.620613] Modules linked in: ebtable_filter(E) ebtables(E) ip6table_filter(E) ip6_tables(E) iptable_filter(E) ip_tables(E) x_tables(E) bpfilter(E) scsi_transport_iscsi(E) af_packet(E) iscsi_ibft(E) iscsi_boot_sysfs(E) ext4(E) intel_rapl_msr(E) intel_rapl_common(E) crc16(E) mbcache(E) jbd2(E) sb_edac(E) x86_pkg_temp_thermal(E) intel_powerclamp(E) coretemp(E) kvm_intel(E) kvm(E) irqbypass(E) crc32_pclmul(E) iTCO_wdt(E) ghash_clmulni_intel(E) iTCO_vendor_support(E) aesni_intel(E) crypto_simd(E) cryptd(E) glue_helper(E) ipmi_si(E) igb(E) ioatdma(E) pcspkr(E) ipmi_devintf(E) mei_me(E) lpc_ich(E) mfd_core(E) ipmi_msghandler(E) joydev(E) i2c_i801(E) mei(E) dca(E) button(E) btrfs(E) libcrc32c(E) xor(E) raid6_pq(E) hid_generic(E) usbhid(E) sd_mod(E) mgag200(E) drm_kms_helper(E) syscopyarea(E) sysfillrect(E) sysimgblt(E) fb_sys_fops(E) i2c_algo_bit(E) isci(E) ehci_pci(E) drm_vram_helper(E) ahci(E) ehci_hcd(E) libsas(E) crc32c_intel(E) ttm(E) libahci(E) scsi_transport_sas(E) drm(E) usbcore(E) >> [ 478.620658] libata(E) wmi(E) sg(E) dm_multipath(E) dm_mod(E) scsi_dh_rdac(E) scsi_dh_emc(E) scsi_dh_alua(E) scsi_mod(E) >> [ 478.837008] CPU: 10 PID: 74 Comm: ksoftirqd/10 Kdump: loaded Tainted: G E 5.4.0-rc4-2-default+ #2 >> [ 478.859457] Hardware name: Intel Corporation LH Pass/SVRBD-ROW_P, BIOS SE5C600.86B.02.01.SP04.112220131546 11/22/2013 >> [ 478.882867] RIP: 0010:dev_watchdog+0x253/0x260 > >Not ringing any bells, but if this timeout is happening, you should also >be seeing some igb "TX Hang" warnings. Usually this warning happens when >some packet is stuck (for whatever reason) in the transmission queue. I am not seeing any TX hang warnings, only the workqueue lockup message (igb_watchdog_task). > >Can you share more details about what you are running? specially the >kind of configuration (if any) you are doing to the controller. I am able to trigger this a few seconds into running pi_stress (from rt-tests, quite a non network workload). But this is not the only one. I'm going through some logs to see what other test is triggering it. Also, no tweaking whatsoever to the controller. Thanks, Davidlohr