2019-10-02 21:55:11

by Ben Greear

Subject: AX200 crash on udp upload, cannot restart

We have a system with several of the AX200 NICs in it, kernel is 5.2.14+. We ran a udp upload
test of 10Mbps across all radios, and after about 10 minutes one of the radios crashed and could
not be restarted. The others continued to run so far.

I will open a bug in the kernel bug tracker.

iwlwifi 0000:10:00.0: Microcode SW error detected. Restarting 0x0.
iwlwifi 0000:10:00.0: Start IWL Error Log Dump:
iwlwifi 0000:10:00.0: Status: 0x00000080, count: 6
iwlwifi 0000:10:00.0: Loaded firmware version: 48.4fa0041f.0
iwlwifi 0000:10:00.0: 0x00000942 | ADVANCED_SYSASSERT
iwlwifi 0000:10:00.0: 0x00A0A210 | trm_hw_status0
iwlwifi 0000:10:00.0: 0x00000000 | trm_hw_status1
iwlwifi 0000:10:00.0: 0x004F8E3C | branchlink2
iwlwifi 0000:10:00.0: 0x00000E26 | interruptlink1
iwlwifi 0000:10:00.0: 0x00000E26 | interruptlink2
iwlwifi 0000:10:00.0: 0xFFE2FFEF | data1
iwlwifi 0000:10:00.0: 0x6A010200 | data2
iwlwifi 0000:10:00.0: 0x040C0605 | data3
iwlwifi 0000:10:00.0: 0xE90146BA | beacon time
iwlwifi 0000:10:00.0: 0x0A57190F | tsf low
iwlwifi 0000:10:00.0: 0x00000001 | tsf hi
iwlwifi 0000:10:00.0: 0x00000000 | time gp1
iwlwifi 0000:10:00.0: 0x129412C7 | time gp2
iwlwifi 0000:10:00.0: 0x00000001 | uCode revision type
iwlwifi 0000:10:00.0: 0x00000030 | uCode version major
iwlwifi 0000:10:00.0: 0x4FA0041F | uCode version minor
iwlwifi 0000:10:00.0: 0x00000340 | hw version
iwlwifi 0000:10:00.0: 0x00C89000 | board version
iwlwifi 0000:10:00.0: 0x80B2FD06 | hcmd
iwlwifi 0000:10:00.0: 0xE6821000 | isr0
iwlwifi 0000:10:00.0: 0x00440000 | isr1
iwlwifi 0000:10:00.0: 0x08F00102 | isr2
iwlwifi 0000:10:00.0: 0x04C187CD | isr3
iwlwifi 0000:10:00.0: 0x00000000 | isr4
iwlwifi 0000:10:00.0: 0x03AC001C | last cmd Id
iwlwifi 0000:10:00.0: 0x004EB8B4 | wait_event
iwlwifi 0000:10:00.0: 0x000000B4 | l2p_control
iwlwifi 0000:10:00.0: 0x00010014 | l2p_duration
iwlwifi 0000:10:00.0: 0x0000000F | l2p_mhvalid
iwlwifi 0000:10:00.0: 0x00000000 | l2p_addr_match
iwlwifi 0000:10:00.0: 0x00000009 | lmpm_pmg_sel
iwlwifi 0000:10:00.0: 0x00000000 | timestamp
iwlwifi 0000:10:00.0: 0x0000307C | flow_handler
iwlwifi 0000:10:00.0: Start IWL Error Log Dump:
iwlwifi 0000:10:00.0: Status: 0x00000080, count: 7
iwlwifi 0000:10:00.0: 0x20000070 | NMI_INTERRUPT_LMAC_FATAL
iwlwifi 0000:10:00.0: 0x00000000 | umac branchlink1
iwlwifi 0000:10:00.0: 0xC008CC3C | umac branchlink2
iwlwifi 0000:10:00.0: 0x8048D0E6 | umac interruptlink1
iwlwifi 0000:10:00.0: 0x8048D0E6 | umac interruptlink2
iwlwifi 0000:10:00.0: 0x00000400 | umac data1
iwlwifi 0000:10:00.0: 0x8048D0E6 | umac data2
iwlwifi 0000:10:00.0: 0x00000000 | umac data3
iwlwifi 0000:10:00.0: 0x00000030 | umac major
iwlwifi 0000:10:00.0: 0x4FA0041F | umac minor
iwlwifi 0000:10:00.0: 0x129412D8 | frame pointer
iwlwifi 0000:10:00.0: 0xC0886284 | stack pointer
iwlwifi 0000:10:00.0: 0x004E019C | last host cmd
iwlwifi 0000:10:00.0: 0x00000000 | isr status reg
iwlwifi 0000:10:00.0: Fseq Registers:
iwlwifi 0000:10:00.0: 0xE0000000 | FSEQ_ERROR_CODE
iwlwifi 0000:10:00.0: 0x80290001 | FSEQ_TOP_INIT_VERSION
iwlwifi 0000:10:00.0: 0x80050008 | FSEQ_CNVIO_INIT_VERSION
iwlwifi 0000:10:00.0: 0x0000A503 | FSEQ_OTP_VERSION
iwlwifi 0000:10:00.0: 0x80000003 | FSEQ_TOP_CONTENT_VERSION
iwlwifi 0000:10:00.0: 0x4552414E | FSEQ_ALIVE_TOKEN
iwlwifi 0000:10:00.0: 0x00100530 | FSEQ_CNVI_ID
iwlwifi 0000:10:00.0: 0x00000532 | FSEQ_CNVR_ID
iwlwifi 0000:10:00.0: 0x00100530 | CNVI_AUX_MISC_CHIP
iwlwifi 0000:10:00.0: 0x00000532 | CNVR_AUX_MISC_CHIP
iwlwifi 0000:10:00.0: 0x05B0905B | CNVR_SCU_SD_REGS_SD_REG_DIG_DCDC_VTRIM
iwlwifi 0000:10:00.0: 0x0000025B | CNVR_SCU_SD_REGS_SD_REG_ACTIVE_VDIG_MIRROR
iwlwifi 0000:10:00.0: Microcode SW error detected. Restarting 0x0.
iwlwifi 0000:10:00.0: Start IWL Error Log Dump:
iwlwifi 0000:10:00.0: Status: 0x00000080, count: 6
iwlwifi 0000:10:00.0: Loaded firmware version: 48.4fa0041f.0
iwlwifi 0000:10:00.0: 0x00000942 | ADVANCED_SYSASSERT
iwlwifi 0000:10:00.0: 0x00A0A210 | trm_hw_status0
iwlwifi 0000:10:00.0: 0x00000000 | trm_hw_status1
iwlwifi 0000:10:00.0: 0x004F8E3C | branchlink2
iwlwifi 0000:10:00.0: 0x00000E26 | interruptlink1
iwlwifi 0000:10:00.0: 0x00000E26 | interruptlink2
iwlwifi 0000:10:00.0: 0xFFB1FFC7 | data1
iwlwifi 0000:10:00.0: 0x6A000200 | data2
iwlwifi 0000:10:00.0: 0x040C0605 | data3
iwlwifi 0000:10:00.0: 0x00C0ED90 | beacon time
iwlwifi 0000:10:00.0: 0xF7C97272 | tsf low
iwlwifi 0000:10:00.0: 0x00000001 | tsf hi
iwlwifi 0000:10:00.0: 0x00000000 | time gp1
iwlwifi 0000:10:00.0: 0x00066C5B | time gp2
iwlwifi 0000:10:00.0: 0x00000001 | uCode revision type
iwlwifi 0000:10:00.0: 0x00000030 | uCode version major
iwlwifi 0000:10:00.0: 0x4FA0041F | uCode version minor
iwlwifi 0000:10:00.0: 0x00000340 | hw version
iwlwifi 0000:10:00.0: 0x00C89000 | board version
iwlwifi 0000:10:00.0: 0x801FFD06 | hcmd
iwlwifi 0000:10:00.0: 0xE68A9000 | isr0
iwlwifi 0000:10:00.0: 0x00440000 | isr1
iwlwifi 0000:10:00.0: 0x08F00002 | isr2
iwlwifi 0000:10:00.0: 0x00C1F00C | isr3
iwlwifi 0000:10:00.0: 0x00000000 | isr4
iwlwifi 0000:10:00.0: 0x02A2001C | last cmd Id
iwlwifi 0000:10:00.0: 0x004EB8B4 | wait_event
iwlwifi 0000:10:00.0: 0x000000D4 | l2p_control
iwlwifi 0000:10:00.0: 0x00010014 | l2p_duration
iwlwifi 0000:10:00.0: 0x00000007 | l2p_mhvalid
iwlwifi 0000:10:00.0: 0x00000000 | l2p_addr_match
iwlwifi 0000:10:00.0: 0x00000009 | lmpm_pmg_sel
iwlwifi 0000:10:00.0: 0x00000000 | timestamp
iwlwifi 0000:10:00.0: 0x000068B8 | flow_handler
iwlwifi 0000:10:00.0: Start IWL Error Log Dump:
iwlwifi 0000:10:00.0: Status: 0x00000080, count: 7
iwlwifi 0000:10:00.0: 0x20000070 | NMI_INTERRUPT_LMAC_FATAL
iwlwifi 0000:10:00.0: 0x00000000 | umac branchlink1
iwlwifi 0000:10:00.0: 0xC008CC3C | umac branchlink2
iwlwifi 0000:10:00.0: 0x8048D0E6 | umac interruptlink1
iwlwifi 0000:10:00.0: 0x8048D0E6 | umac interruptlink2
iwlwifi 0000:10:00.0: 0x00000400 | umac data1
iwlwifi 0000:10:00.0: 0x8048D0E6 | umac data2
iwlwifi 0000:10:00.0: 0x00000000 | umac data3
iwlwifi 0000:10:00.0: 0x00000030 | umac major
iwlwifi 0000:10:00.0: 0x4FA0041F | umac minor
iwlwifi 0000:10:00.0: 0x00066C6B | frame pointer
iwlwifi 0000:10:00.0: 0xC0886284 | stack pointer
iwlwifi 0000:10:00.0: 0x0036010C | last host cmd
iwlwifi 0000:10:00.0: 0x00000000 | isr status reg
iwlwifi 0000:10:00.0: Fseq Registers:
iwlwifi 0000:10:00.0: 0xE0000000 | FSEQ_ERROR_CODE
iwlwifi 0000:10:00.0: 0x80290001 | FSEQ_TOP_INIT_VERSION
iwlwifi 0000:10:00.0: 0x80050008 | FSEQ_CNVIO_INIT_VERSION
iwlwifi 0000:10:00.0: 0x0000A503 | FSEQ_OTP_VERSION
iwlwifi 0000:10:00.0: 0x80000003 | FSEQ_TOP_CONTENT_VERSION
iwlwifi 0000:10:00.0: 0x4552414E | FSEQ_ALIVE_TOKEN
iwlwifi 0000:10:00.0: 0x00100530 | FSEQ_CNVI_ID
iwlwifi 0000:10:00.0: 0x00000532 | FSEQ_CNVR_ID
iwlwifi 0000:10:00.0: 0x00100530 | CNVI_AUX_MISC_CHIP
iwlwifi 0000:10:00.0: 0x00000532 | CNVR_AUX_MISC_CHIP
iwlwifi 0000:10:00.0: 0x05B0905B | CNVR_SCU_SD_REGS_SD_REG_DIG_DCDC_VTRIM
iwlwifi 0000:10:00.0: 0x0000025B | CNVR_SCU_SD_REGS_SD_REG_ACTIVE_VDIG_MIRROR
iwlwifi 0000:08:00.0: Microcode SW error detected. Restarting 0x0.
iwlwifi 0000:08:00.0: Start IWL Error Log Dump:
iwlwifi 0000:08:00.0: Status: 0x00000080, count: 6
iwlwifi 0000:08:00.0: Loaded firmware version: 48.4fa0041f.0
iwlwifi 0000:08:00.0: 0x00000942 | ADVANCED_SYSASSERT
iwlwifi 0000:08:00.0: 0x00A0A210 | trm_hw_status0
iwlwifi 0000:08:00.0: 0x00000000 | trm_hw_status1
iwlwifi 0000:08:00.0: 0x004F8E3C | branchlink2
iwlwifi 0000:08:00.0: 0x00000E26 | interruptlink1
iwlwifi 0000:08:00.0: 0x00000E26 | interruptlink2
iwlwifi 0000:08:00.0: 0xFFD5FFE2 | data1
iwlwifi 0000:08:00.0: 0x6A010201 | data2
iwlwifi 0000:08:00.0: 0x040C0605 | data3
iwlwifi 0000:08:00.0: 0x57007D73 | beacon time
iwlwifi 0000:08:00.0: 0x0CBF8256 | tsf low
iwlwifi 0000:08:00.0: 0x00000001 | tsf hi
iwlwifi 0000:08:00.0: 0x00000000 | time gp1
iwlwifi 0000:08:00.0: 0x1505FF93 | time gp2
iwlwifi 0000:08:00.0: 0x00000001 | uCode revision type
iwlwifi 0000:08:00.0: 0x00000030 | uCode version major
iwlwifi 0000:08:00.0: 0x4FA0041F | uCode version minor
iwlwifi 0000:08:00.0: 0x00000340 | hw version
iwlwifi 0000:08:00.0: 0x00C89000 | board version
iwlwifi 0000:08:00.0: 0x804CFD06 | hcmd
iwlwifi 0000:08:00.0: 0xE6821000 | isr0
iwlwifi 0000:08:00.0: 0x00440000 | isr1
iwlwifi 0000:08:00.0: 0x08F00102 | isr2
iwlwifi 0000:08:00.0: 0x04C19A5D | isr3
iwlwifi 0000:08:00.0: 0x00000000 | isr4
iwlwifi 0000:08:00.0: 0x03CA001C | last cmd Id
iwlwifi 0000:08:00.0: 0x004EB8B4 | wait_event
iwlwifi 0000:08:00.0: 0x00000000 | l2p_control
iwlwifi 0000:08:00.0: 0x00010014 | l2p_duration
iwlwifi 0000:08:00.0: 0x00000000 | l2p_mhvalid
iwlwifi 0000:08:00.0: 0x00000000 | l2p_addr_match
iwlwifi 0000:08:00.0: 0x00000009 | lmpm_pmg_sel
iwlwifi 0000:08:00.0: 0x00000000 | timestamp
iwlwifi 0000:08:00.0: 0x00004090 | flow_handler
iwlwifi 0000:08:00.0: Start IWL Error Log Dump:
iwlwifi 0000:08:00.0: Status: 0x00000080, count: 7
iwlwifi 0000:08:00.0: 0x20000070 | NMI_INTERRUPT_LMAC_FATAL
iwlwifi 0000:08:00.0: 0x00000000 | umac branchlink1
iwlwifi 0000:08:00.0: 0xC008CC3C | umac branchlink2
iwlwifi 0000:08:00.0: 0x8048D0E6 | umac interruptlink1
iwlwifi 0000:08:00.0: 0x8048D0E6 | umac interruptlink2
iwlwifi 0000:08:00.0: 0x00000400 | umac data1
iwlwifi 0000:08:00.0: 0x8048D0E6 | umac data2
iwlwifi 0000:08:00.0: 0x00000000 | umac data3
iwlwifi 0000:08:00.0: 0x00000030 | umac major
iwlwifi 0000:08:00.0: 0x4FA0041F | umac minor
iwlwifi 0000:08:00.0: 0x1505FFA3 | frame pointer
iwlwifi 0000:08:00.0: 0xC0886284 | stack pointer
iwlwifi 0000:08:00.0: 0x00F0019C | last host cmd
iwlwifi 0000:08:00.0: 0x00000000 | isr status reg
iwlwifi 0000:08:00.0: Fseq Registers:
iwlwifi 0000:08:00.0: 0xE0000000 | FSEQ_ERROR_CODE
iwlwifi 0000:08:00.0: 0x80290001 | FSEQ_TOP_INIT_VERSION
iwlwifi 0000:08:00.0: 0x80050008 | FSEQ_CNVIO_INIT_VERSION
iwlwifi 0000:08:00.0: 0x0000A503 | FSEQ_OTP_VERSION
iwlwifi 0000:08:00.0: 0x80000003 | FSEQ_TOP_CONTENT_VERSION
iwlwifi 0000:08:00.0: 0x4552414E | FSEQ_ALIVE_TOKEN
iwlwifi 0000:08:00.0: 0x00100530 | FSEQ_CNVI_ID
iwlwifi 0000:08:00.0: 0x00000532 | FSEQ_CNVR_ID
iwlwifi 0000:08:00.0: 0x00100530 | CNVI_AUX_MISC_CHIP
iwlwifi 0000:08:00.0: 0x00000532 | CNVR_AUX_MISC_CHIP
iwlwifi 0000:08:00.0: 0x05B0905B | CNVR_SCU_SD_REGS_SD_REG_DIG_DCDC_VTRIM
iwlwifi 0000:08:00.0: 0x0000025B | CNVR_SCU_SD_REGS_SD_REG_ACTIVE_VDIG_MIRROR
iwlwifi 0000:08:00.0: Microcode SW error detected. Restarting 0x0.
iwlwifi 0000:08:00.0: Start IWL Error Log Dump:
iwlwifi 0000:08:00.0: Status: 0x00000090, count: 6
iwlwifi 0000:08:00.0: Loaded firmware version: 48.4fa0041f.0
iwlwifi 0000:08:00.0: 0x00000942 | ADVANCED_SYSASSERT
iwlwifi 0000:08:00.0: 0x0000A2F0 | trm_hw_status0
iwlwifi 0000:08:00.0: 0x00000000 | trm_hw_status1
iwlwifi 0000:08:00.0: 0x004F8E3C | branchlink2
iwlwifi 0000:08:00.0: 0x00000E26 | interruptlink1
iwlwifi 0000:08:00.0: 0x00000E26 | interruptlink2
iwlwifi 0000:08:00.0: 0xFFDCFFF0 | data1
iwlwifi 0000:08:00.0: 0x70000300 | data2
iwlwifi 0000:08:00.0: 0x010C0605 | data3
iwlwifi 0000:08:00.0: 0x00000000 | beacon time
iwlwifi 0000:08:00.0: 0x0001ABEA | tsf low
iwlwifi 0000:08:00.0: 0x00000000 | tsf hi
iwlwifi 0000:08:00.0: 0x00000000 | time gp1
iwlwifi 0000:08:00.0: 0x00020DDE | time gp2
iwlwifi 0000:08:00.0: 0x00000001 | uCode revision type
iwlwifi 0000:08:00.0: 0x00000030 | uCode version major
iwlwifi 0000:08:00.0: 0x4FA0041F | uCode version minor
iwlwifi 0000:08:00.0: 0x00000340 | hw version
iwlwifi 0000:08:00.0: 0x00C89000 | board version
iwlwifi 0000:08:00.0: 0x8011FD0C | hcmd
iwlwifi 0000:08:00.0: 0xE29A1000 | isr0
iwlwifi 0000:08:00.0: 0x00000000 | isr1
iwlwifi 0000:08:00.0: 0x08F80002 | isr2
iwlwifi 0000:08:00.0: 0x04C0001C | isr3
iwlwifi 0000:08:00.0: 0x00000000 | isr4
iwlwifi 0000:08:00.0: 0x00000000 | last cmd Id
iwlwifi 0000:08:00.0: 0x0001503E | wait_event
iwlwifi 0000:08:00.0: 0x00000000 | l2p_control
iwlwifi 0000:08:00.0: 0x00000000 | l2p_duration
iwlwifi 0000:08:00.0: 0x00000000 | l2p_mhvalid
iwlwifi 0000:08:00.0: 0x00000000 | l2p_addr_match
iwlwifi 0000:08:00.0: 0x00000009 | lmpm_pmg_sel
iwlwifi 0000:08:00.0: 0x00000000 | timestamp
iwlwifi 0000:08:00.0: 0x00000020 | flow_handler
iwlwifi 0000:08:00.0: Start IWL Error Log Dump:
iwlwifi 0000:08:00.0: Status: 0x00000090, count: 7
iwlwifi 0000:08:00.0: 0x20000070 | NMI_INTERRUPT_LMAC_FATAL
iwlwifi 0000:08:00.0: 0x00000000 | umac branchlink1
iwlwifi 0000:08:00.0: 0xC008CC3C | umac branchlink2
iwlwifi 0000:08:00.0: 0x8048D0E6 | umac interruptlink1
iwlwifi 0000:08:00.0: 0x8048D0E6 | umac interruptlink2
iwlwifi 0000:08:00.0: 0x00000400 | umac data1
iwlwifi 0000:08:00.0: 0x8048D0E6 | umac data2
iwlwifi 0000:08:00.0: 0x00000000 | umac data3
iwlwifi 0000:08:00.0: 0x00000030 | umac major
iwlwifi 0000:08:00.0: 0x4FA0041F | umac minor
iwlwifi 0000:08:00.0: 0x00020DF0 | frame pointer
iwlwifi 0000:08:00.0: 0xC0886284 | stack pointer
iwlwifi 0000:08:00.0: 0x00010C00 | last host cmd
iwlwifi 0000:08:00.0: 0x00000000 | isr status reg
iwlwifi 0000:08:00.0: Fseq Registers:
iwlwifi 0000:08:00.0: 0xE0000000 | FSEQ_ERROR_CODE
iwlwifi 0000:08:00.0: 0x80290001 | FSEQ_TOP_INIT_VERSION
iwlwifi 0000:08:00.0: 0x80050008 | FSEQ_CNVIO_INIT_VERSION
iwlwifi 0000:08:00.0: 0x0000A503 | FSEQ_OTP_VERSION
iwlwifi 0000:08:00.0: 0x80000003 | FSEQ_TOP_CONTENT_VERSION
iwlwifi 0000:08:00.0: 0x4552414E | FSEQ_ALIVE_TOKEN
iwlwifi 0000:08:00.0: 0x00100530 | FSEQ_CNVI_ID
iwlwifi 0000:08:00.0: 0x00000532 | FSEQ_CNVR_ID
iwlwifi 0000:08:00.0: 0x00100530 | CNVI_AUX_MISC_CHIP
iwlwifi 0000:08:00.0: 0x00000532 | CNVR_AUX_MISC_CHIP
iwlwifi 0000:08:00.0: 0x05B0905B | CNVR_SCU_SD_REGS_SD_REG_DIG_DCDC_VTRIM
iwlwifi 0000:08:00.0: 0x0000025B | CNVR_SCU_SD_REGS_SD_REG_ACTIVE_VDIG_MIRROR
iwlwifi 0000:08:00.0: Firmware error during reconfiguration - reprobe!
iwlwifi 0000:08:00.0: Failed to start RT ucode: -5
iwlwifi 0000:08:00.0: Firmware not running - cannot dump error
wlan6: Failed check-sdata-in-driver check, flags: 0x0
wlan6: Failed check-sdata-in-driver check, flags: 0x0
wlan6: Failed check-sdata-in-driver check, flags: 0x0
iwlwifi 0000:08:00.0: Failed to trigger RX queues sync (-5)
wlan6: Failed check-sdata-in-driver check, flags: 0x0
wlan6: Failed check-sdata-in-driver check, flags: 0x0
wlan6: Failed check-sdata-in-driver check, flags: 0x0
wlan6: Failed check-sdata-in-driver check, flags: 0x0
wlan6: Failed check-sdata-in-driver check, flags: 0x0
wlan6: Failed check-sdata-in-driver check, flags: 0x0
wlan6: Failed check-sdata-in-driver check, flags: 0x0
wlan6: Failed check-sdata-in-driver check, flags: 0x0
wlan6: Failed check-sdata-in-driver check, flags: 0x0
iwlwifi 0000:08:00.0: iwl_trans_wait_txq_empty bad state = 0
wlan6: Failed check-sdata-in-driver check, flags: 0x0
iwlwifi 0000:08:00.0: Microcode SW error detected. Restarting 0x0.
iwlwifi 0000:08:00.0: Start IWL Error Log Dump:
iwlwifi 0000:08:00.0: Status: 0x00000080, count: 6
iwlwifi 0000:08:00.0: Loaded firmware version: 48.4fa0041f.0
iwlwifi 0000:08:00.0: 0x00000942 | ADVANCED_SYSASSERT
iwlwifi 0000:08:00.0: 0x0000A2F0 | trm_hw_status0
iwlwifi 0000:08:00.0: 0x00000000 | trm_hw_status1
iwlwifi 0000:08:00.0: 0x004F8E3C | branchlink2
iwlwifi 0000:08:00.0: 0x00000E26 | interruptlink1
iwlwifi 0000:08:00.0: 0x00000E26 | interruptlink2
iwlwifi 0000:08:00.0: 0xFFE6FFF3 | data1
iwlwifi 0000:08:00.0: 0x70000201 | data2
iwlwifi 0000:08:00.0: 0x010C0605 | data3
iwlwifi 0000:08:00.0: 0x00000000 | beacon time
iwlwifi 0000:08:00.0: 0x0001A90F | tsf low
iwlwifi 0000:08:00.0: 0x00000000 | tsf hi
iwlwifi 0000:08:00.0: 0x00000000 | time gp1
iwlwifi 0000:08:00.0: 0x00020AD8 | time gp2
iwlwifi 0000:08:00.0: 0x00000001 | uCode revision type
iwlwifi 0000:08:00.0: 0x00000030 | uCode version major
iwlwifi 0000:08:00.0: 0x4FA0041F | uCode version minor
iwlwifi 0000:08:00.0: 0x00000340 | hw version
iwlwifi 0000:08:00.0: 0x18C89000 | board version
iwlwifi 0000:08:00.0: 0x8011FD0C | hcmd
iwlwifi 0000:08:00.0: 0xE69A9600 | isr0
iwlwifi 0000:08:00.0: 0x00000000 | isr1
iwlwifi 0000:08:00.0: 0x08F80002 | isr2
iwlwifi 0000:08:00.0: 0x04C0001C | isr3
iwlwifi 0000:08:00.0: 0x00000000 | isr4
iwlwifi 0000:08:00.0: 0x00000000 | last cmd Id
iwlwifi 0000:08:00.0: 0x0001503E | wait_event
iwlwifi 0000:08:00.0: 0x00000000 | l2p_control
iwlwifi 0000:08:00.0: 0x00000000 | l2p_duration
iwlwifi 0000:08:00.0: 0x00000000 | l2p_mhvalid
iwlwifi 0000:08:00.0: 0x00000000 | l2p_addr_match
iwlwifi 0000:08:00.0: 0x00000009 | lmpm_pmg_sel
iwlwifi 0000:08:00.0: 0x00000000 | timestamp
iwlwifi 0000:08:00.0: 0x00000020 | flow_handler
iwlwifi 0000:08:00.0: Start IWL Error Log Dump:
iwlwifi 0000:08:00.0: Status: 0x00000080, count: 7
iwlwifi 0000:08:00.0: 0x20000070 | NMI_INTERRUPT_LMAC_FATAL
iwlwifi 0000:08:00.0: 0x00000000 | umac branchlink1
iwlwifi 0000:08:00.0: 0xC008CC3C | umac branchlink2
iwlwifi 0000:08:00.0: 0x8048D0E6 | umac interruptlink1
iwlwifi 0000:08:00.0: 0x8048D0E6 | umac interruptlink2
iwlwifi 0000:08:00.0: 0x00000400 | umac data1
iwlwifi 0000:08:00.0: 0x8048D0E6 | umac data2
iwlwifi 0000:08:00.0: 0x00000000 | umac data3
iwlwifi 0000:08:00.0: 0x00000030 | umac major
iwlwifi 0000:08:00.0: 0x4FA0041F | umac minor
iwlwifi 0000:08:00.0: 0x00020AEA | frame pointer
iwlwifi 0000:08:00.0: 0xC0886284 | stack pointer
iwlwifi 0000:08:00.0: 0x00010C00 | last host cmd
iwlwifi 0000:08:00.0: 0x00000000 | isr status reg
iwlwifi 0000:08:00.0: Fseq Registers:
iwlwifi 0000:08:00.0: 0xE0000000 | FSEQ_ERROR_CODE
iwlwifi 0000:08:00.0: 0x80290001 | FSEQ_TOP_INIT_VERSION
iwlwifi 0000:08:00.0: 0x80050008 | FSEQ_CNVIO_INIT_VERSION
iwlwifi 0000:08:00.0: 0x0000A503 | FSEQ_OTP_VERSION
iwlwifi 0000:08:00.0: 0x80000003 | FSEQ_TOP_CONTENT_VERSION
iwlwifi 0000:08:00.0: 0x4552414E | FSEQ_ALIVE_TOKEN
iwlwifi 0000:08:00.0: 0x00100530 | FSEQ_CNVI_ID
iwlwifi 0000:08:00.0: 0x00000532 | FSEQ_CNVR_ID
iwlwifi 0000:08:00.0: 0x00100530 | CNVI_AUX_MISC_CHIP
iwlwifi 0000:08:00.0: 0x00000532 | CNVR_AUX_MISC_CHIP
iwlwifi 0000:08:00.0: 0x05B0905B | CNVR_SCU_SD_REGS_SD_REG_DIG_DCDC_VTRIM
iwlwifi 0000:08:00.0: 0x0000025B | CNVR_SCU_SD_REGS_SD_REG_ACTIVE_VDIG_MIRROR
iwlwifi 0000:08:00.0: Firmware not running - cannot dump error
iwlwifi 0000:08:00.0: Failed to run INIT ucode: -5

Thanks,
Ben

--
Ben Greear <[email protected]>
Candela Technologies Inc http://www.candelatech.com

2019-10-08 07:34:42

by Sergey Matyukevich

Subject: Re: AX200 crash on udp upload, cannot restart

> We have a system with several of the AX200 NICs in it, kernel is 5.2.14+. We ran a udp upload
> test of 10Mbps across all radios, and after about 10 minutes one of the radios crashed and could
> not be restarted. The others continued to run so far.
>
> I will open a bug in the kernel bug tracker.

Hello Ben,

We observed similar issues in our tests as well. All the details
have been described in kernel bugzilla issue:
https://urldefense.proofpoint.com/v2/url?u=https-3A__bugzilla.kernel.org_show-5Fbug.cgi-3Fid-3D205061&d=DwIFAg&c=MHZppzMdXMt3JYjCV71UsQ&r=RFH8dgrFzz0_hnNXpEl_u3TZqD-B6kYLzfvbDuCKw3U&m=opeh64GEVevn0071vriL-kH2B_orc25yacBPa3YdgLI&s=CKuyBZ0VdAQocDiZGOIDyDC6GG9w4E7OikmGvzblazU&e=

Regards,
Sergey

2019-10-08 08:02:32

by Luca Coelho

Subject: Re: AX200 crash on udp upload, cannot restart

On Tue, 2019-10-08 at 07:33 +0000, Sergey Matyukevich wrote:
> > We have a system with several of the AX200 NICs in it, kernel is 5.2.14+. We ran a udp upload
> > test of 10Mbps across all radios, and after about 10 minutes one of the radios crashed and could
> > not be restarted. The others continued to run so far.
> >
> > I will open a bug in the kernel bug tracker.
>
> Hello Ben,
>
> We observed similar issues in our tests as well. All the details
> have been described in kernel bugzilla issue:
> https://urldefense.proofpoint.com/v2/url?u=https-3A__bugzilla.kernel.org_show-5Fbug.cgi-3Fid-3D205061&d=DwIFAg&c=MHZppzMdXMt3JYjCV71UsQ&r=RFH8dgrFzz0_hnNXpEl_u3TZqD-B6kYLzfvbDuCKw3U&m=opeh64GEVevn0071vriL-kH2B_orc25yacBPa3YdgLI&s=CKuyBZ0VdAQocDiZGOIDyDC6GG9w4E7OikmGvzblazU&e=

Thanks for the reports!

Ben also added a bug in bugzilla[1], let's use that one for tracking
(I'll mark Sergey's as a duplicate).

This is a know issue and our PHY team is already working on it
internally. I don't have much more details at the moment, but I'll
update the bugzilla entry as soon as we know more.


--
Cheers,
Luca.

2019-10-08 08:06:59

by Luca Coelho

Subject: Re: AX200 crash on udp upload, cannot restart

On Tue, 2019-10-08 at 10:58 +0300, Luca Coelho wrote:
> On Tue, 2019-10-08 at 07:33 +0000, Sergey Matyukevich wrote:
> > > We have a system with several of the AX200 NICs in it, kernel is 5.2.14+. We ran a udp upload
> > > test of 10Mbps across all radios, and after about 10 minutes one of the radios crashed and could
> > > not be restarted. The others continued to run so far.
> > >
> > > I will open a bug in the kernel bug tracker.
> >
> > Hello Ben,
> >
> > We observed similar issues in our tests as well. All the details
> > have been described in kernel bugzilla issue:
> > https://urldefense.proofpoint.com/v2/url?u=https-3A__bugzilla.kernel.org_show-5Fbug.cgi-3Fid-3D205061&d=DwIFAg&c=MHZppzMdXMt3JYjCV71UsQ&r=RFH8dgrFzz0_hnNXpEl_u3TZqD-B6kYLzfvbDuCKw3U&m=opeh64GEVevn0071vriL-kH2B_orc25yacBPa3YdgLI&s=CKuyBZ0VdAQocDiZGOIDyDC6GG9w4E7OikmGvzblazU&e=
>
> Thanks for the reports!
>
> Ben also added a bug in bugzilla[1], let's use that one for tracking
> (I'll mark Sergey's as a duplicate).
>
> This is a know issue and our PHY team is already working on it
> internally. I don't have much more details at the moment, but I'll
> update the bugzilla entry as soon as we know more.

Actually the bug Sergey pointed out is not the same. It's a different
sysassert, 0x103C and it will be investigated separately.

--
Cheers,
Luca.

2019-10-08 14:14:01

by Tim Higgins

Subject: Re: AX200 crash on udp upload, cannot restart

This is not just a UDP issue. I've seen crashes and/or throughput drops running
TCP/IP uplink iperf3 traffic to test maximum bandwidth.

On 10/8/2019 12:58 AM, Luca Coelho wrote:
> On Tue, 2019-10-08 at 07:33 +0000, Sergey Matyukevich wrote:
>>> We have a system with several of the AX200 NICs in it, kernel is 5.2.14+. We ran a udp upload
>>> test of 10Mbps across all radios, and after about 10 minutes one of the radios crashed and could
>>> not be restarted. The others continued to run so far.
>>>
>>> I will open a bug in the kernel bug tracker.
>>
>> Hello Ben,
>>
>> We observed similar issues in our tests as well. All the details
>> have been described in kernel bugzilla issue:
>> https://urldefense.proofpoint.com/v2/url?u=https-3A__bugzilla.kernel.org_show-5Fbug.cgi-3Fid-3D205061&d=DwIFAg&c=MHZppzMdXMt3JYjCV71UsQ&r=RFH8dgrFzz0_hnNXpEl_u3TZqD-B6kYLzfvbDuCKw3U&m=opeh64GEVevn0071vriL-kH2B_orc25yacBPa3YdgLI&s=CKuyBZ0VdAQocDiZGOIDyDC6GG9w4E7OikmGvzblazU&e=
>
> Thanks for the reports!
>
> Ben also added a bug in bugzilla[1], let's use that one for tracking
> (I'll mark Sergey's as a duplicate).
>
> This is a know issue and our PHY team is already working on it
> internally. I don't have much more details at the moment, but I'll
> update the bugzilla entry as soon as we know more.
>
>
> --
> Cheers,
> Luca.
>

2019-10-08 16:10:41

by Sergey Matyukevich

Subject: Re: AX200 crash on udp upload, cannot restart

> > On Tue, 2019-10-08 at 07:33 +0000, Sergey Matyukevich wrote:
> > > > We have a system with several of the AX200 NICs in it, kernel is 5.2.14+. We ran a udp upload
> > > > test of 10Mbps across all radios, and after about 10 minutes one of the radios crashed and could
> > > > not be restarted. The others continued to run so far.
> > > >
> > > > I will open a bug in the kernel bug tracker.
> > >
> > > Hello Ben,
> > >
> > > We observed similar issues in our tests as well. All the details
> > > have been described in kernel bugzilla issue:
> > > https://urldefense.proofpoint.com/v2/url?u=https-3A__bugzilla.kernel.org_show-5Fbug.cgi-3Fid-3D205061&d=DwIFAg&c=MHZppzMdXMt3JYjCV71UsQ&r=RFH8dgrFzz0_hnNXpEl_u3TZqD-B6kYLzfvbDuCKw3U&m=opeh64GEVevn0071vriL-kH2B_orc25yacBPa3YdgLI&s=CKuyBZ0VdAQocDiZGOIDyDC6GG9w4E7OikmGvzblazU&e=
> >
> > Thanks for the reports!
> >
> > Ben also added a bug in bugzilla[1], let's use that one for tracking
> > (I'll mark Sergey's as a duplicate).
> >
> > This is a know issue and our PHY team is already working on it
> > internally. I don't have much more details at the moment, but I'll
> > update the bugzilla entry as soon as we know more.
>
> Actually the bug Sergey pointed out is not the same. It's a different
> sysassert, 0x103C and it will be investigated separately.

Hi Luca,

By the way, could you please clarify if current firmware for AX200
supports 160MHz band in 11ax ?

Regards,
Sergey