(cc list is too big, I shrink it)
On Sun, Oct 01, 2023 at 12:12:02PM +0700, Bagas Sanjaya wrote:
> On Sat, Sep 30, 2023 at 06:04:22PM -0400, enc0der wrote:
> > Hello all!
> >
> > This is the first time I have ever reported anything linux related, so
> > if this is not the proper way, please let me know what the correct way
> > is.
> >
> > I am using an NVIDIA Jetson Orin Nano developer platform. They
> > release what they call a jetpack that comes with linux and their
> > additions on top. We are using the latest version they release (just
> > released about a month ago)
>
> Something like a distro? What version?
>
> >
> > When I plug in a USB WiFi adapter that uses the rt8000usb driver, if I
> > connect to a network it sees, I get a kernel panic. If I have
> > "automatically connect" it kernel panics when I plug the USB in.
> >
> > The version of the kernel they ship is:
> >
> > 5.10.120-tegra. (tegra is their additions)
> >
> > I talked with NVIDIA first on what I was seeing and after looking at
> > my log, they said it is likely a driver problem.
Is possible that this is rt2800usb or usb host driver issue. But without
full logs we can not be sure.
> > Right after I plug in the device, this is the sequence of messages I see:
> >
> > [ 264.400281] BUG: scheduling while atomic: NetworkManager/622/0x00000203
After that message there should be stack trace visible. To debug this
you would need to find a way to see the full logs (dmesg/kmsg) after the crash.
It can be serial console, netconsole, pstore or some other thing. Perhaps
your platform allow to boot debug kernel with various check, which will
not panic when the bug occures and will show useful info in the logs.
> > [ 28.071586] lr : arm_smmu_dma_sync+0x40/0x70
> > [ 28.075965] sp : ffff8000100231a0
> > [ 28.079365] x29: 0000000000001000 x28: ffff4655c01d0ec0
> > [ 28.084817] x27: ffffaced1f227000 x26: ffff4655c6ee32c0
> > [ 28.090270] x25: 0000000000000000 x24: ffffaced1e405858
> > [ 28.095718] x23: ffff46572e84ae00 x22: ffff4655c6ee2c40
> > [ 28.101165] x21: ffff4655c82c3480 x20: ffffaced1db49e08
> > [ 28.106618] x19: ffff8000100231c0 x18: 0000000000010101
> > [ 28.112073] x17: 0000000000cccccc x16: ffffaced1d23382c
> > [ 28.117520] x15: 0000000000000000 x14: 0000000000000000
> > [ 28.122970] x13: 0000000000000001 x12: 0000000000000000
> > [ 28.128421] x11: 0000000000000008 x10: 0000000000000ab0
> > [ 28.133863] x9 : ffff800010023180 x8 : ffff4655c6ee3750
> > [ 28.139309] x7 : 000000067eb29c20 x6 : 0000000000000238
> > [ 28.144763] x5 : 00000000410fd420 x4 : 0000000000f0000f
> > [ 28.150214] x3 : 0000000000001000 x2 : ffff4655c82c3480
> > [ 28.155658] x1 : ffffaced1db49e08 x0 : ffff465704c37558
> > [ 28.161107] Call trace:
> > [ 28.163620] 0x1000
> > [ 28.165777] Code: bad PC value
> > [ 28.168911] ---[ end trace 62dc42c98ec427ca ]---
> > [ 28.183964] Kernel panic - not syncing: Oops: Fatal exception
> > [ 28.189864] SMP: stopping secondary CPUs
> > [ 29.275883] SMP: failed to stop secondary CPUs 0-5
> > [ 29.280811] Kernel Offset: 0x2ced0d200000 from 0xffff800010000000
This actually suggest that the issue is somewhere in the core.
But again, without full logs we can not be sure.
> > [ 29.287066] PHYS_OFFSET: 0xffffb9ab40000000
> > [ 29.291360] CPU features: 0x08040006,4a80aa38
> > [ 29.295832] Memory Limit: none
> > [ 29.309234] ---[ end Kernel panic - not syncing: Oops: Fatal exception ]---
> >
> > (This one I believe when I started with the wifi adapter connected to
> > USB3 and networking was set to automatically connect.
> >
> > I see in the git repo that these drivers have been changed over the
> > last few years. Given the age of the kernel that NVIDIA is using, I
> > am not sure how to correlate changes listed in the history of the
> > files with the release. I guess I could download and diff them until
> > I figure out where.
The rt2800 driver wasn't modified for ages. It's rater stable, but
perhaps there are issues in other involved modules i.e. mac80211.
Regards
Stanislaw
On 03/10/2023 01:50, Stanislaw Gruszka wrote:
>
> (cc list is too big, I shrink it)
>
> On Sun, Oct 01, 2023 at 12:12:02PM +0700, Bagas Sanjaya wrote:
>> On Sat, Sep 30, 2023 at 06:04:22PM -0400, enc0der wrote:
>>> [ 28.071586] lr : arm_smmu_dma_sync+0x40/0x70
>>> [ 28.075965] sp : ffff8000100231a0
>>> [ 28.079365] x29: 0000000000001000 x28: ffff4655c01d0ec0
>>> [ 28.084817] x27: ffffaced1f227000 x26: ffff4655c6ee32c0
>>> [ 28.090270] x25: 0000000000000000 x24: ffffaced1e405858
>>> [ 28.095718] x23: ffff46572e84ae00 x22: ffff4655c6ee2c40
>>> [ 28.101165] x21: ffff4655c82c3480 x20: ffffaced1db49e08
>>> [ 28.106618] x19: ffff8000100231c0 x18: 0000000000010101
>>> [ 28.112073] x17: 0000000000cccccc x16: ffffaced1d23382c
>>> [ 28.117520] x15: 0000000000000000 x14: 0000000000000000
>>> [ 28.122970] x13: 0000000000000001 x12: 0000000000000000
>>> [ 28.128421] x11: 0000000000000008 x10: 0000000000000ab0
>>> [ 28.133863] x9 : ffff800010023180 x8 : ffff4655c6ee3750
>>> [ 28.139309] x7 : 000000067eb29c20 x6 : 0000000000000238
>>> [ 28.144763] x5 : 00000000410fd420 x4 : 0000000000f0000f
>>> [ 28.150214] x3 : 0000000000001000 x2 : ffff4655c82c3480
>>> [ 28.155658] x1 : ffffaced1db49e08 x0 : ffff465704c37558
>>> [ 28.161107] Call trace:
>>> [ 28.163620] 0x1000
>>> [ 28.165777] Code: bad PC value
>>> [ 28.168911] ---[ end trace 62dc42c98ec427ca ]---
>>> [ 28.183964] Kernel panic - not syncing: Oops: Fatal exception
>>> [ 28.189864] SMP: stopping secondary CPUs
>>> [ 29.275883] SMP: failed to stop secondary CPUs 0-5
>>> [ 29.280811] Kernel Offset: 0x2ced0d200000 from 0xffff800010000000
>
> This actually suggest that the issue is somewhere in the core.
> But again, without full logs we can not be sure.
>
The reason why I added RCU subsystem maintainers to the Cc: list
was because the log the reporter provided points warning to
kernel/rcu/tree_plugin.h.
Thanks.
--
An old man doll... just what I always wanted! - Clara
Hello Stanislaw!
On Mon, Oct 2, 2023 at 2:50 PM Stanislaw Gruszka <[email protected]> wrote:
>
> Is possible that this is rt2800usb or usb host driver issue. But without
> full logs we can not be sure.
Okay, I was able to use dmesg -w before it kernel panic'd to grab some
additional details, first this is when I plug in th USB WiFi adapter
but I have it not automatically connect. In this state, it will not
kernel panic:
[ 1496.115251] usb 1-3.4: new high-speed USB device number 7 using tegra-xusb
[ 1496.333698] usb 1-3.4: New USB device found, idVendor=148f,
idProduct=5370, bcdDevice= 1.01
[ 1496.333707] usb 1-3.4: New USB device strings: Mfr=1, Product=2,
SerialNumber=3
[ 1496.333712] usb 1-3.4: Product: 802.11 n WLAN
[ 1496.333716] usb 1-3.4: Manufacturer: Ralink
[ 1496.333719] usb 1-3.4: SerialNumber: 1.0
[ 1497.187704] usb 1-3.4: reset high-speed USB device number 7 using tegra-xusb
[ 1497.399765] ieee80211 phy0: rt2x00_set_rt: Info - RT chipset 5390,
rev 0502 detected
[ 1497.574025] ieee80211 phy0: rt2x00_set_rf: Info - RF chipset 5370 detected
[ 1497.575366] ieee80211 phy0: Selected rate control algorithm 'minstrel_ht'
[ 1497.577940] usbcore: registered new interface driver rt2800usb
[ 1497.744748] ieee80211 phy0: rt2x00lib_request_firmware: Info -
Loading firmware file 'rt2870.bin'
[ 1497.747318] ieee80211 phy0: rt2x00lib_request_firmware: Info -
Firmware detected - version: 0.36
Then, I tell it to connect to a local network, and I see a loop of
errors over and over before it eventually panics:
(I just copied in a few of them since many of these repeated over and over:
[ 1541.821783] wlan0: authenticate with 6c:4b:b4:30:9b:04
[ 1542.000817] wlan0: send auth to 6c:4b:b4:30:9b:04 (try 1/3)
[ 1542.002490] wlan0: authenticated
[ 1542.006241] wlan0: associate with 6c:4b:b4:30:9b:04 (try 1/3)
[ 1542.010192] wlan0: RX AssocResp from 6c:4b:b4:30:9b:04 (capab=0x411
status=0 aid=14)
[ 1542.050657] wlan0: associated
[ 1542.075032] IPv6: ADDRCONF(NETDEV_CHANGE): wlan0: link becomes ready
[ 1542.091614] wlan0: Limiting TX power to 30 (30 - 0) dBm as
advertised by 6c:4b:b4:30:9b:04
[ 1542.242112] BUG: scheduling while atomic: ksoftirqd/3/29/0x00000103
[ 1542.248587] Modules linked in: rt2800usb(E) rt2x00usb(E)
rt2800lib(E) rt2x00lib(E) mac80211(E) cfg80211(E) nvidia_modeset(OE)
fuse(E) lzo_rle(E) lzo_compress(E) zram(E) ramoops(E) reed_solomon(E)
loop(E) snd_soc_tegra186_asrc(E) snd_soc_tegra210_ope(E)
snd_soc_tegra186_arad(E) snd_soc_tegra186_dspk(E)
snd_soc_tegra210_iqc(E) aes_ce_blk(E) crypto_simd(E) cryptd(E)
snd_soc_tegra210_mvc(E) snd_soc_tegra210_afc(E) aes_ce_cipher(E)
snd_soc_tegra210_dmic(E) snd_soc_tegra210_adx(E) ghash_ce(E)
snd_soc_tegra210_amx(E) sha2_ce(E) snd_soc_tegra210_i2s(E)
snd_soc_tegra210_mixer(E) snd_soc_tegra210_admaif(E) sha256_arm64(E)
snd_soc_tegra210_sfc(E) snd_soc_tegra_pcm(E) hid_ite(E) sha1_ce(E)
input_leds(E) spidev(E) snd_soc_tegra210_adsp(E)
snd_soc_tegra_machine_driver(E) snd_soc_spdif_tx(E)
snd_soc_tegra_utils(E) snd_soc_simple_card_utils(E)
snd_hda_codec_hdmi(E) snd_soc_tegra210_ahub(E) nvadsp(E)
userspace_alert(E) snd_hda_tegra(E) tegra_bpmp_thermal(E)
tegra210_adma(E) nv_imx219(E) snd_hda_codec(E)
[ 1542.248665] snd_hda_core(E) spi_tegra114(E) nvidia(OE)
binfmt_misc(E) ina3221(E) pwm_fan(E) nvgpu(E) nvmap(E) ip_tables(E)
x_tables(E) [last unloaded: mtd]
[ 1542.248686] CPU: 3 PID: 29 Comm: ksoftirqd/3 Tainted: G W
OE 5.10.120-tegra #1
[ 1542.248687] Hardware name: Unknown NVIDIA Orin Nano Developer
Kit/NVIDIA Orin Nano Developer Kit, BIOS 4.1-33958178 08/01/2023
[ 1542.248690] Call trace:
[ 1542.248702] dump_backtrace+0x0/0x1d0
[ 1542.248705] show_stack+0x30/0x40
[ 1542.248712] dump_stack+0xd8/0x138
[ 1542.248717] __schedule_bug+0x78/0x90
[ 1542.248722] __schedule+0x844/0x910
[ 1542.248724] schedule+0x78/0x110
[ 1542.248727] schedule_timeout+0x184/0x340
[ 1542.248731] nvhost_syncpt_wait_timeout+0x450/0x720
[ 1542.248733] nvhost_syncpt_wait_timeout_ext+0xf4/0x120
[ 1542.248738] tegra_se_channel_submit_gather.isra.0+0x160/0x440
[ 1542.248740] tegra_se_ccm_compute_auth+0x2d8/0x650
[ 1542.248743] tegra_se_aes_ccm_encrypt+0x6c/0x150
[ 1542.248746] crypto_aead_encrypt+0x38/0x50
[ 1542.248768] aead_encrypt+0x130/0x180 [mac80211]
[ 1542.248782] ieee80211_crypto_ccmp_encrypt+0x1f8/0x270 [mac80211]
[ 1542.248793] ieee80211_txq_schedule_start+0xae4/0xc10 [mac80211]
[ 1542.248803] ieee80211_proberesp_get+0x3ec/0x830 [mac80211]
[ 1542.248814] ieee80211_tx_prepare_skb+0x27c/0x2d0 [mac80211]
[ 1542.248824] ieee80211_xmit+0xa0/0xd0 [mac80211]
[ 1542.248835] __ieee80211_subif_start_xmit+0x780/0xb10 [mac80211]
[ 1542.248845] ieee80211_subif_start_xmit+0x5c/0x2f0 [mac80211]
[ 1542.248850] dev_hard_start_xmit+0x10c/0x330
[ 1542.248855] sch_direct_xmit+0xf4/0x360
[ 1542.248857] __qdisc_run+0x140/0x730
[ 1542.248859] net_tx_action+0x14c/0x380
[ 1542.248862] __do_softirq+0x140/0x3e8
[ 1542.248865] run_ksoftirqd+0x50/0x60
[ 1542.248868] smpboot_thread_fn+0x1c4/0x280
[ 1542.248870] kthread+0x148/0x170
[ 1542.248872] ret_from_fork+0x10/0x24
[ 1542.248882] ------------[ cut here ]------------
[ 1542.248887] WARNING: CPU: 3 PID: 29 at kernel/rcu/tree_plugin.h:297
rcu_note_context_switch+0x50/0x540
[ 1542.258457] Modules linked in: rt2800usb(E) rt2x00usb(E)
rt2800lib(E) rt2x00lib(E) mac80211(E) cfg80211(E) nvidia_modeset(OE)
fuse(E) lzo_rle(E) lzo_compress(E) zram(E) ramoops(E) reed_solomon(E)
loop(E) snd_soc_tegra186_asrc(E) snd_soc_tegra210_ope(E)
snd_soc_tegra186_arad(E) snd_soc_tegra186_dspk(E)
snd_soc_tegra210_iqc(E) aes_ce_blk(E) crypto_simd(E) cryptd(E)
snd_soc_tegra210_mvc(E) snd_soc_tegra210_afc(E) aes_ce_cipher(E)
snd_soc_tegra210_dmic(E) snd_soc_tegra210_adx(E) ghash_ce(E)
snd_soc_tegra210_amx(E) sha2_ce(E) snd_soc_tegra210_i2s(E)
snd_soc_tegra210_mixer(E) snd_soc_tegra210_admaif(E) sha256_arm64(E)
snd_soc_tegra210_sfc(E) snd_soc_tegra_pcm(E) hid_ite(E) sha1_ce(E)
input_leds(E) spidev(E) snd_soc_tegra210_adsp(E)
snd_soc_tegra_machine_driver(E) snd_soc_spdif_tx(E)
snd_soc_tegra_utils(E) snd_soc_simple_card_utils(E)
snd_hda_codec_hdmi(E) snd_soc_tegra210_ahub(E) nvadsp(E)
userspace_alert(E) snd_hda_tegra(E) tegra_bpmp_thermal(E)
tegra210_adma(E) nv_imx219(E) snd_hda_codec(E)
[ 1542.258510] snd_hda_core(E) spi_tegra114(E) nvidia(OE)
binfmt_misc(E) ina3221(E) pwm_fan(E) nvgpu(E) nvmap(E) ip_tables(E)
x_tables(E) [last unloaded: mtd]
[ 1542.258524] CPU: 3 PID: 29 Comm: ksoftirqd/3 Tainted: G W
OE 5.10.120-tegra #1
[ 1542.258525] Hardware name: Unknown NVIDIA Orin Nano Developer
Kit/NVIDIA Orin Nano Developer Kit, BIOS 4.1-33958178 08/01/2023
[ 1542.258529] pstate: 20c00089 (nzCv daIf +PAN +UAO -TCO BTYPE=--)
[ 1542.258532] pc : rcu_note_context_switch+0x50/0x540
[ 1542.258535] lr : rcu_note_context_switch+0x28/0x540
[ 1542.258536] sp : ffff8000101e3270
[ 1542.258538] x29: ffff8000101e3270 x28: 0000000000000000
[ 1542.258541] x27: ffffb2b1e4fe7000 x26: ffffb2b1e49fbe00
[ 1542.258544] x25: 0000000000000000 x24: ffffb2b1e41c5858
[ 1542.258548] x23: ffff293a2e827e00 x22: ffff2938c0228ec0
[ 1542.258551] x21: 0000000000000000 x20: ffff2938c0228ec0
[ 1542.258554] x19: ffff293a2e828b00 x18: 0000000000000060
[ 1542.258557] x17: 0000000000018021 x16: ffffb2b1e2fe5220
[ 1542.258560] x15: ffff2938c0229430 x14: ffffffffffffffff
[ 1542.258564] x13: ffff8000901e2d75 x12: ffff8000101e2d7e
[ 1542.258567] x11: 0101010101010101 x10: ffffffffff7f7f7f
[ 1542.258570] x9 : 00000000fffffffe x8 : 343278302f303178
[ 1542.258573] x7 : 302b6b726f665f6d x6 : 0000000000000002
[ 1542.258576] x5 : ffff80001001c000 x4 : ffffb2b1e4ff2000
[ 1542.258579] x3 : ffffb2b1e4ff2dc0 x2 : ffffb2b1e3180d70
[ 1542.258582] x1 : ffff8000101e3270 x0 : 0000000000000002
[ 1542.258585] Call trace:
[ 1542.258589] rcu_note_context_switch+0x50/0x540
[ 1542.258592] __schedule+0xc0/0x910
[ 1542.258594] schedule+0x78/0x110
[ 1542.258597] schedule_timeout+0x184/0x340
[ 1542.258600] nvhost_syncpt_wait_timeout+0x450/0x720
[ 1542.258602] nvhost_syncpt_wait_timeout_ext+0xf4/0x120
[ 1542.258605] tegra_se_channel_submit_gather.isra.0+0x160/0x440
[ 1542.258607] tegra_se_ccm_compute_auth+0x2d8/0x650
[ 1542.258610] tegra_se_aes_ccm_encrypt+0x6c/0x150
[ 1542.258612] crypto_aead_encrypt+0x38/0x50
[ 1542.258625] aead_encrypt+0x130/0x180 [mac80211]
[ 1542.258636] ieee80211_crypto_ccmp_encrypt+0x1f8/0x270 [mac80211]
[ 1542.258648] ieee80211_txq_schedule_start+0xae4/0xc10 [mac80211]
[ 1542.258660] ieee80211_proberesp_get+0x3ec/0x830 [mac80211]
[ 1542.258672] ieee80211_tx_prepare_skb+0x27c/0x2d0 [mac80211]
[ 1542.258684] ieee80211_xmit+0xa0/0xd0 [mac80211]
[ 1542.258695] __ieee80211_subif_start_xmit+0x780/0xb10 [mac80211]
[ 1542.258707] ieee80211_subif_start_xmit+0x5c/0x2f0 [mac80211]
[ 1542.258710] dev_hard_start_xmit+0x10c/0x330
[ 1542.258713] sch_direct_xmit+0xf4/0x360
[ 1542.258715] __qdisc_run+0x140/0x730
[ 1542.258718] net_tx_action+0x14c/0x380
[ 1542.258720] __do_softirq+0x140/0x3e8
[ 1542.258723] run_ksoftirqd+0x50/0x60
[ 1542.258726] smpboot_thread_fn+0x1c4/0x280
[ 1542.258728] kthread+0x148/0x170
[ 1542.258730] ret_from_fork+0x10/0x24
[ 1542.258732] ---[ end trace c64fbdc5cc928ac7 ]---
[ 1542.263555] NOHZ tick-stop error: Non-RCU local softirq work is
pending, handler #280!!!
[ 1542.271921] softirq: huh, entered softirq 2 NET_TX 00000000548727ea
with preempt_count 00000100, exited with fffffffe?
[ 1542.275488] BUG: scheduling while atomic: ksoftirqd/5/39/0x00000103
[ 1542.289407] Modules linked in: rt2800usb(E) rt2x00usb(E)
rt2800lib(E) rt2x00lib(E) mac80211(E) cfg80211(E) nvidia_modeset(OE)
fuse(E) lzo_rle(E) lzo_compress(E) zram(E) ramoops(E) reed_solomon(E)
loop(E) snd_soc_tegra186_asrc(E) snd_soc_tegra210_ope(E)
snd_soc_tegra186_arad(E) snd_soc_tegra186_dspk(E)
snd_soc_tegra210_iqc(E) aes_ce_blk(E) crypto_simd(E) cryptd(E)
snd_soc_tegra210_mvc(E) snd_soc_tegra210_afc(E) aes_ce_cipher(E)
snd_soc_tegra210_dmic(E) snd_soc_tegra210_adx(E) ghash_ce(E)
snd_soc_tegra210_amx(E) sha2_ce(E) snd_soc_tegra210_i2s(E)
snd_soc_tegra210_mixer(E) snd_soc_tegra210_admaif(E) sha256_arm64(E)
snd_soc_tegra210_sfc(E) snd_soc_tegra_pcm(E) hid_ite(E) sha1_ce(E)
input_leds(E) spidev(E) snd_soc_tegra210_adsp(E)
snd_soc_tegra_machine_driver(E) snd_soc_spdif_tx(E)
snd_soc_tegra_utils(E) snd_soc_simple_card_utils(E)
snd_hda_codec_hdmi(E) snd_soc_tegra210_ahub(E) nvadsp(E)
userspace_alert(E) snd_hda_tegra(E) tegra_bpmp_thermal(E)
tegra210_adma(E) nv_imx219(E) snd_hda_codec(E)
[ 1542.289527] snd_hda_core(E) spi_tegra114(E) nvidia(OE)
binfmt_misc(E) ina3221(E) pwm_fan(E) nvgpu(E) nvmap(E) ip_tables(E)
x_tables(E) [last unloaded: mtd]
[ 1542.289559] CPU: 5 PID: 39 Comm: ksoftirqd/5 Tainted: G W
OE 5.10.120-tegra #1
[ 1542.289563] Hardware name: Unknown NVIDIA Orin Nano Developer
Kit/NVIDIA Orin Nano Developer Kit, BIOS 4.1-33958178 08/01/2023
[ 1542.289566] Call trace:
[ 1542.289578] dump_backtrace+0x0/0x1d0
[ 1542.289585] show_stack+0x30/0x40
[ 1542.289594] dump_stack+0xd8/0x138
[ 1542.289602] __schedule_bug+0x78/0x90
[ 1542.289609] __schedule+0x844/0x910
[ 1542.289613] schedule+0x78/0x110
[ 1542.289619] schedule_timeout+0x184/0x340
[ 1542.289625] nvhost_syncpt_wait_timeout+0x450/0x720
[ 1542.289629] nvhost_syncpt_wait_timeout_ext+0xf4/0x120
[ 1542.289636] tegra_se_channel_submit_gather.isra.0+0x160/0x440
[ 1542.289641] tegra_se_ccm_compute_auth+0x2d8/0x650
[ 1542.289646] tegra_se_aes_ccm_encrypt+0x6c/0x150
[ 1542.289651] crypto_aead_encrypt+0x38/0x50
[ 1542.289685] aead_encrypt+0x130/0x180 [mac80211]
[ 1542.289711] ieee80211_crypto_ccmp_encrypt+0x1f8/0x270 [mac80211]
[ 1542.289735] ieee80211_txq_schedule_start+0xae4/0xc10 [mac80211]
[ 1542.289757] ieee80211_proberesp_get+0x3ec/0x830 [mac80211]
[ 1542.289779] ieee80211_tx_prepare_skb+0x27c/0x2d0 [mac80211]
[ 1542.289801] ieee80211_xmit+0xa0/0xd0 [mac80211]
[ 1542.289823] __ieee80211_subif_start_xmit+0x780/0xb10 [mac80211]
[ 1542.289845] ieee80211_subif_start_xmit+0x5c/0x2f0 [mac80211]
[ 1542.289852] dev_hard_start_xmit+0x10c/0x330
[ 1542.289858] sch_direct_xmit+0xf4/0x360
[ 1542.289862] __qdisc_run+0x140/0x730
[ 1542.289867] net_tx_action+0x14c/0x380
[ 1542.289871] __do_softirq+0x140/0x3e8
[ 1542.289876] run_ksoftirqd+0x50/0x60
[ 1542.289882] smpboot_thread_fn+0x1c4/0x280
[ 1542.289885] kthread+0x148/0x170
[ 1542.289890] ret_from_fork+0x10/0x24
[ 1542.290056] softirq: huh, entered softirq 2 NET_TX 00000000548727ea
with preempt_count 00000100, exited with fffffffe?
[ 1542.310049] BUG: scheduling while atomic: kworker/u12:0/3307/0x00000201
[ 1542.316883] Modules linked in: rt2800usb(E) rt2x00usb(E)
rt2800lib(E) rt2x00lib(E) mac80211(E) cfg80211(E) nvidia_modeset(OE)
fuse(E) lzo_rle(E) lzo_compress(E) zram(E) ramoops(E) reed_solomon(E)
loop(E) snd_soc_tegra186_asrc(E) snd_soc_tegra210_ope(E)
snd_soc_tegra186_arad(E) snd_soc_tegra186_dspk(E)
snd_soc_tegra210_iqc(E) aes_ce_blk(E) crypto_simd(E) cryptd(E)
snd_soc_tegra210_mvc(E) snd_soc_tegra210_afc(E) aes_ce_cipher(E)
snd_soc_tegra210_dmic(E) snd_soc_tegra210_adx(E) ghash_ce(E)
snd_soc_tegra210_amx(E) sha2_ce(E) snd_soc_tegra210_i2s(E)
snd_soc_tegra210_mixer(E) snd_soc_tegra210_admaif(E) sha256_arm64(E)
snd_soc_tegra210_sfc(E) snd_soc_tegra_pcm(E) hid_ite(E) sha1_ce(E)
input_leds(E) spidev(E) snd_soc_tegra210_adsp(E)
snd_soc_tegra_machine_driver(E) snd_soc_spdif_tx(E)
snd_soc_tegra_utils(E) snd_soc_simple_card_utils(E)
snd_hda_codec_hdmi(E) snd_soc_tegra210_ahub(E) nvadsp(E)
userspace_alert(E) snd_hda_tegra(E) tegra_bpmp_thermal(E)
tegra210_adma(E) nv_imx219(E) snd_hda_codec(E)
[ 1542.316959] snd_hda_core(E) spi_tegra114(E) nvidia(OE)
binfmt_misc(E) ina3221(E) pwm_fan(E) nvgpu(E) nvmap(E) ip_tables(E)
x_tables(E) [last unloaded: mtd]
[ 1542.316981] CPU: 0 PID: 3307 Comm: kworker/u12:0 Tainted: G
W OE 5.10.120-tegra #1
[ 1542.316983] Hardware name: Unknown NVIDIA Orin Nano Developer
Kit/NVIDIA Orin Nano Developer Kit, BIOS 4.1-33958178 08/01/2023
[ 1542.317008] Workqueue: phy0 ieee80211_ba_session_work [mac80211]
[ 1542.317011] Call trace:
[ 1542.317018] dump_backtrace+0x0/0x1d0
[ 1542.317022] show_stack+0x30/0x40
[ 1542.317029] dump_stack+0xd8/0x138
[ 1542.317033] __schedule_bug+0x78/0x90
[ 1542.317038] __schedule+0x844/0x910
[ 1542.317040] schedule+0x78/0x110
[ 1542.317044] schedule_timeout+0x184/0x340
[ 1542.317047] nvhost_syncpt_wait_timeout+0x450/0x720
[ 1542.317050] nvhost_syncpt_wait_timeout_ext+0xf4/0x120
[ 1542.317054] tegra_se_channel_submit_gather.isra.0+0x160/0x440
[ 1542.317057] tegra_se_ccm_compute_auth+0x2d8/0x650
[ 1542.317060] tegra_se_aes_ccm_encrypt+0x6c/0x150
[ 1542.317063] crypto_aead_encrypt+0x38/0x50
[ 1542.317080] aead_encrypt+0x130/0x180 [mac80211]
[ 1542.317094] ieee80211_crypto_ccmp_encrypt+0x1f8/0x270 [mac80211]
[ 1542.317108] ieee80211_txq_schedule_start+0xae4/0xc10 [mac80211]
[ 1542.317121] ieee80211_proberesp_get+0x3ec/0x830 [mac80211]
[ 1542.317135] ieee80211_tx_prepare_skb+0x27c/0x2d0 [mac80211]
[ 1542.317148] ieee80211_xmit+0xa0/0xd0 [mac80211]
[ 1542.317161] __ieee80211_tx_skb_tid_band+0x84/0xb0 [mac80211]
[ 1542.317174] ieee80211_start_tx_ba_cb_irqsafe+0x300/0x3c0 [mac80211]
[ 1542.317187] ieee80211_tx_ba_session_handle_start+0xec/0x1b0 [mac80211]
[ 1542.317200] ieee80211_ba_session_work+0x2a0/0x350 [mac80211]
[ 1542.317204] process_one_work+0x1c4/0x4a0
[ 1542.317206] worker_thread+0x54/0x430
[ 1542.317208] kthread+0x148/0x170
[ 1542.317211] ret_from_fork+0x10/0x24
[ 1542.317383] BUG: workqueue leaked lock or atomic:
kworker/u12:0/0xfffffe00/3307
last function: ieee80211_ba_session_work [mac80211]
The last set of messages:
[ 1575.970833] BUG: scheduling while atomic: NetworkManager/593/0xfffffdff
[ 1575.977680] Modules linked in: rt2800usb(E) rt2x00usb(E)
rt2800lib(E) rt2x00lib(E) mac80211(E) cfg80211(E) nvidia_modeset(OE)
fuse(E) lzo_rle(E) lzo_compress(E) zram(E) ramoops(E) reed_solomon(E)
loop(E) snd_soc_tegra186_asrc(E) snd_soc_tegra210_ope(E)
snd_soc_tegra186_arad(E) snd_soc_tegra186_dspk(E)
snd_soc_tegra210_iqc(E) aes_ce_blk(E) crypto_simd(E) cryptd(E)
snd_soc_tegra210_mvc(E) snd_soc_tegra210_afc(E) aes_ce_cipher(E)
snd_soc_tegra210_dmic(E) snd_soc_tegra210_adx(E) ghash_ce(E)
snd_soc_tegra210_amx(E) sha2_ce(E) snd_soc_tegra210_i2s(E)
snd_soc_tegra210_mixer(E) snd_soc_tegra210_admaif(E) sha256_arm64(E)
snd_soc_tegra210_sfc(E) snd_soc_tegra_pcm(E) hid_ite(E) sha1_ce(E)
input_leds(E) spidev(E) snd_soc_tegra210_adsp(E)
snd_soc_tegra_machine_driver(E) snd_soc_spdif_tx(E)
snd_soc_tegra_utils(E) snd_soc_simple_card_utils(E)
snd_hda_codec_hdmi(E) snd_soc_tegra210_ahub(E) nvadsp(E)
userspace_alert(E) snd_hda_tegra(E) tegra_bpmp_thermal(E)
tegra210_adma(E) nv_imx219(E) snd_hda_codec(E)
[ 1575.977790] snd_hda_core(E) spi_tegra114(E) nvidia(OE)
binfmt_misc(E) ina3221(E) pwm_fan(E) nvgpu(E) nvmap(E) ip_tables(E)
x_tables(E) [last unloaded: mtd]
[ 1575.977819] CPU: 4 PID: 593 Comm: NetworkManager Tainted: G
W OE 5.10.120-tegra #1
[ 1575.977822] Hardware name: Unknown NVIDIA Orin Nano Developer
Kit/NVIDIA Orin Nano Developer Kit, BIOS 4.1-33958178 08/01/2023
[ 1575.977825] Call trace:
[ 1575.977834] dump_backtrace+0x0/0x1d0
[ 1575.977840] show_stack+0x30/0x40
[ 1575.977846] dump_stack+0xd8/0x138
[ 1575.977852] __schedule_bug+0x78/0x90
[ 1575.977857] __schedule+0x844/0x910
[ 1575.977861] schedule+0x78/0x110
[ 1575.977867] schedule_hrtimeout_range_clock+0xa0/0x120
[ 1575.977872] schedule_hrtimeout_range+0x3c/0x50
[ 1575.977880] do_sys_poll+0x3d4/0x770
[ 1575.977885] __arm64_sys_ppoll+0xc0/0x100
[ 1575.977891] el0_svc_common.constprop.0+0x80/0x1d0
[ 1575.977896] do_el0_svc+0x38/0xb0
[ 1575.977900] el0_svc+0x1c/0x30
[ 1575.977904] el0_sync_handler+0xa8/0xb0
[ 1575.977908] el0_sync+0x16c/0x180
[ 1587.493670] wlan0: deauthenticating from 6c:4b:b4:30:9b:04 by local
choice (Reason: 3=DEAUTH_LEAVING)
Then at this point the communications were cut (I was using a wired
interface to capture)
From the serial port, once I tell it to connect to the local network,
this is all that is output before serial stops
[ 533.875985] BUG: scheduling while atomic: ksoftirqd/0/12/0x00000103
[ 533.882790] WARNING: CPU: 0 PID: 12 at kernel/rcu/tree_plugin.h:297
rcu_note_context_switch+0x50/0x540
[ 533.892621] ---[ end trace a78168b0d15c7046 ]---
[ 533.897590] softirq: huh, entered softirq 2 NET_TX 00000000cca7c5d3
with preempt_count 00000100, exited with fffffffe?
[ 533.941129] BUG: scheduling while atomic: ksoftirqd/2/24/0x00000103
[ 533.947928] softirq: huh, entered softirq 2 NET_TX 00000000cca7c5d3
with preempt_count 00000100, exited with fffffffe?
[ 533.963887] BUG: scheduling while atomic: kworker/u12:3/722/0x00000201
[ 533.971012] BUG: workqueue leaked lock or atomic:
kworker/u12:3/0xfffffe00/722
[ 533.971012] last function: ieee80211_ba_session_work [mac80211]
[ 533.985079] BUG: workqueue leaked lock or atomic:
kworker/u12:3/0xfffffe00/722
[ 533.985079] last function: ieee80211_ibss_leave [mac80211]
[ 533.998657] BUG: scheduling while atomic: kworker/u12:3/722/0xfffffe01
[ 534.983931] BUG: scheduling while atomic: kworker/u12:0/7/0x00000102
[ 534.991172] NOHZ tick-stop error: Non-RCU local softirq work is
pending, handler #02!!!
[ 535.007609] softirq: huh, entered softirq 6 TASKLET
0000000048396bde with preempt_count 00000101, exited with 00000000?
[ 535.018825] BUG: scheduling while atomic: kworker/u12:0/7/0x00000201
[ 535.026005] BUG: workqueue leaked lock or atomic: kworker/u12:0/0xfffffe00/7
[ 535.026005] last function: ieee80211_ba_session_work [mac80211]
[ 535.040029] BUG: scheduling while atomic: kworker/u12:0/7/0xfffffe01
[ 535.056041] BUG: scheduling while atomic: kworker/u12:0/7/0x00000201
[ 535.063242] BUG: workqueue leaked lock or atomic: kworker/u12:0/0xfffffe00/7
[ 535.063242] last function: ieee80211_ba_session_work [mac80211]
[ 535.077144] BUG: scheduling while atomic: kworker/u12:0/7/0xfffffe01
[ 535.084030] NOHZ tick-stop error: Non-RCU local softirq work is
pending, handler #280!!!
[ 535.854930] BUG: scheduling while atomic: NetworkManager/625/0x00000203
[ 535.862489] NOHZ tick-stop error: Non-RCU local softirq work is
pending, handler #2c0!!!
[ 535.870814] NOHZ tick-stop error: Non-RCU local softirq work is
pending, handler #2c0!!!
[ 535.887341] WARNING: CPU: 0 PID: 625 at kernel/softirq.c:174
__local_bh_enable_ip+0xac/0xc0
[ 535.896074] ---[ end trace a78168b0d15c7047 ]---
[ 535.900889] BUG: scheduling while atomic: NetworkManager/625/0xfffffdff
[ 535.907957] NOHZ tick-stop error: Non-RCU local softirq work is
pending, handler #2c2!!!
[ 535.916279] NOHZ tick-stop error: Non-RCU local softirq work is
pending, handler #2c2!!!
[ 536.103830] BUG: scheduling while atomic: kworker/u12:0/7/0x00000102
[ 536.110787] softirq: huh, entered softirq 6 TASKLET
0000000048396bde with preempt_count 00000101, exited with 00000000?
[ 536.121976] BUG: scheduling while atomic: kworker/u12:0/7/0x00000201
[ 536.128931] BUG: workqueue leaked lock or atomic: kworker/u12:0/0xfffffe00/7
[ 536.128931] last function: ieee80211_ba_session_work [mac80211]
[ 536.142827] BUG: scheduling while atomic: kworker/u12:0/7/0xfffffe01
[ 536.149562] NOHZ tick-stop error: Non-RCU local softirq work is
pending, handler #80!!!
[ 536.157772] NOHZ tick-stop error: Non-RCU local softirq work is
pending, handler #80!!!
[ 536.187788] BUG: scheduling while atomic: kworker/u12:0/7/0x00000201
[ 536.194783] BUG: workqueue leaked lock or atomic: kworker/u12:0/0xfffffe00/7
[ 536.194783] last function: ieee80211_ba_session_work [mac80211]
[ 536.208655] BUG: scheduling while atomic: kworker/u12:0/7/0xfffffe01
[ 536.215394] NOHZ tick-stop error: Non-RCU local softirq work is
pending, handler #280!!!
[ 537.227755] BUG: scheduling while atomic: kworker/u12:3/722/0x00000102
[ 537.234965] NOHZ tick-stop error: Non-RCU local softirq work is
pending, handler #282!!!
[ 537.251488] softirq: huh, entered softirq 6 TASKLET
0000000048396bde with preempt_count 00000101, exited with 00000000?
[ 537.262678] BUG: scheduling while atomic: kworker/u12:3/722/0x00000201
[ 537.269960] BUG: workqueue leaked lock or atomic:
kworker/u12:3/0xfffffe00/722
[ 537.269960] last function: ieee80211_ba_session_work [mac80211]
[ 537.284025] BUG: workqueue leaked lock or atomic:
kworker/u12:3/0xfffffe00/722
[ 537.284025] last function: ieee80211_ibss_leave [mac80211]
[ 537.297583] BUG: scheduling while atomic: kworker/u12:3/722/0xfffffe01
[ 537.343746] BUG: scheduling while atomic: kworker/u12:3/722/0x00000201
[ 537.351032] BUG: workqueue leaked lock or atomic:
kworker/u12:3/0xfffffe00/722
[ 537.351032] last function: ieee80211_ba_session_work [mac80211]
[ 537.365115] BUG: scheduling while atomic: kworker/u12:3/722/0xfffffe01
[ 538.375733] BUG: scheduling while atomic: kworker/u12:0/7/0x00000102
[ 538.392605] softirq: huh, entered softirq 6 TASKLET
0000000048396bde with preempt_count 00000101, exited with 00000000?
[ 538.403822] BUG: scheduling while atomic: kworker/u12:0/7/0x00000201
[ 538.410984] BUG: workqueue leaked lock or atomic: kworker/u12:0/0xfffffe00/7
[ 538.410984] last function: ieee80211_ba_session_work [mac80211]
[ 538.424985] BUG: workqueue leaked lock or atomic: kworker/u12:0/0xfffffe00/7
[ 538.424985] last function: ieee80211_ba_session_work [mac80211]
[ 538.438865] BUG: scheduling while atomic: kworker/u12:0/7/0xfffffe01
[ 538.460354] BUG: scheduling while atomic: ksoftirqd/0/12/0x00000101
[ 538.467953] softirq: huh, entered softirq 6 TASKLET
0000000048396bde with preempt_count 00000100, exited with 00000000?
[ 538.631875] BUG: scheduling while atomic: ksoftirqd/5/39/0x00000103
[ 538.639025] softirq: huh, entered softirq 2 NET_TX 00000000cca7c5d3
with preempt_count 00000100, exited with fffffffe?
[ 539.508955] BUG: scheduling while atomic: NetworkManager/625/0x00000403
[ 539.525507] BUG: scheduling while atomic: NetworkManager/625/0xfffffbff
[ 542.849869] BUG: scheduling while atomic: NetworkManager/625/0x00000203
[ 542.866840] BUG: scheduling while atomic: NetworkManager/625/0xfffffdff
[ 543.508184] BUG: scheduling while atomic: NetworkManager/625/0x00000403
[ 543.523724] BUG: scheduling while atomic: NetworkManager/625/0xfffffbff
[ 543.582356] BUG: scheduling while atomic: NetworkManager/625/0x00000403
[ 543.590206] WARNING: CPU: 2 PID: 625 at net/core/skbuff.c:665
skb_release_head_state+0x10c/0x120
[ 543.599396] ---[ end trace a78168b0d15c7048 ]---
[ 543.604213] WARNING: CPU: 2 PID: 625 at net/core/skbuff.c:665
skb_release_head_state+0x10c/0x120
[ 543.613516] ---[ end trace a78168b0d15c7049 ]---
[ 543.618313] WARNING: CPU: 2 PID: 625 at net/core/skbuff.c:665
skb_release_head_state+0x10c/0x120
[ 543.627533] ---[ end trace a78168b0d15c704a ]---
[ 543.632440] WARNING: CPU: 2 PID: 625 at net/core/skbuff.c:665
skb_release_head_state+0x10c/0x120
[ 543.641624] ---[ end trace a78168b0d15c704b ]---
[ 543.646395] BUG: scheduling while atomic: NetworkManager/625/0xfffffbff
[ 543.653378] BUG: scheduling while atomic: kworker/2:1/44/0x00000505
[ 543.660273] ------------[ cut here ]------------
[ 543.665037] WARNING: CPU: 2 PID: 44 at kernel/time/timer.c:1420
call_timer_fn+0x1f8/0x200
[ 543.673596] ---[ end trace a78168b0d15c704c ]---
[ 543.687399] BUG: scheduling while atomic: swapper/2/0/0x00000504
[ 543.693876] bad: scheduling from the idle thread!
Then unit reboots.
If I turn on auto-connect, and boot with the device already attached,
I can see the panic, from serial output:
[ 23.278662] BUG: scheduling while atomic: NetworkManager/722/0x00000203
[ 23.286079] WARNING: CPU: 1 PID: 722 at
kernel/rcu/tree_plugin.h:297 rcu_note_context_switch+0x50/0x540
[ 23.296285] ---[ end trace 60819f07c492dc1c ]---
[ 23.382446] BUG: scheduling while atomic: NetworkManager/722/0x00000505
[ 23.389654] NOHZ tick-stop error: Non-RCU local softirq work is
pending, handler #202!!!
[ 23.397965] NOHZ tick-stop error: Non-RCU local softirq work is
pending, handler #202!!!
[ 23.406289] WARNING: CPU: 1 PID: 0 at kernel/rcu/tree.c:624
rcu_eqs_enter.isra.0+0x128/0x130
[ 23.415092] ---[ end trace 60819f07c492dc1d ]---
[ 29.410485] Kernel panic - not syncing: stack-protector: Kernel
stack is corrupted in: __schedule+0x910/0x910
[ 29.420717] CPU: 1 PID: 722 Comm: NetworkManager Tainted: G
W OE 5.10.120-tegra #1
[ 29.429584] Hardware name: Unknown NVIDIA Orin Nano Developer
Kit/NVIDIA Orin Nano Developer Kit, BIOS 4.1-33958178 08/01/2023
[ 29.441313] Call trace:
[ 29.443843] dump_backtrace+0x0/0x1d0
[ 29.447614] show_stack+0x30/0x40
[ 29.451025] dump_stack+0xd8/0x138
[ 29.454519] panic+0x17c/0x384
[ 29.457661] __stack_chk_fail+0x30/0x40
[ 29.461608] schedule+0x0/0x110
[ 29.464837] schedule+0x78/0x110
[ 29.468158] __arm_lpae_dma_sync+0x1e0/0x200
[ 29.472550] __arm_lpae_dma_sync+0x14c/0x200
[ 29.476951] __arm_lpae_dma_sync+0x14c/0x200
[ 29.481342] __arm_lpae_dma_sync+0x14c/0x200
[ 29.485735] arm_lpae_dma_sync+0x54/0x80
[ 29.489771] arm_smmu_dma_sync+0x40/0x70
[ 29.493805] __iommu_map+0x138/0x250
[ 29.497479] _iommu_map+0x70/0xd0
[ 29.500892] 0x80
[ 29.502879] SMP: stopping secondary CPUs
[ 29.506918] Kernel Offset: 0x2ff010360000 from 0xffff800010000000
[ 29.513177] PHYS_OFFSET: 0xffffb7a9c0000000
[ 29.517465] CPU features: 0x08040006,4a80aa38
[ 29.521933] Memory Limit: none
[ 29.536986] ---[ end Kernel panic - not syncing: stack-protector:
Kernel stack is corrupted in: __schedule+0x910/0x910 ]---
> The rt2800 driver wasn't modified for ages. It's rater stable, but
> perhaps there are issues in other involved modules i.e. mac80211.
>
> Regards
> Stanislaw
Thanks!
Rick
Hi
On Tue, Oct 03, 2023 at 09:34:32PM -0400, enc0der wrote:
> Hello Stanislaw!
>
> On Mon, Oct 2, 2023 at 2:50 PM Stanislaw Gruszka <[email protected]> wrote:
> >
> > Is possible that this is rt2800usb or usb host driver issue. But without
> > full logs we can not be sure.
>
> Okay, I was able to use dmesg -w before it kernel panic'd to grab some
> additional details, first this is when I plug in th USB WiFi adapter
> but I have it not automatically connect. In this state, it will not
> kernel panic:
<snip>
> [ 1542.242112] BUG: scheduling while atomic: ksoftirqd/3/29/0x00000103
> [ 1542.248587] Modules linked in: rt2800usb(E) rt2x00usb(E)
> rt2800lib(E) rt2x00lib(E) mac80211(E) cfg80211(E) nvidia_modeset(OE)
> fuse(E) lzo_rle(E) lzo_compress(E) zram(E) ramoops(E) reed_solomon(E)
> loop(E) snd_soc_tegra186_asrc(E) snd_soc_tegra210_ope(E)
> snd_soc_tegra186_arad(E) snd_soc_tegra186_dspk(E)
> snd_soc_tegra210_iqc(E) aes_ce_blk(E) crypto_simd(E) cryptd(E)
> snd_soc_tegra210_mvc(E) snd_soc_tegra210_afc(E) aes_ce_cipher(E)
> snd_soc_tegra210_dmic(E) snd_soc_tegra210_adx(E) ghash_ce(E)
> snd_soc_tegra210_amx(E) sha2_ce(E) snd_soc_tegra210_i2s(E)
> snd_soc_tegra210_mixer(E) snd_soc_tegra210_admaif(E) sha256_arm64(E)
> snd_soc_tegra210_sfc(E) snd_soc_tegra_pcm(E) hid_ite(E) sha1_ce(E)
> input_leds(E) spidev(E) snd_soc_tegra210_adsp(E)
> snd_soc_tegra_machine_driver(E) snd_soc_spdif_tx(E)
> snd_soc_tegra_utils(E) snd_soc_simple_card_utils(E)
> snd_hda_codec_hdmi(E) snd_soc_tegra210_ahub(E) nvadsp(E)
> userspace_alert(E) snd_hda_tegra(E) tegra_bpmp_thermal(E)
> tegra210_adma(E) nv_imx219(E) snd_hda_codec(E)
> [ 1542.248665] snd_hda_core(E) spi_tegra114(E) nvidia(OE)
> binfmt_misc(E) ina3221(E) pwm_fan(E) nvgpu(E) nvmap(E) ip_tables(E)
> x_tables(E) [last unloaded: mtd]
> [ 1542.248686] CPU: 3 PID: 29 Comm: ksoftirqd/3 Tainted: G W
> OE 5.10.120-tegra #1
> [ 1542.248687] Hardware name: Unknown NVIDIA Orin Nano Developer
> Kit/NVIDIA Orin Nano Developer Kit, BIOS 4.1-33958178 08/01/2023
> [ 1542.248690] Call trace:
> [ 1542.248702] dump_backtrace+0x0/0x1d0
> [ 1542.248705] show_stack+0x30/0x40
> [ 1542.248712] dump_stack+0xd8/0x138
> [ 1542.248717] __schedule_bug+0x78/0x90
> [ 1542.248722] __schedule+0x844/0x910
> [ 1542.248724] schedule+0x78/0x110
> [ 1542.248727] schedule_timeout+0x184/0x340
> [ 1542.248731] nvhost_syncpt_wait_timeout+0x450/0x720
> [ 1542.248733] nvhost_syncpt_wait_timeout_ext+0xf4/0x120
> [ 1542.248738] tegra_se_channel_submit_gather.isra.0+0x160/0x440
> [ 1542.248740] tegra_se_ccm_compute_auth+0x2d8/0x650
> [ 1542.248743] tegra_se_aes_ccm_encrypt+0x6c/0x150
> [ 1542.248746] crypto_aead_encrypt+0x38/0x50
> [ 1542.248768] aead_encrypt+0x130/0x180 [mac80211]
> [ 1542.248782] ieee80211_crypto_ccmp_encrypt+0x1f8/0x270 [mac80211]
> [ 1542.248793] ieee80211_txq_schedule_start+0xae4/0xc10 [mac80211]
Here is the issue. We send the frames with spin_lock taken, in such
case no sleep (i.e. schedule() call) is allowed. Some function from
tegra/nvhost is actually sleeping, hence the bug.
As already pointed Thorsten, those tegra_/nvhost_ are proprietary functions,
which are not included in the upstream linux kernel, so we can not fix them.
However I can advice you to detach those from crypto_aead_encrypt,
this should be doable. At worst your will need to recompile your
kernel with those crypto offload engines disabled, but perhaps
this can be configured dynamically.
Regards
Stanislaw
On Wed, Oct 4, 2023 at 2:28 PM Stanislaw Gruszka <[email protected]> wrote:
> Here is the issue. We send the frames with spin_lock taken, in such
> case no sleep (i.e. schedule() call) is allowed. Some function from
> tegra/nvhost is actually sleeping, hence the bug.
>
> As already pointed Thorsten, those tegra_/nvhost_ are proprietary functions,
> which are not included in the upstream linux kernel, so we can not fix them.
>
> However I can advice you to detach those from crypto_aead_encrypt,
> this should be doable. At worst your will need to recompile your
> kernel with those crypto offload engines disabled, but perhaps
> this can be configured dynamically.
Thank you Stanislaw and everyone else for your help, super
appreciated. I will bring this back to Nvidia as this makes sense to
me the problem is in their upstream changes. I suspect the person who
was trying to help me just wasn't familiar with all their own changes.
> Regards
> Stanislaw