2023-01-24 13:24:37

by kernel test robot

[permalink] [raw]
Subject: [rt-devel:linux-6.2.y-rt-rebase] [printk] 5342b8e20b: hwsim.ap_ft_eap_cui.fail


Greeting,

FYI, we noticed hwsim.ap_ft_eap_cui.fail due to commit (built with gcc-11):

commit: 5342b8e20b15e5fb37e49de2435e62dd00ff20fe ("printk: Bring back the RT bits.")
https://git.kernel.org/cgit/linux/kernel/git/rt/linux-rt-devel.git linux-6.2.y-rt-rebase

in testcase: hwsim
version: hwsim-x86_64-717e5d7-1_20220525
with following parameters:

test: group-18



on test machine: 4 threads Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz (Skylake) with 32G memory

caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):


please be noted we also observed below failed on this commit, but pass on
parent

d144a18b3d136079 5342b8e20b15e5fb37e49de2435
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:6 83% 5:6 hwsim.ap_ft_eap_cui.fail
:6 100% 6:6 hwsim.ap_ft_many.fail
:6 100% 6:6 hwsim.ap_ft_pmf_bip_cmac_128.fail


If you fix the issue, kindly add following tag
| Reported-by: kernel test robot <[email protected]>
| Link: https://lore.kernel.org/oe-lkp/[email protected]


2023-01-21 20:29:30 ./run-tests.py ap_ft_eap_cui
DEV: wlan0: 02:00:00:00:00:00
DEV: wlan1: 02:00:00:00:01:00
DEV: wlan2: 02:00:00:00:02:00
APDEV: wlan3
APDEV: wlan4
START ap_ft_eap_cui 1/1
Test: WPA2-EAP-FT AP with CUI
Starting AP wlan3
Starting AP wlan4
Connect to first AP
Connect STA wlan0 to AP
Roam to the second AP
Roam back to the first AP
Roaming association rejected
Traceback (most recent call last):
File "/lkp/benchmarks/hwsim/tests/hwsim/./run-tests.py", line 534, in main
t(dev, apdev)
File "/lkp/benchmarks/hwsim/tests/hwsim/test_ap_ft.py", line 1519, in test_ap_ft_eap_cui
generic_ap_ft_eap(dev, apdev, vlan=False, cui=True)
File "/lkp/benchmarks/hwsim/tests/hwsim/test_ap_ft.py", line 1485, in generic_ap_ft_eap
run_roams(dev[0], apdev, hapd, hapd1, ssid, passphrase, eap=True,
File "/lkp/benchmarks/hwsim/tests/hwsim/test_ap_ft.py", line 273, in run_roams
dev.roam(ap1['bssid'])
File "/lkp/benchmarks/hwsim/tests/hwsim/wpasupplicant.py", line 1238, in roam
raise Exception("Roaming association rejected")
Exception: Roaming association rejected
FAIL ap_ft_eap_cui 2.405507 2023-01-21 20:29:33.761610
passed 0 test case(s)
skipped 0 test case(s)
failed tests: ap_ft_eap_cui


To reproduce:

git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
sudo bin/lkp install job.yaml # job file is attached in this email
bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run
sudo bin/lkp run generated-yaml-file

# if come across any failure that blocks the test,
# please remove ~/.lkp and /lkp dir to run from a clean state.



--
0-DAY CI Kernel Test Service
https://github.com/intel/lkp-tests



Attachments:
(No filename) (2.89 kB)
config-6.2.0-rc3-00014-g5342b8e20b15 (168.19 kB)
job-script (5.40 kB)
dmesg.xz (146.20 kB)
hwsim (65.32 kB)
job.yaml (4.45 kB)
reproduce (3.85 kB)
Download all attachments
Subject: Re: [rt-devel:linux-6.2.y-rt-rebase] [printk] 5342b8e20b: hwsim.ap_ft_eap_cui.fail

On 2023-01-24 21:23:54 [+0800], kernel test robot wrote:
> d144a18b3d136079 5342b8e20b15e5fb37e49de2435
> ---------------- ---------------------------
> fail:runs %reproduction fail:runs
> | | |
> :6 83% 5:6 hwsim.ap_ft_eap_cui.fail
> :6 100% 6:6 hwsim.ap_ft_many.fail
> :6 100% 6:6 hwsim.ap_ft_pmf_bip_cmac_128.fail

> Roaming association rejected
> Traceback (most recent call last):
> File "/lkp/benchmarks/hwsim/tests/hwsim/./run-tests.py", line 534, in main
> t(dev, apdev)
> File "/lkp/benchmarks/hwsim/tests/hwsim/test_ap_ft.py", line 1519, in test_ap_ft_eap_cui
> generic_ap_ft_eap(dev, apdev, vlan=False, cui=True)
> File "/lkp/benchmarks/hwsim/tests/hwsim/test_ap_ft.py", line 1485, in generic_ap_ft_eap
> run_roams(dev[0], apdev, hapd, hapd1, ssid, passphrase, eap=True,
> File "/lkp/benchmarks/hwsim/tests/hwsim/test_ap_ft.py", line 273, in run_roams
> dev.roam(ap1['bssid'])
> File "/lkp/benchmarks/hwsim/tests/hwsim/wpasupplicant.py", line 1238, in roam
> raise Exception("Roaming association rejected")
> Exception: Roaming association rejected
> FAIL ap_ft_eap_cui 2.405507 2023-01-21 20:29:33.761610
> passed 0 test case(s)
> skipped 0 test case(s)
> failed tests: ap_ft_eap_cui

This looks unrelated to the commit question. Please check.

Sebastian

Subject: Re: [rt-devel:linux-6.2.y-rt-rebase] [printk] 5342b8e20b: hwsim.ap_ft_eap_cui.fail

On 2023-01-28 09:45:57 [+0800], Oliver Sang wrote:
> hi Sebastian,
Hi Oliver,

> we rebuilt the kernel for both this commit and its parent, and make sure the
> config are same for both (as attached, actually also same to the config we used
> in last tests for oiginal report), then rerun the tests more times, but the
> issue seems still persistent
>
> d144a18b3d136079 5342b8e20b15e5fb37e49de2435
> ---------------- ---------------------------
> fail:runs %reproduction fail:runs
> | | |
> :20 100% 20:20 hwsim.ap_ft_eap_cui.fail
> :20 100% 20:20 hwsim.ap_ft_many.fail
> :20 100% 20:20 hwsim.ap_ft_pmf_bip_cmac_128.fail
>
> attached one dmesg for this commit and another for parent FYI.

| wlan0: send auth to 02:00:00:00:03:00 (try 1/3)
| +wlan0: send auth to 02:00:00:00:03:00 (try 2/3)
| +wlan0: send auth to 02:00:00:00:03:00 (try 3/3)
| wlan0: authenticated
| wlan0: associate with 02:00:00:00:03:00 (try 1/3)
| -wlan0: RX ReassocResp from 02:00:00:00:03:00 (capab=0x411 status=0 aid=1)

| -wlan0: associated

| +wlan0: RX ReassocResp from 02:00:00:00:03:00 (capab=0x411 status=55 aid=1)
| +wlan0: 02:00:00:00:03:00 denied association (code=55)

It is hard to comprehend that the printk change broke wifi/ hwsim. Let
me add John to see what he thinks.

> BTW, we noticed PREEMPT_RT is mentioned in commit message, but we didn't enable
> it in our config, not sure if this is relevant?

These printk changes are kind of staged for upstream inclusion. "kind
of" because John is reworking them. So either I broke something while
rebasing them or the timing changed and this pops up. The 6.1 series had
mostly the same printk code. This should work independent of PREEMPT_RT.

Sebastian

2023-01-28 01:46:24

by kernel test robot

[permalink] [raw]
Subject: Re: [rt-devel:linux-6.2.y-rt-rebase] [printk] 5342b8e20b: hwsim.ap_ft_eap_cui.fail

hi Sebastian,

On Tue, Jan 24, 2023 at 03:10:06PM +0100, Sebastian Andrzej Siewior wrote:
> On 2023-01-24 21:23:54 [+0800], kernel test robot wrote:
> > d144a18b3d136079 5342b8e20b15e5fb37e49de2435
> > ---------------- ---------------------------
> > fail:runs %reproduction fail:runs
> > | | |
> > :6 83% 5:6 hwsim.ap_ft_eap_cui.fail
> > :6 100% 6:6 hwsim.ap_ft_many.fail
> > :6 100% 6:6 hwsim.ap_ft_pmf_bip_cmac_128.fail
> …
> > Roaming association rejected
> > Traceback (most recent call last):
> > File "/lkp/benchmarks/hwsim/tests/hwsim/./run-tests.py", line 534, in main
> > t(dev, apdev)
> > File "/lkp/benchmarks/hwsim/tests/hwsim/test_ap_ft.py", line 1519, in test_ap_ft_eap_cui
> > generic_ap_ft_eap(dev, apdev, vlan=False, cui=True)
> > File "/lkp/benchmarks/hwsim/tests/hwsim/test_ap_ft.py", line 1485, in generic_ap_ft_eap
> > run_roams(dev[0], apdev, hapd, hapd1, ssid, passphrase, eap=True,
> > File "/lkp/benchmarks/hwsim/tests/hwsim/test_ap_ft.py", line 273, in run_roams
> > dev.roam(ap1['bssid'])
> > File "/lkp/benchmarks/hwsim/tests/hwsim/wpasupplicant.py", line 1238, in roam
> > raise Exception("Roaming association rejected")
> > Exception: Roaming association rejected
> > FAIL ap_ft_eap_cui 2.405507 2023-01-21 20:29:33.761610
> > passed 0 test case(s)
> > skipped 0 test case(s)
> > failed tests: ap_ft_eap_cui
>
> This looks unrelated to the commit question. Please check.

we rebuilt the kernel for both this commit and its parent, and make sure the
config are same for both (as attached, actually also same to the config we used
in last tests for oiginal report), then rerun the tests more times, but the
issue seems still persistent

d144a18b3d136079 5342b8e20b15e5fb37e49de2435
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:20 100% 20:20 hwsim.ap_ft_eap_cui.fail
:20 100% 20:20 hwsim.ap_ft_many.fail
:20 100% 20:20 hwsim.ap_ft_pmf_bip_cmac_128.fail

attached one dmesg for this commit and another for parent FYI.

BTW, we noticed PREEMPT_RT is mentioned in commit message, but we didn't enable
it in our config, not sure if this is relevant?

>
> Sebastian


Attachments:
(No filename) (2.39 kB)
dmesg.xz (146.64 kB)
dmesg-parent.xz (192.45 kB)
config-6.2.0-rc3-00014-g5342b8e20b15 (168.19 kB)
Download all attachments