Received-SPF: pass (google.com: domain of linux-wireless+bounces-5739-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45d1:ec00::1 as permitted sender) client-ip=2604:1380:45d1:ec00::1;
Date: Tue, 2 Apr 2024 14:18:51 +0800
From: Oliver Sang <oliver.sang@intel.com>
To: Johannes Berg <johannes@sipsolutions.net>
CC: <oe-lkp@lists.linux.dev>, <lkp@intel.com>, <linux-kernel@vger.kernel.org>,
	Ilan Peer <ilan.peer@intel.com>, Miriam Rachel Korenblit
	<miriam.rachel.korenblit@intel.com>, <linux-wireless@vger.kernel.org>,
	<oliver.sang@intel.com>
Subject: Re: [linus:master] [wifi]  310c8387c6: hwsim.autogo_chan_switch.fail
Message-ID: <ZgujSwzFcEwXAeFO@xsang-OptiPlex-9020>
References: <202403291042.d9211733-oliver.sang@intel.com>
 <21c0ba406df6bc4cbd54810b3ff343ced5462615.camel@sipsolutions.net>
Content-Type: multipart/mixed; boundary="N59uyj9E2OLxwQK7"
Content-Disposition: inline
In-Reply-To: <21c0ba406df6bc4cbd54810b3ff343ced5462615.camel@sipsolutions.net>
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?3jDmWYUmarIAw7vHg2/AV7IolcaO0ieG+SXKUj4P/lxfcBdErfIDTM5dp4YL?=
 =?us-ascii?Q?fvzeA1XVIQd20oxO+aocISbagIKBHxB7W5z9BqB5S4uvN9Xtvr8HO/SiVS8U?=
 =?us-ascii?Q?6VTI/0yBnnvYQzh2Ps1QJezuzFU7EgzU4erO/vRF8FSpsrJlit/ZoSZQ/3AG?=
 =?us-ascii?Q?VZg0BKZgVv1hjJphd14xEftSvDDpl7q2dRzurva3O++iYNaCH41YdMfNdrZK?=
 =?us-ascii?Q?hO1TBw46wagWN9vENQDHOguB/B0SbDZzaHIAKplwLbrD4FYi+ssEd404wRkh?=
 =?us-ascii?Q?T+F5l33OqkBgkAgOBvZxZn84caD11zQSDFFm/j/NJmTPL5H1Zygl88BOOeua?=
 =?us-ascii?Q?B5MDWf0HVEObn/QzEiqomGvHeDJFl1Gb3ArglBFCUoNTBB+GM+hm7g4cVjuW?=
 =?us-ascii?Q?OD3mQswqzJ9KHKwHG8xblppp3vGuBR1jwCWwZfCT02GRVWrAB5b+y2kKB0ne?=
 =?us-ascii?Q?csFcF52CJpDuTnzEJnAi/Y0Yw+Xn6zKhbqZkSfJtTySpmWyuEarK/HK1P/xl?=
 =?us-ascii?Q?t+jCI3l9C2MIvtKcDn+8yfGEKZDg5iH73PseiFKV8XcmnAxSoEP9ueKs5Kmu?=
 =?us-ascii?Q?eDw8loxLIjma2yzae/6mlAVGNhKXlIvH9IA//GyiUbGVy9futP0Qtge41V3p?=
 =?us-ascii?Q?PCG+k51aqt123u8ORPUIxly5U3RwBvnQ4j6jENYBb+RVweJ53pVMX57GxqQu?=
 =?us-ascii?Q?dpvC0wsDfZDVqFiUyTkPSrzpzu30eH9WeEGHEy4QK0UNuf2YfXiTxjPq5D5H?=
 =?us-ascii?Q?FPbYY6TDiB5iygxHkkQI2xk20NGs+WZQm82raYlZq5LvmToB/R/QLtcfKQLl?=
 =?us-ascii?Q?hEYQgOG6ra9VlTbPez2RGB7UbdjxIO8bBDBwUFxuRBRssd/8sbPRBawcL+er?=
 =?us-ascii?Q?H1CWKBSzRZEt0770o5AME6Yup7jq1GpPQKNAV7jocV+1i3+9bBd8D3gTuItK?=
 =?us-ascii?Q?+CPAMTCnFPY1LPAfLcP+nagJQOzAUBqfn0pKsZoVhSyGld/CCg5/4J3ITKgi?=
 =?us-ascii?Q?s3OZq3JU8BJSyUUdKEcKpx0/6Bo/pHOq8bZWvKWvMFDt0Vn12i/P7qcnlccc?=
 =?us-ascii?Q?M1uN3hSqWYVyvXB2YHoIN6ZO7FcUnxxYqVbs/IOtJPLKdhafn4xTFmyr6m7H?=
 =?us-ascii?Q?RWQ5ogrOJcUo44PvxB+Qdv3HRGPYAU5UbiYn2LsNJYM/dS7TlAS/eZ7r6arp?=
 =?us-ascii?Q?2C1h3d6SwSn1PBQ84IbjNeStYcW7Dsu6uN8wwHsjkH+GEeNvjqm3roYjhZej?=
 =?us-ascii?Q?wwBobeEHcjqWgxsQheLFPqttFj1AdzVSHm7GJQl9SZEdJDovLS+M4lK/f4N/?=
 =?us-ascii?Q?svuy5gqyJKgfBQAECkcAD6snRLEgzuDXSDFt+7utPXTXOcH1cPDUP0Agl14O?=
 =?us-ascii?Q?a6cUPci5dYiy1yOGVT79dAg6E6L0xzEjpbbnVUqvdDJ8zrzcmi6asQ3qH052?=
 =?us-ascii?Q?IguPmy+q19VtxDFEA78ug2PyJVsro5p3L/+FS61sDFXFFxz0yvhUL8i2ioD8?=
 =?us-ascii?Q?m/FQE7Nkympx0gVZwiTYqT7ynaGhXBbMfAuavze9MINYcZtUdv4qZYBkFqEW?=
 =?us-ascii?Q?m1pdpQNudQeMH+2+UVbtgDzVTbT94U3RaJBg6Dxf1o4kR7ng0b2UoutUTMOm?=
 =?us-ascii?Q?nw=3D=3D?=
X-MS-Exchange-CrossTenant-Network-Message-Id: 2d9da658-5a48-46d8-4691-08dc52dcc8d8
X-MS-Exchange-CrossTenant-AuthSource: LV3PR11MB8603.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 02 Apr 2024 06:18:59.7217
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: dTn1hMimfAXSMvWQmaM8A9NsNoza4Oziylb4Z83IsZmBAdiPRLEj1nI1krCLaa9MJbB1Adi1+bEz95S57Tf5aw==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SJ2PR11MB8347
X-OriginatorOrg: intel.com

--N59uyj9E2OLxwQK7
Content-Type: text/plain; charset="us-ascii"
Content-Disposition: inline

hi, johannes,

On Fri, Mar 29, 2024 at 11:08:51AM +0100, Johannes Berg wrote:
> On Fri, 2024-03-29 at 10:24 +0800, kernel test robot wrote:
> > 
> > Hello,
> > 
> > kernel test robot noticed "hwsim.autogo_chan_switch.fail" on:
> > 
> > commit: 310c8387c63830bc375827242e0f9fa689f82e21 ("wifi: mac80211: clean up connection process")
> > https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
> > 
> > [test failed on linus/master 7033999ecd7b8cf9ea59265035a0150961e023ee]
> > [test failed on linux-next/master 26074e1be23143b2388cacb36166766c235feb7c]
> > 
> > in testcase: hwsim
> > version: hwsim-x86_64-717e5d7-1_20240320
> > with following parameters:
> > 
> > 	test: autogo_chan_switch
> 
> Does any of that tell you which version of the tests it's using? It
> doesn't tell me, and "717e5d7" doesn't seem to be a hostap sha1. I also
> didn't find it in the CI archive.

sorry for confusing, due to some history reason, we improperly captured sha1
from https://github.com/bcopeland/wmediumd.git in the version label.

now we fixed it and it will show such like hwsim-x86_64-07c9f183e-1_20240402
in the future. the 07c9f183e is from http://w1.fi/hostap.git

07c9f183e (HEAD -> main, origin/pending, origin/main, origin/HEAD) tests: Avoid control interface throttling in various test cases


by just this version, we tested 310c8387c6 and its parent again, confirmed
the issue is still persistent

61f0261131c8dc2b 310c8387c63830bc375827242e0
---------------- ---------------------------
       fail:runs  %reproduction    fail:runs
           |             |             |
           :10          80%          10:10    hwsim.autogo_chan_switch.fail
           :10          80%          10:10    hwsim.autogo_chan_switch_group_iface.fail

I attached one hwsim output from parent (hwsim.61f0261131) and one from
310c8387c6 (hwsim.310c8387c6) for details.


> 
> That said, there were test issues raised with recent commits (and
> particularly this one), even upstream one of them (eht puncturing 1) is
> still failing as far as I know.

thanks for information! if you have any patch want us to test, just let us
know. Thanks!

> 
> johannes
> 

--N59uyj9E2OLxwQK7
Content-Type: text/plain; charset="us-ascii"
Content-Disposition: attachment; filename="hwsim.61f0261131"

group: group-20, test: autogo_chan_switch
2024-04-02 02:33:29 export USER=root
2024-04-02 02:33:29 ./build.sh
Building TNC testing tools
Building wlantest
Building hs20-osu-client
Building hostapd
Building wpa_supplicant
2024-04-02 02:34:30 ./start.sh
2024-04-02 02:34:32 ./run-tests.py autogo_chan_switch
DEV: wlan0: 02:00:00:00:00:00
DEV: wlan1: 02:00:00:00:01:00
DEV: wlan2: 02:00:00:00:02:00
APDEV: wlan3
APDEV: wlan4
START autogo_chan_switch 1/1
Test: P2P autonomous GO switching channels
Start autonomous GO wlan0
Try to connect the client to the GO
wlan1: Trying to discover peer 02:00:00:00:00:00
Client connected
PASS autogo_chan_switch 16.361446 2024-04-02 02:35:03.458893
passed all 1 test case(s)
2024-04-02 02:35:03 ./run-tests.py autogo_chan_switch_group_iface
DEV: wlan0: 02:00:00:00:00:00
DEV: wlan1: 02:00:00:00:01:00
DEV: wlan2: 02:00:00:00:02:00
APDEV: wlan3
APDEV: wlan4
START autogo_chan_switch_group_iface 1/1
Test: P2P autonomous GO switching channels (separate group interface)
Start autonomous GO wlan0
Try to connect the client to the GO
wlan1: Trying to discover peer 02:00:00:00:00:00
Client connected
PASS autogo_chan_switch_group_iface 17.332407 2024-04-02 02:35:32.180969
passed all 1 test case(s)
2024-04-02 02:35:32 ./run-tests.py p2p_device_autogo_chan_switch
DEV: wlan0: 02:00:00:00:00:00
DEV: wlan1: 02:00:00:00:01:00
DEV: wlan2: 02:00:00:00:02:00
APDEV: wlan3
APDEV: wlan4
START p2p_device_autogo_chan_switch 1/1
Test: P2P autonomous GO switching channels with cfg80211 P2P Device
Start autonomous GO wlan7
Try to connect the client to the GO
wlan1: Trying to discover peer 42:00:00:00:07:00
Client connected
PASS p2p_device_autogo_chan_switch 24.354487 2024-04-02 02:36:07.851656
passed all 1 test case(s)
2024-04-02 02:36:07 ./stop.sh

--N59uyj9E2OLxwQK7
Content-Type: text/plain; charset="us-ascii"
Content-Disposition: attachment; filename="hwsim.310c8387c6"

group: group-20, test: autogo_chan_switch
2024-04-02 02:29:04 export USER=root
2024-04-02 02:29:04 ./build.sh
Building TNC testing tools
Building wlantest
Building hs20-osu-client
Building hostapd
Building wpa_supplicant
2024-04-02 02:30:06 ./start.sh
2024-04-02 02:30:07 ./run-tests.py autogo_chan_switch
DEV: wlan0: 02:00:00:00:00:00
DEV: wlan1: 02:00:00:00:01:00
DEV: wlan2: 02:00:00:00:02:00
APDEV: wlan3
APDEV: wlan4
START autogo_chan_switch 1/1
Test: P2P autonomous GO switching channels
Start autonomous GO wlan0
Try to connect the client to the GO
wlan1: Trying to discover peer 02:00:00:00:00:00
Client connected
sending data without carrier won't work
Traceback (most recent call last):
  File "/lkp/benchmarks/hwsim/tests/hwsim/./run-tests.py", line 593, in main
    t(dev)
  File "/lkp/benchmarks/hwsim/tests/hwsim/test_p2p_autogo.py", line 357, in test_autogo_chan_switch
    run_autogo_chan_switch(dev)
  File "/lkp/benchmarks/hwsim/tests/hwsim/test_p2p_autogo.py", line 375, in run_autogo_chan_switch
    hwsim_utils.test_connectivity_p2p(dev[0], dev[1])
  File "/lkp/benchmarks/hwsim/tests/hwsim/hwsim_utils.py", line 227, in test_connectivity_p2p
    test_connectivity(dev1, dev2, dscp, tos, dev1group=True, dev2group=True)
  File "/lkp/benchmarks/hwsim/tests/hwsim/hwsim_utils.py", line 217, in test_connectivity
    raise Exception(last_err)
Exception: sending data without carrier won't work
FAIL autogo_chan_switch 16.286132 2024-04-02 02:30:39.168596
passed 0 test case(s)
skipped 0 test case(s)
failed tests: autogo_chan_switch
2024-04-02 02:30:39 ./run-tests.py autogo_chan_switch_group_iface
DEV: wlan0: 02:00:00:00:00:00
DEV: wlan1: 02:00:00:00:01:00
DEV: wlan2: 02:00:00:00:02:00
APDEV: wlan3
APDEV: wlan4
START autogo_chan_switch_group_iface 1/1
Test: P2P autonomous GO switching channels (separate group interface)
Start autonomous GO wlan0
Try to connect the client to the GO
wlan1: Trying to discover peer 02:00:00:00:00:00
Client connected
sending data without carrier won't work
Traceback (most recent call last):
  File "/lkp/benchmarks/hwsim/tests/hwsim/./run-tests.py", line 593, in main
    t(dev)
  File "/lkp/benchmarks/hwsim/tests/hwsim/test_p2p_autogo.py", line 383, in test_autogo_chan_switch_group_iface
    run_autogo_chan_switch(dev)
  File "/lkp/benchmarks/hwsim/tests/hwsim/test_p2p_autogo.py", line 375, in run_autogo_chan_switch
    hwsim_utils.test_connectivity_p2p(dev[0], dev[1])
  File "/lkp/benchmarks/hwsim/tests/hwsim/hwsim_utils.py", line 227, in test_connectivity_p2p
    test_connectivity(dev1, dev2, dscp, tos, dev1group=True, dev2group=True)
  File "/lkp/benchmarks/hwsim/tests/hwsim/hwsim_utils.py", line 217, in test_connectivity
    raise Exception(last_err)
Exception: sending data without carrier won't work
FAIL autogo_chan_switch_group_iface 17.390208 2024-04-02 02:31:07.869510
passed 0 test case(s)
skipped 0 test case(s)
failed tests: autogo_chan_switch_group_iface
2024-04-02 02:31:07 ./run-tests.py p2p_device_autogo_chan_switch
DEV: wlan0: 02:00:00:00:00:00
DEV: wlan1: 02:00:00:00:01:00
DEV: wlan2: 02:00:00:00:02:00
APDEV: wlan3
APDEV: wlan4
START p2p_device_autogo_chan_switch 1/1
Test: P2P autonomous GO switching channels with cfg80211 P2P Device
Start autonomous GO wlan7
Try to connect the client to the GO
wlan1: Trying to discover peer 42:00:00:00:07:00
Client connected
PASS p2p_device_autogo_chan_switch 24.104111 2024-04-02 02:31:43.303405
passed all 1 test case(s)
2024-04-02 02:31:43 ./stop.sh

--N59uyj9E2OLxwQK7--