2012-07-03 12:47:47

by Piotr.Nakraszewicz

[permalink] [raw]
Subject: wlan automated tests

Hi,

What is the current status of wlan automated tests?

I found 3 started projects:

1. wifi-test:
http://wireless.kernel.org/en/developers/Testing/wifi-test
But it looks dead. Last commit is from 2010.

2. LTP:
http://thread.gmane.org/gmane.linux.kernel.wireless.general/19759
http://thread.gmane.org/gmane.linux.ltp/7884

The last comment I found was from 2009 from Luis R. Rodriguez:
"The GSoC student fell off from the face of the earth without even notice so the project was never finished. The project is up for grabs for anyone now to implement."

Is that still valid?

3. Chromium Wifi tests:
http://thread.gmane.org/gmane.linux.kernel.wireless.general/57576

The problem is they are designed to test chromium OS so it looks like they can't be used for purpose described here:
https://wiki.linuxfoundation.org/en/Google_Summer_of_Code_2009#Automation_of_testing_using_mac80211_hwsim_and_Orbit
"Ideally we'd like to see automated tests run weekly to ensure there are no regressions for basic functionality. To test mac80211 and cfg80211 we can use and advance mac80211_hwsim as required without the need to actually use hardware."


I'm planning to use and extend one of these projects and I'd like to know which one is preferable.
Any hints?

Pozdrawiam / Best regards,
Piotr




2012-07-03 16:46:36

by Paul Stewart

[permalink] [raw]
Subject: Re: wlan automated tests

On Tue, Jul 3, 2012 at 9:11 AM, Luis R. Rodriguez <[email protected]> wrote:
> On Tue, Jul 3, 2012 at 8:54 AM, Paul Stewart <[email protected]> wrote:
>> On Tue, Jul 3, 2012 at 5:47 AM, <[email protected]> wrote:
>>> Hi,
>>>
>>> What is the current status of wlan automated tests?
>>>
>>> I found 3 started projects:
>>>
>>> 1. wifi-test:
>>> http://wireless.kernel.org/en/developers/Testing/wifi-test
>>> But it looks dead. Last commit is from 2010.
>>>
>>> 2. LTP:
>>> http://thread.gmane.org/gmane.linux.kernel.wireless.general/19759
>>> http://thread.gmane.org/gmane.linux.ltp/7884
>>>
>>> The last comment I found was from 2009 from Luis R. Rodriguez:
>>> "The GSoC student fell off from the face of the earth without even notice so the project was never finished. The project is up for grabs for anyone now to implement."
>>>
>>> Is that still valid?
>>>
>>> 3. Chromium Wifi tests:
>>> http://thread.gmane.org/gmane.linux.kernel.wireless.general/57576
>>>
>>> The problem is they are designed to test chromium OS so it looks like they can't be used for purpose described here:
>>
>> It should be reasonably straightforward to use this setup with
>> something other than ChromeOS. Most of the work required to do so
>> would circle around creating platform-specific routines used to
>> establish and monitor status of connections -- the
>> site_wlan_connect.py and site_wlan_wait_state.py scripts.
>
> That's pretty awesome, what is the source of documentation for this?
> Is code pushed back upstream to autotest now ?

There's not a whole lot of documentation floating around externally,
however that should change fairly soon. Since, as you say, this stuff
is fairly customized for ChromeOS as-is, no effort has been made to
push the core of the WiFi tests upstream.

>
> Luis

2012-07-03 15:54:24

by Paul Stewart

[permalink] [raw]
Subject: Re: wlan automated tests

On Tue, Jul 3, 2012 at 5:47 AM, <[email protected]> wrote:
> Hi,
>
> What is the current status of wlan automated tests?
>
> I found 3 started projects:
>
> 1. wifi-test:
> http://wireless.kernel.org/en/developers/Testing/wifi-test
> But it looks dead. Last commit is from 2010.
>
> 2. LTP:
> http://thread.gmane.org/gmane.linux.kernel.wireless.general/19759
> http://thread.gmane.org/gmane.linux.ltp/7884
>
> The last comment I found was from 2009 from Luis R. Rodriguez:
> "The GSoC student fell off from the face of the earth without even notice so the project was never finished. The project is up for grabs for anyone now to implement."
>
> Is that still valid?
>
> 3. Chromium Wifi tests:
> http://thread.gmane.org/gmane.linux.kernel.wireless.general/57576
>
> The problem is they are designed to test chromium OS so it looks like they can't be used for purpose described here:

It should be reasonably straightforward to use this setup with
something other than ChromeOS. Most of the work required to do so
would circle around creating platform-specific routines used to
establish and monitor status of connections -- the
site_wlan_connect.py and site_wlan_wait_state.py scripts.

> https://wiki.linuxfoundation.org/en/Google_Summer_of_Code_2009#Automation_of_testing_using_mac80211_hwsim_and_Orbit
> "Ideally we'd like to see automated tests run weekly to ensure there are no regressions for basic functionality. To test mac80211 and cfg80211 we can use and advance mac80211_hwsim as required without the need to actually use hardware."
>
>
> I'm planning to use and extend one of these projects and I'd like to know which one is preferable.
> Any hints?
>
> Pozdrawiam / Best regards,
> Piotr
>
>

2012-07-04 11:28:21

by Piotr.Nakraszewicz

[permalink] [raw]
Subject: RE: wlan automated tests

T24gVHVlLCBKdWwgMywgMjAxMiBhdCA1OjU0IFBNLCBQYXVsIFN0ZXdhcnQgPHBzdGV3QGNocm9t
aXVtLm9yZz4gd3JvdGU6DQo+DQo+IEl0IHNob3VsZCBiZSByZWFzb25hYmx5IHN0cmFpZ2h0Zm9y
d2FyZCB0byB1c2UgdGhpcyBzZXR1cCB3aXRoIA0KPiBzb21ldGhpbmcgb3RoZXIgdGhhbiBDaHJv
bWVPUy4gIE1vc3Qgb2YgdGhlIHdvcmsgcmVxdWlyZWQgdG8gZG8gc28gDQo+IHdvdWxkIGNpcmNs
ZSBhcm91bmQgY3JlYXRpbmcgcGxhdGZvcm0tc3BlY2lmaWMgcm91dGluZXMgdXNlZCB0byANCj4g
ZXN0YWJsaXNoIGFuZCBtb25pdG9yIHN0YXR1cyBvZiBjb25uZWN0aW9ucyAtLSB0aGUgDQo+IHNp
dGVfd2xhbl9jb25uZWN0LnB5IGFuZCBzaXRlX3dsYW5fd2FpdF9zdGF0ZS5weSBzY3JpcHRzLg0K
DQpUaGF0IGxvb2tzIHByb21pc2luZywgSSB3aWxsIGZvY3VzIG9uIHRoYXQuDQpUaGFua3MgZm9y
IGFsbCB0aGUgcmVwbGllcy4NCkknbGwgYmUgcG9zdGluZyBteSBmaW5kaW5ncyBhbmQvb3IgcXVl
c3Rpb25zIGhlcmUuDQoNClBvemRyYXdpYW0gLyBCZXN0IHJlZ2FyZHMsDQpQaW90cg0K

2012-07-03 13:29:42

by Johannes Berg

[permalink] [raw]
Subject: Re: wlan automated tests

On Tue, 2012-07-03 at 15:47 +0300, [email protected] wrote:

> 1. wifi-test:
> http://wireless.kernel.org/en/developers/Testing/wifi-test
> But it looks dead. Last commit is from 2010.

This is definitely dead.

> 2. LTP:
> http://thread.gmane.org/gmane.linux.kernel.wireless.general/19759
> http://thread.gmane.org/gmane.linux.ltp/7884

I don't know about this.

> 3. Chromium Wifi tests:
> http://thread.gmane.org/gmane.linux.kernel.wireless.general/57576

But I think this is probably the best one to extend.


Just earlier today I was thinking about nl80211-based tests like "scan
with the maximum IE length advertised" etc. I guess this would be
worthwhile to add into the test suite somehow.

johannes


2012-07-03 15:45:16

by Luis R. Rodriguez

[permalink] [raw]
Subject: Re: wlan automated tests

On Tue, Jul 3, 2012 at 6:29 AM, Johannes Berg <[email protected]> wrote:
> On Tue, 2012-07-03 at 15:47 +0300, [email protected] wrote:
>
>> 1. wifi-test:
>> http://wireless.kernel.org/en/developers/Testing/wifi-test
>> But it looks dead. Last commit is from 2010.
>
> This is definitely dead.
>
>> 2. LTP:
>> http://thread.gmane.org/gmane.linux.kernel.wireless.general/19759
>> http://thread.gmane.org/gmane.linux.ltp/7884
>
> I don't know about this.
>
>> 3. Chromium Wifi tests:
>> http://thread.gmane.org/gmane.linux.kernel.wireless.general/57576
>
> But I think this is probably the best one to extend.

Indeed, in fact I'm hoping somewhere out there AP mode operation can
be extended to the framework by some entity.

Luis

2012-07-03 16:11:47

by Luis R. Rodriguez

[permalink] [raw]
Subject: Re: wlan automated tests

On Tue, Jul 3, 2012 at 8:54 AM, Paul Stewart <[email protected]> wrote:
> On Tue, Jul 3, 2012 at 5:47 AM, <[email protected]> wrote:
>> Hi,
>>
>> What is the current status of wlan automated tests?
>>
>> I found 3 started projects:
>>
>> 1. wifi-test:
>> http://wireless.kernel.org/en/developers/Testing/wifi-test
>> But it looks dead. Last commit is from 2010.
>>
>> 2. LTP:
>> http://thread.gmane.org/gmane.linux.kernel.wireless.general/19759
>> http://thread.gmane.org/gmane.linux.ltp/7884
>>
>> The last comment I found was from 2009 from Luis R. Rodriguez:
>> "The GSoC student fell off from the face of the earth without even notice so the project was never finished. The project is up for grabs for anyone now to implement."
>>
>> Is that still valid?
>>
>> 3. Chromium Wifi tests:
>> http://thread.gmane.org/gmane.linux.kernel.wireless.general/57576
>>
>> The problem is they are designed to test chromium OS so it looks like they can't be used for purpose described here:
>
> It should be reasonably straightforward to use this setup with
> something other than ChromeOS. Most of the work required to do so
> would circle around creating platform-specific routines used to
> establish and monitor status of connections -- the
> site_wlan_connect.py and site_wlan_wait_state.py scripts.

That's pretty awesome, what is the source of documentation for this?
Is code pushed back upstream to autotest now ?

Luis