2003-03-20 22:02:09

by Doug Ramier

[permalink] [raw]
Subject: LTP version 20030306

We have found that in the past several months that the LTP version appears
to become "buggier" with each successive release.

>From the patches that are coming across this list there are an incredible
number of problems.

After overcoming problems with the compilation, we are getting between 50
and 130 failures on 64 and 32 bit versions which with 20030206 we had on
the order of a dozen.

I have a few questions:
1) Is everyone getting a "large" number of false failures?
2) Are the tests checked out before being released by SourceForge?
3) Are the tests only verified on Intel? How about PowerPC and iSeries?
4) Is there a version released after the release that has the 205 patches
installed?

Thanks,
Doug Ramier
pSeries / iSeries Linux Testing
507/253-2186
t/l 553-2186




2003-03-20 22:33:06

by Paul Larson

[permalink] [raw]
Subject: Re: [LTP] LTP version 20030306

On Thu, 2003-03-20 at 16:12, Doug Ramier wrote:
> After overcoming problems with the compilation, we are getting between 50
> and 130 failures on 64 and 32 bit versions which with 20030206 we had on
> the order of a dozen.
Quick suggestion, instead of sending a flame out to everyone you can
think of, try sending some specific information about the problem you're
having the the appropriate mailing list (ltp-list). Details will help
us solve your problem, ranting will not.

> I have a few questions:
> 1) Is everyone getting a "large" number of false failures?
No, again, details please

> 2) Are the tests checked out before being released by SourceForge?
Yes
> 3) Are the tests only verified on Intel? How about PowerPC and iSeries?
We can verify on the hardware we have available to us. Obviously we
don't have everything ever made, or even a sample of every architecture
supported by Linux. Being an open source project we depend on others to
let us know when they are having problems on an architecture that we
don't have. Are you volunteering?

> 4) Is there a version released after the release that has the 205 patches
> installed?
I'm not sure what "205 patches" you're referring to. We make monthly
releases, and fixes are made to cvs in the interim. You can pull from
the cvs tree to get the latest.

2003-03-20 22:29:17

by Robert Williamson

[permalink] [raw]
Subject: Re: [LTP] LTP version 20030306


> We have found that in the past several months that the LTP version
appears
> to become "buggier" with each successive release.
I apologize for the large number of "bugs" in the recent releases, but it
was because we added a large amount of new tests in a short amount of time.
Anyone familiar with the history of the LTP knows that the same thing
happened when we added 500+ new testcases after the move from SGI's site a
few years back.

> From the patches that are coming across this list there are an incredible
> number of problems.
Most of these patches were warning cleanup patches.

> After overcoming problems with the compilation, we are getting between 50
> and 130 failures on 64 and 32 bit versions which with 20030206 we had on
> the order of a dozen.
If you send your problems to the [email protected], we would be more
than happy to assist you. Strangely, we have never seen that many problems
when we receive results on i386, s390, s390x, x86-64, IA64, MIPS, or PPC64.

> I have a few questions:
> 1) Is everyone getting a "large" number of false failures?
I cannot answer for everyone, and I'm not sure what a "large" number means.

> 2) Are the tests checked out before being released by SourceForge?
Yes, we build, install, and run every release of the LTP BEFORE we
announce. We review the failures and check for any build errors.

> 3) Are the tests only verified on Intel? How about PowerPC and iSeries?
Unfortunately, we are unable to test each release on every architecture
supported by Linux. We choose to test the release on i386 archs, because
this is the main architecture of choice and the code is usually "cleaner".
Although we try to execute the LTP on s390 and PPC64 archs, we rely on the
Open Source community to run and test the LTP against other non-i386
archs...and submit patches for problems they find.

> 4) Is there a version released after the release that has the 205 patches
> installed?
No. However, most of those patches you speak of were compiler warning
cleanups and anyone can anonymously pull the latest copy of the LTP from
our CVS tree.


- Robbie

Robert V. Williamson <[email protected]>
Linux Test Project
IBM Linux Technology Center
Phone: (512) 838-9295 T/L: 678-9295
Fax: (512) 838-4603
Web: http://ltp.sourceforge.net
IRC: #ltp on freenode.irc.net
====================
"Only two things are infinite, the universe and human stupidity, and I'm
not sure about the former." -Albert Einstein



Doug
Ramier/Rochester/Contr/IB To: [email protected], [email protected],
M@IBMUS [email protected]
Sent by: cc: Li Ge/Austin/IBM@IBMUS, Linda Scott/Austin/IBM@IBMUS
[email protected] Subject: [LTP] LTP version 20030306
ceforge.net


03/20/2003 04:12 PM





We have found that in the past several months that the LTP version appears
to become "buggier" with each successive release.

>From the patches that are coming across this list there are an incredible
number of problems.

After overcoming problems with the compilation, we are getting between 50
and 130 failures on 64 and 32 bit versions which with 20030206 we had on
the order of a dozen.

I have a few questions:
1) Is everyone getting a "large" number of false failures?
2) Are the tests checked out before being released by SourceForge?
3) Are the tests only verified on Intel? How about PowerPC and iSeries?
4) Is there a version released after the release that has the 205 patches
installed?

Thanks,
Doug Ramier
pSeries / iSeries Linux Testing
507/253-2186
t/l 553-2186





-------------------------------------------------------
This SF.net email is sponsored by: Tablet PC.
Does your code think in ink? You could win a Tablet PC.
Get a free Tablet PC hat just for playing. What are you waiting for?
http://ads.sourceforge.net/cgi-bin/redirect.pl?micr5043en
_______________________________________________
Ltp-list mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/ltp-list