2002-07-30 11:23:45

by Axel H. Siebenwirth

[permalink] [raw]
Subject: Testing of filesystems

Hi,

I wonder what a good way is to stress test my JFS filesystem. Is there a tool
that does something like that maybe? Dont't want performance testing, just
all kinds of stress testing to see how the filesystem "is" and to check
integrity and functionality.
What are you filesystem developers use to do something like that?

Thanks,
Axel


2002-07-30 12:02:22

by Richard B. Johnson

[permalink] [raw]
Subject: Re: Testing of filesystems

On Tue, 30 Jul 2002, Axel Siebenwirth wrote:

> Hi,
>
> I wonder what a good way is to stress test my JFS filesystem. Is there a tool
> that does something like that maybe? Dont't want performance testing, just
> all kinds of stress testing to see how the filesystem "is" and to check
> integrity and functionality.
> What are you filesystem developers use to do something like that?
>
> Thanks,
> Axel

Compile the kernel in a directory tree on the file-system you
want to test......

while true ; do make clean ; make -j 16 bzImage ; make modules ; done


Let this run for a day or so...


Cheers,
Dick Johnson
Penguin : Linux version 2.4.18 on an i686 machine (797.90 BogoMips).
The US military has given us many words, FUBAR, SNAFU, now ENRON.
Yes, top management were graduates of West Point and Annapolis.

2002-07-30 12:12:27

by Alex Riesen

[permalink] [raw]
Subject: Re: Testing of filesystems

On Tue, Jul 30, 2002 at 11:49:02AM +0200, Axel Siebenwirth wrote:
> Hi,
>
> I wonder what a good way is to stress test my JFS filesystem. Is there a tool
> that does something like that maybe? Dont't want performance testing, just
> all kinds of stress testing to see how the filesystem "is" and to check
> integrity and functionality.
> What are you filesystem developers use to do something like that?

while sleep 1; do

for i in `seq 1 100`; do
dd if=/dev/zero of=f$i bs=$(( $i * 100 )) count=$(( $i * 10 ))
done
cat * >/dev/null
rm *
make -C dummy-kernel dep bzImage modules -j2

done

2002-07-30 12:19:32

by Bill Rugolsky Jr.

[permalink] [raw]
Subject: Re: Testing of filesystems

On Tue, Jul 30, 2002 at 11:49:02AM +0200, Axel Siebenwirth wrote:
> I wonder what a good way is to stress test my JFS filesystem. Is there a tool
> that does something like that maybe? Dont't want performance testing, just
> all kinds of stress testing to see how the filesystem "is" and to check
> integrity and functionality.

See the ext3 cvs tree at

http://sourceforge.net/projects/gkernel

[Jeff Garzik's CVS tree hosts the ext3 tree.]

Andrew Morton, being conscientious and methodical, has written lots of
filesystem testing tools during his work on ext3. Some of these tests
are for specific ext3 regressions, but many are useful as general
integrity tests oriented toward journalled filesystems. He has also
ported/improved several other tools, including a bunch of changes to
the notorious FSX, the File System eXerciser.

The Namesys folks also have a test suite for Reiserfs, see http://www.namesys.com.

Regards,

Bill Rugolsky

2002-07-30 12:27:07

by Roy Sigurd Karlsbakk

[permalink] [raw]
Subject: Re: Testing of filesystems


What sort of tools _have_ been used to test JFS to date? and - what version(s)
have been tested?

On Tuesday 30 July 2002 14:22, Bill Rugolsky Jr. wrote:
> On Tue, Jul 30, 2002 at 11:49:02AM +0200, Axel Siebenwirth wrote:
> > I wonder what a good way is to stress test my JFS filesystem. Is there a
> > tool that does something like that maybe? Dont't want performance
> > testing, just all kinds of stress testing to see how the filesystem "is"
> > and to check integrity and functionality.
>
> See the ext3 cvs tree at
>
> http://sourceforge.net/projects/gkernel
>
> [Jeff Garzik's CVS tree hosts the ext3 tree.]
>
> Andrew Morton, being conscientious and methodical, has written lots of
> filesystem testing tools during his work on ext3. Some of these tests
> are for specific ext3 regressions, but many are useful as general
> integrity tests oriented toward journalled filesystems. He has also
> ported/improved several other tools, including a bunch of changes to
> the notorious FSX, the File System eXerciser.
>
> The Namesys folks also have a test suite for Reiserfs, see http://www.namesys.com.
>
> Regards,
>
> Bill Rugolsky
> -
> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> the body of a message to [email protected]
> More majordomo info at http://vger.kernel.org/majordomo-info.html
> Please read the FAQ at http://www.tux.org/lkml/

--
Roy Sigurd Karlsbakk, Datavaktmester

Computers are like air conditioners.
They stop working when you open Windows.

2002-07-30 15:37:13

by Paul Larson

[permalink] [raw]
Subject: Re: Testing of filesystems

On Tue, 2002-07-30 at 07:15, Alex Riesen wrote:
> On Tue, Jul 30, 2002 at 11:49:02AM +0200, Axel Siebenwirth wrote:
> > Hi,
> >
> > I wonder what a good way is to stress test my JFS filesystem. Is there a tool
> > that does something like that maybe? Dont't want performance testing, just
> > all kinds of stress testing to see how the filesystem "is" and to check
> > integrity and functionality.
> > What are you filesystem developers use to do something like that?
You may also want to take a look at the tests in the Linux Test
Project. There are several tests there that target the filesystem.

Paul Larson
Linux Test Project
http://ltp.sourceforge.net

2002-07-30 17:49:27

by Cliff White

[permalink] [raw]
Subject: Re: Testing of filesystems

> Hi,
>
> I wonder what a good way is to stress test my JFS filesystem. Is there a tool
> that does something like that maybe? Dont't want performance testing, just
> all kinds of stress testing to see how the filesystem "is" and to check
> integrity and functionality.
> What are you filesystem developers use to do something like that?
>

You can use the Scalable Test Platform at the OSDL.
We currently have iozone and tiobench test which support JFS, and
we're looking to add other tests. For details, see
http://www.osdl.org/stp/
cliffw

> Thanks,
> Axel
> -
> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> the body of a message to [email protected]
> More majordomo info at http://vger.kernel.org/majordomo-info.html
> Please read the FAQ at http://www.tux.org/lkml/
>


2002-08-11 02:47:14

by Tom Vier

[permalink] [raw]
Subject: Re: Testing of filesystems

On Tue, Jul 30, 2002 at 11:49:02AM +0200, Axel Siebenwirth wrote:
> I wonder what a good way is to stress test my JFS filesystem. Is there a tool
<snip>

fsx.c came up a while ago on l-k. it's an old (but still very useful) fs
stressor(sp) from neXT. i have a copy davej modded for linux. if you can't
find it, i can send it to you. i haven't been brave enough to run it myself,
on my alpha's reiserfs. 8) it found some hard to find bugs in ext2 that were
lurking for years (iirc).

--
Tom Vier <[email protected]>
DSA Key ID 0xE6CB97DA

2002-08-11 08:44:37

by Hans Reiser

[permalink] [raw]
Subject: Re: Testing of filesystems

Tom Vier wrote:

>On Tue, Jul 30, 2002 at 11:49:02AM +0200, Axel Siebenwirth wrote:
>
>
>>I wonder what a good way is to stress test my JFS filesystem. Is there a tool
>>
>>
><snip>
>
>fsx.c came up a while ago on l-k. it's an old (but still very useful) fs
>stressor(sp) from neXT. i have a copy davej modded for linux. if you can't
>find it, i can send it to you. i haven't been brave enough to run it myself,
>on my alpha's reiserfs. 8) it found some hard to find bugs in ext2 that were
>lurking for years (iirc).
>
>
>
It found bugs in reiserfs and we fixed them.:)

--
Hans



2002-08-11 09:30:22

by Andrew Morton

[permalink] [raw]
Subject: Re: Testing of filesystems

Hans Reiser wrote:
>
> Tom Vier wrote:
>
> >On Tue, Jul 30, 2002 at 11:49:02AM +0200, Axel Siebenwirth wrote:
> >
> >
> >>I wonder what a good way is to stress test my JFS filesystem. Is there a tool
> >>
> >>
> ><snip>
> >
> >fsx.c came up a while ago on l-k. it's an old (but still very useful) fs
> >stressor(sp) from neXT. i have a copy davej modded for linux. if you can't
> >find it, i can send it to you. i haven't been brave enough to run it myself,
> >on my alpha's reiserfs. 8) it found some hard to find bugs in ext2 that were
> >lurking for years (iirc).
> >
> >
> >
> It found bugs in reiserfs and we fixed them.:)

fsx-linux is great. Caused me no end of grief in 2.5.13. Running
it on small blocksize fs alongside really heavy memory pressure
touches all sorts of corner cases.

I have a version which is tricked up to understand O_DIRECT
in http://www.zip.com.au/~akpm/linux/ext3-tools.tar.gz