2013-06-12 05:36:20

by jon ernst

[permalink] [raw]
Subject: xfstest ext4 'utility required' run stop

Hi,

When I try to run xfstest 301 - 304. They all got error message "utility required, run stop, stkip this test" , test 305 is fine.
But it did not tell which utility is required. I do have test patition and scratch partition set up. And I do have e4defrag on my linux.

What could be the reason?please help.

Thanks!


2013-06-12 06:13:22

by Zheng Liu

[permalink] [raw]
Subject: Re: xfstest ext4 'utility required' run stop

On Wed, Jun 12, 2013 at 01:36:18AM -0400, jon ernst wrote:
> Hi,
>
> When I try to run xfstest 301 - 304. They all got error message "utility required, run stop, stkip this test" , test 305 is fine.
> But it did not tell which utility is required. I do have test patition and scratch partition set up. And I do have e4defrag on my linux.
>
> What could be the reason?please help.

Hi Jon,

Could you please check that 'fio' utility has been installed? You can
get it from this link:
git clone git://git.kernel.dk/fio.git

Regards,
- Zheng

2013-06-12 13:57:21

by Lukas Czerner

[permalink] [raw]
Subject: Re: xfstest ext4 'utility required' run stop

On Wed, 12 Jun 2013, Zheng Liu wrote:

> Date: Wed, 12 Jun 2013 14:31:32 +0800
> From: Zheng Liu <[email protected]>
> To: jon ernst <[email protected]>
> Cc: [email protected]
> Subject: Re: xfstest ext4 'utility required' run stop
>
> On Wed, Jun 12, 2013 at 01:36:18AM -0400, jon ernst wrote:
> > Hi,
> >
> > When I try to run xfstest 301 - 304. They all got error message "utility required, run stop, stkip this test" , test 305 is fine.
> > But it did not tell which utility is required. I do have test patition and scratch partition set up. And I do have e4defrag on my linux.
> >
> > What could be the reason?please help.
>
> Hi Jon,
>
> Could you please check that 'fio' utility has been installed? You can
> get it from this link:
> git clone git://git.kernel.dk/fio.git
>
> Regards,
> - Zheng

Right, you're missing 'fio' utility. And there is a bug in xfstests
because it should tell you that, I will send patch.

Thanks!
-Lukas

> --
> To unsubscribe from this list: send the line "unsubscribe linux-ext4" in
> the body of a message to [email protected]
> More majordomo info at http://vger.kernel.org/majordomo-info.html
>

2013-06-12 14:47:47

by Theodore Ts'o

[permalink] [raw]
Subject: Re: xfstest ext4 'utility required' run stop

On Wed, Jun 12, 2013 at 01:36:18AM -0400, jon ernst wrote:
> Hi,
>
> When I try to run xfstest 301 - 304. They all got error message "utility required, run stop, stkip this test" , test 305 is fine.
> But it did not tell which utility is required. I do have test patition and scratch partition set up. And I do have e4defrag on my linux.
>
> What could be the reason?please help.

For your convenience, you might want to take a look at:

git://git.kernel.org/pub/scm/fs/ext2/xfstests-bld.git

This will build all of the tools you need for xfstests, in a hermetic
build environment, and create a tarball that has everything you need
to run xfstests. There are also some convenience scripts which allow
you to easily kick off an xfstests run using qemu.


- Ted

2013-06-13 03:53:34

by jon ernst

[permalink] [raw]
Subject: Re: xfstest ext4 'utility required' run stop


>For your convenience, you might want to take a look at:

>git://git.kernel.org/pub/scm/fs/ext2/xfstests-bld.git

>This will build all of the tools you need for xfstests, in a hermetic
>build environment, and create a tarball that has everything you need
>to run xfstests. There are also some convenience scripts which allow
>you to easily kick off an xfstests run using qemu.
Thank you!
I found a small issue in README of xfstest-bld.
"make tarball" won't work unlesee do "make" once.
"make" pulls several repo's source code.
Then "make tarball" works.



> - Ted

2013-06-13 05:17:32

by jon ernst

[permalink] [raw]
Subject: Re: xfstest ext4 'utility required' run stop

Hi All,
about xfstestI installed fio. But still got error when I run ext4 test 301.
Could anyone enlight me what;s wrong with my configuration?
I have latest ext4 dev branch code with latest xfstest code.
fio version is 2.1.1

this is whole log:
Thank you!

fio: failed parsing ioengine=ioe_e4defrag
fio: job global dropped
fio         valid values: sync       Use read/write
                   : psync      Use pread/pwrite
                   : vsync      Use readv/writev
                   : libaio     Linux native asynchronous IO
                   : posixaio   POSIX asynchronous IO
                   : mmap       Memory mapped IO
                   : splice     splice/vmsplice based IO
                   : netsplice  splice/vmsplice to/from the network
                   : sg         SCSI generic v3 IO
                   : null       Testing engine (no data transfer)
                   : net        Network IO
                   : syslet-rw  syslet enabled async pread/pwrite IO
                   : cpuio      CPU cycle burner engine
                   : binject    binject direct inject block engine
                   : rdma       RDMA IO engine
                   : external   Load external engine (append name)


fio --ioengine=ioe_e4defrag --iodepth=1 --directory=/device8 --filesize=3424725990 --size=999G --buffered=0 --fadvise_hint=0 --name=defrag-4k --ioengine=e4defrag --iodepth=1 --bs=128k --donorname=test1.def --inplace=0 --rw=write --numjobs=4 --runtime=30*1 --time_based --filename=test1 --name=aio-dio-verifier --ioengine=libaio --iodepth=128*1 --numjobs=1 --verify=crc32c-intel --verify_fatal=1 --verify_dump=1 --verify_backlog=1024 --verify_async=1 --verifysort=1 --direct=1 --bs=64k --rw=randwrite --runtime=30*1 --time_based --filename=test1
mke2fs 1.42 (29-Nov-2011)
Filesystem label=
OS type: Linux
Block size=4096 (log=2)
Fragment size=4096 (log=2)
Stride=0 blocks, Stripe width=0 blocks
629552 inodes, 2518180 blocks
125909 blocks (5.00%) reserved for the super user
First data block=0
Maximum filesystem blocks=2579496960
77 block groups
32768 blocks per group, 32768 fragments per group
8176 inodes per group
Superblock backups stored on blocks:
32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632

Allocating group tables:

# Common e4defrag regression tests
[global]
ioengine=ioe_e4defrag
iodepth=1
directory=/device8
filesize=3424725990
size=999G
buffered=0
fadvise_hint=0

#################################
# Test1
# Defragment file while other task does direct io

# Continious sequential defrag activity
[defrag-4k]
ioengine=e4defrag
iodepth=1
bs=128k
donorname=test1.def
filename=test1
inplace=0
rw=write
numjobs=4
runtime=30*1
time_based

# Verifier
[aio-dio-verifier]
ioengine=libaio
iodepth=128*1
numjobs=1
verify=crc32c-intel
verify_fatal=1
verify_dump=1
verify_backlog=1024
verify_async=1
verifysort=1
direct=1
bs=64k
rw=randwrite
filename=test1
runtime=30*1
time_based
# /usr/bin/fio /tmp/5884.fio
fio: engine libaio not loadable
fio: failed to load engine libaio
defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
...
defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
fio: file:ioengines.c:99, func=dlopen, error=libaio: cannot open shared object file: No such file or directory
failed: '/usr/bin/fio /tmp/5884.fio'
fio --ioengine=ioe_e4defrag --iodepth=1 --directory=/device8 --filesize=3424725990 --size=999G --buffered=0 --fadvise_hint=0 --name=defrag-4k --ioengine=e4defrag --iodepth=1 --bs=128k --donorname=test1.def --inplace=0 --rw=write --numjobs=4 --runtime=30*1 --time_based --filename=test1 --name=aio-dio-verifier --ioengine=libaio --iodepth=128*1 --numjobs=1 --verify=crc32c-intel --verify_fatal=1 --verify_dump=1 --verify_backlog=1024 --verify_async=1 --verifysort=1 --direct=1 --bs=64k --rw=randwrite --runtime=30*1 --time_based --filename=test1
mke2fs 1.42 (29-Nov-2011)
Filesystem label=
OS type: Linux
Block size=4096 (log=2)
Fragment size=4096 (log=2)
Stride=0 blocks, Stripe width=0 blocks
629552 inodes, 2518180 blocks
125909 blocks (5.00%) reserved for the super user
First data block=0
Maximum filesystem blocks=2579496960
77 block groups
32768 blocks per group, 32768 fragments per group
8176 inodes per group
Superblock backups stored on blocks:
32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632

Allocating group tables:

# Common e4defrag regression tests
[global]
ioengine=ioe_e4defrag
iodepth=1
directory=/device8
filesize=3424725990
size=999G
buffered=0
fadvise_hint=0

#################################
# Test1
# Defragment file while other task does direct io

# Continious sequential defrag activity
[defrag-4k]
ioengine=e4defrag
iodepth=1
bs=128k
donorname=test1.def
filename=test1
inplace=0
rw=write
numjobs=4
runtime=30*1
time_based

# Verifier
[aio-dio-verifier]
ioengine=libaio
iodepth=128*1
numjobs=1
verify=crc32c-intel
verify_fatal=1
verify_dump=1
verify_backlog=1024
verify_async=1
verifysort=1
direct=1
bs=64k
rw=randwrite
filename=test1
runtime=30*1
time_based
# /usr/bin/fio /tmp/3999.fio
fio: engine libaio not loadable
fio: failed to load engine libaio
defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
...
defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
fio: file:ioengines.c:99, func=dlopen, error=libaio: cannot open shared object file: No such file or directory
failed: '/usr/bin/fio /tmp/3999.fio'
fio --ioengine=ioe_e4defrag --iodepth=1 --directory=/device8 --filesize=3424725990 --size=999G --buffered=0 --fadvise_hint=0 --name=defrag-4k --ioengine=e4defrag --iodepth=1 --bs=128k --donorname=test1.def --inplace=0 --rw=write --numjobs=4 --runtime=30*1 --time_based --filename=test1 --name=aio-dio-verifier --ioengine=libaio --iodepth=128*1 --numjobs=1 --verify=crc32c-intel --verify_fatal=1 --verify_dump=1 --verify_backlog=1024 --verify_async=1 --verifysort=1 --direct=1 --bs=64k --rw=randwrite --runtime=30*1 --time_based --filename=test1
mke2fs 1.42 (29-Nov-2011)
Filesystem label=
OS type: Linux
Block size=4096 (log=2)
Fragment size=4096 (log=2)
Stride=0 blocks, Stripe width=0 blocks
629552 inodes, 2518180 blocks
125909 blocks (5.00%) reserved for the super user
First data block=0
Maximum filesystem blocks=2579496960
77 block groups
32768 blocks per group, 32768 fragments per group
8176 inodes per group
Superblock backups stored on blocks:
32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632

Allocating group tables:  

# Common e4defrag regression tests
[global]
ioengine=ioe_e4defrag
iodepth=1
directory=/device8
filesize=3424725990
size=999G
buffered=0
fadvise_hint=0

#################################
# Test1
# Defragment file while other task does direct io

# Continious sequential defrag activity
[defrag-4k]
ioengine=e4defrag
iodepth=1
bs=128k
donorname=test1.def
filename=test1
inplace=0
rw=write
numjobs=4
runtime=30*1
time_based

# Verifier
[aio-dio-verifier]
ioengine=libaio
iodepth=128*1
numjobs=1
verify=crc32c-intel
verify_fatal=1
verify_dump=1
verify_backlog=1024
verify_async=1
verifysort=1
direct=1
bs=64k
rw=randwrite
filename=test1
runtime=30*1
time_based
# /usr/bin/fio /tmp/12231.fio
fio: engine libaio not loadable
fio: failed to load engine libaio
defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
...
defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
fio: file:ioengines.c:99, func=dlopen, error=libaio: cannot open shared object file: No such file or directory
failed: '/usr/bin/fio /tmp/12231.fio'

2013-06-13 06:43:57

by Zheng Liu

[permalink] [raw]
Subject: Re: xfstest ext4 'utility required' run stop

Hi Jon,

Could you please tell us which xfstest's version are you used? If I
remember correctly, testcases 301-304 have a bug at some certain
version. Could you please upgrade your xfstests to the latest version?
Or as Ted suggested, you could use xfstests-bld.

Regards,
- Zheng

On Thu, Jun 13, 2013 at 01:17:30AM -0400, jon ernst wrote:
> Hi All,
> about xfstestI installed fio. But still got error when I run ext4 test 301.
> Could anyone enlight me what;s wrong with my configuration?
> I have latest ext4 dev branch code with latest xfstest code.
> fio version is 2.1.1
>
> this is whole log:
> Thank you!
>
> fio: failed parsing ioengine=ioe_e4defrag
> fio: job global dropped
> fio         valid values: sync       Use read/write
>                    : psync      Use pread/pwrite
>                    : vsync      Use readv/writev
>                    : libaio     Linux native asynchronous IO
>                    : posixaio   POSIX asynchronous IO
>                    : mmap       Memory mapped IO
>                    : splice     splice/vmsplice based IO
>                    : netsplice  splice/vmsplice to/from the network
>                    : sg         SCSI generic v3 IO
>                    : null       Testing engine (no data transfer)
>                    : net        Network IO
>                    : syslet-rw  syslet enabled async pread/pwrite IO
>                    : cpuio      CPU cycle burner engine
>                    : binject    binject direct inject block engine
>                    : rdma       RDMA IO engine
>                    : external   Load external engine (append name)
>
>
> fio --ioengine=ioe_e4defrag --iodepth=1 --directory=/device8 --filesize=3424725990 --size=999G --buffered=0 --fadvise_hint=0 --name=defrag-4k --ioengine=e4defrag --iodepth=1 --bs=128k --donorname=test1.def --inplace=0 --rw=write --numjobs=4 --runtime=30*1 --time_based --filename=test1 --name=aio-dio-verifier --ioengine=libaio --iodepth=128*1 --numjobs=1 --verify=crc32c-intel --verify_fatal=1 --verify_dump=1 --verify_backlog=1024 --verify_async=1 --verifysort=1 --direct=1 --bs=64k --rw=randwrite --runtime=30*1 --time_based --filename=test1
> mke2fs 1.42 (29-Nov-2011)
> Filesystem label=
> OS type: Linux
> Block size=4096 (log=2)
> Fragment size=4096 (log=2)
> Stride=0 blocks, Stripe width=0 blocks
> 629552 inodes, 2518180 blocks
> 125909 blocks (5.00%) reserved for the super user
> First data block=0
> Maximum filesystem blocks=2579496960
> 77 block groups
> 32768 blocks per group, 32768 fragments per group
> 8176 inodes per group
> Superblock backups stored on blocks:
> 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632
>
> Allocating group tables:
>
> # Common e4defrag regression tests
> [global]
> ioengine=ioe_e4defrag
> iodepth=1
> directory=/device8
> filesize=3424725990
> size=999G
> buffered=0
> fadvise_hint=0
>
> #################################
> # Test1
> # Defragment file while other task does direct io
>
> # Continious sequential defrag activity
> [defrag-4k]
> ioengine=e4defrag
> iodepth=1
> bs=128k
> donorname=test1.def
> filename=test1
> inplace=0
> rw=write
> numjobs=4
> runtime=30*1
> time_based
>
> # Verifier
> [aio-dio-verifier]
> ioengine=libaio
> iodepth=128*1
> numjobs=1
> verify=crc32c-intel
> verify_fatal=1
> verify_dump=1
> verify_backlog=1024
> verify_async=1
> verifysort=1
> direct=1
> bs=64k
> rw=randwrite
> filename=test1
> runtime=30*1
> time_based
> # /usr/bin/fio /tmp/5884.fio
> fio: engine libaio not loadable
> fio: failed to load engine libaio
> defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
> ...
> defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
> fio: file:ioengines.c:99, func=dlopen, error=libaio: cannot open shared object file: No such file or directory
> failed: '/usr/bin/fio /tmp/5884.fio'
> fio --ioengine=ioe_e4defrag --iodepth=1 --directory=/device8 --filesize=3424725990 --size=999G --buffered=0 --fadvise_hint=0 --name=defrag-4k --ioengine=e4defrag --iodepth=1 --bs=128k --donorname=test1.def --inplace=0 --rw=write --numjobs=4 --runtime=30*1 --time_based --filename=test1 --name=aio-dio-verifier --ioengine=libaio --iodepth=128*1 --numjobs=1 --verify=crc32c-intel --verify_fatal=1 --verify_dump=1 --verify_backlog=1024 --verify_async=1 --verifysort=1 --direct=1 --bs=64k --rw=randwrite --runtime=30*1 --time_based --filename=test1
> mke2fs 1.42 (29-Nov-2011)
> Filesystem label=
> OS type: Linux
> Block size=4096 (log=2)
> Fragment size=4096 (log=2)
> Stride=0 blocks, Stripe width=0 blocks
> 629552 inodes, 2518180 blocks
> 125909 blocks (5.00%) reserved for the super user
> First data block=0
> Maximum filesystem blocks=2579496960
> 77 block groups
> 32768 blocks per group, 32768 fragments per group
> 8176 inodes per group
> Superblock backups stored on blocks:
> 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632
>
> Allocating group tables:
>
> # Common e4defrag regression tests
> [global]
> ioengine=ioe_e4defrag
> iodepth=1
> directory=/device8
> filesize=3424725990
> size=999G
> buffered=0
> fadvise_hint=0
>
> #################################
> # Test1
> # Defragment file while other task does direct io
>
> # Continious sequential defrag activity
> [defrag-4k]
> ioengine=e4defrag
> iodepth=1
> bs=128k
> donorname=test1.def
> filename=test1
> inplace=0
> rw=write
> numjobs=4
> runtime=30*1
> time_based
>
> # Verifier
> [aio-dio-verifier]
> ioengine=libaio
> iodepth=128*1
> numjobs=1
> verify=crc32c-intel
> verify_fatal=1
> verify_dump=1
> verify_backlog=1024
> verify_async=1
> verifysort=1
> direct=1
> bs=64k
> rw=randwrite
> filename=test1
> runtime=30*1
> time_based
> # /usr/bin/fio /tmp/3999.fio
> fio: engine libaio not loadable
> fio: failed to load engine libaio
> defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
> ...
> defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
> fio: file:ioengines.c:99, func=dlopen, error=libaio: cannot open shared object file: No such file or directory
> failed: '/usr/bin/fio /tmp/3999.fio'
> fio --ioengine=ioe_e4defrag --iodepth=1 --directory=/device8 --filesize=3424725990 --size=999G --buffered=0 --fadvise_hint=0 --name=defrag-4k --ioengine=e4defrag --iodepth=1 --bs=128k --donorname=test1.def --inplace=0 --rw=write --numjobs=4 --runtime=30*1 --time_based --filename=test1 --name=aio-dio-verifier --ioengine=libaio --iodepth=128*1 --numjobs=1 --verify=crc32c-intel --verify_fatal=1 --verify_dump=1 --verify_backlog=1024 --verify_async=1 --verifysort=1 --direct=1 --bs=64k --rw=randwrite --runtime=30*1 --time_based --filename=test1
> mke2fs 1.42 (29-Nov-2011)
> Filesystem label=
> OS type: Linux
> Block size=4096 (log=2)
> Fragment size=4096 (log=2)
> Stride=0 blocks, Stripe width=0 blocks
> 629552 inodes, 2518180 blocks
> 125909 blocks (5.00%) reserved for the super user
> First data block=0
> Maximum filesystem blocks=2579496960
> 77 block groups
> 32768 blocks per group, 32768 fragments per group
> 8176 inodes per group
> Superblock backups stored on blocks:
> 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632
>
> Allocating group tables:  
>
> # Common e4defrag regression tests
> [global]
> ioengine=ioe_e4defrag
> iodepth=1
> directory=/device8
> filesize=3424725990
> size=999G
> buffered=0
> fadvise_hint=0
>
> #################################
> # Test1
> # Defragment file while other task does direct io
>
> # Continious sequential defrag activity
> [defrag-4k]
> ioengine=e4defrag
> iodepth=1
> bs=128k
> donorname=test1.def
> filename=test1
> inplace=0
> rw=write
> numjobs=4
> runtime=30*1
> time_based
>
> # Verifier
> [aio-dio-verifier]
> ioengine=libaio
> iodepth=128*1
> numjobs=1
> verify=crc32c-intel
> verify_fatal=1
> verify_dump=1
> verify_backlog=1024
> verify_async=1
> verifysort=1
> direct=1
> bs=64k
> rw=randwrite
> filename=test1
> runtime=30*1
> time_based
> # /usr/bin/fio /tmp/12231.fio
> fio: engine libaio not loadable
> fio: failed to load engine libaio
> defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
> ...
> defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
> fio: file:ioengines.c:99, func=dlopen, error=libaio: cannot open shared object file: No such file or directory
> failed: '/usr/bin/fio /tmp/12231.fio'
> --
> To unsubscribe from this list: send the line "unsubscribe linux-ext4" in
> the body of a message to [email protected]
> More majordomo info at http://vger.kernel.org/majordomo-info.html

2013-06-13 07:33:55

by Dmitry Monakhov

[permalink] [raw]
Subject: Re: xfstest ext4 'utility required' run stop

On Thu, 13 Jun 2013 01:17:30 -0400, "jon ernst" <[email protected]> wrote:
> Hi All,
> about xfstestI installed fio. But still got error when I run ext4 test 301.
> Could anyone enlight me what;s wrong with my configuration?
> I have latest ext4 dev branch code with latest xfstest code.
> fio version is 2.1.1
You have compiled fio w/o 'EXT4 move extent' support
which looks strange because it enabled on linux by default
See: 'ext4_me' option in ./configure
BTW: 2.1.1 is broken, Use '4e0a8fa' it is known to work
>
> this is whole log:
> Thank you!
>
> fio: failed parsing ioengine=ioe_e4defrag
> fio: job global dropped
> fio         valid values: sync       Use read/write
>                    : psync      Use pread/pwrite
>                    : vsync      Use readv/writev
>                    : libaio     Linux native asynchronous IO
>                    : posixaio   POSIX asynchronous IO
>                    : mmap       Memory mapped IO
>                    : splice     splice/vmsplice based IO
>                    : netsplice  splice/vmsplice to/from the network
>                    : sg         SCSI generic v3 IO
>                    : null       Testing engine (no data transfer)
>                    : net        Network IO
>                    : syslet-rw  syslet enabled async pread/pwrite IO
>                    : cpuio      CPU cycle burner engine
>                    : binject    binject direct inject block engine
>                    : rdma       RDMA IO engine
>                    : external   Load external engine (append name)
>
>
> fio --ioengine=ioe_e4defrag --iodepth=1 --directory=/device8 --filesize=3424725990 --size=999G --buffered=0 --fadvise_hint=0 --name=defrag-4k --ioengine=e4defrag --iodepth=1 --bs=128k --donorname=test1.def --inplace=0 --rw=write --numjobs=4 --runtime=30*1 --time_based --filename=test1 --name=aio-dio-verifier --ioengine=libaio --iodepth=128*1 --numjobs=1 --verify=crc32c-intel --verify_fatal=1 --verify_dump=1 --verify_backlog=1024 --verify_async=1 --verifysort=1 --direct=1 --bs=64k --rw=randwrite --runtime=30*1 --time_based --filename=test1
> mke2fs 1.42 (29-Nov-2011)
> Filesystem label=
> OS type: Linux
> Block size=4096 (log=2)
> Fragment size=4096 (log=2)
> Stride=0 blocks, Stripe width=0 blocks
> 629552 inodes, 2518180 blocks
> 125909 blocks (5.00%) reserved for the super user
> First data block=0
> Maximum filesystem blocks=2579496960
> 77 block groups
> 32768 blocks per group, 32768 fragments per group
> 8176 inodes per group
> Superblock backups stored on blocks:
> 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632
>
> Allocating group tables:
>
> # Common e4defrag regression tests
> [global]
> ioengine=ioe_e4defrag
> iodepth=1
> directory=/device8
> filesize=3424725990
> size=999G
> buffered=0
> fadvise_hint=0
>
> #################################
> # Test1
> # Defragment file while other task does direct io
>
> # Continious sequential defrag activity
> [defrag-4k]
> ioengine=e4defrag
> iodepth=1
> bs=128k
> donorname=test1.def
> filename=test1
> inplace=0
> rw=write
> numjobs=4
> runtime=30*1
> time_based
>
> # Verifier
> [aio-dio-verifier]
> ioengine=libaio
> iodepth=128*1
> numjobs=1
> verify=crc32c-intel
> verify_fatal=1
> verify_dump=1
> verify_backlog=1024
> verify_async=1
> verifysort=1
> direct=1
> bs=64k
> rw=randwrite
> filename=test1
> runtime=30*1
> time_based
> # /usr/bin/fio /tmp/5884.fio
> fio: engine libaio not loadable
> fio: failed to load engine libaio
> defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
> ...
> defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
> fio: file:ioengines.c:99, func=dlopen, error=libaio: cannot open shared object file: No such file or directory
> failed: '/usr/bin/fio /tmp/5884.fio'
> fio --ioengine=ioe_e4defrag --iodepth=1 --directory=/device8 --filesize=3424725990 --size=999G --buffered=0 --fadvise_hint=0 --name=defrag-4k --ioengine=e4defrag --iodepth=1 --bs=128k --donorname=test1.def --inplace=0 --rw=write --numjobs=4 --runtime=30*1 --time_based --filename=test1 --name=aio-dio-verifier --ioengine=libaio --iodepth=128*1 --numjobs=1 --verify=crc32c-intel --verify_fatal=1 --verify_dump=1 --verify_backlog=1024 --verify_async=1 --verifysort=1 --direct=1 --bs=64k --rw=randwrite --runtime=30*1 --time_based --filename=test1
> mke2fs 1.42 (29-Nov-2011)
> Filesystem label=
> OS type: Linux
> Block size=4096 (log=2)
> Fragment size=4096 (log=2)
> Stride=0 blocks, Stripe width=0 blocks
> 629552 inodes, 2518180 blocks
> 125909 blocks (5.00%) reserved for the super user
> First data block=0
> Maximum filesystem blocks=2579496960
> 77 block groups
> 32768 blocks per group, 32768 fragments per group
> 8176 inodes per group
> Superblock backups stored on blocks:
> 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632
>
> Allocating group tables:
>
> # Common e4defrag regression tests
> [global]
> ioengine=ioe_e4defrag
> iodepth=1
> directory=/device8
> filesize=3424725990
> size=999G
> buffered=0
> fadvise_hint=0
>
> #################################
> # Test1
> # Defragment file while other task does direct io
>
> # Continious sequential defrag activity
> [defrag-4k]
> ioengine=e4defrag
> iodepth=1
> bs=128k
> donorname=test1.def
> filename=test1
> inplace=0
> rw=write
> numjobs=4
> runtime=30*1
> time_based
>
> # Verifier
> [aio-dio-verifier]
> ioengine=libaio
> iodepth=128*1
> numjobs=1
> verify=crc32c-intel
> verify_fatal=1
> verify_dump=1
> verify_backlog=1024
> verify_async=1
> verifysort=1
> direct=1
> bs=64k
> rw=randwrite
> filename=test1
> runtime=30*1
> time_based
> # /usr/bin/fio /tmp/3999.fio
> fio: engine libaio not loadable
> fio: failed to load engine libaio
> defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
> ...
> defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
> fio: file:ioengines.c:99, func=dlopen, error=libaio: cannot open shared object file: No such file or directory
> failed: '/usr/bin/fio /tmp/3999.fio'
> fio --ioengine=ioe_e4defrag --iodepth=1 --directory=/device8 --filesize=3424725990 --size=999G --buffered=0 --fadvise_hint=0 --name=defrag-4k --ioengine=e4defrag --iodepth=1 --bs=128k --donorname=test1.def --inplace=0 --rw=write --numjobs=4 --runtime=30*1 --time_based --filename=test1 --name=aio-dio-verifier --ioengine=libaio --iodepth=128*1 --numjobs=1 --verify=crc32c-intel --verify_fatal=1 --verify_dump=1 --verify_backlog=1024 --verify_async=1 --verifysort=1 --direct=1 --bs=64k --rw=randwrite --runtime=30*1 --time_based --filename=test1
> mke2fs 1.42 (29-Nov-2011)
> Filesystem label=
> OS type: Linux
> Block size=4096 (log=2)
> Fragment size=4096 (log=2)
> Stride=0 blocks, Stripe width=0 blocks
> 629552 inodes, 2518180 blocks
> 125909 blocks (5.00%) reserved for the super user
> First data block=0
> Maximum filesystem blocks=2579496960
> 77 block groups
> 32768 blocks per group, 32768 fragments per group
> 8176 inodes per group
> Superblock backups stored on blocks:
> 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632
>
> Allocating group tables:  
>
> # Common e4defrag regression tests
> [global]
> ioengine=ioe_e4defrag
> iodepth=1
> directory=/device8
> filesize=3424725990
> size=999G
> buffered=0
> fadvise_hint=0
>
> #################################
> # Test1
> # Defragment file while other task does direct io
>
> # Continious sequential defrag activity
> [defrag-4k]
> ioengine=e4defrag
> iodepth=1
> bs=128k
> donorname=test1.def
> filename=test1
> inplace=0
> rw=write
> numjobs=4
> runtime=30*1
> time_based
>
> # Verifier
> [aio-dio-verifier]
> ioengine=libaio
> iodepth=128*1
> numjobs=1
> verify=crc32c-intel
> verify_fatal=1
> verify_dump=1
> verify_backlog=1024
> verify_async=1
> verifysort=1
> direct=1
> bs=64k
> rw=randwrite
> filename=test1
> runtime=30*1
> time_based
> # /usr/bin/fio /tmp/12231.fio
> fio: engine libaio not loadable
> fio: failed to load engine libaio
> defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
> ...
> defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
> fio: file:ioengines.c:99, func=dlopen, error=libaio: cannot open shared object file: No such file or directory
> failed: '/usr/bin/fio /tmp/12231.fio'
> --
> To unsubscribe from this list: send the line "unsubscribe linux-ext4" in
> the body of a message to [email protected]
> More majordomo info at http://vger.kernel.org/majordomo-info.html

2013-06-13 13:43:50

by jon ernst

[permalink] [raw]
Subject: Re: xfstest ext4 'utility required' run stop


>  Hi Jon,

> Could you please tell us which xfstest's version are you used? If I
> remember correctly, testcases 301-304 have a bug at some certain
> version. Could you please upgrade your xfstests to the latest version?
> Or as Ted suggested, you could use xfstests-bld.

> Regards,
>  - Zheng

I built xfstest from latest code. I also built fio from latest code base.
Thanks for your help!

2013-06-13 14:00:03

by Theodore Ts'o

[permalink] [raw]
Subject: Re: xfstest ext4 'utility required' run stop

On Thu, Jun 13, 2013 at 09:43:46AM -0400, jon ernst wrote:
> I built xfstest from latest code. I also built fio from latest code base.
> Thanks for your help!

Dmitry's advice is on-target. Do you have:

#define CONFIG_LINUX_EXT4_MOVE_EXTENT

defined in fio/config-host.h?

- Ted