Ren? Rebe wrote:
[...]
> I run ReiserFS on a RAID5 (of 3 IDE disks) using the latest
> 2.4.(e.g.16)
> kernel for weeks. It works well except that is is painfully
> slow.
[...]
You are not the only one with these problems...
I am convinced there is a serious, negative performance
interaction between software RAID 5 and ReiserFS, at least
on IDE. Performance is less than 25% of what it should be.
---------------
Concise summary:
dbench of reiserfs on a normal drive partition is slightly
* faster * than timing a raw "dd" from that partition.
But, dbench of reiserfs on a reiserfs on software RAID5
is ** only 1/4 as fast ** as a raw "dd" from the RAID5,
And, to make it worse, software RAID 5 is significantly
slower than I think it should be. As a result, my nice
RAID 5 is far, far slower than an ordinary partition.
These are not just dbench numbers - all sorts of testing
shows the problem.
---------------
Here are the details:
I have four Maxtor 60 GB IDE disks, each is master on a single
cable, using two Promise Ultra TX2/100 cards. The host is
a dual P3-800 with 512 MB of RAM. I bought this hardware
specifically to act as a fast, cheap, reliable server...
I have no complaints except the speed.
The raid disks are hde, hdg, hdi, hdk, as /dev/md0, not
partitioned, /dev/md0 is a single 180 GB reiserfs and is
mounted on /home. Chunk size is 1024.
Here's some low level numbers:
Single drive from the RAID:
time dd if=/dev/hdg of=/dev/null bs=1M count=1024
- elapsed time 0:37 = 27.65 MB/sec
Raw RAID5:
time dd if=/dev/md0 of=/dev/null bs=1M count=1024
- elapsed time 0:25 = 40.96 MB/sec
File on Reiserfs on RAID5:
time dd if=/home/test_file_1GB of=/dev/null bs=1M count=1024
- elapsed time 0:33 = 31.03 MB/sec
Old home partition on hda9:
time dd if=/dev/hda9 of=/dev/null bs=1M count=1024
- elapsed time 0:41 = 24 MB/sec
dbench tests:
dbench 32 on reiserfs on md0 : 10.7027 MB/sec
dbench 32 on reiserfs on hda9 : 27.7925 MB/sec
Note that when I first set this hardware up, I tried RAID0
on the same hardware and saw dbench 32 numbers of 76 MB/sec.
So, I think the dbench number for reiserfs on md0 should be
** at least ** five times faster than it is. Are my
expectations too high or is there a real problem here?
(tested on 2.4.15-pre5, this problem has been around for
all 2.4 kernels I've tried.)
Happy to help test and debug... please send suggestions.
Torrey Hoffman
On Thu, 29 Nov 2001 13:36:08 -0800
Torrey Hoffman <[email protected]> wrote:
> Ren? Rebe wrote:
> [...]
> > I run ReiserFS on a RAID5 (of 3 IDE disks) using the latest
> > 2.4.(e.g.16)
> > kernel for weeks. It works well except that is is painfully
> > slow.
> [...]
>
> You are not the only one with these problems...
Have you tryed:
echo 1023 > /proc/sys/vm/max-readahead
(power of 2 -1) found in some -ac or 2.4.16 kernel. I was amazed that
it might accelerated my setup by a factor of 2 ? (I still have
to verify this ...)
[...]
> Happy to help test and debug... please send suggestions.
>
> Torrey Hoffman
>
k33p h4ck1n6
Ren?
--
Ren? Rebe (Registered Linux user: #127875 <http://counter.li.org>)
eMail: [email protected]
[email protected]
Homepage: http://www.tfh-berlin.de/~s712059/index.html
Anyone sending unwanted advertising e-mail to this address will be
charged $25 for network traffic and computing time. By extracting my
address from this message or its header, you agree to these terms.