Rene Rebe wrote:
>
> (Repost - since my first mail has still not arrived ...)
>
> Hi - I need some speed tips for using ReiserFS on an RAID5 Linux-soft-raid device.
>
> Config: AMD K6-2 350
> 3x IBM 40GB IDE discs (connected as master each to a single IDE channel)
> Linux-2.4.1x (currently .16)
> the discs are combined via Linux-software-RAID5
>
> I run ReiserFS on a RAID5 (of 3 IDE disks) using the latest 2.4.(e.g.16)
> kernel for weeks. It works well except that is is painfully slow. In todays tests
> I got arround 3MB/s from ReiserFS (dd if=/home/database/some-video.avi ...) - wich
> matches exatly what I get over NFS for normal development usage, too. The IDE or
> RAID setup doesn't seem to be a problem because I get 33MB/s when I read the
> /dev/md/0 directly (dd if=/dev/md/0 ...)!
Thats odd!
I don't have three various ide-controllers to reproduce your configuration,
but for the raid5 of 3 various scsi disks i have that the times of dd readings for
if= /dev/sda, /dev/md0, /mnt/file_on_reiserfs_on_md0 relates approximately as
1.5 : 1 : 1
So the performance doesn't decrease..
What is about your speed for (dd if=/dev/hdx...)??
Can you measure this for ext2 on md0?
Thanks,
Edward.
Thanks for the reply!
On Thu, 29 Nov 2001 17:11:51 +0000
Edward Shushkin <[email protected]> wrote:
> Thats odd!
> I don't have three various ide-controllers to reproduce your configuration,
You only need one controller in additoin to your on-board one ... 2x 2 channels
-> 4 IDE Master possible ...
> but for the raid5 of 3 various scsi disks i have that the times of dd readings for
> if= /dev/sda, /dev/md0, /mnt/file_on_reiserfs_on_md0 relates approximately as
> 1.5 : 1 : 1
> So the performance doesn't decrease..
> What is about your speed for (dd if=/dev/hdx...)??
Hardware: AMD K6-2 350Mhz; 128MB RAM; Aladin5 based Gigabyte board; additinal
Promise ULTRA ATA-100 controller; vanilla 2.4.16 kernel; [glibc-2.1.3]
I tuned the kernel a bit by:
echo 1023 > /proc/sys/vm/max-readahead
(without this some short test were much worser ...)
RAID-disk I RAID-disk II RAID-disk III
host2 ch0 ma host2 ch1 ma host0 ch1 ma
1. hdparm -tT
60.66 MB/sec 60.66 MB/sec 60.66 MB/sec
20.13 MB/sec 23.62 MB/sec 15.92 MB/sec (UDMA mode II only)
2. dd if=x of=/dev/null bs=1024 count=100000 (avg. of 3 measurements)
30.52 MB/sec 30.54 MB/sec 30.6 MB/sec (??? UDMA2 ... ?)
# ok too much is cached by LInux ... again with 400 MB:
3. dd if=x of=/dev/null bs=1024 count=400000 (avg. of 3 measurements)
30.92 MB/sec 28.32 MB/sec 29.32 MB/sec
4. time dd if=/dev/md/0 of=/dev/null bs=1024 count=400000 (avg. of 3 measurements)
34.567 MB/sec
4. time dd if=/home/everybody/video/movies/Matrix\ 1-2.avi of=/dev/null bs=1024 count=200000
(home is the ReiserFS on RAID5 filesystem ...) (avg. of 3 measurements)
8.785 MB/sec
5. time dd if=/home/everybody/video/movies/Matrix\ 1-2.avi of=/dev/null bs=1024 count=400000
(home is the ReiserFS on RAID5 filesystem ...) (avg. of 3 measurements)
9.306 MB/ses
So I have ide/discX md/0 file-from-reiserfs:
3.2 : 3.71 : 1
Over NFS I get 7.1 MB/sec - this is MUCH better than yesterday - so the "echo 1023 >
/proc/sys/vm/max-readahead" must have done it ... - but more would still be better ;-)
(I'll write a benchmark script and redo the test without this tuning tonight ...)
Notes:
1. The uncontinous results may be caused by a compile workstation that currently compiles
my distribution and accesed some source from time to time (not that much ...).
2. I allready "tuned" the IDE by the additional IDE controller. At the beginning
all discs were connected to the on-board Ali - which gave much worser results. So I added
the Promisse one so that each disc is a Master without Slave devices (I thought the
slowdown may be caused by the concurrend IDE-bus accesses ...)
Question: Are there some block-sizes / allignments issues I should take care when using
ReiserFS on RAID5 ?? - The current setup is a straightforward first-try with default
parameters for all tools (mkraid / mkreiserfs ... - I found no hints on the web).
> Can you measure this for ext2 on md0?
No - sorry. It is a "production" machine. I could backup all the stuff and reinitialize
RAID and reiserfs in another way when I know what to do better (except using SCSI ;-)
or what I did wrong - but I can not play arround with the data all the time ...
> Thanks,
> Edward.
k33p h4ck1n6
Ren?
--
Ren? Rebe (Registered Linux user: #127875 <http://counter.li.org>)
eMail: [email protected]
[email protected]
Homepage: http://www.tfh-berlin.de/~s712059/index.html
Anyone sending unwanted advertising e-mail to this address will be
charged $25 for network traffic and computing time. By extracting my
address from this message or its header, you agree to these terms.