Can you share your experiences of when performance
starts dropping dramatically based on the number of
files in a directory under ext3? (assuming that you
haven't applied any directory indexing patch)
I had always thought that ext3 performed well with a
large number of files per directory, but apparently
directory indexing, which would substantially improve
performance of large directories, has yet to be added
to the kernel (submitted patch:
http://lwn.net/Articles/11481/).
We're not too keen in our company to put cutting-edge
patches into production, but we have a major
performance issue, b/c we have a bottleneck on our
highly trafficked NFS server: 246 directories, each
containing about 14,000 JPG files with an average size
of about 30Kb. So that brings me back to my original
question in the email... Thanks!
__________________________________________________
Do you Yahoo!?
Yahoo! Shopping - Send Flowers for Valentine's Day
http://shopping.yahoo.com
-------------------------------------------------------
This sf.net email is sponsored by:ThinkGeek
Welcome to geek heaven.
http://thinkgeek.com/sf
_______________________________________________
NFS maillist - [email protected]
https://lists.sourceforge.net/lists/listinfo/nfs
Alan, as a data-point the htree patch was included in the first beta of
Phoebe (upcoming Redhat version) but removed in the second beta since it
was probably not considered production quality. In a post to ext3-users,
sct says its still not 100% rock-solid
You might want to consider either using XFS for your fileserver or
modifying your directory structure
> Can you share your experiences of when performance
> starts dropping dramatically based on the number of
> files in a directory under ext3? (assuming that you
> haven't applied any directory indexing patch)
>
> I had always thought that ext3 performed well with a
> large number of files per directory, but apparently
> directory indexing, which would substantially improve
> performance of large directories, has yet to be added
> to the kernel (submitted patch:
> http://lwn.net/Articles/11481/).
-------------------------------------------------------
This sf.net email is sponsored by:ThinkGeek
Welcome to geek heaven.
http://thinkgeek.com/sf
_______________________________________________
NFS maillist - [email protected]
https://lists.sourceforge.net/lists/listinfo/nfs
>>>>> "Alan" == Alan Powell <[email protected]> writes:
Alan> Can you share your experiences of when performance starts
Alan> dropping dramatically based on the number of files in a
Alan> directory under ext3? (assuming that you haven't applied any
Alan> directory indexing patch)
This may be obvious, but I presume you have considered another file
system ? It would seem testing with XFS and reiserfs would be
advisable at least. Certainly my experiences with reiserfs and several
thousand files per directory over NFS have been only good,
Sincerely,
Adrian Phillips
--
Your mouse has moved.
Windows NT must be restarted for the change to take effect.
Reboot now? [OK]
-------------------------------------------------------
This sf.net email is sponsored by:ThinkGeek
Welcome to geek heaven.
http://thinkgeek.com/sf
_______________________________________________
NFS maillist - [email protected]
https://lists.sourceforge.net/lists/listinfo/nfs