hi all
I'm setting up a server serving large >=1GB files. I spoke to this guy
that just finished his PhD on the subject
(http://ConfMan.unik.no/~paalh/index2.html) , and he said he'd managed to
increase the throughput by using a 64kB block size on the files system.
This testing was done on NetBSD (as far as I can remember).
Does anyone know of a file system that supports large files, large
filesystems and large block sizes?
Does any of you have any theories if his practice in using larger block
sizes will have the same impact on performance in Linux as it had in BSD?
Thank you
roy
--
Roy Sigurd Karlsbakk, MCSE, MCNE, CLS, LCA
Computers are like air conditioners.
They stop working when you open Windows.
Hello,
> I'm setting up a server serving large >=1GB files. I spoke to this guy
> that just finished his PhD on the subject
> (http://ConfMan.unik.no/~paalh/index2.html) , and he said he'd managed to
> increase the throughput by using a 64kB block size on the files system.
> This testing was done on NetBSD (as far as I can remember).
>
> Does anyone know of a file system that supports large files, large
> filesystems and large block sizes?
Linux doesn't support larger block size than page size (ie. 4 KB on i386).
> Does any of you have any theories if his practice in using larger block
> sizes will have the same impact on performance in Linux as it had in BSD?
I think performance will improve but only for large files (but that's
probably what you want).
Honza
--
Jan Kara <[email protected]>
SuSE CR Labs
> > I'm setting up a server serving large >=1GB files. I spoke to this guy
> > that just finished his PhD on the subject
> > (http://ConfMan.unik.no/~paalh/index2.html) , and he said he'd managed to
> > increase the throughput by using a 64kB block size on the files system.
> > This testing was done on NetBSD (as far as I can remember).
> >
> > Does anyone know of a file system that supports large files, large
> > filesystems and large block sizes?
> Linux doesn't support larger block size than page size (ie. 4 KB on i386).
Is this limit the indepandant of file system type?
> > Does any of you have any theories if his practice in using larger block
> > sizes will have the same impact on performance in Linux as it had in BSD?
> I think performance will improve but only for large files (but that's
> probably what you want).
As I'm writing above, the files I'm talking of are typically 1-10GB. So
yes - this is what I want.
roy
--
Roy Sigurd Karlsbakk, MCSE, MCNE, CLS, LCA
Computers are like air conditioners.
They stop working when you open Windows.
> > > I'm setting up a server serving large >=1GB files. I spoke to this guy
> > > that just finished his PhD on the subject
> > > (http://ConfMan.unik.no/~paalh/index2.html) , and he said he'd managed to
> > > increase the throughput by using a 64kB block size on the files system.
> > > This testing was done on NetBSD (as far as I can remember).
> > >
> > > Does anyone know of a file system that supports large files, large
> > > filesystems and large block sizes?
>
> > Linux doesn't support larger block size than page size (ie. 4 KB on i386).
>
> Is this limit the indepandant of file system type?
Yes it is. But all reasonable filesystems like ext2, ext3, reiserfs etc. support
4KB block sizes. Maybe you can try XFS which should be designed for large files
but I have no experience with it..
Honza