2005-10-31 02:21:05

by CHIKAMA masaki

[permalink] [raw]
Subject: Can't write over 100GB to large NFS server (10TB)

Hello all.

I have some trouble with large NFS server.
I can't write date over 100GB to NFS server.

Here is my setup.

NFS server (HOSTA)
Fedora Core 3 + update + kernel-2.6.13.4
10TB disk. reiserfs3.

NFS client
Fedora Core 3 + update (2.6.12-1.1380_FC3smp)
SUSE 9.1 (2.6.12.4)
RedHat 7.3 (2.4.25)


How to reproduce

$ df -h
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/VolGroup00-LogVol00
73G 2.9G 66G 5% /
/dev/hda1 99M 38M 56M 41% /boot
none 248M 0 248M 0% /dev/shm
HOSTA:/raid/disk1 11T 100G 11T 1% /misc/HOSTA

$dd if=/dev/zero of=/mis/HOSTA/largefile bs=1024 count=65536
65536+0 records in
65536+0 records out
dd: closing output file `largefile': No space left on device

All three different client produce the same result.

Writing local filesystem is OK.

-rw-rw-r-- 1 demo demo 15106048 Oct 31 11:08 largefile (<- NFS write)
-rw-rw-r-- 1 demo demo 67108864 Oct 31 11:11 largefile2 (<- Local write)

Strangely enough, I have no trouble with 5TB partion(reisefs3)
on the HOSTA.

/dev/mapper/vg0-lvol0
5.1T 2.4T 2.8T 46% /raid/disk0
/dev/mapper/vg1-lvol0
11T 100G 11T 1% /raid/disk1

Any help appreciates.
Thanks.


--
CHIKAMA Masaki @ NICT



-------------------------------------------------------
This SF.Net email is sponsored by the JBoss Inc.
Get Certified Today * Register for a JBoss Training Course
Free Certification Exam for All Training Attendees Through End of 2005
Visit http://www.jboss.com/services/certification for more information
_______________________________________________
NFS maillist - [email protected]
https://lists.sourceforge.net/lists/listinfo/nfs


2005-11-02 05:08:00

by CHIKAMA masaki

[permalink] [raw]
Subject: Re: Can't write over 100GB to large NFS server (10TB)

Hello all.

There is a 8TB (not 16TB) filesystem limitation in reiserfs3
and this cause my problem. The Nfs server is not guilty.

http://marc.theaimsgroup.com/?l=reiserfs&m=112255940804474&w=2

I changed to xfs and problem solved.
Sorry for bothering the list.

Thanks.


On Mon, 31 Oct 2005 11:20:56 +0900
CHIKAMA masaki <[email protected]> wrote:

> Hello all.
>
> I have some trouble with large NFS server.
> I can't write date over 100GB to NFS server.
>
> Here is my setup.
>
> NFS server (HOSTA)
> Fedora Core 3 + update + kernel-2.6.13.4
> 10TB disk. reiserfs3.
>
> NFS client
> Fedora Core 3 + update (2.6.12-1.1380_FC3smp)
> SUSE 9.1 (2.6.12.4)
> RedHat 7.3 (2.4.25)
>
>
> How to reproduce
>
> $ df -h
> Filesystem Size Used Avail Use% Mounted on
> /dev/mapper/VolGroup00-LogVol00
> 73G 2.9G 66G 5% /
> /dev/hda1 99M 38M 56M 41% /boot
> none 248M 0 248M 0% /dev/shm
> HOSTA:/raid/disk1 11T 100G 11T 1% /misc/HOSTA
>
> $dd if=/dev/zero of=/mis/HOSTA/largefile bs=1024 count=65536
> 65536+0 records in
> 65536+0 records out
> dd: closing output file `largefile': No space left on device
>
> All three different client produce the same result.
>
> Writing local filesystem is OK.
>
> -rw-rw-r-- 1 demo demo 15106048 Oct 31 11:08 largefile (<- NFS write)
> -rw-rw-r-- 1 demo demo 67108864 Oct 31 11:11 largefile2 (<- Local write)
>
> Strangely enough, I have no trouble with 5TB partion(reisefs3)
> on the HOSTA.
>
> /dev/mapper/vg0-lvol0
> 5.1T 2.4T 2.8T 46% /raid/disk0
> /dev/mapper/vg1-lvol0
> 11T 100G 11T 1% /raid/disk1
>
> Any help appreciates.
> Thanks.
>
>
> --
> CHIKAMA Masaki @ NICT
>
>
>
> -------------------------------------------------------
> This SF.Net email is sponsored by the JBoss Inc.
> Get Certified Today * Register for a JBoss Training Course
> Free Certification Exam for All Training Attendees Through End of 2005
> Visit http://www.jboss.com/services/certification for more information
> _______________________________________________
> NFS maillist - [email protected]
> https://lists.sourceforge.net/lists/listinfo/nfs


--
CHIKAMA Masaki @ NICT



-------------------------------------------------------
SF.Net email is sponsored by:
Tame your development challenges with Apache's Geronimo App Server. Download
it for free - -and be entered to win a 42" plasma tv or your very own
Sony(tm)PSP. Click here to play: http://sourceforge.net/geronimo.php
_______________________________________________
NFS maillist - [email protected]
https://lists.sourceforge.net/lists/listinfo/nfs