2010-01-23 15:52:07

by Whoop Whouzer

[permalink] [raw]
Subject: nfs client performance while server is down

Howdy,

I was wondering why nfs is designed in such a way that the performance
of an nfs client machine gets very bad when the nfs server is offline?
This is even the case with a soft mount (either via mount or fstab).
Just about every application that requires disk access (not talking
about nfs share acces) gets really slow to unresponsive. For instance
nautilus becomes unresponsive when displaying the contents of any
folder on the local disk,
playing movie files (stored on local disk) let totem or vlc get stuck
on set intervals, even the terminal becomes unresponsive at times.

I could understand that these problems would occur while accessing the
nfs share directory while the server is offline, but why for totally
unrelated directories?

I have experienced this behaviour on various distro's, and also found
various bug reports on this issue, they don't seem to get solved as
this is viewed as nfs design.
I see this as a flaw because clients are totally dependent on the
server. This would be less of a deal if the entire home directory
would be stored on nfs (although I even think some sort of
synchronisation technology could and should be implemented in this
case). It is a bit odd that (technically) one machine serving some
"useless" files to a non-trivial directory on client machines can take
down these client machines.

For me the preferred functionality would be:
*If an nfs server gets offline the client's nfs share becomes
unaccessible, but local directories and applications (that only
require local disk access) stay responsive.
*If an nfs server gets online (after being offline while the client
has not been restarted) the nfs share becomes reconnected.

regards,
Whoop


2010-01-25 16:49:26

by Chuck Lever

[permalink] [raw]
Subject: Re: nfs client performance while server is down

On Jan 24, 2010, at 7:09 PM, Whoop Whouzer wrote:
> I did some network traces and there is nothing strange happening as
> far as I can tell. I shut down the server (some network traffic
> occurred as is to be expected). It got quiet again, I launched
> nautilus, it got stuck without displaying anything and there was no
> real network activity except 3 broadcasts using the ARP protocol
> asking where the server was (could be just coincidence).

That sounds like the client does want to reconnect with the server.

You could try enabling debug tracing on your client (sudo rpcdebug -m
nfs -s all) after shutting down your server, then try to start
nautilus. The kernel log would then contain NFS-related messages that
might indicate where to look next.

> Closing
> nautilus and launching it again will let it hang again but I see no
> additional network traffic. After a while nautilus will display the
> contents of the folder without any network traffic.
>
> On Sun, Jan 24, 2010 at 10:34 PM, Muntz, Daniel
> <[email protected]> wrote:
>> Perhaps something in your $PATH is in the NFS mount? Do a network
>> trace and maybe you can see if, in fact, there are actually NFS
>> operations being attempted that you weren't expecting. Then try to
>> figure out why.
>>
>> -Dan
>>
>>> -----Original Message-----
>>> From: Whoop Whouzer [mailto:[email protected]]
>>> Sent: Saturday, January 23, 2010 8:28 AM
>>> To: Peter Chacko
>>> Cc: [email protected]
>>> Subject: Re: nfs client performance while server is down
>>>
>>> I don't remember all the different set-ups I tried it on, but I just
>>> confirmed this with the following combinations:
>>>
>>> ubuntu server 10.04 (alpha 2) --> ubuntu desktop 9.10, ubuntu
>>> desktop
>>> 10.04 (alpha 2), fedora 12
>>> ubuntu server 9.10 --> ubuntu desktop 9.10, ubuntu desktop 10.04
>>> (alpha 2), fedora 12
>>>
>>> I'll be happy to test it on another client machine (distro) even
>>> another server (although it would require a little more time)
>>>
>>> Here are some examples on the bugreports I noticed and how they do
>>> not
>>> seem to get solved:
>>> https://bugzilla.redhat.com/show_bug.cgi?id=175283
>>> https://bugs.launchpad.net/ubuntu/+source/nfs-utils/+bug/164120
>>>
>>> regards,
>>> Whoop
>>>
>>> On Sat, Jan 23, 2010 at 4:57 PM, Peter Chacko
>>> <[email protected]> wrote:
>>>> Which client OS you observed this behavior ? This has nothing to
>>>> do
>>>> NFS design, and its purely stateless...Its upto the client OS
>>>> implementation about aspects like how to deal with local
>>> IO, when NFS
>>>> share gets disconnected..
>>>>
>>>> May be a VFS bug on the local OS you found this problem ..
>>>>
>>>> thanks
>>>>
>>>> On Sat, Jan 23, 2010 at 9:15 PM, Whoop Whouzer
>>> <[email protected]> wrote:
>>>>> Howdy,
>>>>>
>>>>> I was wondering why nfs is designed in such a way that the
>>> performance
>>>>> of an nfs client machine gets very bad when the nfs server
>>> is offline?
>>>>> This is even the case with a soft mount (either via mount
>>> or fstab).
>>>>> Just about every application that requires disk access (not
>>>>> talking
>>>>> about nfs share acces) gets really slow to unresponsive.
>>> For instance
>>>>> nautilus becomes unresponsive when displaying the contents of any
>>>>> folder on the local disk,
>>>>> playing movie files (stored on local disk) let totem or
>>> vlc get stuck
>>>>> on set intervals, even the terminal becomes unresponsive at times.
>>>>>
>>>>> I could understand that these problems would occur while
>>> accessing the
>>>>> nfs share directoiourry while the server is offline, but
>>> why for totally
>>>>> unrelated directories?
>>>>>
>>>>> I have experienced this behaviour on various distro's, and
>>> also found
>>>>> various bug reports on this issue, they don't seem to get solved
>>>>> as
>>>>> this is viewed as nfs design.
>>>>> I see this as a flaw because clients are totally dependent on the
>>>>> server. This would be less of a deal if the entire home directory
>>>>> would be stored on nfs (although I even think some sort of
>>>>> synchronisation technology could and should be implemented in this
>>>>> case). It is a bit odd that (technically) one machine serving some
>>>>> "useless" files to a non-trivial directory on client
>>> machines can take
>>>>> down these client machines.
>>>>>
>>>>> For me the preferred functionality would be:
>>>>> *If an nfs server gets offline the client's nfs share becomes
>>>>> unaccessible, but local directories and applications (that only
>>>>> require local disk access) stay responsive.
>>>>> *If an nfs server gets online (after being offline while the
>>>>> client
>>>>> has not been restarted) the nfs share becomes reconnected.
>>>>>
>>>>> regards,
>>>>> Whoop
>>>>> --
>>>>> To unsubscribe from this list: send the line "unsubscribe
>>> linux-nfs" in
>>>>> the body of a message to [email protected]
>>>>> More majordomo info at http://vger.kernel.org/majordomo-info.html
>>>>>
>>>>
>>> --
>>> To unsubscribe from this list: send the line "unsubscribe
>>> linux-nfs" in
>>> the body of a message to [email protected]
>>> More majordomo info at http://vger.kernel.org/majordomo-info.html
>>>
>>
> --
> To unsubscribe from this list: send the line "unsubscribe linux-nfs"
> in
> the body of a message to [email protected]
> More majordomo info at http://vger.kernel.org/majordomo-info.html

--
Chuck Lever
chuck[dot]lever[at]oracle[dot]com





2010-01-25 19:02:16

by Whoop Whouzer

[permalink] [raw]
Subject: Re: nfs client performance while server is down

Ok, I did that, after shutting down the server and enabling debug
trace I tried to open the home folder of the current account (totally
unrelated to the nfsshare), it wouldn't open at all, I got no nautilus
at all. During the time my cursor was in busy mode I got the following
messages in kern.log (for ubuntu 10.04 client):
Jan 25 19:30:13 whoop-desktop kernel: [ 160.719262] NFS call fsstat
Jan 25 19:30:37 whoop-desktop kernel: [ 184.458611] NFS:
permission(0:16/74386), mask=0x10, res=0
Jan 25 19:30:37 whoop-desktop kernel: [ 184.458647] NFS call access
Jan 25 19:30:43 whoop-desktop kernel: [ 190.721086] nfs: server
192.168.1.130 not responding, timed out
Jan 25 19:30:43 whoop-desktop kernel: [ 190.721113] NFS reply statfs: -5
Jan 25 19:30:43 whoop-desktop kernel: [ 190.721116] nfs_statfs:
statfs error = 5
These series of traces are repeating over and over again at a set
interval (there is no flooding of the logs), even if I do nothing.
It's even worse than I thought because when I tried to shutdown, the
machine wouldn't shutdown because it claimed
the "File manager" was still running (although it was not visible on
screen); so I had to kill that before I could shutdown (properly).

In Fedora 12 I had a similar user experience (nautilus did show up
without showing any contents and it was hanging). I had enabled
tracing and it seems to be logged to /var/log/messages. I got this
output in fedora:
Jan 25 20:48:38 localhost kernel: NFS reply statfs: -5
Jan 25 20:48:38 localhost kernel: nfs_statfs: statfs error = 5
Jan 25 20:48:38 localhost kernel: NFS call fsstat
Jan 25 20:49:14 localhost kernel: nfs: server 192.168.1.130 not
responding, timed out
Jan 25 20:49:14 localhost kernel: NFS reply getattr: -5
Jan 25 20:49:14 localhost kernel: nfs_revalidate_inode: (0:14/74386)
getattr failed, error=-5
Jan 25 20:49:25 localhost kernel: NFS: revalidating (0:14/74386)
Jan 25 20:49:25 localhost kernel: NFS call getattr
Jan 25 20:50:14 localhost kernel: nfs: server 192.168.1.130 not
responding, timed out
Jan 25 20:50:14 localhost kernel: NFS reply access: -5
Jan 25 20:50:14 localhost kernel: NFS: permission(0:14/74386), mask=0x1, res=-5
Jan 25 20:50:14 localhost kernel: NFS call access
Jan 25 20:51:14 localhost kernel: nfs: server 192.168.1.130 not
responding, timed out
Jan 25 20:51:14 localhost kernel: NFS reply statfs: -5
Jan 25 20:51:14 localhost kernel: nfs_statfs: statfs error = 5
Jan 25 20:51:14 localhost kernel: NFS call fsstat
Most of the trace is repeating in set intervals as well, there is no
flooding of the logs...
Fedora would not shutdown normally either


On Mon, Jan 25, 2010 at 5:48 PM, Chuck Lever <[email protected]> wrote:
> On Jan 24, 2010, at 7:09 PM, Whoop Whouzer wrote:
>>
>> I did some network traces and there is nothing strange happening as
>> far as I can tell. I shut down the server (some network traffic
>> occurred as is to be expected). It got quiet again, I launched
>> nautilus, it got stuck without displaying anything and there was no
>> real network activity except 3 broadcasts using the ARP protocol
>> asking where the server was (could be just coincidence).
>
> That sounds like the client does want to reconnect with the server.
>
> You could try enabling debug tracing on your client (sudo rpcdebug -m nfs -s
> all) after shutting down your server, then try to start nautilus. ?The
> kernel log would then contain NFS-related messages that might indicate where
> to look next.
>
>> Closing
>> nautilus and launching it again will let it hang again but I see no
>> additional network traffic. After a while nautilus will display the
>> contents of the folder without any network traffic.
>>
>> On Sun, Jan 24, 2010 at 10:34 PM, Muntz, Daniel <[email protected]>
>> wrote:
>>>
>>> Perhaps something in your $PATH is in the NFS mount? ?Do a network trace
>>> and maybe you can see if, in fact, there are actually NFS operations being
>>> attempted that you weren't expecting. ?Then try to figure out why.
>>>
>>> ?-Dan
>>>
>>>> -----Original Message-----
>>>> From: Whoop Whouzer [mailto:[email protected]]
>>>> Sent: Saturday, January 23, 2010 8:28 AM
>>>> To: Peter Chacko
>>>> Cc: [email protected]
>>>> Subject: Re: nfs client performance while server is down
>>>>
>>>> I don't remember all the different set-ups I tried it on, but I just
>>>> confirmed this with the following combinations:
>>>>
>>>> ubuntu server 10.04 (alpha 2) --> ubuntu desktop 9.10, ubuntu desktop
>>>> 10.04 (alpha 2), fedora 12
>>>> ubuntu server 9.10 --> ubuntu desktop 9.10, ubuntu desktop 10.04
>>>> (alpha 2), fedora 12
>>>>
>>>> I'll be happy to test it on another client machine (distro) even
>>>> another server (although it would require a little more time)
>>>>
>>>> Here are some examples on the bugreports I noticed and how they do not
>>>> seem to get solved:
>>>> https://bugzilla.redhat.com/show_bug.cgi?id=175283
>>>> https://bugs.launchpad.net/ubuntu/+source/nfs-utils/+bug/164120
>>>>
>>>> regards,
>>>> Whoop
>>>>
>>>> On Sat, Jan 23, 2010 at 4:57 PM, Peter Chacko
>>>> <[email protected]> wrote:
>>>>>
>>>>> Which client OS you observed this behavior ? ?This has nothing to do
>>>>> NFS design, and its purely stateless...Its upto the client OS
>>>>> implementation about aspects like how to deal with local
>>>>
>>>> IO, when NFS
>>>>>
>>>>> share gets ?disconnected..
>>>>>
>>>>> May be a VFS bug on the local OS you found this problem ..
>>>>>
>>>>> thanks
>>>>>
>>>>> On Sat, Jan 23, 2010 at 9:15 PM, Whoop Whouzer
>>>>
>>>> <[email protected]> wrote:
>>>>>>
>>>>>> Howdy,
>>>>>>
>>>>>> I was wondering why nfs is designed in such a way that the
>>>>
>>>> performance
>>>>>>
>>>>>> of an nfs client machine gets very bad when the nfs server
>>>>
>>>> is offline?
>>>>>>
>>>>>> This is even the case with a soft mount (either via mount
>>>>
>>>> or fstab).
>>>>>>
>>>>>> Just about every application that requires disk access (not talking
>>>>>> about nfs share acces) gets really slow to unresponsive.
>>>>
>>>> For instance
>>>>>>
>>>>>> nautilus becomes unresponsive when displaying the contents of any
>>>>>> folder on the local disk,
>>>>>> playing movie files (stored on local disk) let totem or
>>>>
>>>> vlc get stuck
>>>>>>
>>>>>> on set intervals, even the terminal becomes unresponsive at times.
>>>>>>
>>>>>> I could understand that these problems would occur while
>>>>
>>>> accessing the
>>>>>>
>>>>>> nfs share directoiourry while the server is offline, but
>>>>
>>>> why for totally
>>>>>>
>>>>>> unrelated directories?
>>>>>>
>>>>>> I have experienced this behaviour on various distro's, and
>>>>
>>>> also found
>>>>>>
>>>>>> various bug reports on this issue, they don't seem to get solved as
>>>>>> this is viewed as nfs design.
>>>>>> I see this as a flaw because clients are totally dependent on the
>>>>>> server. This would be less of a deal if the entire home directory
>>>>>> would be stored on nfs (although I even think some sort of
>>>>>> synchronisation technology could and should be implemented in this
>>>>>> case). It is a bit odd that (technically) one machine serving some
>>>>>> "useless" files to a non-trivial directory on client
>>>>
>>>> machines can take
>>>>>>
>>>>>> down these client machines.
>>>>>>
>>>>>> For me the preferred functionality would be:
>>>>>> *If an nfs server gets offline the client's nfs share becomes
>>>>>> unaccessible, but local directories and applications (that only
>>>>>> require local disk access) stay responsive.
>>>>>> *If an nfs server gets online (after being offline while the client
>>>>>> has not been restarted) the nfs share becomes reconnected.
>>>>>>
>>>>>> regards,
>>>>>> Whoop
>>>>>> --
>>>>>> To unsubscribe from this list: send the line "unsubscribe
>>>>
>>>> linux-nfs" in
>>>>>>
>>>>>> the body of a message to [email protected]
>>>>>> More majordomo info at ?http://vger.kernel.org/majordomo-info.html
>>>>>>
>>>>>
>>>> --
>>>> To unsubscribe from this list: send the line "unsubscribe
>>>> linux-nfs" in
>>>> the body of a message to [email protected]
>>>> More majordomo info at ?http://vger.kernel.org/majordomo-info.html
>>>>
>>>
>> --
>> To unsubscribe from this list: send the line "unsubscribe linux-nfs" in
>> the body of a message to [email protected]
>> More majordomo info at ?http://vger.kernel.org/majordomo-info.html
>
> --
> Chuck Lever
> chuck[dot]lever[at]oracle[dot]com
>
>
>
>
>

2010-01-23 16:27:40

by Whoop Whouzer

[permalink] [raw]
Subject: Re: nfs client performance while server is down

I don't remember all the different set-ups I tried it on, but I just
confirmed this with the following combinations:

ubuntu server 10.04 (alpha 2) --> ubuntu desktop 9.10, ubuntu desktop
10.04 (alpha 2), fedora 12
ubuntu server 9.10 --> ubuntu desktop 9.10, ubuntu desktop 10.04
(alpha 2), fedora 12

I'll be happy to test it on another client machine (distro) even
another server (although it would require a little more time)

Here are some examples on the bugreports I noticed and how they do not
seem to get solved:
https://bugzilla.redhat.com/show_bug.cgi?id=175283
https://bugs.launchpad.net/ubuntu/+source/nfs-utils/+bug/164120

regards,
Whoop

On Sat, Jan 23, 2010 at 4:57 PM, Peter Chacko <[email protected]> wrote:
> Which client OS you observed this behavior ? ?This has nothing to do
> NFS design, and its purely stateless...Its upto the client OS
> implementation about aspects like how to deal with local IO, when NFS
> share gets ?disconnected..
>
> May be a VFS bug on the local OS you found this problem ..
>
> thanks
>
> On Sat, Jan 23, 2010 at 9:15 PM, Whoop Whouzer <[email protected]> wrote:
>> Howdy,
>>
>> I was wondering why nfs is designed in such a way that the performance
>> of an nfs client machine gets very bad when the nfs server is offline?
>> This is even the case with a soft mount (either via mount or fstab).
>> Just about every application that requires disk access (not talking
>> about nfs share acces) gets really slow to unresponsive. For instance
>> nautilus becomes unresponsive when displaying the contents of any
>> folder on the local disk,
>> playing movie files (stored on local disk) let totem or vlc get stuck
>> on set intervals, even the terminal becomes unresponsive at times.
>>
>> I could understand that these problems would occur while accessing the
>> nfs share directoiourry while the server is offline, but why for totally
>> unrelated directories?
>>
>> I have experienced this behaviour on various distro's, and also found
>> various bug reports on this issue, they don't seem to get solved as
>> this is viewed as nfs design.
>> I see this as a flaw because clients are totally dependent on the
>> server. This would be less of a deal if the entire home directory
>> would be stored on nfs (although I even think some sort of
>> synchronisation technology could and should be implemented in this
>> case). It is a bit odd that (technically) one machine serving some
>> "useless" files to a non-trivial directory on client machines can take
>> down these client machines.
>>
>> For me the preferred functionality would be:
>> *If an nfs server gets offline the client's nfs share becomes
>> unaccessible, but local directories and applications (that only
>> require local disk access) stay responsive.
>> *If an nfs server gets online (after being offline while the client
>> has not been restarted) the nfs share becomes reconnected.
>>
>> regards,
>> Whoop
>> --
>> To unsubscribe from this list: send the line "unsubscribe linux-nfs" in
>> the body of a message to [email protected]
>> More majordomo info at ?http://vger.kernel.org/majordomo-info.html
>>
>

2010-01-23 16:04:21

by Peter Chacko

[permalink] [raw]
Subject: Re: nfs client performance while server is down

Which client OS you observed this behavior ? This has nothing to do
NFS design, and its purely stateless...Its upto the client OS
implementation about aspects like how to deal with local IO, when NFS
share gets disconnected..

May be a VFS bug on the local OS you found this problem ..

thanks

On Sat, Jan 23, 2010 at 9:15 PM, Whoop Whouzer <[email protected]>=
wrote:
> Howdy,
>
> I was wondering why nfs is designed in such a way that the performanc=
e
> of an nfs client machine gets very bad when the nfs server is offline=
?
> This is even the case with a soft mount (either via mount or fstab).
> Just about every application that requires disk access (not talking
> about nfs share acces) gets really slow to unresponsive. For instance
> nautilus becomes unresponsive when displaying the contents of any
> folder on the local disk,
> playing movie files (stored on local disk) let totem or vlc get stuck
> on set intervals, even the terminal becomes unresponsive at times.
>
> I could understand that these problems would occur while accessing th=
e
> nfs share directoiourry while the server is offline, but why for tota=
lly
> unrelated directories?
>
> I have experienced this behaviour on various distro's, and also found
> various bug reports on this issue, they don't seem to get solved as
> this is viewed as nfs design.
> I see this as a flaw because clients are totally dependent on the
> server. This would be less of a deal if the entire home directory
> would be stored on nfs (although I even think some sort of
> synchronisation technology could and should be implemented in this
> case). It is a bit odd that (technically) one machine serving some
> "useless" files to a non-trivial directory on client machines can tak=
e
> down these client machines.
>
> For me the preferred functionality would be:
> *If an nfs server gets offline the client's nfs share becomes
> unaccessible, but local directories and applications (that only
> require local disk access) stay responsive.
> *If an nfs server gets online (after being offline while the client
> has not been restarted) the nfs share becomes reconnected.
>
> regards,
> Whoop
> --
> To unsubscribe from this list: send the line "unsubscribe linux-nfs" =
in
> the body of a message to [email protected]
> More majordomo info at =A0http://vger.kernel.org/majordomo-info.html
>

2010-01-24 21:34:55

by Muntz, Daniel

[permalink] [raw]
Subject: RE: nfs client performance while server is down

Perhaps something in your $PATH is in the NFS mount? Do a network trac=
e and maybe you can see if, in fact, there are actually NFS operations =
being attempted that you weren't expecting. Then try to figure out why=
=2E

-Dan=20

> -----Original Message-----
> From: Whoop Whouzer [mailto:[email protected]]=20
> Sent: Saturday, January 23, 2010 8:28 AM
> To: Peter Chacko
> Cc: [email protected]
> Subject: Re: nfs client performance while server is down
>=20
> I don't remember all the different set-ups I tried it on, but I just
> confirmed this with the following combinations:
>=20
> ubuntu server 10.04 (alpha 2) --> ubuntu desktop 9.10, ubuntu desktop
> 10.04 (alpha 2), fedora 12
> ubuntu server 9.10 --> ubuntu desktop 9.10, ubuntu desktop 10.04
> (alpha 2), fedora 12
>=20
> I'll be happy to test it on another client machine (distro) even
> another server (although it would require a little more time)
>=20
> Here are some examples on the bugreports I noticed and how they do no=
t
> seem to get solved:
> https://bugzilla.redhat.com/show_bug.cgi?id=3D175283
> https://bugs.launchpad.net/ubuntu/+source/nfs-utils/+bug/164120
>=20
> regards,
> Whoop
>=20
> On Sat, Jan 23, 2010 at 4:57 PM, Peter Chacko=20
> <[email protected]> wrote:
> > Which client OS you observed this behavior ? =A0This has nothing to=
do
> > NFS design, and its purely stateless...Its upto the client OS
> > implementation about aspects like how to deal with local=20
> IO, when NFS
> > share gets =A0disconnected..
> >
> > May be a VFS bug on the local OS you found this problem ..
> >
> > thanks
> >
> > On Sat, Jan 23, 2010 at 9:15 PM, Whoop Whouzer=20
> <[email protected]> wrote:
> >> Howdy,
> >>
> >> I was wondering why nfs is designed in such a way that the=20
> performance
> >> of an nfs client machine gets very bad when the nfs server=20
> is offline?
> >> This is even the case with a soft mount (either via mount=20
> or fstab).
> >> Just about every application that requires disk access (not talkin=
g
> >> about nfs share acces) gets really slow to unresponsive.=20
> For instance
> >> nautilus becomes unresponsive when displaying the contents of any
> >> folder on the local disk,
> >> playing movie files (stored on local disk) let totem or=20
> vlc get stuck
> >> on set intervals, even the terminal becomes unresponsive at times.
> >>
> >> I could understand that these problems would occur while=20
> accessing the
> >> nfs share directoiourry while the server is offline, but=20
> why for totally
> >> unrelated directories?
> >>
> >> I have experienced this behaviour on various distro's, and=20
> also found
> >> various bug reports on this issue, they don't seem to get solved a=
s
> >> this is viewed as nfs design.
> >> I see this as a flaw because clients are totally dependent on the
> >> server. This would be less of a deal if the entire home directory
> >> would be stored on nfs (although I even think some sort of
> >> synchronisation technology could and should be implemented in this
> >> case). It is a bit odd that (technically) one machine serving some
> >> "useless" files to a non-trivial directory on client=20
> machines can take
> >> down these client machines.
> >>
> >> For me the preferred functionality would be:
> >> *If an nfs server gets offline the client's nfs share becomes
> >> unaccessible, but local directories and applications (that only
> >> require local disk access) stay responsive.
> >> *If an nfs server gets online (after being offline while the clien=
t
> >> has not been restarted) the nfs share becomes reconnected.
> >>
> >> regards,
> >> Whoop
> >> --
> >> To unsubscribe from this list: send the line "unsubscribe=20
> linux-nfs" in
> >> the body of a message to [email protected]
> >> More majordomo info at =A0http://vger.kernel.org/majordomo-info.ht=
ml
> >>
> >
> --
> To unsubscribe from this list: send the line "unsubscribe=20
> linux-nfs" in
> the body of a message to [email protected]
> More majordomo info at http://vger.kernel.org/majordomo-info.html
>=20

2010-01-24 22:03:10

by Whoop Whouzer

[permalink] [raw]
Subject: Re: nfs client performance while server is down

I don't think so, I added this to fstab:
hpserver:/home/whoop/share /nfsshare nfs
rsize=3D8192,wsize=3D8192,timeo=3D14,soft 0 0

and created the /nfsshare directory just for that.
echo $PATH gives me this:
/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games


On Sun, Jan 24, 2010 at 10:34 PM, Muntz, Daniel <[email protected]> =
wrote:
> Perhaps something in your $PATH is in the NFS mount? =A0Do a network =
trace and maybe you can see if, in fact, there are actually NFS operati=
ons being attempted that you weren't expecting. =A0Then try to figure o=
ut why.
>
> =A0-Dan
>
>> -----Original Message-----
>> From: Whoop Whouzer [mailto:[email protected]]
>> Sent: Saturday, January 23, 2010 8:28 AM
>> To: Peter Chacko
>> Cc: [email protected]
>> Subject: Re: nfs client performance while server is down
>>
>> I don't remember all the different set-ups I tried it on, but I just
>> confirmed this with the following combinations:
>>
>> ubuntu server 10.04 (alpha 2) --> ubuntu desktop 9.10, ubuntu deskto=
p
>> 10.04 (alpha 2), fedora 12
>> ubuntu server 9.10 --> ubuntu desktop 9.10, ubuntu desktop 10.04
>> (alpha 2), fedora 12
>>
>> I'll be happy to test it on another client machine (distro) even
>> another server (although it would require a little more time)
>>
>> Here are some examples on the bugreports I noticed and how they do n=
ot
>> seem to get solved:
>> https://bugzilla.redhat.com/show_bug.cgi?id=3D175283
>> https://bugs.launchpad.net/ubuntu/+source/nfs-utils/+bug/164120
>>
>> regards,
>> Whoop
>>
>> On Sat, Jan 23, 2010 at 4:57 PM, Peter Chacko
>> <[email protected]> wrote:
>> > Which client OS you observed this behavior ? =A0This has nothing t=
o do
>> > NFS design, and its purely stateless...Its upto the client OS
>> > implementation about aspects like how to deal with local
>> IO, when NFS
>> > share gets =A0disconnected..
>> >
>> > May be a VFS bug on the local OS you found this problem ..
>> >
>> > thanks
>> >
>> > On Sat, Jan 23, 2010 at 9:15 PM, Whoop Whouzer
>> <[email protected]> wrote:
>> >> Howdy,
>> >>
>> >> I was wondering why nfs is designed in such a way that the
>> performance
>> >> of an nfs client machine gets very bad when the nfs server
>> is offline?
>> >> This is even the case with a soft mount (either via mount
>> or fstab).
>> >> Just about every application that requires disk access (not talki=
ng
>> >> about nfs share acces) gets really slow to unresponsive.
>> For instance
>> >> nautilus becomes unresponsive when displaying the contents of any
>> >> folder on the local disk,
>> >> playing movie files (stored on local disk) let totem or
>> vlc get stuck
>> >> on set intervals, even the terminal becomes unresponsive at times=
=2E
>> >>
>> >> I could understand that these problems would occur while
>> accessing the
>> >> nfs share directoiourry while the server is offline, but
>> why for totally
>> >> unrelated directories?
>> >>
>> >> I have experienced this behaviour on various distro's, and
>> also found
>> >> various bug reports on this issue, they don't seem to get solved =
as
>> >> this is viewed as nfs design.
>> >> I see this as a flaw because clients are totally dependent on the
>> >> server. This would be less of a deal if the entire home directory
>> >> would be stored on nfs (although I even think some sort of
>> >> synchronisation technology could and should be implemented in thi=
s
>> >> case). It is a bit odd that (technically) one machine serving som=
e
>> >> "useless" files to a non-trivial directory on client
>> machines can take
>> >> down these client machines.
>> >>
>> >> For me the preferred functionality would be:
>> >> *If an nfs server gets offline the client's nfs share becomes
>> >> unaccessible, but local directories and applications (that only
>> >> require local disk access) stay responsive.
>> >> *If an nfs server gets online (after being offline while the clie=
nt
>> >> has not been restarted) the nfs share becomes reconnected.
>> >>
>> >> regards,
>> >> Whoop
>> >> --
>> >> To unsubscribe from this list: send the line "unsubscribe
>> linux-nfs" in
>> >> the body of a message to [email protected]
>> >> More majordomo info at =A0http://vger.kernel.org/majordomo-info.h=
tml
>> >>
>> >
>> --
>> To unsubscribe from this list: send the line "unsubscribe
>> linux-nfs" in
>> the body of a message to [email protected]
>> More majordomo info at =A0http://vger.kernel.org/majordomo-info.html
>>
>

2010-01-25 00:09:15

by Whoop Whouzer

[permalink] [raw]
Subject: Re: nfs client performance while server is down

I did some network traces and there is nothing strange happening as
far as I can tell. I shut down the server (some network traffic
occurred as is to be expected). It got quiet again, I launched
nautilus, it got stuck without displaying anything and there was no
real network activity except 3 broadcasts using the ARP protocol
asking where the server was (could be just coincidence). Closing
nautilus and launching it again will let it hang again but I see no
additional network traffic. After a while nautilus will display the
contents of the folder without any network traffic.

On Sun, Jan 24, 2010 at 10:34 PM, Muntz, Daniel <[email protected]> =
wrote:
> Perhaps something in your $PATH is in the NFS mount? =A0Do a network =
trace and maybe you can see if, in fact, there are actually NFS operati=
ons being attempted that you weren't expecting. =A0Then try to figure o=
ut why.
>
> =A0-Dan
>
>> -----Original Message-----
>> From: Whoop Whouzer [mailto:[email protected]]
>> Sent: Saturday, January 23, 2010 8:28 AM
>> To: Peter Chacko
>> Cc: [email protected]
>> Subject: Re: nfs client performance while server is down
>>
>> I don't remember all the different set-ups I tried it on, but I just
>> confirmed this with the following combinations:
>>
>> ubuntu server 10.04 (alpha 2) --> ubuntu desktop 9.10, ubuntu deskto=
p
>> 10.04 (alpha 2), fedora 12
>> ubuntu server 9.10 --> ubuntu desktop 9.10, ubuntu desktop 10.04
>> (alpha 2), fedora 12
>>
>> I'll be happy to test it on another client machine (distro) even
>> another server (although it would require a little more time)
>>
>> Here are some examples on the bugreports I noticed and how they do n=
ot
>> seem to get solved:
>> https://bugzilla.redhat.com/show_bug.cgi?id=3D175283
>> https://bugs.launchpad.net/ubuntu/+source/nfs-utils/+bug/164120
>>
>> regards,
>> Whoop
>>
>> On Sat, Jan 23, 2010 at 4:57 PM, Peter Chacko
>> <[email protected]> wrote:
>> > Which client OS you observed this behavior ? =A0This has nothing t=
o do
>> > NFS design, and its purely stateless...Its upto the client OS
>> > implementation about aspects like how to deal with local
>> IO, when NFS
>> > share gets =A0disconnected..
>> >
>> > May be a VFS bug on the local OS you found this problem ..
>> >
>> > thanks
>> >
>> > On Sat, Jan 23, 2010 at 9:15 PM, Whoop Whouzer
>> <[email protected]> wrote:
>> >> Howdy,
>> >>
>> >> I was wondering why nfs is designed in such a way that the
>> performance
>> >> of an nfs client machine gets very bad when the nfs server
>> is offline?
>> >> This is even the case with a soft mount (either via mount
>> or fstab).
>> >> Just about every application that requires disk access (not talki=
ng
>> >> about nfs share acces) gets really slow to unresponsive.
>> For instance
>> >> nautilus becomes unresponsive when displaying the contents of any
>> >> folder on the local disk,
>> >> playing movie files (stored on local disk) let totem or
>> vlc get stuck
>> >> on set intervals, even the terminal becomes unresponsive at times=
=2E
>> >>
>> >> I could understand that these problems would occur while
>> accessing the
>> >> nfs share directoiourry while the server is offline, but
>> why for totally
>> >> unrelated directories?
>> >>
>> >> I have experienced this behaviour on various distro's, and
>> also found
>> >> various bug reports on this issue, they don't seem to get solved =
as
>> >> this is viewed as nfs design.
>> >> I see this as a flaw because clients are totally dependent on the
>> >> server. This would be less of a deal if the entire home directory
>> >> would be stored on nfs (although I even think some sort of
>> >> synchronisation technology could and should be implemented in thi=
s
>> >> case). It is a bit odd that (technically) one machine serving som=
e
>> >> "useless" files to a non-trivial directory on client
>> machines can take
>> >> down these client machines.
>> >>
>> >> For me the preferred functionality would be:
>> >> *If an nfs server gets offline the client's nfs share becomes
>> >> unaccessible, but local directories and applications (that only
>> >> require local disk access) stay responsive.
>> >> *If an nfs server gets online (after being offline while the clie=
nt
>> >> has not been restarted) the nfs share becomes reconnected.
>> >>
>> >> regards,
>> >> Whoop
>> >> --
>> >> To unsubscribe from this list: send the line "unsubscribe
>> linux-nfs" in
>> >> the body of a message to [email protected]
>> >> More majordomo info at =A0http://vger.kernel.org/majordomo-info.h=
tml
>> >>
>> >
>> --
>> To unsubscribe from this list: send the line "unsubscribe
>> linux-nfs" in
>> the body of a message to [email protected]
>> More majordomo info at =A0http://vger.kernel.org/majordomo-info.html
>>
>