From: Peter Staubach <staubach@redhat.com>
Subject: Re: NFS caching problem
Date: Mon, 26 Sep 2005 16:11:25 -0400
Message-ID: <433855ED.2000606@redhat.com>
References: <43384863.10807@atmos.washington.edu> <1127764918.8327.22.camel@lade.trondhjem.org>
Mime-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Cc: David Warren <warren@atmos.washington.edu>,
	nfs@lists.sourceforge.net
To: Trond Myklebust <trond.myklebust@fys.uio.no>
In-Reply-To: <1127764918.8327.22.camel@lade.trondhjem.org>
Sender: nfs-admin@lists.sourceforge.net
Errors-To: nfs-admin@lists.sourceforge.net

Trond Myklebust wrote:

>m=E5 den 26.09.2005 Klokka 12:13 (-0700) skreiv David Warren:
> =20
>
>>I have discovered a wierd problem with NFSv3 on linux.
>>I have 3 machines
>>machine A and B  both mount a disk D  from machine C
>>The options are tcp,rw,hard and intr.
>>
>>Program test runs on machine A writing to D:
>>(fortran)
>>      program test
>>      do i=3D1,10
>>         call system("/bin/rm t")
>>         open (10, file=3D't', status=3D'new')
>>         write(10,*)i
>>         write(6,*)i
>>         close(10)
>>         call sleep(1)
>>      enddo
>>      end
>>
>>program t2 runs on machine B reading from D:
>>(c, but doesn't have to be)
>>#include <stdlib.h>
>>#include <fcntl.h>
>>main(){
>>  char in[80];
>>  int file;
>>  int len;
>>
>>  while(1){
>>    file=3Dopen("t", O_RDONLY);
>>    len=3Dread(file,in,79);
>>    in[len]=3D'\0';
>>    printf("%s\n",in);
>>    close(file);
>>  }
>>}
>>
>>while machine A is counting 1 - 10 and placing these numbers into file=20
>>t, machine B is continually reading 1 from file t, then after a while i=
t=20
>>will switch to another number and read it for a while. In my first=20
>>version of this, I was opening and rewriting the same file. In that=20
>>version, machine B always read 1's. Now that I am creating new inodes=20
>>all the time, it changes every few minutes while I repeatedly rerun tes=
t=20
>>on machine A.
>>
>>Now for the other interresting facts:
>>Reading this file from an unrelated sun during this produces the same=20
>>result as machine B.
>>The same thing under NFSv4 does not do this. It works exactly as one=20
>>would expect it to. As soon as the file is writen, the reader sees the=20
>>new data.
>>
>>Any ideas what I could have done wrong in my NFSv3 set up? Is there som=
e=20
>>kernel parameter that need tweaking? is there some mount option I shoul=
d=20
>>have???
>>Thanks.
>>   =20
>>
>
>When I see that problem on my test-rig, it appears to be due to the
>reuse of inode numbers by my server. IOW: the file created by the
>fortran program always ends up having the same inode number (check this
>using 'ls -i t').
>
>In that case, the client is indeed expected to have problems recognising
>that the file has changed w.r.t. the cache.
>

Actually, the server is responsible for changing the file handle when the
inode is reused.  There is a semantic called a "generation count" which i=
s
used to differentiate between instances of files (re)using the same inode
number.  If the server does not do this, then it is broken and relays thi=
s
breakage on to clients as demonstrated here.

       ps


-------------------------------------------------------
SF.Net email is sponsored by:
Tame your development challenges with Apache's Geronimo App Server. 
Download it for free - -and be entered to win a 42" plasma tv or your very
own Sony(tm)PSP.  Click here to play: http://sourceforge.net/geronimo.php
_______________________________________________
NFS maillist  -  NFS@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nfs