Subject: Re: [NFS] Re: [PATCH] zerocopy NFS for 2.5.36
> Hello,
>
> Thanks for testing my patches.
>
> > I am still seeing some sort of problem on an 8 way (hyperthreaded 8
> > logical/4 physical) on UDP with these patches. I cannot get more than 2
> > NFSd threads in a run state at one time. TCP usually has 8 or more.
The
> > test involves 40 100Mbit clients reading a 200 MB file on one server (4
> > acenic adapters) in cache. I am fighting some other issues at the
moment
> > (acpi wierdness), but so far before the patches, 82 MB/sec for NFSv2,UDP
and
> > 138 MB/sec for NFSv2,TCP. With the patches, 115 MB/sec for NFSv2,UDP
and
> > 181 MB/sec for NFSv2,TCP. One CPU is maxed due to acpi int storm, so I
> > think the results will get better. I'm not sure what other lock or
> > contention point this is hitting on UDP. If there is anything I can do
to
> > help, please let me know, thanks.
>
> I guess some UDP packets might be lost. It may happen easily as UDP
protocol
> doesn't support flow control.
> Can you check how many errors has happened?
> You can see them in /proc/net/snmp of the server and the clients.
server: Udp: InDatagrams NoPorts InErrors OutDatagrams
Udp: 1000665 41 0 1000666
clients: Udp: InDatagrams NoPorts InErrors OutDatagrams
Udp: 200403 0 0 200406
(all clients the same)
> And how many threads did you start on your machine?
> Buffer size of a UDP socket depends on number of kNFS threads.
> Large number of threads might help you.
128 threads. client rsize=8196. Server and client MTU is 1500.
Andrew Theurer
Hi,
> server: Udp: InDatagrams NoPorts InErrors OutDatagrams
> Udp: 1000665 41 0 1000666
> clients: Udp: InDatagrams NoPorts InErrors OutDatagrams
> Udp: 200403 0 0 200406
> (all clients the same)
How about IP datagrams? You can see the IP fields in /proc/net/snmp
IP layer may also discard them.
> > And how many threads did you start on your machine?
> > Buffer size of a UDP socket depends on number of kNFS threads.
> > Large number of threads might help you.
>
> 128 threads. client rsize=8196. Server and client MTU is 1500.
It seems enough...