From: Brian Elliott Finley Subject: Re: rpc.mountd at 99% cpu Date: Thu, 29 Sep 2005 15:17:37 -0500 Message-ID: <433C4BE1.7000107@anl.gov> References: <433C3C87.4040401@anl.gov><20050929213533.koygqlpb3hy8ogsg@home.staff.uni-marburg.de><433C43AE.5060709@anl.gov> <20050929215204.85kt3qx0hwf4kc00@home.staff.uni-marburg.de> <433C49F1.1010409@anl.gov> Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Cc: nfs@lists.sourceforge.net Return-path: Received: from sc8-sf-mx2-b.sourceforge.net ([10.3.1.92] helo=mail.sourceforge.net) by sc8-sf-list2.sourceforge.net with esmtp (Exim 4.30) id 1EL4qV-0004nb-Ae for nfs@lists.sourceforge.net; Thu, 29 Sep 2005 13:17:35 -0700 Received: from peabody.anl.gov ([146.137.222.62] helo=anlmail.anl.gov) by mail.sourceforge.net with esmtp (Exim 4.44) id 1EL4qU-0006NG-Qe for nfs@lists.sourceforge.net; Thu, 29 Sep 2005 13:17:35 -0700 To: Reuti In-Reply-To: <433C49F1.1010409@anl.gov> Sender: nfs-admin@lists.sourceforge.net Errors-To: nfs-admin@lists.sourceforge.net List-Unsubscribe: , List-Id: Discussion of NFS under Linux development, interoperability, and testing. List-Post: List-Help: List-Subscribe: , List-Archive: I've taken a quick look at your posts. My situation is a bit different: * Using nfs v3 only * /proc/fs/nfsd does exist, but it is not a mounted filesystem * stale filehandles and errors don't seem to be an issue, only rpc.mountd monopolizing CPU during client mounting Cheers, -Brian Brian Elliott Finley wrote: >Reuti, > >/proc/fs/nfsd/ does exist. I'll go back and have a look at your posts. > >-Brian > > > >Reuti wrote: > > > >>Typo: the one I meant was /proc/fs/nfsd - is there anything in this >>directory? >> >>-- Reuti >> >>Zitat von Brian Elliott Finley : >> >> >> >>>Reuti, >>> >>>Thanks for your reply, but I'm afraid /proc/nfs/nfsd is *not* currently >>>mounted. >>> >>>Cheers, -Brian >>> >>> >>>Reuti wrote: >>> >>> >>> >>>>Brian, >>>> >>>>is there a file system mounted in /proc/nfs/nfsd - then nfsd is working >>>>in a new >>>>mode? You can try *not* to mount it in the start/stop-script of the NFS >>>>server. >>>>This way you will force nsfd to operate in a legacy mode. If you >>>>followed my >>>>posts last week, this solved a problem with stale file handles for me. >>>> >>>>Cheers - Reuti >>>> >>>> >>>>Zitat von Brian Elliott Finley : >>>> >>>> >>>> >>>>>I've got an nfs server (quad cpu amd64, 36G mem, failover >>>>> >>>>> >>fiberchannel) >> >> >>>>>running ubuntu, and I'm getting the following behavior that I haven't >>>>>been able to track down yet: >>>>> >>>>> * rpc.mountd spikes to 99% cpu usage when a client machine mounts, >>>>> causing a temporary disruption in service to all client systems >>>>> >>>>>Google, NFS Howtos, NFS Perf Tuning docs, IRC (can't find an NFS >>>>>specific IRC channel), local sysadmins all turn up nothing so >>>>> >>>>> >>far. Here >> >> >>>>>are potentially relavant data: >>>>> >>>>> * exportfs -v -o rw,secure,sync,no_root_squash >>>>> 10.10.0.0/255.255.0.0:/export/home >>>>> * nfs server has all clients info in /etc/hosts >>>>> * /etc/hosts is first in nsswitch.conf >>>>> * kernel is ubuntu's: linux-image-2.6.10-5-amd64-k8-smp >>>>> * nfs performance is fine once a filesystem is mounted >>>>> * unless, someone else is mounting a filesystem, in which case >>>>> already mounted filesystems >>>>> * only 8 clients >>>>> * home directories mounted by autofs on clients as >>>>> server:/export/home/bob /home/bob >>>>> * 32 nfsd threads >>>>> * % netstat -in >>>>> Kernel Interface table >>>>> Iface MTU Met RX-OK RX-ERR RX-DRP RX-OVR TX-OK TX-ERR >>>>> >>>>> >>TX-DRP >> >> >>>>> TX-OVR Flg >>>>> eth0 1500 0 247854230 0 0 0324570001 0 >>>>> 0 0 BMRU >>>>> eth1 1500 0 1022171197 0 0 0258643880 >>>>> 0 0 0 BMR U >>>>> lo 16436 0 419024 0 0 0 419024 0 >>>>> 0 0 LRU >>>>> * % cat /proc/net/rpc/nfsd | grep ^th >>>>> th 32 8229 13759.142 6537.314 1919.479 4.212 129.977 52.636 >>>>> >>>>> >>11.780 >> >> >>>>> 10.231 0.000 101.321 >>>>> * caching bind9 installed on server, and it points to itself for >>>>> first nameserver entry >>>>> >>>>>Any one know what's up here? Or how I can tell what's making >>>>> >>>>> >>rpc.mountd >> >> >>>>>take so much time? >>>>> >>>>>-- >>>>>Brian Elliott Finley >>>>>Linux Strategist, CIS >>>>>Desk: 630.252.4742 >>>>>Cell: 630.631.6621 >>>>> >>>>> >>>>> >>>>>------------------------------------------------------- >>>>>This SF.Net email is sponsored by: >>>>>Power Architecture Resource Center: Free content, downloads, >>>>> >>>>> >>>>discussions, >>>> >>>> >>>>>and more. http://solutions.newsforge.com/ibmarch.tmpl >>>>>_______________________________________________ >>>>>NFS maillist - NFS@lists.sourceforge.net >>>>>https://lists.sourceforge.net/lists/listinfo/nfs >>>>> >>>>> >>>>> >>>> >>>> >>>> >>>>------------------------------------------------------- >>>>This SF.Net email is sponsored by: >>>>Power Architecture Resource Center: Free content, downloads, >>>> >>>> >>discussions, >> >> >>>>and more. http://solutions.newsforge.com/ibmarch.tmpl >>>>_______________________________________________ >>>>NFS maillist - NFS@lists.sourceforge.net >>>>https://lists.sourceforge.net/lists/listinfo/nfs >>>> >>>> >>>> >>>-- >>>Brian Elliott Finley >>>Linux Strategist, CIS >>>Desk: 630.252.4742 >>>Cell: 630.631.6621 >>> >>> >>> >>>------------------------------------------------------- >>>This SF.Net email is sponsored by: >>>Power Architecture Resource Center: Free content, downloads, >>> >>> >>discussions, >> >> >>>and more. http://solutions.newsforge.com/ibmarch.tmpl >>>_______________________________________________ >>>NFS maillist - NFS@lists.sourceforge.net >>>https://lists.sourceforge.net/lists/listinfo/nfs >>> >>> >>> > > > -- Brian Elliott Finley Linux Strategist, CIS Desk: 630.252.4742 Cell: 630.631.6621 ------------------------------------------------------- This SF.Net email is sponsored by: Power Architecture Resource Center: Free content, downloads, discussions, and more. http://solutions.newsforge.com/ibmarch.tmpl _______________________________________________ NFS maillist - NFS@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/nfs