From: Ian Kent Subject: Re: NFS performance tuning Date: Sun, 8 Jan 2006 14:51:53 +0800 (WST) Message-ID: References: <43BE9EC3.3090108@totalflood.com> <32f0438a5087c2ea289922bbacb1897d@local> Mime-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Cc: Stephen Carville , NFS List Return-path: Received: from sc8-sf-mx1-b.sourceforge.net ([10.3.1.91] helo=mail.sourceforge.net) by sc8-sf-list2.sourceforge.net with esmtp (Exim 4.30) id 1EvUPe-0007Ui-Tw for nfs@lists.sourceforge.net; Sat, 07 Jan 2006 22:52:22 -0800 Received: from wombat.indigo.net.au ([202.0.185.19]) by mail.sourceforge.net with esmtps (TLSv1:DES-CBC3-SHA:168) (Exim 4.44) id 1EvUPc-0007BL-LP for nfs@lists.sourceforge.net; Sat, 07 Jan 2006 22:52:23 -0800 To: Blake Golliher In-Reply-To: <32f0438a5087c2ea289922bbacb1897d@local> Sender: nfs-admin@lists.sourceforge.net Errors-To: nfs-admin@lists.sourceforge.net List-Unsubscribe: , List-Id: Discussion of NFS under Linux development, interoperability, and testing. List-Post: List-Help: List-Subscribe: , List-Archive: On Fri, 6 Jan 2006, Blake Golliher wrote: > Did you specify using a 32k read and write size, that I didn't see somewhere? > If you have a very clean network, you could get an advantage of using UDP as > well. I'm not sure which transport you are using though. > > Oh I see a mention of nfs v2 tcp. Well, I'd recommend moving to nfs v3, using > a 64k read/write size, and using UDP. That might give you some gains. Of > course, I'm usually a TCP bigot for nfs transport, but for a very clean, > almost back to back, dedicated switch type of environment, I'll allow it. Mmm. I thought UDP was max. 8k read and write size and 32k was the max. for TCP. > > -Blake > > On Jan 6, 2006, at 8:45 AM, Stephen Carville wrote: > > > I have NFS server running on a Dell 2850: > > > > Name: Amazon > > CPU: 3000 Mhz Xeon (X2) > > Memory: 2G > > Swap: 8G > > OS: Fedora Core 3 > > NFS: Version 1-4 > > > > I export a 150G volume thusly: > > > > /NFS/tigris_backup > > 10.1.1.0/24(rw,wdelay,nohide,insecure,root_squash,no_subtree_check,anonuid=65534,anongid=65534) > > > > The client is a Dell 2650 running Oracle 9i > > > > Name: Tigris > > CPU: 3200Mhz Xeon (X2) > > Memory: 8G > > Swap: 4G > > OS: Redhat ES 3.2 > > NFS: Version 2/tcp > > > > Both have hyperthreading enabled. > > The machines are connected via a dedicated gigabit switch. > > > > The goal (among others) is to run the nightly RMAN backups of the Oracle > > database to the NFS drive on Amazon where it is backed up to tape later. > > To this end I mount the NFS volume, run the backups, and unmount the volme. > > > > That part works well. However the thruput on the connection is much > > less than I expected. Simple file transfers for example give only about: > > > > Using NFS > > Amazon to Tigris: 168 Mbps > > Tigris to Amazon: 104 Mbps > > > > Using ftp > > ssh A to T: 320 Mbps > > ssh T to A 360 Mbps > > > > I can accept that I may never get a full Gigabit per second over copper > > but it still looks like there is room for improvement in the NFS trnsfer > > speeds. > > > > Suggestions? > > > > -- > > Stephen Carville > > Unix and Network Admin > > Nationwide Totalflood > > 6033 W. Century Blvd > > Los Angeles, CA 90045 > > 310-342-3602 > > > > > > > > ------------------------------------------------------- > > This SF.net email is sponsored by: Splunk Inc. Do you grep through log files > > for problems? Stop! Download the new AJAX search engine that makes > > searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! > > http://ads.osdn.com/?ad_id=7637&alloc_id=16865&op=click > > _______________________________________________ > > NFS maillist - NFS@lists.sourceforge.net > > https://lists.sourceforge.net/lists/listinfo/nfs > > > > > > > > ------------------------------------------------------- > This SF.net email is sponsored by: Splunk Inc. Do you grep through log files > for problems? Stop! Download the new AJAX search engine that makes > searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! > http://ads.osdn.com/?ad_id=7637&alloc_id=16865&op=click > _______________________________________________ > NFS maillist - NFS@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/nfs ------------------------------------------------------- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://ads.osdn.com/?ad_id=7637&alloc_id=16865&op=click _______________________________________________ NFS maillist - NFS@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/nfs