From: "Matt Heaton" Subject: Re: nfs performance problem Date: Tue, 5 Nov 2002 13:22:25 -0700 Sender: nfs-admin@lists.sourceforge.net Message-ID: <098d01c28509$0df86e20$e2a446a6@user1i6avc9gfx> References: <005b01c284f5$ae1d6090$640a010a@winda> <20021105201758.I23227@vestdata.no> <007901c28505$51e9c240$640a010a@winda> Mime-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Return-path: Received: from mgr3.xmission.com ([198.60.22.203]) by usw-sf-list1.sourceforge.net with esmtp (Exim 3.31-VA-mm2 #1 (Debian)) id 189AFX-0006DY-00 for ; Tue, 05 Nov 2002 12:24:35 -0800 To: "poczta.dotcom.pl" , Errors-To: nfs-admin@lists.sourceforge.net List-Help: List-Post: List-Subscribe: , List-Id: Discussion of NFS under Linux development, interoperability, and testing. List-Unsubscribe: , List-Archive: I have 3ware cards as well (2 7500 Series 8 drive), just like yours. ALso with 120 GIG drives (7200) RPM. Whever I get 150-200 tps in iostat then my NFS runs SO SLOW. I also only get 1 MB, to 1.5 MB over NFS. The local speed seems to be ok, not great though. MY OPINION is that this is because of seek time on the raid array. I am serving very small files, just like you are. I am requesting about 200-300 files per second from each NFS server. So even though our throughput of only 1.5 MB isn't high. The number of files per second is actually quite high, and causes things to slow down because of seek time issues. PLEASE GIVE US CACHEFS SOMEONE?? Does anyone have experience with IDE Raid arrays that get over 250 tps in iostat that work fine? I would be VERY VERY VERY interested to find out. L8r... Matt > On Tue, Nov 05, 2002 at 07:03:43PM +0100, poczta.dotcom.pl wrote: > > Hi All > > > > I have really slow working nfs. > > Server is build on: > > - dual pentium Xeon 2GHz, > > - 2 3ware 7500 controllers, > > - raid 5 on 7 160GB discs on controler 1 > > - raid 5 on 6 160GB disks on cotroller 2 > > > > Serwer is used for ~500k maildirs, > > all clients (~20) are freebsd boxes, when nfs transfer is around 1MB/s for writing and 1.5MB/s for reading > > listing user directories even with very few file stakes up to 15 seconds. > > > > I tried nfs-ALL patch, but it didn' t help. > > How is local performance? local read/writes are ok > What filesystem do you use? reiserfs on top of lvm (to be able to get snapshots) > What's the output from "iostat -x -d -k 60 3"? > below is output from 'iostat -d 60 3' (- my iostat does not take '-k' option, and '-d' gives me empty output) - mayby this is enough? Linux 2.4.19 (hostname) 11/05/02 Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn dev8-0 16.16 205.52 82.84 3481842 1403528 dev8-1 160.58 1266.39 1346.12 21455002 22805744 Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn dev8-0 9.23 134.93 16.13 8096 968 dev8-1 150.92 753.20 1715.87 45192 102952 Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn dev8-0 10.02 135.07 26.53 8104 1592 dev8-1 152.78 763.33 1767.20 45800 106032 rafal ------------------------------------------------------- This sf.net email is sponsored by: See the NEW Palm Tungsten T handheld. Power & Color in a compact size! http://ads.sourceforge.net/cgi-bin/redirect.pl?palm0001en _______________________________________________ NFS maillist - NFS@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/nfs ------------------------------------------------------- This sf.net email is sponsored by: See the NEW Palm Tungsten T handheld. Power & Color in a compact size! http://ads.sourceforge.net/cgi-bin/redirect.pl?palm0001en _______________________________________________ NFS maillist - NFS@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/nfs