Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1765012AbXFRSPV (ORCPT ); Mon, 18 Jun 2007 14:15:21 -0400 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1760595AbXFRSPH (ORCPT ); Mon, 18 Jun 2007 14:15:07 -0400 Received: from dsl081-033-126.lax1.dsl.speakeasy.net ([64.81.33.126]:40036 "EHLO bifrost.lang.hm" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1757187AbXFRSPF (ORCPT ); Mon, 18 Jun 2007 14:15:05 -0400 Date: Mon, 18 Jun 2007 11:12:45 -0700 (PDT) From: david@lang.hm X-X-Sender: dlang@asgard.lang.hm To: Lennart Sorensen cc: Brendan Conoboy , Neil Brown , Wakko Warner , linux-kernel@vger.kernel.org, linux-raid@vger.kernel.org Subject: Re: limits on raid In-Reply-To: <20070618180327.GP10008@csclub.uwaterloo.ca> Message-ID: References: <18034.479.256870.600360@notabene.brown> <18034.3676.477575.490448@notabene.brown> <20070616020320.GB2002@animx.eu.org> <18035.23867.576212.859440@notabene.brown> <4676BEC2.7090809@redhat.com> <20070618180327.GP10008@csclub.uwaterloo.ca> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Sender: linux-kernel-owner@vger.kernel.org X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 1674 Lines: 38 On Mon, 18 Jun 2007, Lennart Sorensen wrote: > On Mon, Jun 18, 2007 at 10:28:38AM -0700, david@lang.hm wrote: >> I plan to test the different configurations. >> >> however, if I was saturating the bus with the reconstruct how can I fire >> off a dd if=/dev/zero of=/mnt/test and get ~45M/sec whild only slowing the >> reconstruct to ~4M/sec? >> >> I'm putting 10x as much data through the bus at that point, it would seem >> to proove that it's not the bus that's saturated. > > dd 45MB/s from the raid sounds reasonable. > > If you have 45 drives, doing a resync of raid5 or radi6 should probably > involve reading all the disks, and writing new parity data to one drive. > So if you are writing 5MB/s, then you are reading 44*5MB/s from the > other drives, which is 220MB/s. If your resync drops to 4MB/s when > doing dd, then you have 44*4MB/s which is 176MB/s or 44MB/s less read > capacity, which surprisingly seems to match the dd speed you are > getting. Seems like you are indeed very much saturating a bus > somewhere. The numbers certainly agree with that theory. > > What kind of setup is the drives connected to? simple ultra-wide SCSI to a single controller. I didn't realize that the rate reported by /proc/mdstat was the write speed that was takeing place, I thought it was the total data rate (reads + writes). the next time this message gets changed it would be a good thing to clarify this. David Lang - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/