DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=beta;
        h=received:message-id:date:from:sender:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references:x-google-sender-auth;
        b=lbGWFI6E/KJQx0QFm1177DJQ1cnvGuV1Zh5ID2KUL5I0YV5wo/j+fmr6T4Xo/myf9NPql408kAA4Cqt4gOPlRzw+5slgAzWiTfwVQCwXmtJcXQA2do3keM9dF1mdIldarxrBxBppjvaCxlifLAG89tfo/Ud9Z1J7j5OGe3Iuk4I=
Message-ID: <2c0942db0705200020o6dafc9d5k3276c65b3fc9cd4d@mail.gmail.com>
Date: Sun, 20 May 2007 00:20:15 -0700
From: "Ray Lee" <ray-lk@madrabbit.org>
To: "Michael Gerdau" <mgd@technosis.de>
Subject: Re: Sched - graphic smoothness under load - cfs-v13 sd-0.48
Cc: "Bill Davidsen" <davidsen@tmr.com>,
       "Linux Kernel M/L" <linux-kernel@vger.kernel.org>
In-Reply-To: <200705200859.56327.mgd@technosis.de>
MIME-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
References: <464F57DD.2000309@tmr.com> <200705200812.26391.mgd@technosis.de>
	 <2c0942db0705192330r4004d7bem3556c939c1581553@mail.gmail.com>
	 <200705200859.56327.mgd@technosis.de>
Sender: linux-kernel-owner@vger.kernel.org
Content-Length: 1842
Lines: 40

On 5/19/07, Michael Gerdau <mgd@technosis.de> wrote:
> > > I don't want to say the values aren't useful. I simply think there is
> > > a high noiselevel.
> >
> > The noise is reflected in the standard deviation he has on those rows.
> > The average +- stdev  of one overlaps the average +- stdev of the
> > other,
>
> For the fairness test on cfs13 this simply is wrong.

Ah, you are correct. I was looking at the glxgears test and mostly
ignoring the fairness one as I'm not sure what the test is doing. As
the deviations seem erratic, the fairness test looks like it needs
more passes to converge, but that's just a guess. I honestly don't
know what's going on with that one.

> And for the
> test to be stable would require that avg of one is within avg+-stddev
> of the other (simple overlap does not suffice).

Er, I think you took a different statistics class than I did :-). In
general, the 'true' value we're trying to find/measure has a certain
percentage chance of lying within the average +- n*deviation, with the
percentage going up as n increases, right? (68% for n=1, 95% for n=2,
etc.)

Both distributions have that property, and so to consider one of the
averages as the 'true' value and the other a mere distribution that
has to overlap it is... somewhat inaccurate.

In general, if they both overlap within one standard deviation of each
other, you can say that the data has pretty good agreement with
itself. Which for the glxgears case, it does. The fairness test isn't
so cut and dried, but it's not horrifically out of whack, either. So
I'll reserve judgment on that one :-).
-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/