More history from hackbench from STP from the 2.5 and 2.6 mm kernels.
These are also separated by the number of processors from 1-, 2-, 4- and
8-processor systems. I think there might be a few anomalies in this list...
1-way:
Kernel Metric Change (%) URL
-------------------- ------ ---------- ----------------------------------------
2.5.62-mm1 18.1 N/A http://khack.osdl.org/stp/266295/
2.5.62-mm3 14.4 -20.3 http://khack.osdl.org/stp/266948/
2.5.63-mm1 14.2 -1.4 http://khack.osdl.org/stp/267564/
2.5.63-mm2 14.1 -0.5 http://khack.osdl.org/stp/267808/
2.5.64-mm4 14.1 -0.2 http://khack.osdl.org/stp/268444/
2.5.64-mm6 14.1 -0.0 http://khack.osdl.org/stp/268552/
2.5.65-mm1 13.6 -3.8 http://khack.osdl.org/stp/268824/
2.5.65-mm2 13.6 0.1 http://khack.osdl.org/stp/268882/
2.5.65-mm3 13.2 -2.8 http://khack.osdl.org/stp/268954/
2.5.65-mm4 13.8 4.6 http://khack.osdl.org/stp/269011/
2.5.66-mm1 13.6 -1.3 http://khack.osdl.org/stp/269497/
2.5.66-mm2 14.0 2.6 http://khack.osdl.org/stp/269679/
2.5.66-mm3 13.8 -1.1 http://khack.osdl.org/stp/270049/
2.5.67-mm1 13.8 -0.2 http://khack.osdl.org/stp/270280/
2.5.67-mm2 13.8 -0.0 http://khack.osdl.org/stp/270435/
2.5.67-mm4 14.0 1.2 http://khack.osdl.org/stp/270599/
2.5.68-mm1 14.1 1.2 http://khack.osdl.org/stp/270714/
2.5.68-mm2 34.1 141.2 http://khack.osdl.org/stp/270888/
2.5.68-mm3 33.7 -1.1 http://khack.osdl.org/stp/271132/
2.5.68-mm4 33.1 -1.8 http://khack.osdl.org/stp/271286/
2.5.69-mm2 32.8 -1.1 http://khack.osdl.org/stp/271846/
2.5.69-mm3 32.9 0.6 http://khack.osdl.org/stp/271956/
2.5.69-mm5 32.5 -1.5 http://khack.osdl.org/stp/272207/
2.5.69-mm6 32.7 0.8 http://khack.osdl.org/stp/272278/
2.5.70-mm3 33.3 1.8 http://khack.osdl.org/stp/273203/
2.5.70-mm5 17.7 -47.0 http://khack.osdl.org/stp/273458/
2.5.70-mm7 17.3 -2.2 http://khack.osdl.org/stp/273645/
2.5.70-mm9 17.2 -0.7 http://khack.osdl.org/stp/273904/
2.5.72-mm1 17.2 0.4 http://khack.osdl.org/stp/274215/
2.5.73-mm1 17.5 1.5 http://khack.osdl.org/stp/274824/
2.5.73-mm2 17.6 0.5 http://khack.osdl.org/stp/275094/
2.5.74-mm2 18.4 4.4 http://khack.osdl.org/stp/275388/
2.5.74-mm3 17.4 -5.2 http://khack.osdl.org/stp/275517/
2.6.0-test1-mm1 18.1 4.2 http://khack.osdl.org/stp/276034/
2.6.0-test1-mm2 17.3 -4.7 http://khack.osdl.org/stp/276254/
2.6.0-test2-mm1 16.7 -3.6 http://khack.osdl.org/stp/276491/
2.6.0-test2-mm2 16.1 -3.5 http://khack.osdl.org/stp/276821/
2.6.0-test2-mm3 17.9 11.1 http://khack.osdl.org/stp/277017/
2.6.0-test2-mm4 17.4 -2.8 http://khack.osdl.org/stp/277086/
2.6.0-test2-mm5 16.7 -3.8 http://khack.osdl.org/stp/277282/
2.6.0-test3-mm1 16.8 0.9 http://khack.osdl.org/stp/277418/
2.6.0-test4-mm1 15.1 -10.3 http://khack.osdl.org/stp/280107/
2.6.0-test4-mm2 15.4 1.7 http://khack.osdl.org/stp/280103/
2.6.0-test4-mm4 15.8 3.0 http://khack.osdl.org/stp/280099/
2.6.0-test4-mm5 16.3 2.7 http://khack.osdl.org/stp/280095/
2.6.0-test4-mm6 15.3 -6.1 http://khack.osdl.org/stp/280091/
2.6.0-test5-mm2 15.3 0.3 http://khack.osdl.org/stp/280087/
2-way:
Kernel Metric Change (%) URL
-------------------- ------ ---------- ----------------------------------------
2.5.64-mm4 11.2 N/A http://khack.osdl.org/stp/268445/
2.5.64-mm5 11.1 -1.5 http://khack.osdl.org/stp/268487/
2.5.64-mm6 11.4 3.3 http://khack.osdl.org/stp/268571/
2.5.65-mm1 11.3 -1.2 http://khack.osdl.org/stp/268843/
2.5.65-mm2 11.4 0.9 http://khack.osdl.org/stp/268901/
2.5.65-mm3 11.1 -2.5 http://khack.osdl.org/stp/268973/
2.5.66-mm1 11.3 1.3 http://khack.osdl.org/stp/269516/
2.5.66-mm3 11.4 1.5 http://khack.osdl.org/stp/270068/
2.5.67-mm1 11.1 -2.7 http://khack.osdl.org/stp/270299/
2.5.67-mm2 11.3 1.3 http://khack.osdl.org/stp/270454/
2.5.67-mm4 11.2 -0.3 http://khack.osdl.org/stp/270618/
2.5.68-mm1 11.2 -0.2 http://khack.osdl.org/stp/270733/
2.5.68-mm2 23.6 110.7 http://khack.osdl.org/stp/270907/
2.5.68-mm4 22.9 -2.8 http://khack.osdl.org/stp/271285/
2.5.69-mm3 22.4 -2.2 http://khack.osdl.org/stp/271955/
2.5.69-mm5 22.9 1.8 http://khack.osdl.org/stp/272206/
2.5.70-mm5 13.3 -41.6 http://khack.osdl.org/stp/273457/
2.5.70-mm6 12.8 -3.8 http://khack.osdl.org/stp/273548/
2.5.70-mm9 12.9 0.3 http://khack.osdl.org/stp/273903/
2.5.72-mm2 13.0 1.0 http://khack.osdl.org/stp/274359/
2.5.73-mm1 13.1 0.5 http://khack.osdl.org/stp/274823/
2.5.73-mm2 12.9 -1.3 http://khack.osdl.org/stp/275093/
2.5.74-mm2 13.4 4.0 http://khack.osdl.org/stp/275387/
2.5.74-mm3 13.2 -1.8 http://khack.osdl.org/stp/275516/
2.5.75-mm1 13.4 1.5 http://khack.osdl.org/stp/275713/
2.6.0-test1-mm1 13.4 -0.2 http://khack.osdl.org/stp/276033/
2.6.0-test1-mm2 13.6 1.6 http://khack.osdl.org/stp/276253/
2.6.0-test2-mm1 12.7 -6.3 http://khack.osdl.org/stp/276490/
2.6.0-test2-mm2 12.9 1.7 http://khack.osdl.org/stp/276820/
2.6.0-test2-mm3 13.2 2.4 http://khack.osdl.org/stp/277016/
2.6.0-test2-mm4 13.7 3.6 http://khack.osdl.org/stp/277085/
2.6.0-test2-mm5 13.7 0.1 http://khack.osdl.org/stp/277281/
2.6.0-test3-mm1 12.5 -9.0 http://khack.osdl.org/stp/277417/
2.6.0-test4-mm1 11.2 -10.4 http://khack.osdl.org/stp/280108/
2.6.0-test4-mm2 11.7 4.4 http://khack.osdl.org/stp/280104/
2.6.0-test4-mm4 11.7 0.0 http://khack.osdl.org/stp/280100/
2.6.0-test4-mm5 12.5 6.6 http://khack.osdl.org/stp/280096/
2.6.0-test4-mm6 11.8 -5.2 http://khack.osdl.org/stp/280092/
2.6.0-test5-mm2 11.8 -0.5 http://khack.osdl.org/stp/280088/
4-way:
Kernel Metric Change (%) URL
-------------------- ------ ---------- ----------------------------------------
2.5.66-mm1 9.6 N/A http://khack.osdl.org/stp/269532/
2.5.66-mm3 9.3 -3.3 http://khack.osdl.org/stp/270084/
2.5.67-mm1 8.9 -3.7 http://khack.osdl.org/stp/270315/
2.5.67-mm2 9.5 6.0 http://khack.osdl.org/stp/270470/
2.5.67-mm4 9.2 -2.4 http://khack.osdl.org/stp/270634/
2.5.68-mm1 9.2 0.2 http://khack.osdl.org/stp/270749/
2.5.68-mm2 17.2 86.1 http://khack.osdl.org/stp/270923/
2.5.68-mm4 17.1 -0.8 http://khack.osdl.org/stp/271284/
2.5.69-mm1 16.7 -2.0 http://khack.osdl.org/stp/271654/
2.5.69-mm3 16.7 0.1 http://khack.osdl.org/stp/271954/
2.5.69-mm5 16.7 -0.3 http://khack.osdl.org/stp/272205/
2.5.70-mm5 9.6 -42.8 http://khack.osdl.org/stp/273456/
2.5.70-mm9 10.3 7.4 http://khack.osdl.org/stp/273902/
2.5.72-mm2 10.2 -0.9 http://khack.osdl.org/stp/274358/
2.5.73-mm1 10.3 1.3 http://khack.osdl.org/stp/274822/
2.5.73-mm2 10.4 1.2 http://khack.osdl.org/stp/275092/
2.5.74-mm2 10.4 0.1 http://khack.osdl.org/stp/275386/
2.5.74-mm3 10.6 1.5 http://khack.osdl.org/stp/275515/
2.5.75-mm1 10.5 -1.0 http://khack.osdl.org/stp/275712/
2.6.0-test1-mm1 10.3 -1.9 http://khack.osdl.org/stp/276032/
2.6.0-test1-mm2 11.0 7.3 http://khack.osdl.org/stp/276252/
2.6.0-test2-mm1 9.9 -10.4 http://khack.osdl.org/stp/276489/
2.6.0-test2-mm2 10.3 4.2 http://khack.osdl.org/stp/276819/
2.6.0-test2-mm3 9.4 -9.2 http://khack.osdl.org/stp/277015/
2.6.0-test2-mm5 10.4 11.0 http://khack.osdl.org/stp/277280/
2.6.0-test3-mm1 9.4 -9.6 http://khack.osdl.org/stp/277416/
2.6.0-test3-mm3 8.7 -6.9 http://khack.osdl.org/stp/277862/
2.6.0-test4-mm1 8.1 -7.3 http://khack.osdl.org/stp/280109/
2.6.0-test4-mm2 8.3 2.7 http://khack.osdl.org/stp/280105/
2.6.0-test4-mm4 8.3 -0.8 http://khack.osdl.org/stp/280101/
2.6.0-test4-mm5 8.6 4.6 http://khack.osdl.org/stp/280097/
2.6.0-test4-mm6 8.3 -3.4 http://khack.osdl.org/stp/280093/
2.6.0-test5-mm2 8.4 0.1 http://khack.osdl.org/stp/280089/
8-way:
Kernel Metric Change (%) URL
-------------------- ------ ---------- ----------------------------------------
2.5.64-mm6 7.5 N/A http://khack.osdl.org/stp/268597/
2.5.65-mm1 7.5 0.6 http://khack.osdl.org/stp/268869/
2.5.65-mm2 7.7 1.4 http://khack.osdl.org/stp/268927/
2.5.65-mm3 7.7 0.0 http://khack.osdl.org/stp/268999/
2.5.65-mm4 7.6 -0.6 http://khack.osdl.org/stp/269056/
2.5.66-mm1 7.6 -0.1 http://khack.osdl.org/stp/269542/
2.5.66-mm3 7.5 -0.8 http://khack.osdl.org/stp/270094/
2.5.67-mm1 7.4 -1.4 http://khack.osdl.org/stp/270325/
2.5.67-mm4 6.8 -9.0 http://khack.osdl.org/stp/270643/
2.5.68-mm1 6.7 -0.7 http://khack.osdl.org/stp/270758/
2.5.68-mm2 11.8 75.1 http://khack.osdl.org/stp/270932/
2.5.68-mm4 11.4 -2.8 http://khack.osdl.org/stp/271283/
2.5.69-mm1 11.3 -0.9 http://khack.osdl.org/stp/271653/
2.5.69-mm2 11.3 0.2 http://khack.osdl.org/stp/271843/
2.5.69-mm3 11.3 -0.5 http://khack.osdl.org/stp/271953/
2.5.69-mm5 11.3 0.4 http://khack.osdl.org/stp/272204/
2.5.69-mm6 11.2 -1.1 http://khack.osdl.org/stp/272275/
2.5.69-mm7 11.6 3.9 http://khack.osdl.org/stp/272333/
2.5.69-mm9 12.6 7.9 http://khack.osdl.org/stp/272543/
2.5.70-mm1 11.7 -7.3 http://khack.osdl.org/stp/272726/
2.5.70-mm5 7.4 -36.9 http://khack.osdl.org/stp/273455/
2.5.70-mm9 7.9 6.8 http://khack.osdl.org/stp/273901/
2.5.72-mm1 7.9 0.3 http://khack.osdl.org/stp/274212/
2.5.72-mm2 7.8 -1.4 http://khack.osdl.org/stp/274357/
2.5.73-mm1 8.0 2.5 http://khack.osdl.org/stp/274821/
2.5.73-mm2 7.9 -0.9 http://khack.osdl.org/stp/275091/
2.5.74-mm2 15.8 100.6 http://khack.osdl.org/stp/275385/
2.5.74-mm3 8.0 -49.6 http://khack.osdl.org/stp/275514/
2.5.75-mm1 26.3 229.9 http://khack.osdl.org/stp/275711/
2.6.0-test1-mm1 7.8 -70.5 http://khack.osdl.org/stp/276031/
2.6.0-test1-mm2 8.2 5.2 http://khack.osdl.org/stp/276251/
2.6.0-test2-mm1 7.9 -3.9 http://khack.osdl.org/stp/276488/
2.6.0-test2-mm2 8.0 2.2 http://khack.osdl.org/stp/276818/
2.6.0-test2-mm5 7.9 -1.2 http://khack.osdl.org/stp/277279/
2.6.0-test3-mm1 7.3 -8.5 http://khack.osdl.org/stp/277415/
2.6.0-test3-mm3 7.1 -2.7 http://khack.osdl.org/stp/277882/
2.6.0-test4-mm1 6.6 -7.2 http://khack.osdl.org/stp/280110/
2.6.0-test4-mm2 6.8 3.2 http://khack.osdl.org/stp/280106/
2.6.0-test4-mm4 6.7 -0.2 http://khack.osdl.org/stp/280102/
2.6.0-test4-mm6 6.8 1.3 http://khack.osdl.org/stp/280094/
2.6.0-test5-mm2 6.8 0.2 http://khack.osdl.org/stp/280163/
Kernels not listed either do not have results or the kernel was not
able to be used on STP.
The 'Metric' is the average time in seconds to do something with 100
processes.
Smaller numbers are better as well as a (-) change.
'Change' refers to a percentage change in the metric from the last
completed test with results.
--
Mark Wong - - [email protected]
Open Source Development Lab Inc - A non-profit corporation
12725 SW Millikan Way - Suite 400 - Beaverton, OR 97005
(503) 626-2455 x 32 (office)
(503) 626-2436 (fax)
[email protected] wrote:
>
> More history from hackbench from STP from the 2.5 and 2.6 mm kernels.
This looks great, but tragically incomprehensible.
Could someone please provide some interpretation, tell us what hackbench
is, and what all the numbers mean?
Do we rock or do we suck?
On Sep 18, 2003 17:07 -0700, Andrew Morton wrote:
> [email protected] wrote:
> >
> > More history from hackbench from STP from the 2.5 and 2.6 mm kernels.
>
> This looks great, but tragically incomprehensible.
>
> Could someone please provide some interpretation, tell us what hackbench
> is, and what all the numbers mean?
>
> Do we rock or do we suck?
I was wondering that also, until I noticed the description at the end.
We should keep the test description at the start, or people lose interest
too quickly ;-)
> [email protected] wrote:
> > The 'Metric' is the average time in seconds to do something with 100
> > processes. Smaller numbers are better as well as a (-) change.
> > 'Change' refers to a percentage change in the metric from the last
> > completed test with results.
Cheers, Andreas
--
Andreas Dilger
http://sourceforge.net/projects/ext2resize/
http://www-mddsp.enel.ucalgary.ca/People/adilger/
On Thu, Sep 18, 2003 at 05:07:54PM -0700, Andrew Morton wrote:
> [email protected] wrote:
> >
> > More history from hackbench from STP from the 2.5 and 2.6 mm kernels.
>
> This looks great, but tragically incomprehensible.
>
> Could someone please provide some interpretation, tell us what hackbench
> is, and what all the numbers mean?
>
> Do we rock or do we suck?
Sorry, I was a bit hasty.
Hackbench is a test from Rusty Russel that's intended to test the scalability
of the scheduler. The results I gathered are from a test where 100 processes
are started to send a message to another set of 100 processes. This is
repeated at least a few times and the time taken to complete each instance
is averaged. Anyone feel free to correct me as I learned this second hand.
The general trend in the metric indicates everything has been improving, so I
think we rock.
On Thu, 2003-09-18 at 17:58, Mark Wong wrote:
> On Thu, Sep 18, 2003 at 05:07:54PM -0700, Andrew Morton wrote:
> > [email protected] wrote:
> > >
> > > More history from hackbench from STP from the 2.5 and 2.6 mm kernels.
> >
> > This looks great, but tragically incomprehensible.
> >
> > Could someone please provide some interpretation, tell us what hackbench
> > is, and what all the numbers mean?
> >
> > Do we rock or do we suck?
>
> Sorry, I was a bit hasty.
>
> Hackbench is a test from Rusty Russel that's intended to test the scalability
> of the scheduler. The results I gathered are from a test where 100 processes
> are started to send a message to another set of 100 processes. This is
> repeated at least a few times and the time taken to complete each instance
> is averaged. Anyone feel free to correct me as I learned this second hand.
Each individual test run executes the test for 20 processes, then 40,
then 60, 80, and finally 100 processes. Each set of processes are
executed 5 times, and an average time to complete the exercise is
given for each of the sets. The test report (shown by the link) has
a graph of the averaged times for each of the sets. In all cases,
there is a very good linear correlation as the number of processes
increase. The results for the previous email showd only the times
for the 100 process set.
As you look again and compare the times against the 1-way, 2-way, 4-way
and 8-way systems, you see the times decrease as the number of
processors in a system increase. This is also a good trend. And it
seems to be a fairly good linear correlation as well, implying that
the scheduler has done a good job at scaling between processes within
one system increase, and a good job at scaling as the number of
processors increase.
As stated in the reply above, as the kernel is evolving, continual
improvements are being made to the scheduler, as shown by the decrease
in average times for the run of 100 set of processes with each
subsequent release of the kernel.
>
> The general trend in the metric indicates everything has been improving, so I
> think we rock.
> _______________________________________________
> Linstab mailing list
> [email protected]
> http://lists.osdl.org/mailman/listinfo/linstab
--
Craig Thomas
[email protected]