My opinion is that I've never had bzip find a bug that some other
spec test hasn't. I think 20 hours is way too long for a regression
test. We should either shrink the input size or just not have it.  

Ali


On Thu, 03 Feb 2011 15:35:29 -0800, Gabe Black wrote:  So how do
people feel about this? bzip2 in x86 on O3 takes more than 20 hours to
run. Should that be part of the regressions or not? I have it ready to
go if that's acceptable, but to me it seems too long.

 Gabe

 On
02/01/11 17:30, Gabe Black wrote:  Normally I wouldn't send stats
updates out for review. I'm adding new regressions here, though, and I
think people may be interested in the run time, especially for bzip2. I
think it was about 20+ hours on opt on a big machine from HP. This may
be trimmed down if/when performance bottlenecks get fixed since O3 will
have to do less work, but cutting it in half is still a long, long time
for a regression. I notice that the number of ticks for the benchmarks
that are in common with Alpha is about 4 times higher, suggesting a
performance bug of some sort (I doubt x86 gcc is 4X worse).

 Gabe

 On
02/01/11 17:23, Gabe Black wrote:  

                This is an automatically
generated e-mail. To reply, visit: http://reviews.m5sim.org/r/463/
[1]

Review request for Default, Ali Saidi, Gabe Black, Steve Reinhardt,
and Nathan Binkert. 
By Gabe Black. 

DESCRIPTION

X86: Add o3
regressions in SE mode.

DIFFS

        *
tests/long/00.gzip/ref/x86/linux/o3-timing/config.ini (PRE-CREATION)
        *
tests/long/00.gzip/ref/x86/linux/o3-timing/simerr (PRE-CREATION)
        *
tests/long/00.gzip/ref/x86/linux/o3-timing/simout (PRE-CREATION)
        *
tests/long/00.gzip/ref/x86/linux/o3-timing/stats.txt (PRE-CREATION)
        *
tests/long/10.mcf/ref/x86/linux/o3-timing/config.ini (PRE-CREATION)
        *
tests/long/10.mcf/ref/x86/linux/o3-timing/mcf.out (PRE-CREATION)
        *
tests/long/10.mcf/ref/x86/linux/o3-timing/simerr (PRE-CREATION)
        *
tests/long/10.mcf/ref/x86/linux/o3-timing/simout (PRE-CREATION)
        *
tests/long/10.mcf/ref/x86/linux/o3-timing/stats.txt (PRE-CREATION)
        *
tests/long/20.parser/ref/x86/linux/o3-timing/config.ini (PRE-CREATION)

        * tests/long/20.parser/ref/x86/linux/o3-timing/simerr (PRE-CREATION)

        * tests/long/20.parser/ref/x86/linux/o3-timing/simout (PRE-CREATION)

        * tests/long/20.parser/ref/x86/linux/o3-timing/stats.txt
(PRE-CREATION)
        *
tests/long/60.bzip2/ref/x86/linux/o3-timing/config.ini (PRE-CREATION)

        * tests/long/60.bzip2/ref/x86/linux/o3-timing/simerr (PRE-CREATION)
        *
tests/long/60.bzip2/ref/x86/linux/o3-timing/simout (PRE-CREATION)
        *
tests/long/60.bzip2/ref/x86/linux/o3-timing/stats.txt (PRE-CREATION)
        *
tests/long/70.twolf/ref/x86/linux/o3-timing/config.ini (PRE-CREATION)

        * tests/long/70.twolf/ref/x86/linux/o3-timing/simerr (PRE-CREATION)
        *
tests/long/70.twolf/ref/x86/linux/o3-timing/simout (PRE-CREATION)
        *
tests/long/70.twolf/ref/x86/linux/o3-timing/smred.out (PRE-CREATION)
        *
tests/long/70.twolf/ref/x86/linux/o3-timing/smred.pin (PRE-CREATION)
        *
tests/long/70.twolf/ref/x86/linux/o3-timing/smred.pl1 (PRE-CREATION)
        *
tests/long/70.twolf/ref/x86/linux/o3-timing/smred.pl2 (PRE-CREATION)
        *
tests/long/70.twolf/ref/x86/linux/o3-timing/smred.sav (PRE-CREATION)
        *
tests/long/70.twolf/ref/x86/linux/o3-timing/smred.sv2 (PRE-CREATION)
        *
tests/long/70.twolf/ref/x86/linux/o3-timing/smred.twf (PRE-CREATION)
        *
tests/long/70.twolf/ref/x86/linux/o3-timing/stats.txt (PRE-CREATION)
        *
tests/quick/00.hello/ref/x86/linux/o3-timing/config.ini (PRE-CREATION)

        * tests/quick/00.hello/ref/x86/linux/o3-timing/simerr (PRE-CREATION)

        * tests/quick/00.hello/ref/x86/linux/o3-timing/simout (PRE-CREATION)

        * tests/quick/00.hello/ref/x86/linux/o3-timing/stats.txt
(PRE-CREATION)

View Diff [2]  

  
_______________________________________________ m5-dev mailing list
[email protected] [3] http://m5sim.org/mailman/listinfo/m5-dev [4] 

_______________________________________________ m5-dev mailing list
[email protected] [5] http://m5sim.org/mailman/listinfo/m5-dev [6] 




Links:
------
[1] http://reviews.m5sim.org/r/463/
[2]
http://reviews.m5sim.org/r/463/diff/
[3] mailto:[email protected]
[4]
http://m5sim.org/mailman/listinfo/m5-dev
[5] mailto:[email protected]
[6]
http://m5sim.org/mailman/listinfo/m5-dev
_______________________________________________
m5-dev mailing list
[email protected]
http://m5sim.org/mailman/listinfo/m5-dev

Reply via email to