nofib regressions in HEAD since 7.6.2 release
Johan Tibell
johan.tibell at gmail.com
Fri Feb 8 18:59:49 CET 2013
Part 3:
7.6.1 vs 7.6.2:
--------------------------------------------------------------------------------
Program Size Allocs Runtime Elapsed TotalMem
--------------------------------------------------------------------------------
anna -0.6% +0.0% 0.07 0.08 +0.0%
ansi -2.0% +0.0% 0.00 0.00 +0.0%
atom -1.3% +0.0% +0.0% +0.0% +0.0%
awards -1.8% +0.0% 0.00 0.00 +0.0%
banner -2.6% +0.0% 0.00 0.00 +0.0%
bernouilli -1.0% +0.0% 0.13 0.13 +0.0%
binary-trees -1.2% +0.0% +1.2% +1.2% +0.0%
boyer -2.2% +0.0% 0.03 0.04 +0.0%
boyer2 -2.6% +0.0% 0.01 0.01 +0.0%
bspt -1.1% +0.0% 0.01 0.02 +0.0%
cacheprof -1.4% +0.0% +2.5% +0.0% +0.0%
calendar -2.2% +0.0% 0.00 0.00 +0.0%
cichelli -2.6% +0.0% 0.05 0.06 +0.0%
circsim -1.9% +0.0% -0.3% +1.3% +0.0%
clausify -2.2% +0.0% 0.03 0.03 +0.0%
comp_lab_zift -2.1% +0.0% 0.13 0.14 +0.0%
compress -1.4% +0.0% 0.11 0.11 +0.0%
compress2 -1.8% +0.0% 0.12 0.14 +0.0%
constraints -2.2% +0.0% +2.0% +2.4% +0.0%
cryptarithm1 -2.8% +0.0% +2.1% +0.5% +0.0%
cryptarithm2 -2.7% +0.0% 0.01 0.01 +0.0%
cse -2.7% +0.0% 0.00 0.00 +0.0%
eliza -2.5% +0.0% 0.00 0.00 +0.0%
event -2.2% +0.0% 0.09 0.10 +0.0%
exp3_8 -2.2% +0.0% 0.14 0.14 +0.0%
expert -2.0% +0.0% 0.00 0.00 +0.0%
fannkuch-redux -1.7% +0.0% -5.2% -5.6% +0.0%
fasta -2.3% +8.7% +1.3% -1.2% -50.0%
fem -0.7% +0.0% 0.02 0.03 +0.0%
fft -1.3% +0.0% 0.02 0.03 +0.0%
fft2 +0.0% +0.0% 0.04 0.05 +0.0%
fibheaps -2.2% +0.0% 0.03 0.03 +0.0%
fish -2.2% +0.0% 0.01 0.01 +0.0%
fluid -0.3% +0.0% 0.01 0.01 +0.0%
fulsom -0.2% +0.0% 0.19 0.19 -1.3%
gamteb -1.1% +0.0% 0.03 0.04 +0.0%
gcd -1.4% +0.0% 0.02 0.03 +0.0%
gen_regexps -2.7% +0.0% 0.00 0.00 +0.0%
genfft -1.7% +0.0% 0.03 0.03 +0.0%
gg -1.0% +0.0% 0.01 0.02 +0.0%
grep -2.5% +0.0% 0.00 0.00 +0.0%
hidden -0.4% +0.0% +0.0% -2.5% +0.0%
hpg -1.1% +0.0% 0.05 0.10 +0.0%
ida -1.7% +0.0% 0.06 0.06 +0.0%
infer -2.0% +0.0% 0.05 0.05 +0.0%
integer -1.3% +0.0% +3.0% +3.1% +0.0%
integrate -0.3% +0.0% 0.21 +6.4% -1.9%
k-nucleotide -1.1% +0.0% -2.2% -2.3% +0.0%
kahan -1.4% +0.0% -1.7% -1.7% +0.0%
knights -1.9% +0.0% 0.00 0.01 +0.0%
lcss -2.2% +0.0% -1.0% -1.8% +0.0%
life -2.3% +0.0% 0.16 0.16 +0.0%
lift -2.0% +0.0% 0.00 0.00 +0.0%
listcompr -2.8% +0.0% 0.06 0.06 +0.0%
listcopy -2.8% +0.0% 0.06 0.06 +0.0%
maillist -2.6% +1.0% 0.03 0.05 -8.7%
mandel -0.0% +0.0% 0.04 0.05 +0.0%
mandel2 -2.8% +0.0% 0.00 0.00 +0.0%
minimax -2.6% +0.0% 0.00 0.00 +0.0%
mkhprog -2.6% +0.0% 0.00 0.00 +0.0%
multiplier -2.2% +0.0% 0.08 0.08 +0.0%
n-body -1.2% +0.0% -1.1% -1.3% +0.0%
nucleic2 -1.2% +0.0% 0.05 0.05 +0.0%
para -2.0% +0.0% +5.4% +2.6% +0.0%
paraffins -2.2% +0.0% 0.06 0.08 +0.0%
parser -2.1% +0.0% 0.03 0.03 +0.0%
parstof -2.2% +0.0% 0.01 0.00 +0.0%
pic -0.3% +0.0% 0.00 0.00 +0.0%
pidigits -1.5% +0.0% +1.2% -1.7% +0.0%
power -1.0% +0.0% +1.4% +1.4% +0.0%
pretty -1.4% +0.0% 0.00 0.00 +0.0%
primes -1.8% +0.0% 0.05 0.05 +0.0%
primetest -1.3% +0.0% 0.08 0.07 +0.0%
prolog -2.4% +0.0% 0.00 0.00 +0.0%
puzzle -2.7% +0.0% 0.10 0.10 +0.0%
queens -2.3% +0.0% 0.02 0.02 +0.0%
reptile -1.4% +0.0% 0.01 0.02 +0.0%
reverse-complem -2.9% +0.0% 0.06 0.08 +0.0%
rewrite -2.1% +0.0% 0.02 0.02 +0.0%
rfib +0.0% +0.0% 0.02 0.02 +0.0%
rsa -1.4% +0.0% 0.02 0.02 +0.0%
scc -2.9% +0.0% 0.00 0.00 +0.0%
sched -2.2% +0.0% 0.02 0.02 +0.0%
scs +0.0% +0.0% -2.8% -1.1% +0.0%
simple -1.0% +0.0% 0.15 0.16 +0.0%
solid -1.3% +0.0% 0.09 0.10 +0.0%
sorting -2.6% +0.0% 0.00 0.00 +0.0%
spectral-norm -1.2% +0.0% -0.2% +0.0% +0.0%
sphere -1.9% +0.0% 0.03 0.03 +0.0%
symalg -0.0% +0.0% 0.00 0.01 +0.0%
tak -2.3% +0.0% 0.01 0.01 +0.0%
transform -1.9% +0.0% -1.7% -0.9% +0.0%
treejoin -2.7% +0.0% 0.15 0.16 +0.0%
typecheck -2.2% +0.0% 0.15 0.15 +0.0%
veritas -1.1% +0.0% 0.00 0.00 +0.0%
wang -1.3% +0.0% 0.07 0.08 +0.0%
wave4main -2.1% +0.0% 0.19 0.18 +0.0%
wheel-sieve1 -1.7% +0.0% +5.0% +2.4% +0.0%
wheel-sieve2 -1.7% +0.0% 0.11 0.13 +0.0%
x2n1 -0.3% +0.0% 0.01 0.01 +0.0%
--------------------------------------------------------------------------------
Min -2.9% +0.0% -5.2% -5.6% -50.0%
Max +0.0% +8.7% +5.4% +6.4% +0.0%
Geometric Mean -1.7% +0.1% +0.4% +0.0% -0.8%
The big regression Bryan and I saw in hashable between 7.6.1 and 7.6.2
isn't visible here, so we might need to extract a separate benchmark for it.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.haskell.org/pipermail/ghc-devs/attachments/20130208/62fe490b/attachment-0001.htm>
More information about the ghc-devs
mailing list