[commit: nofib] master: Adjust normal runtimes for nofib along with related changes (08cc9b6)

git at git.haskell.org git at git.haskell.org
Wed Nov 14 17:12:22 UTC 2018


Repository : ssh://git@git.haskell.org/nofib

On branch  : master
Link       : http://ghc.haskell.org/trac/ghc/changeset/08cc9b6b2c7f7fdaaaf80361ab84a501f0a573c5/nofib

>---------------------------------------------------------------

commit 08cc9b6b2c7f7fdaaaf80361ab84a501f0a573c5
Author: klebinger.andreas at gmx.at <klebinger.andreas at gmx.at>
Date:   Wed Nov 14 18:07:43 2018 +0100

    Adjust normal runtimes for nofib along with related changes
    
    Runtime for nofib benchmarks was all over the place.
    This patch adjusts runtime for most benchmarks such
    that it falls into the 0.2-2s range.
    
    This means that:
    * A default run will take longer
    * Time spent will be better distributed among benchmarks.
    * More benchmarks have runtimes long enough to be used
      for runtime analysis.
    
    Some more changes were done which go hand in hand
    with changing runtimes.
    * Some benchmarks now create their input files during boot.
    * Moved input files for anna in their own directory.
    * Remove printing of output for some of the floating
      point heavy benchmarks.
    * Added a comment about desired runtimes to README.
    * Made grep actually benchmark something.
    * Throw cachgrind out of the default benchmarks.
      The nondeterministic behaviour has been an issue for a
      while and it doesn't seem like an essential benchmark.
    
    Test Plan: run nofib in modes slow/normal/fast
    
    Reviewers: O26 nofib, alpmestan
    
    Reviewed By: alpmestan
    
    Subscribers: sgraf, alpmestan
    
    Differential Revision: https://phabricator.haskell.org/D4989


>---------------------------------------------------------------

08cc9b6b2c7f7fdaaaf80361ab84a501f0a573c5
 .gitignore                                         |      4 +
 README.md                                          |     11 +
 gc/circsim/Makefile                                |      2 +-
 gc/circsim/{circsim.stdout => circsim.slowstdout}  |      0
 gc/circsim/circsim.stdout                          |      2 +-
 gc/constraints/Makefile                            |      2 +-
 .../{constraints.stdout => constraints.slowstdout} |      0
 gc/constraints/constraints.stdout                  |     10 +-
 gc/gc_bench/Makefile                               |      5 +-
 gc/happy/TestInput.hs                              |      0
 gc/hash/Makefile                                   |      2 +-
 gc/lcss/Makefile                                   |      4 +-
 gc/lcss/lcss.faststdout                            |      2 +-
 gc/lcss/lcss.slowstdout                            |      2 +-
 gc/lcss/lcss.stdout                                |      2 +-
 gc/mutstore1/Makefile                              |      4 +-
 gc/power/Makefile                                  |      4 +-
 .../power.stdout => gc/power/power.faststdout      |      0
 gc/power/power.slowstdout                          |      8 +-
 gc/power/power.stdout                              |      8 +-
 imaginary/bernouilli/Makefile                      |      5 +-
 .../{bernouilli.stdout => bernouilli.faststdout}   |      0
 imaginary/bernouilli/bernouilli.stdout             |      2 +-
 imaginary/digits-of-e1/Makefile                    |      4 +-
 imaginary/digits-of-e1/digits-of-e1.slowstdout     |      2 +-
 imaginary/digits-of-e1/digits-of-e1.stdout         |      2 +-
 imaginary/digits-of-e2/Makefile                    |      4 +-
 imaginary/digits-of-e2/digits-of-e2.slowstdout     |      2 +-
 imaginary/digits-of-e2/digits-of-e2.stdout         |      2 +-
 imaginary/exp3_8/Makefile                          |      2 +-
 .../exp3_8/{exp3_8.stdout => exp3_8.faststdout}    |      0
 imaginary/exp3_8/exp3_8.slowstdout                 |      1 -
 imaginary/exp3_8/exp3_8.stdout                     |      2 +-
 imaginary/gen_regexps/gen_regexps.faststdin        |      1 +
 imaginary/gen_regexps/gen_regexps.faststdout       |      1 +
 imaginary/gen_regexps/gen_regexps.slowstdin        |      1 -
 imaginary/gen_regexps/gen_regexps.slowstdout       |      1 -
 imaginary/gen_regexps/gen_regexps.stdin            |      2 +-
 imaginary/gen_regexps/gen_regexps.stdout           |      2 +-
 imaginary/integrate/Makefile                       |      6 +-
 .../{integrate.slowstdout => integrate.faststdout} |      0
 imaginary/integrate/integrate.slowstdout           |      2 +-
 imaginary/integrate/integrate.stdout               |      2 +-
 imaginary/paraffins/Makefile                       |      4 +-
 .../{paraffins.stdout => paraffins.faststdout}     |      0
 imaginary/paraffins/paraffins.slowstdout           |      4 -
 imaginary/paraffins/paraffins.stdout               |      8 +-
 imaginary/primes/Makefile                          |      6 +-
 imaginary/primes/primes.slowstdout                 |      2 +-
 imaginary/primes/primes.stdout                     |      2 +-
 imaginary/queens/Makefile                          |      4 +-
 .../queens/{queens.stdout => queens.faststdout}    |      0
 imaginary/queens/queens.slowstdout                 |      1 -
 imaginary/queens/queens.stdout                     |      2 +-
 imaginary/rfib/Makefile                            |      6 +-
 .../rfib/{rfib.slowstdout => rfib.faststdout}      |      0
 imaginary/rfib/rfib.stdout                         |      2 +-
 imaginary/tak/Makefile                             |      2 +-
 imaginary/tak/tak.slowstdout                       |      1 -
 imaginary/wheel-sieve1/Makefile                    |      4 +-
 imaginary/wheel-sieve1/wheel-sieve1.slowstdout     |      2 +-
 imaginary/wheel-sieve1/wheel-sieve1.stdout         |      2 +-
 imaginary/wheel-sieve2/Makefile                    |      6 +-
 imaginary/wheel-sieve2/wheel-sieve2.slowstdout     |      1 -
 imaginary/wheel-sieve2/wheel-sieve2.stdout         |      2 +-
 imaginary/x2n1/Makefile                            |      4 +-
 imaginary/x2n1/{x2n1.stdout => x2n1.faststdout}    |      0
 imaginary/x2n1/x2n1.slowstdout                     |      1 -
 imaginary/x2n1/x2n1.stdout                         |      2 +-
 real/Makefile                                      |      5 +-
 real/anna/Makefile                                 |      2 -
 real/anna/{big.cor => anna.faststdin}              |      0
 real/anna/{anna.stdout => anna.faststdout}         |      0
 real/anna/anna.stdin                               |   1262 +
 real/anna/anna.stdout                              |   5015 +-
 real/anna/{ => cor_files}/ap_CaseAlts.cor          |      0
 real/anna/{ => cor_files}/ap_CaseArgs.cor          |      0
 real/anna/{ => cor_files}/ap_CaseOfCase.cor        |      0
 real/anna/{ => cor_files}/ap_CaseOfCase2.cor       |      0
 real/anna/{ => cor_files}/ap_CaseOfCase3.cor       |      0
 real/anna/{ => cor_files}/ap_FuncCall.cor          |      0
 real/anna/{ => cor_files}/ap_ListOfList.cor        |      0
 real/anna/{ => cor_files}/ap_SemiLazyAdd.cor       |      0
 real/anna/{ => cor_files}/ap_SemiLazyCase.cor      |      0
 real/anna/{ => cor_files}/ap_SimpleLazy.cor        |      0
 real/anna/{ => cor_files}/ap_SimpleStrict.cor      |      0
 real/anna/{ => cor_files}/ap_Unzip.cor             |      0
 real/anna/{ => cor_files}/ap_Zip.cor               |      0
 real/anna/{ => cor_files}/append.cor               |      0
 real/anna/{ => cor_files}/avlTree.cor              |      0
 real/anna/{ => cor_files}/big.cor                  |      0
 real/anna/{ => cor_files}/bmark.cor                |      0
 real/anna/{ => cor_files}/bomb.cor                 |      0
 real/anna/{ => cor_files}/bomb2.cor                |      0
 real/anna/{ => cor_files}/bug.cor                  |      0
 real/anna/{ => cor_files}/bug_Anna1.cor            |      0
 real/anna/{ => cor_files}/bug_Anna2.cor            |      0
 real/anna/{ => cor_files}/bug_Anna3.cor            |      0
 real/anna/{ => cor_files}/bug_Anna4.cor            |      0
 real/anna/{ => cor_files}/bug_Anna5.cor            |      0
 real/anna/{ => cor_files}/bug_Anna6.cor            |      0
 real/anna/{ => cor_files}/bug_types1.cor           |      0
 real/anna/{ => cor_files}/bug_types2.cor           |      0
 real/anna/{ => cor_files}/bury.cor                 |      0
 real/anna/{ => cor_files}/cfoldr.cor               |      0
 real/anna/{ => cor_files}/concat.cor               |      0
 real/anna/{ => cor_files}/concat22.cor             |      0
 real/anna/{ => cor_files}/concat24.cor             |      0
 real/anna/{ => cor_files}/concat44.cor             |      0
 real/anna/{ => cor_files}/coreExpr.cor             |      0
 real/anna/{ => cor_files}/coreExpr0.cor            |      0
 real/anna/{ => cor_files}/divide.cor               |      0
 real/anna/{ => cor_files}/dividetree.cor           |      0
 real/anna/{ => cor_files}/dot_3.cor                |      0
 real/anna/{ => cor_files}/dot_4.cor                |      0
 real/anna/{ => cor_files}/eta.cor                  |      0
 real/anna/{ => cor_files}/filter.cor               |      0
 real/anna/{ => cor_files}/foldrFoldl.cor           |      0
 real/anna/{ => cor_files}/fourier.cor              |      0
 real/anna/{ => cor_files}/funcDomain.cor           |      0
 real/anna/{ => cor_files}/higherOrder.cor          |      0
 real/anna/{ => cor_files}/john.cor                 |      0
 real/anna/{ => cor_files}/llfiasco.cor             |      0
 real/anna/{ => cor_files}/manyIterate.cor          |      0
 real/anna/{ => cor_files}/mutualRec.cor            |      0
 real/anna/{ => cor_files}/ol_num.cor               |      0
 real/anna/{ => cor_files}/pairid.cor               |      0
 real/anna/{ => cor_files}/parallelOr.cor           |      0
 real/anna/{ => cor_files}/poly_loseGain.cor        |      0
 real/anna/{ => cor_files}/poly_simple.cor          |      0
 real/anna/{ => cor_files}/preludeList.cor          |      0
 real/anna/{ => cor_files}/realNasties.cor          |      0
 real/anna/{ => cor_files}/reverse.cor              |      0
 real/anna/{ => cor_files}/sebastian1.cor           |      0
 real/anna/{ => cor_files}/sebastian2.cor           |      0
 real/anna/{ => cor_files}/sets.cor                 |      0
 real/anna/{ => cor_files}/standardTest.cor         |      0
 real/anna/{ => cor_files}/treeDepth.cor            |      0
 real/compress/Makefile                             |     11 +
 .../{compress.stdin => compress.faststdin}         |      0
 .../{compress.stdout => compress.faststdout}       |    Bin
 real/compress/compress.stdout-mingw                |    Bin 95823 -> 0 bytes
 real/compress2/Makefile                            |     14 +
 .../{compress2.stdin => compress2.faststdin}       |      0
 .../{compress2.stdout => compress2.faststdout}     |    Bin
 real/fulsom/Makefile                               |      4 +-
 gc/fulsom/out => real/fulsom/fulsom.faststdout     |    Bin
 real/fulsom/fulsom.stdout                          |    Bin 87916 -> 346864 bytes
 real/fulsom/fulsom.stdout-mingw                    |    Bin 185 -> 0 bytes
 real/gamteb/{gamteb.stdin => gamteb.faststdin}     |      0
 real/gamteb/{gamteb.stdout => gamteb.faststdout}   |      0
 real/gamteb/{gamteb.stdout1 => gamteb.faststdout1} |      0
 real/gamteb/gamteb.stdin                           |      2 +-
 real/gamteb/gamteb.stdout                          |  78779 +++++-
 real/grep/Makefile                                 |      3 +-
 real/grep/grep.stdout                              |     19 +
 real/hpg/Env.lhs                                   |      5 +-
 real/hpg/Makefile                                  |      8 +-
 real/hpg/README.nofib                              |      4 +
 real/hpg/{hpg.stdout => hpg.faststdout}            |      0
 real/hpg/hpg.stderr                                |      1 -
 real/hpg/hpg.stdout                                |  28280 +-
 real/rsa/rsa.stdin                                 |   3503 +-
 real/rsa/rsa.stdout                                |   1378 +-
 real/scs/Main.hs                                   |      3 +-
 real/scs/Makefile                                  |      6 +-
 real/scs/scs.stdout                                |    744 +-
 real/scs/scs.stdout-x86-linux                      |    743 -
 real/scs/scs.stdout-x86_64                         |    743 -
 real/symalg/{symalg.stdin => symalg.faststdin}     |      0
 real/symalg/{symalg.stdout => symalg.faststdout}   |      0
 real/symalg/symalg.stdin                           |      2 +-
 real/symalg/symalg.stdout                          |      6 +-
 shootout/binary-trees/Makefile                     |      4 +-
 shootout/binary-trees/binary-trees.stdout          |     18 +-
 shootout/fasta/Makefile                            |      2 +-
 shootout/k-nucleotide/Makefile                     |      2 +-
 shootout/k-nucleotide/k-nucleotide.stdout          |     44 +-
 shootout/pidigits/Makefile                         |      2 +-
 shootout/pidigits/pidigits.stdout                  |    200 +
 shootout/reverse-complement/Makefile               |      2 +-
 spectral/atom/Makefile                             |      4 +-
 spectral/atom/atom.slowstdout                      |   1700 -
 spectral/atom/atom.stdout                          |   1000 +
 spectral/boyer/Makefile                            |      4 +-
 spectral/circsim/Makefile                          |      4 +-
 .../circsim/circsim.slowstdout                     |      0
 spectral/circsim/circsim.stdout                    |      2 +-
 spectral/clausify/Makefile                         |      4 +-
 .../{clausify.stdout => clausify.faststdout}       |      0
 spectral/clausify/clausify.slowstdout              |    100 -
 spectral/clausify/clausify.stdout                  |    193 +
 spectral/fft2/Main.lhs                             |     18 +-
 spectral/fft2/Makefile                             |      4 +-
 spectral/fft2/README.nofib                         |     11 +
 spectral/fft2/fft2.stdout                          |      4 +-
 spectral/fft2/{ => old}/Makefile                   |      0
 spectral/fft2/{ => old}/fft2.slowstdout            |      0
 spectral/fft2/{ => old}/fft2.slowstdout-x86-linux  |      0
 spectral/fft2/{ => old}/fft2.slowstdout-x86-mingw  |      0
 spectral/fft2/{ => old}/fft2.slowstdout-x86_64     |      0
 spectral/fft2/{ => old}/fft2.stdout                |      0
 spectral/fft2/{ => old}/fft2.stdout-mingw          |      0
 spectral/fft2/{ => old}/fft2.stdout-x86_64         |      0
 spectral/fft2/{ => old}/fft2.stdout1               |      0
 spectral/fft2/{ => old}/fft2.stdout2               |      0
 spectral/fft2/{ => old}/fft2.stdout3               |      0
 spectral/fft2/{ => old}/fft2.stdout4               |      0
 spectral/fft2/{ => old}/fft2.stdout5               |      0
 spectral/fft2/{ => old}/fft2.stdout6               |      0
 spectral/fft2/{ => old}/fft2.stdout7               |      0
 spectral/fibheaps/Makefile                         |      4 +-
 spectral/gcd/Makefile                              |      4 +-
 spectral/gcd/{gcd.stdout => gcd.faststdout}        |      0
 spectral/gcd/gcd.slowstdout                        |      1 -
 spectral/gcd/gcd.stdout                            |      2 +-
 spectral/hartel/comp_lab_zift/Makefile             |      4 +-
 ...mp_lab_zift.stdout => comp_lab_zift.faststdout} |      0
 .../hartel/comp_lab_zift/comp_lab_zift.slowstdout  |      1 -
 spectral/hartel/comp_lab_zift/comp_lab_zift.stdout |      2 +-
 spectral/hartel/event/Makefile                     |      4 +-
 spectral/hartel/fft/Makefile                       |      4 +-
 spectral/hartel/fft/{fft.stdout => fft.faststdout} |      0
 spectral/hartel/fft/fft.slowstdout                 |      1 -
 spectral/hartel/fft/fft.stdout                     |      2 +-
 spectral/hartel/genfft/Makefile                    |      4 +-
 .../genfft/{genfft.stdout => genfft.faststdout}    |      0
 spectral/hartel/genfft/genfft.slowstdout           |      1 -
 spectral/hartel/genfft/genfft.stdout               |      2 +-
 spectral/hartel/ida/Makefile                       |      4 +-
 spectral/hartel/ida/{ida.stdout => ida.faststdout} |      0
 spectral/hartel/ida/ida.slowstdout                 |      2 -
 spectral/hartel/ida/ida.stdout                     |      4 +-
 spectral/hartel/sched/Makefile                     |      2 +-
 .../sched/{sched.stdout => sched.faststdout}       |      0
 spectral/hartel/sched/sched.slowstdout             |      1 -
 spectral/hartel/sched/sched.stdout                 |      2 +-
 spectral/hartel/solid/Makefile                     |      4 +-
 .../solid/{solid.stdout => solid.faststdout}       |      0
 spectral/hartel/solid/solid.slowstdout             |      4 +
 spectral/hartel/solid/solid.stdout                 |      6 +
 spectral/hartel/transform/Makefile                 |      4 +-
 .../{transform.stdout => transform.faststdout}     |      0
 spectral/hartel/transform/transform.slowstdout     |      1 -
 spectral/hartel/transform/transform.stdout         |      2 +-
 spectral/hartel/typecheck/Makefile                 |      4 +-
 .../{typecheck.stdout => typecheck.faststdout}     |      0
 spectral/hartel/typecheck/typecheck.slowstdout     |      1 -
 spectral/hartel/typecheck/typecheck.stdout         |      2 +-
 spectral/hartel/wang/Makefile                      |      4 +-
 .../hartel/wang/{wang.stdout => wang.faststdout}   |      0
 spectral/hartel/wang/wang.slowstdout               |      1 -
 spectral/hartel/wang/wang.stdout                   |      2 +-
 spectral/hartel/wave4main/Makefile                 |      6 +-
 .../{wave4main.stdout2 => wave4main.faststdout}    |      0
 spectral/hartel/wave4main/wave4main.slowstdout     |      1 -
 .../wave4main/wave4main.slowstdout-x86-linux       |      1 -
 spectral/hartel/wave4main/wave4main.stdout         |      2 +-
 spectral/hartel/wave4main/wave4main.stdout3        |      1 -
 spectral/knights/Makefile                          |      4 +-
 .../knights/{knights.stdout => knights.faststdout} |      0
 spectral/knights/knights.slowstdout                |    484 +-
 spectral/knights/knights.stdout                    |     64 +-
 spectral/lcss/Makefile                             |      2 +-
 spectral/lcss/lcss.slowstdout                      |      1 -
 spectral/lcss/lcss.stdout                          |      2 +-
 spectral/multiplier/Makefile                       |      4 +-
 spectral/power/Makefile                            |      4 +-
 spectral/power/{power.stdout => power.faststdout}  |      0
 spectral/power/power.slowstdout                    |      4 -
 spectral/power/power.stdout                        |      8 +-
 .../primetest/{mersenne607 => primetest.faststdin} |      0
 .../{primetest.stdout => primetest.faststdout}     |      0
 spectral/primetest/primetest.slowstdin             |      2 -
 spectral/primetest/primetest.slowstdout            |      1 -
 spectral/primetest/primetest.stdin                 |     29 +
 spectral/primetest/primetest.stdout                |      2 +-
 spectral/rewrite/Makefile                          |      4 +-
 spectral/sphere/Makefile                           |      4 +-
 .../sphere/{sphere.stdout => sphere.faststdout}    |      0
 spectral/sphere/sphere.slowstdout                  |  40003 ---
 spectral/sphere/sphere.stdout                      | 244460 +++++++++++++++++-
 282 files changed, 358703 insertions(+), 50526 deletions(-)

Diff suppressed because of size. To see it, use:

    git diff-tree --root --patch-with-stat --no-color --find-copies-harder --ignore-space-at-eol --cc 08cc9b6b2c7f7fdaaaf80361ab84a501f0a573c5


More information about the ghc-commits mailing list