nofib regressions in HEAD since 7.6.2 release

Johan Tibell johan.tibell at gmail.com
Fri Feb 8 18:59:49 CET 2013


Part 3:

7.6.1 vs 7.6.2:

--------------------------------------------------------------------------------
        Program           Size    Allocs   Runtime   Elapsed  TotalMem
--------------------------------------------------------------------------------
           anna          -0.6%     +0.0%      0.07      0.08     +0.0%
           ansi          -2.0%     +0.0%      0.00      0.00     +0.0%
           atom          -1.3%     +0.0%     +0.0%     +0.0%     +0.0%
         awards          -1.8%     +0.0%      0.00      0.00     +0.0%
         banner          -2.6%     +0.0%      0.00      0.00     +0.0%
     bernouilli          -1.0%     +0.0%      0.13      0.13     +0.0%
   binary-trees          -1.2%     +0.0%     +1.2%     +1.2%     +0.0%
          boyer          -2.2%     +0.0%      0.03      0.04     +0.0%
         boyer2          -2.6%     +0.0%      0.01      0.01     +0.0%
           bspt          -1.1%     +0.0%      0.01      0.02     +0.0%
      cacheprof          -1.4%     +0.0%     +2.5%     +0.0%     +0.0%
       calendar          -2.2%     +0.0%      0.00      0.00     +0.0%
       cichelli          -2.6%     +0.0%      0.05      0.06     +0.0%
        circsim          -1.9%     +0.0%     -0.3%     +1.3%     +0.0%
       clausify          -2.2%     +0.0%      0.03      0.03     +0.0%
  comp_lab_zift          -2.1%     +0.0%      0.13      0.14     +0.0%
       compress          -1.4%     +0.0%      0.11      0.11     +0.0%
      compress2          -1.8%     +0.0%      0.12      0.14     +0.0%
    constraints          -2.2%     +0.0%     +2.0%     +2.4%     +0.0%
   cryptarithm1          -2.8%     +0.0%     +2.1%     +0.5%     +0.0%
   cryptarithm2          -2.7%     +0.0%      0.01      0.01     +0.0%
            cse          -2.7%     +0.0%      0.00      0.00     +0.0%
          eliza          -2.5%     +0.0%      0.00      0.00     +0.0%
          event          -2.2%     +0.0%      0.09      0.10     +0.0%
         exp3_8          -2.2%     +0.0%      0.14      0.14     +0.0%
         expert          -2.0%     +0.0%      0.00      0.00     +0.0%
 fannkuch-redux          -1.7%     +0.0%     -5.2%     -5.6%     +0.0%
          fasta          -2.3%     +8.7%     +1.3%     -1.2%    -50.0%
            fem          -0.7%     +0.0%      0.02      0.03     +0.0%
            fft          -1.3%     +0.0%      0.02      0.03     +0.0%
           fft2          +0.0%     +0.0%      0.04      0.05     +0.0%
       fibheaps          -2.2%     +0.0%      0.03      0.03     +0.0%
           fish          -2.2%     +0.0%      0.01      0.01     +0.0%
          fluid          -0.3%     +0.0%      0.01      0.01     +0.0%
         fulsom          -0.2%     +0.0%      0.19      0.19     -1.3%
         gamteb          -1.1%     +0.0%      0.03      0.04     +0.0%
            gcd          -1.4%     +0.0%      0.02      0.03     +0.0%
    gen_regexps          -2.7%     +0.0%      0.00      0.00     +0.0%
         genfft          -1.7%     +0.0%      0.03      0.03     +0.0%
             gg          -1.0%     +0.0%      0.01      0.02     +0.0%
           grep          -2.5%     +0.0%      0.00      0.00     +0.0%
         hidden          -0.4%     +0.0%     +0.0%     -2.5%     +0.0%
            hpg          -1.1%     +0.0%      0.05      0.10     +0.0%
            ida          -1.7%     +0.0%      0.06      0.06     +0.0%
          infer          -2.0%     +0.0%      0.05      0.05     +0.0%
        integer          -1.3%     +0.0%     +3.0%     +3.1%     +0.0%
      integrate          -0.3%     +0.0%      0.21     +6.4%     -1.9%
   k-nucleotide          -1.1%     +0.0%     -2.2%     -2.3%     +0.0%
          kahan          -1.4%     +0.0%     -1.7%     -1.7%     +0.0%
        knights          -1.9%     +0.0%      0.00      0.01     +0.0%
           lcss          -2.2%     +0.0%     -1.0%     -1.8%     +0.0%
           life          -2.3%     +0.0%      0.16      0.16     +0.0%
           lift          -2.0%     +0.0%      0.00      0.00     +0.0%
      listcompr          -2.8%     +0.0%      0.06      0.06     +0.0%
       listcopy          -2.8%     +0.0%      0.06      0.06     +0.0%
       maillist          -2.6%     +1.0%      0.03      0.05     -8.7%
         mandel          -0.0%     +0.0%      0.04      0.05     +0.0%
        mandel2          -2.8%     +0.0%      0.00      0.00     +0.0%
        minimax          -2.6%     +0.0%      0.00      0.00     +0.0%
        mkhprog          -2.6%     +0.0%      0.00      0.00     +0.0%
     multiplier          -2.2%     +0.0%      0.08      0.08     +0.0%
         n-body          -1.2%     +0.0%     -1.1%     -1.3%     +0.0%
       nucleic2          -1.2%     +0.0%      0.05      0.05     +0.0%
           para          -2.0%     +0.0%     +5.4%     +2.6%     +0.0%
      paraffins          -2.2%     +0.0%      0.06      0.08     +0.0%
         parser          -2.1%     +0.0%      0.03      0.03     +0.0%
        parstof          -2.2%     +0.0%      0.01      0.00     +0.0%
            pic          -0.3%     +0.0%      0.00      0.00     +0.0%
       pidigits          -1.5%     +0.0%     +1.2%     -1.7%     +0.0%
          power          -1.0%     +0.0%     +1.4%     +1.4%     +0.0%
         pretty          -1.4%     +0.0%      0.00      0.00     +0.0%
         primes          -1.8%     +0.0%      0.05      0.05     +0.0%
      primetest          -1.3%     +0.0%      0.08      0.07     +0.0%
         prolog          -2.4%     +0.0%      0.00      0.00     +0.0%
         puzzle          -2.7%     +0.0%      0.10      0.10     +0.0%
         queens          -2.3%     +0.0%      0.02      0.02     +0.0%
        reptile          -1.4%     +0.0%      0.01      0.02     +0.0%
reverse-complem          -2.9%     +0.0%      0.06      0.08     +0.0%
        rewrite          -2.1%     +0.0%      0.02      0.02     +0.0%
           rfib          +0.0%     +0.0%      0.02      0.02     +0.0%
            rsa          -1.4%     +0.0%      0.02      0.02     +0.0%
            scc          -2.9%     +0.0%      0.00      0.00     +0.0%
          sched          -2.2%     +0.0%      0.02      0.02     +0.0%
            scs          +0.0%     +0.0%     -2.8%     -1.1%     +0.0%
         simple          -1.0%     +0.0%      0.15      0.16     +0.0%
          solid          -1.3%     +0.0%      0.09      0.10     +0.0%
        sorting          -2.6%     +0.0%      0.00      0.00     +0.0%
  spectral-norm          -1.2%     +0.0%     -0.2%     +0.0%     +0.0%
         sphere          -1.9%     +0.0%      0.03      0.03     +0.0%
         symalg          -0.0%     +0.0%      0.00      0.01     +0.0%
            tak          -2.3%     +0.0%      0.01      0.01     +0.0%
      transform          -1.9%     +0.0%     -1.7%     -0.9%     +0.0%
       treejoin          -2.7%     +0.0%      0.15      0.16     +0.0%
      typecheck          -2.2%     +0.0%      0.15      0.15     +0.0%
        veritas          -1.1%     +0.0%      0.00      0.00     +0.0%
           wang          -1.3%     +0.0%      0.07      0.08     +0.0%
      wave4main          -2.1%     +0.0%      0.19      0.18     +0.0%
   wheel-sieve1          -1.7%     +0.0%     +5.0%     +2.4%     +0.0%
   wheel-sieve2          -1.7%     +0.0%      0.11      0.13     +0.0%
           x2n1          -0.3%     +0.0%      0.01      0.01     +0.0%
--------------------------------------------------------------------------------
            Min          -2.9%     +0.0%     -5.2%     -5.6%    -50.0%
            Max          +0.0%     +8.7%     +5.4%     +6.4%     +0.0%
 Geometric Mean          -1.7%     +0.1%     +0.4%     +0.0%     -0.8%

The big regression Bryan and I saw in hashable between 7.6.1 and 7.6.2
isn't visible here, so we might need to extract a separate benchmark for it.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.haskell.org/pipermail/ghc-devs/attachments/20130208/62fe490b/attachment-0001.htm>


More information about the ghc-devs mailing list