[GHC] #12758: Bring sanity to our performance testsuite

[GHC]

#12758: Bring sanity to our performance testsuite
-------------------------------------+-------------------------------------
           Reporter:  bgamari        |             Owner:
               Type:  task           |            Status:  new
           Priority:  normal         |         Milestone:  8.2.1
          Component:  Test Suite     |           Version:  8.0.1
           Keywords:                 |  Operating System:  Unknown/Multiple
       Architecture:                 |   Type of failure:  None/Unknown
  Unknown/Multiple                   |
          Test Case:                 |        Blocked By:
           Blocking:                 |   Related Tickets:
Differential Rev(s):                 |         Wiki Page:
-------------------------------------+-------------------------------------
 The GHC testsuite's performance tests tends to be a constant source of
 busy-work as it requires that contributors manually bump performance
 numbers and propagate these changes across platforms. Moreover, the
 testsuite is poor at noticing performance regressions due to false
 positive failures (due to spurious environmental differences) and false
 negatives (due to the rather generous acceptance windows that many tests
 have).

 Joachim and I briefly discussed this at Hac Phi and came up with the
 following proposal:

  * We rip expected performance numbers out of the `.T` files
  *

--
Ticket URL: <http://ghc.haskell.org/trac/ghc/ticket/12758>
GHC <http://www.haskell.org/ghc/>
The Glasgow Haskell Compiler