Attempt at a real world benchmark

[Simon Peyton Jones]

I'm delighted to see all this traffic about GHC perf -- thank you.

277 modules sounds like quite a lot; but in general a test suite that took a while (minutes, not hours) to compile would be fine.  We can run it on a nightly server somewhere.  Having a dashboard where you can see the results would be good.

Simon

| -----Original Message-----
| From: ghc-devs [mailto:ghc-devs-bounces at haskell.org] On Behalf Of Joachim
| Breitner
| Sent: 08 December 2016 06:04
| To: ghc-devs at haskell.org
| Subject: Attempt at a real world benchmark
| 
| Hi,
| 
| I have talked so much about it, it was about time to actually follow
| through.
| 
| I took a real-world program (tttool, one of mine, show shameless),
| inlined all the dependencies so that it would compile without Cabal, just
| with a single invocation of GHC on the 277 modules.
| 
| The state, including a README, can be found at
| https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.c
| om%2Fnomeata%2Ftttool-nofib%23turning-tttool-into-a-
| benchmark&data=02%7C01%7Csimonpj%40microsoft.com%7C834f94186ee44b6a816308
| d41f300611%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C63616773850524881
| 6&sdata=QdbCK1mlVXo7xmJT744uvBSEagqVVMh8J69UE27oks4%3D&reserved=0
| 
| I am not sure how useful this is going to be:
|  + Tests lots of common and important real-world libraries.
|  − Takes a lot of time to compile, includes CPP macros and C code.
| (More details in the README linked above).
| 
| It is late, so I’ll just send this out as it is for now to get the
| discussion going if this is a useful approach, or what should be done
| different.
| 
| (If this is deemed to be useful, I’d do the same for, say, pandoc next).
| 
| Greetings,
| Joachim
| 
| --
| Joachim “nomeata” Breitner
|   mail at joachim-breitner.de •
| https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.joac
| him-
| breitner.de%2F&data=02%7C01%7Csimonpj%40microsoft.com%7C834f94186ee44b6a8
| 16308d41f300611%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636167738505
| 248816&sdata=dwGABuFYcY%2BlFbHWs2PeBm0YyEgAUzHoRgaOaZfLVmc%3D&reserved=0
|   XMPP: nomeata at joachim-breitner.de • OpenPGP-Key: 0xF0FBF51F
|   Debian Developer: nomeata at debian.org