[Haskell-cafe] Re: [Haskell] ANNOUNCE: The Fibon benchmark suite
dagit at codersbase.com
Tue Nov 9 16:45:41 EST 2010
On Tue, Nov 9, 2010 at 1:24 PM, David Peixotto <dmp at rice.edu> wrote:
> I'm pleased to announce the release of the Fibon benchmark tools and suite.
> Fibon is a set of tools for running and analyzing benchmark programs in
> Haskell. Most importantly, it includes an optional set of benchmark
> programs including many programs taken from the Hackage open source
> The source code for the tools and benchmarks are available on github
> The Fibon tools (without the benchmarks) are available on hackage.
> The package needs to be unpacked and built in place to be able to run any
> benchmarks. It can be used with the official Fibon benchmarks or you can
> create your own suite and just use Fibon to run and analyze your benchmark
> Some more documentation is available on the fibon wiki
> Fibon Tools
> Fibon is a pure Haskell framework for running and analyzing benchmark
> programs. Cabal is used for building the benchmarks. The benchmark
> harness, configuration files, and benchmark descriptions are all written in
> Haskell. The benchmark descriptions and run configurations are all
> compiled into the benchmark runner to ensure that configuration errors are
> found at compile time.
> The Fibon tools are not tied to any compiler infrastructure and can build
> benchmarks using any compiler supported by cabal. However, there are some
> extra features available when using GHC to build the benchmarks:
> * Support in config files for using an inplace GHC HEAD build
> * Support in `fibon-run` for collecting GC stats from GHC compiled
> * Support in `fibon-analyse` for reading GC stats from Fibon result files
> The Fibon Benchmark Suite
> The Fibon benchmark suite currently contains 34 benchmarks from a variety
> sources. The individual benchmarks and lines of code are given below.
Congrats on the release! It looks like you've invested a lot of time and
put in some hard work.
I have a few questions:
* What differentiates fibon from criterion? I see both use the statistics
* Does it track memory statistics? I glanced at the FAQ but didn't see
anything about it.
* Are the numbers in the sample output seconds or milliseconds? What is
the stddev (eg., what does the distribution of run-times look like)?
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the Haskell-Cafe