[Haskell-cafe] Re: Mining Twitter data in Haskell and Clojure

Duncan Coutts duncan.coutts at googlemail.com
Thu Jun 24 14:30:05 EDT 2010


On 24 June 2010 13:10, Simon Marlow <marlowsd at gmail.com> wrote:
> On 17/06/2010 06:23, braver wrote:
>
>> I'll work with Simon to investigate the runtime, but would welcome any
>> ideas on further speeding up cafe4.
>
> An update on this: with the help of Alex I tracked down the problem (an
> integer overflow bug in GHC's memory allocator), and his program now runs to
> completion.
>
> This is the largest program (in terms of memory requirements) I've ever seen
> anyone run using GHC.  In fact there was no machine in our building capable
> of running it, I had to fire up the largest Amazon EC2 instance available
> (68GB) to debug it - this bug cost me $26.

I foresee Simon not having to pay for any of his beer at ICFP thus summer...


Duncan


More information about the Haskell-Cafe mailing list