[Haskell-cafe] memory-efficient data type for Netflix data - UArray Int Int vs UArray Int Word8

wren ng thornton wren at freegeek.org
Mon Feb 23 19:03:59 EST 2009

Kenneth Hoste wrote:
> Well, I'm using UArray, but I'm willing to consider other suitable 
> containers...
> As long as they are memory efficient. :-)
> The typical usage of a UArray will be getting all it's contents,
> and converting it to a list to easily manipulate (filter, ...).
> So, maybe another data type allows me to store the data in a limited 
> amount of memory
> (which is my main concern now)...

Have you considered using spectral (or counting) bloom filters? I know 
there's a non-spectral version available[1], though I haven't looked at 
it to see how easily it could be made to count.

[1] http://hackage.haskell.org/cgi-bin/hackage-scripts/package/bloomfilter

Live well,

More information about the Haskell-Cafe mailing list