[Haskell-cafe] Storing big datasets

Joachim Durchholz jo at durchholz.org
Sat May 7 09:17:07 UTC 2016


Am 07.05.2016 um 02:27 schrieb Lana Black:
> Hi Mikhail,
>
> Have you considered external database engines? I suppose you could benefit from using Redis in your case.

Wikipedia says that while Redis can use the disk as "virtual memory", 
that feature is deprecated, so it definitely expects to keep the whole 
dataset in memory. Which kind of defeats the whole point for Mikhail.

sqlite comes to mind. HDBC claims to have a driver for it, and it's 
linked into the application so there would be no additional setup required.

If Mikhail already has another database in his application, the setup 
cost is already paid for, and he might want to check whether that's fast 
enough for his purposes.
I'd expect postgresql or mysql to be too slow, but H2 to work just fine. 
Of course that's just expectations, so testing would be needed.

Regards,
Jo


More information about the Haskell-Cafe mailing list