[Haskell-cafe] Storing big datasets
jo at durchholz.org
Sat May 7 09:17:07 UTC 2016
Am 07.05.2016 um 02:27 schrieb Lana Black:
> Hi Mikhail,
> Have you considered external database engines? I suppose you could benefit from using Redis in your case.
Wikipedia says that while Redis can use the disk as "virtual memory",
that feature is deprecated, so it definitely expects to keep the whole
dataset in memory. Which kind of defeats the whole point for Mikhail.
sqlite comes to mind. HDBC claims to have a driver for it, and it's
linked into the application so there would be no additional setup required.
If Mikhail already has another database in his application, the setup
cost is already paid for, and he might want to check whether that's fast
enough for his purposes.
I'd expect postgresql or mysql to be too slow, but H2 to work just fine.
Of course that's just expectations, so testing would be needed.
More information about the Haskell-Cafe