[Haskell-cafe] [ANN] sparkle: native Apache Spark applications in Haskell
maydwell at gmail.com
Thu Feb 25 23:56:11 UTC 2016
Just wanted to say that there's interest here in Melbourne in Spark+Haskell
too and we'll definitely be trying this out to see what it's like.
One of the problems that some of the more exotic language-bindings to spark
have is that while they include RDD support, they lack a language-idiomatic
interpretation of DataFrames. Does Sparkle attempt to tackle this?
Many thanks to Tweag I/O for doing this. It must have been a lot of work!
On Fri, Feb 26, 2016 at 4:50 AM, Alp Mestanogullari <alpmestan at gmail.com>
> Hello -cafe!
> Recently at Tweag I/O we've been working on sparkle, a library for writing
> (distributed) Apache Spark applications directly in Haskell!
> We have published a blog post introducing the project (and some of its
> challenges) here:
> The corresponding repository lives at https://github.com/tweag/sparkle
> While this is still early stage work, we can already write non-trivial
> Spark applications in Haskell and have them run accross an entire cluster.
> We obviously do not cover the whole Spark API yet (very, very far from
> that) but would be glad to already get some feedback.
> Alp Mestanogullari
> Haskell-Cafe mailing list
> Haskell-Cafe at haskell.org
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the Haskell-Cafe