[Haskell-cafe] [ANN] sparkle: native Apache Spark applications in Haskell

[Lyndon Maydwell]

Hi Alp,


Just wanted to say that there's interest here in Melbourne in Spark+Haskell
too and we'll definitely be trying this out to see what it's like.

One of the problems that some of the more exotic language-bindings to spark
have is that while they include RDD support, they lack a language-idiomatic
interpretation of DataFrames. Does Sparkle attempt to tackle this?


Many thanks to Tweag I/O for doing this. It must have been a lot of work!


Regards,

 - Lyndon

On Fri, Feb 26, 2016 at 4:50 AM, Alp Mestanogullari <alpmestan at gmail.com>
wrote:

> Hello -cafe!
>
> Recently at Tweag I/O we've been working on sparkle, a library for writing
> (distributed) Apache Spark applications directly in Haskell!
>
> We have published a blog post introducing the project (and some of its
> challenges) here:
> http://www.tweag.io/blog/haskell-meets-large-scale-distributed-analytics
>
> The corresponding repository lives at https://github.com/tweag/sparkle
>
> While this is still early stage work, we can already write non-trivial
> Spark applications in Haskell and have them run accross an entire cluster.
> We obviously do not cover the whole Spark API yet (very, very far from
> that) but would be glad to already get some feedback.
>
> Cheers
>
> --
> Alp Mestanogullari
>
> _______________________________________________
> Haskell-Cafe mailing list
> Haskell-Cafe at haskell.org
> http://mail.haskell.org/cgi-bin/mailman/listinfo/haskell-cafe
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.haskell.org/pipermail/haskell-cafe/attachments/20160226/96b1cbd1/attachment.html>