[Haskell-cafe] [ANN] task-distribution: simple distribution of new code in a cluster computing setup

Axel Mannhardt axel.mannhardt at freiheit.com
Thu Mar 24 12:15:51 UTC 2016


Hello cafe,

I am happy to announce task-distribution, a framework written in order
to distribute and execute tasks as fast as possible on a large data
set. 

Its accentuation is that it supports distributing new logic to other
nodes from within the program itself, thus avoiding both restarting
slave node processes and a separated plugin-management infrastructure.

An example use case is running continuously changing analytics logic on
a given data set stored in HDFS.

Avalailable on hackage and github:
https://github.com/michaxm/task-distribution

Cheers,
Axel




More information about the Haskell-Cafe mailing list