[Haskell-cafe] ANN: DBFunctor – Functional Data Management / ETL Data Processing in Haskell

Nikos Karagiannidis nikoshaskell at gmail.com
Sun Oct 14 16:29:55 UTC 2018


 Dear all,

I am pleased to announce the release on Hackage of a new Haskell ETL
Library, namely DBFunctor-0.1.0.0.

(“ETL” stands for Extract Transform and Load and is the standard technology
for accomplishing data management tasks in Data Warehouses / Data Marts and
in general for data migrations, or for preparing data for any analytic
purpose (Ad hoc queries, data exploration/data analysis, Reporting and
Business Intelligence, feeding Machine Learning algorithms, etc.))

Version 0.1.0.0 can be used for *in-memory data processing* without the
need of some external database. It is just a Haskell library linked in your
Haskell program that enables full SQL functionality over tabular data
(e.g., CSV files) but also the ability to write a full ETL data processing
flow.

Key features of this release are:

1. *Julius DSL*: A Type-Level Embedded Domain Specific Language (EDSL) for
ETL
2. Supports all known relational algebra operations
3. Implements the ETL Mapping and other typical ETL constructs and
operations
4. Applicable to all kinds of tabular data
5. In-memory, database-less data processing

For more information please check out the project homepage:
https://github.com/nkarag/haskell-DBFunctor

Also there is a tutorial that can help you to easily get started with
Julius DSL:
https://github.com/nkarag/haskell-DBFunctor/blob/master/doc/JULIUS-TUTORIAL.md

* Learn how to implement your ETL flows with Julius DSL
* Learn how to implement common ETL operations (append a delta to some
target table, or create a surrogate key column etc.)
* Build your own aggregate or analytic functions (string_agg, or a montlhy
running total)
* Express complex queries with Julius (equivalent to the WITH-clause in SQL)
* and many more ...

For any issues/problems with the DBFunctor package please open an issue on
github.

Happy data processing!

Thank you.

Best Regards,
Nikos
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.haskell.org/pipermail/haskell-cafe/attachments/20181014/7f8f4f8d/attachment.html>


More information about the Haskell-Cafe mailing list