[Haskell-cafe] ANN: DBFunctor – Functional Data Management / ETL Data Processing in Haskell

Nikos Karagiannidis nikoshaskell at gmail.com
Tue Oct 16 10:23:13 UTC 2018


Dear all,

I am pleased to announce the release on Hackage of a new Haskell ETL
Library, namely DBFunctor-0.1.0.0.

(“ETL” stands for Extract Transform and Load and is the standard technology
for accomplishing data management tasks in
Data Warehouses / Data Marts and in general for data migrations, or for
preparing data for any analytic purpose (Ad hoc
queries, data exploration/data analysis, Reporting and Business
Intelligence, feeding Machine Learning algorithms, etc.))

Version 0.1.0.0 can be used for **in-memory** data processing without the
need of some external database. It is just a Haskell
library linked in your Haskell program that enables full SQL functionality
over tabular data (e.g., CSV files) but also
the ability to write a full ETL data processing flow.

Key features of this release are:

1. ** Julius DSL ** : A Type-Level Embedded Domain Specific Language (EDSL)
for ETL
2. Supports all known relational algebra operations
3. Implements the ETL Mapping and other typical ETL constructs and
operations
4. Applicable to all kinds of tabular data
5. In-memory, database-less data processing

For more information please check out the project homepage:
https://github.com/nkarag/haskell-DBFunctor

Also there is a tutorial that can help you to easily get started with
Julius DSL:
https://github.com/nkarag/haskell-DBFunctor/blob/master/doc/JULIUS-TUTORIAL.md


* Learn how to implement your ETL flows with Julius DSL
* Learn how to implement common ETL operations (e.g., append a delta to
some target table, or create a surrogate key column etc.)
* Build your own aggregate or analytic functions (e.g., string_agg, or a
montlhy running total)
* Express complex queries with Julius (equivalent to the WITH-clause in SQL)
* and many more ...

For any issues/problems with the DBFunctor package please open an issue on
github.

Happy data processing!

Thank you.

Best Regards,
Nikos
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.haskell.org/pipermail/haskell-cafe/attachments/20181016/12d88ef7/attachment.html>


More information about the Haskell-Cafe mailing list