The new version 0.22.0 of Flowman has been released. Among the new features is a a new documentation subsystem for automatically creating a reference documentation of the whole data flow and the final data model including data quality checks. Along with that feature comes the ability to publish execution and data quality metrics directly into a SQL database .Moreover, the support for Azure SQL / SQL Server databases has been improved significantly with higher write speed and transactional writes. Project loading times have also been reduced, which has its special value for interactive development work inside the Flowman shell.
About Flowman
Flowman is an open source data build tool on top of Apache Spark which uses a declarative approach for specifying the full data flow including all sources, targets and transformation. Like usual, you can find the latest version of Flowman prebuilt for different Spark / Hadoop versions at https://flowman.io
