We are happy to announce a fresh and exciting release of Flowman. This release is mainly a maintenance release with a couple of minor improvements
- New distribution for Amazon EMR 6.8.0. This simplifies using Flowman in AWS.
- New ‘iterativeSql’ mapping for solving a new set of recursive problems
Of course, this release also contains a bunch of smaller bug fixes and other improvements.
Detailed Changes
- github-260: Remove hive-storage-api from several plugins and lib
- github-261: Add descriptions to all pom.xml
- github-262: Verification of “relation” targets should only check existence
- github-263: Add filter condition to data quality checks in documentation
- github-265: Make JDBC dialects pluggable
- github-264: Provide “jars” for all plugins
- github-267: Add new flowman-spark-dependencies module to simplify dependency management
- github-269: Implement new ‘iterativeSql’ mapping
- github-270: Upgrade Spark to 3.3.1
- github-271: Upgrade Delta to 2.1.1
- github-272: Create build profile for AWS EMR 6.8.0
- github-273: Refactor file abstraction
- github-274: Print Flowman configuration to console
Download
As usual, you can download the latest version from the Download section or directly from GitHub.
