Flowman 0.29.0 released

Email
LinkedIn
Facebook
Twitter

We are happy to announce a fresh and exciting release of Flowman. This release is mainly a maintenance release with a couple of minor improvements

  • New distribution for Amazon EMR 6.8.0. This simplifies using Flowman in AWS.
  • New ‘iterativeSql’ mapping for solving a new set of recursive problems

Of course, this release also contains a bunch of smaller bug fixes and other improvements.

Detailed Changes

  • github-260: Remove hive-storage-api from several plugins and lib
  • github-261: Add descriptions to all pom.xml
  • github-262: Verification of “relation” targets should only check existence
  • github-263: Add filter condition to data quality checks in documentation
  • github-265: Make JDBC dialects pluggable
  • github-264: Provide “jars” for all plugins
  • github-267: Add new flowman-spark-dependencies module to simplify dependency management
  • github-269: Implement new ‘iterativeSql’ mapping
  • github-270: Upgrade Spark to 3.3.1
  • github-271: Upgrade Delta to 2.1.1
  • github-272: Create build profile for AWS EMR 6.8.0
  • github-273: Refactor file abstraction
  • github-274: Print Flowman configuration to console

Download

As usual, you can download the latest version from the Download section or directly from GitHub.

Flowman at Smartclip

smartclip is a successful and growing company specialized for online video advertisement. More importantly, smartclip was one of the first companies implementing

Flowman 1.0.0 released

Flowman version 1.0.0 has finally arrived. For several years, multiple companies are using Flowman in production as a robust and reliable solution