The new version 0.25.0 of Flowman has been released. This release contains a couple of smaller changes and fixes plus a new relation for creating and managing views in SQL databases, which are accessed via JDBC. This last addition strengthens Flowmans position in environments where data resides in classical relational databases instead of HDFS or object storages.
Detailed Changes
- github-184: Only read in *.yml / *.yaml files in module loader
- github-183: Support storing SQL in external file in
hiveView
- github-185: Missing _SUCCESS file when writing to dynamic partitions
- github-186: Support output mode
OVERWRITE_DYNAMIC
for Delta relation - github-149: Support creating views in JDBC with new
jdbcView
relation - github-190: Replace logo in documentation
- github-188: Log detailed timing information when writing to JDBC relation
- github-191: Add user provided description to quality checks
- github-192: Provide example queries for JDBC metric sink
Download
As usual you can find the latest Flowman version at https://flowman.io/download/ and older downloads on the GitHub release page at https://github.com/dimajix/flow