Hi <!channel>, happy 2/2/22!
Welcome to our new members
blob wave, 50+ and growing!
(We are also at 199 stars on Github, so one of you has the opportunity to be the 200, and be our 🌟 of the week 🤩)
First,
@Or Avidov and I want to thank all of you who provided feedback and helped us shape our product roadmap.
It's incredibly valuable, and we can't thank you enough! 🙏
Our new product version now includes three modules:
* *
elementary rocket Data lineage visualization - Based on DWH logs, no integrations are required.
* *
elementary rocket Monitoring - Logs and metrics are collected in your DWH for detection of reliability issues (dbt package that our CLI executes).
* *
elementary rocket Slack alerts - Sent by the CLI on each execution that detected issues for alert according to your configuration.
The new release includes: 🎉
1.
Major performance improvements to the lineage (especially in
snowflake dwh), and parsing fixes.
2.
First monitoring module - monitor schema changes in your source tables (new columns, new tables, deletions, type changes).
a. We know how painful it is when changes in sources break downstream logic, and this is a way to reduce this blind spot.
b. It is also valuable for detecting new data produced by your sources that you can utilize.
c. The configuration is through your dbt 'schema.yml' files under sources, just where you usually configure tests and all (the module is relevant for non-dbt users as well).
3.
Slack alerts - on changes in schema, according to your configuration.
4.
New commands, names and configuration. We believe these are big usability improvements, and we would love your feedback.
All the
details are here, update using pip when you are ready to try it out!
Other exciting news - we closed our first funding for Elementary! 🎉
This means we now have more resources to build it faster and better, and we promise you will notice the impact.
Our next release will add the lineage data to the dbt package, so it will be stored in your DWH.
This will solve performance, and enable you to export the data as well.
As always - feel free to reach out!