Pierre CORBEL
01/31/2022, 2:01 PMMatch for a specific use case
Hello there 👋,
I wanted to ask you if Airbyte was a good option for a particular use-case: not as an ETL but as a RETL 🧐.
I explain: we developed a lot of data-models via dbt in our DataWarehouse, Snowflake, and we unload them to a PostgreSQL instance in order to expose them to our end-users (Snowflake is OLAP oriented and not fast-enough for end-users queries, thus the need to unload them to Postgres) ⚡️.
So our use-case is to keep a perfect sync between our Snowflake tables and our Postgres tables 🔄.
By perfect sync, I mean having all the fields needed, a regular incremental replication and handling of deleted rows ⏰
We already set-up primary key in our Snowflake tables, as well as a "meta-field" with the last update date of the row 👍.
Thanks a lot! 🙏Augustin Lafanechere (Airbyte)
01/31/2022, 2:48 PMPierre CORBEL
01/31/2022, 3:15 PMPierre CORBEL
01/31/2022, 3:38 PMairbyte source --conf foo | airbyte destination --config bar