Ariyo Kabir
01/26/2022, 1:23 PMAndreas
01/26/2022, 1:28 PMJani Sourander
01/27/2022, 6:50 AMGRANT CONNECT
. Wouldn’t it need a lot more grants? For comparison, AWS DMS wants a user to have SYSADM
(?!) and DATAACCESS
. Debezium puts tables into a capture mode using ASN Capture/Apply agents, which sounds a bit scary on any production-related databases.Preetam Balijepalli
01/27/2022, 12:20 PMDaniel Eduardo Portugal Revilla
01/27/2022, 4:36 PMPedro Machado
01/27/2022, 6:16 PMMatthieu Berger
01/27/2022, 8:18 PMworkspaceId
somehow into the destination ?Ryan Loveland
01/27/2022, 11:15 PMArvi
01/28/2022, 8:00 AMNick Booth
01/28/2022, 9:10 AMLine Rahal
01/28/2022, 4:44 PMThao Pham
01/28/2022, 6:19 PMMatthieu Vegreville
01/28/2022, 7:49 PMSaif Mahamood
01/28/2022, 8:57 PMThao Pham
01/28/2022, 9:20 PMVictor
01/28/2022, 10:07 PMSreenivas Reddy
01/29/2022, 6:00 AMSreenivas Reddy
01/29/2022, 6:02 AMWahyudinata Setiawan
01/29/2022, 11:01 PMDaniel Eduardo Portugal Revilla
01/31/2022, 1:41 PMPierre CORBEL
01/31/2022, 2:01 PMMatch for a specific use case
Hello there 👋,
I wanted to ask you if Airbyte was a good option for a particular use-case: not as an ETL but as a RETL 🧐.
I explain: we developed a lot of data-models via dbt in our DataWarehouse, Snowflake, and we unload them to a PostgreSQL instance in order to expose them to our end-users (Snowflake is OLAP oriented and not fast-enough for end-users queries, thus the need to unload them to Postgres) ⚡️.
So our use-case is to keep a perfect sync between our Snowflake tables and our Postgres tables 🔄.
By perfect sync, I mean having all the fields needed, a regular incremental replication and handling of deleted rows ⏰
We already set-up primary key in our Snowflake tables, as well as a "meta-field" with the last update date of the row 👍.
Thanks a lot! 🙏Daniel Eduardo Portugal Revilla
01/31/2022, 5:14 PMDave Lindley
01/31/2022, 5:18 PMNava Gross
01/31/2022, 8:22 PMTien Nguyen
01/31/2022, 11:17 PMUlf Svensson
01/31/2022, 11:28 PMReynaldo Mendez
02/01/2022, 4:37 AMAniruddha Chattopadhyay
02/01/2022, 8:22 AMNikzad Khani
02/01/2022, 8:15 PMArmand
02/02/2022, 2:17 AMdocker-compose up
airbyte-server | 2022-02-02 02:15:45 ERROR i.a.s.ServerApp(main):236 - Server failed
airbyte-server | java.lang.NullPointerException: Cannot invoke "org.flywaydb.core.api.MigrationInfo.getVersion()" because the return value of "io.airbyte.db.instance.DatabaseMigrator.getLatestMigration()" is null
airbyte-server | at io.airbyte.db.instance.MinimumFlywayMigrationVersionCheck.assertMigrations(MinimumFlywayMigrationVersionCheck.java:75) ~[io.airbyte.airbyte-db-lib-0.35.15-alpha.jar:?]
airbyte-server | at io.airbyte.server.ServerApp.assertDatabasesReady(ServerApp.java:131) ~[io.airbyte-airbyte-server-0.35.15-alpha.jar:?]
airbyte-server | at io.airbyte.server.ServerApp.getServer(ServerApp.java:155) ~[io.airbyte-airbyte-server-0.35.15-alpha.jar:?]
airbyte-server | at io.airbyte.server.ServerApp.main(ServerApp.java:234) [io.airbyte-airbyte-server-0.35.15-alpha.jar:?]
airbyte-server exited with code 1