Hello everyone I have good news i have made some progress wi Airbyte #announcements

Hello everyone! I have good news, i have made some...

Alberto Costa

03/08/2021, 4:40 PM

Hello everyone! I have good news, i have made some progress with using Airbyte and now the sync of some pretty large tables in our company is almost working: The last bit of problem happening now is the follow: After Airbyte completes loading data from source to destination (ie Snowflake), it triggers the finalization procedure, moving data from table

AIRBYTE_STG._airbyte_1615200259762__airbyte_raw_Campaign

AIRBYTE_STG._airbyte_raw_Campaign

. This query is started in Snowflake, but it gets killed exactly after 5 minutes. My guess is that there’s a timeout happening. Airbyte logs are:

✅ 1

Alberto Costa

03/08/2021, 4:41 PM

can someone help me troubleshoot this?

Alberto Costa

03/08/2021, 4:50 PM

my guess 😄 https://github.com/airbytehq/airbyte/blob/754c1a332164687875af1f254e1ecf182ed652e7[…]rbyte/integrations/destination/snowflake/SnowflakeDatabase.java

Jared Rhizor (Airbyte)

03/08/2021, 5:14 PM

That does look very suspicious 😛

Jared Rhizor (Airbyte)

03/08/2021, 5:16 PM

We’ll bump the timeout (maybe 30 min?) and get a new version of that out sometime today

Jared Rhizor (Airbyte)

03/08/2021, 8:13 PM

@Alberto Costa this is live now. You can go to the admin page on Airbyte and update the snowflake destination version to

0.1.19

, which has the 30min timeout.

Alberto Costa

03/09/2021, 9:18 AM

amazing @Jared Rhizor (Airbyte)! thank you 🙌

Open in Slack

Previous Next