https://linen.dev logo
#ask-community-for-troubleshooting
Title
# ask-community-for-troubleshooting
p

Phil Marius

08/20/2021, 8:46 AM
Hey all, having a few problems with Airbyte on EC2 with a Redshift destination. I’m loading our MySQL database in and it’s taking a very long time for ~20GB data and then fails. I started running it at 11:30am BST yesterday and it failed at 19:30pm. Looking at the logs I can’t tell what’s failing because I’m getting
Completed successfully
from the dbt output. As it failed though, it’s on its third attempt since, close to 24 hours after I first tried running it. Anyone come across this before? Airbyte is running on a t2.large instance and the Redshift cluster is a 2 node dc2.large. Screenshots attached of “failing” logs and the long run times
c

Chris (deprecated profile)

08/20/2021, 8:48 AM
can you post some full logs files? You can download them from the UI and attach it below in this slack thread
o

Opeyemi Fabiyi

08/20/2021, 9:22 AM
@Phil Marius Check the full log to be sure there was no failure in-between especially
Zero value prohibited
p

Phil Marius

08/20/2021, 9:36 AM
Found it
Zero value date prohibited
. Cheers for pointing that out, does that mean there’s a NULL value in a date column?
Principal developer has mentioned that we had an issue with
0000-00-00 00:00:00
being in some of the columns, apparently is a bug in MySQL. Could it be this? Fivetran seemed to load this completely fine which was strange
c

Chris (deprecated profile)

08/20/2021, 9:46 AM
o

Opeyemi Fabiyi

08/20/2021, 6:34 PM
@Phil Marius You can try the suggested option by @Chris (deprecated profile) though it didn't work for me for tables that I have null in the date field
p

Phil Marius

08/23/2021, 10:00 AM
Apologies for not getting back sooner, trying this now
I don’t think we have nulls in the date columns, guess I’ll be finding out now haha
👍 1
u

[DEPRECATED] Marcos Marx

08/23/2021, 8:18 PM
@Phil Marius let me know if this param work for you
p

Phil Marius

08/24/2021, 8:38 AM
It worked! However it said 0 bytes / no records were copied over. Redshift isn’t showing anything aside from the tables created
u

[DEPRECATED] Marcos Marx

08/24/2021, 8:00 PM
did you reset your connection?
3 Views