https://linen.dev logo
Join Slack
Powered by
Hey everyone. Today i was testing a mysql connecto...
# announcements
a
Hey everyone. Today i was testing a mysql connector with a slightly larger number of tables (15) to see performances. Unfortunately Airbyte seems to be idling after completing the creation of temp tables in snowflake. Anyone has any experience with this?
s
Hey @Alberto Costa, will look into this shortly. What version of airbyte and the Mysql and Snowflake connectors are you on?
the latest snowflake version is 
0.1.17
and mysql 
0.1.10
, can you make sure you are on those versions and try the sync? we’ve fixed some timeout issues in mysql recently and just want to make sure this is a novel problem
a
0.1.17 for snowflake but i see 0.1.9 for mysql
is there a way to update the versions? i’m using airbyte 
v0.14.0
j
to update the version, go in the Admin section and put 0.1.10 for MySQL and click on "change"
let us know if that fixes the issue!
a
Hi John! Thank you very much, i tried with 
0.1.10
and it seems to work smoothly now!
The issue regarding mysql connector not starting syncing at all is fixed by 
0.1.10
but now I tried to import a larger table (40 GB of data) and the process is failing.
Copy code
2021-02-16 13:27:22 INFO (/tmp/workspace/100/0) LineGobbler(voidCall):69 - 2021-02-16 13:27:22 [32mINFO[m i.a.i.d.s.SnowflakeSqlOperations(insertRecords):60 - {} - actual size of batch: 933
2021-02-16 13:27:30 INFO (/tmp/workspace/100/0) LineGobbler(voidCall):69 - 2021-02-16 13:27:30 [32mINFO[m i.a.i.d.b.BufferedStreamConsumer(writeStreamsWithNRecords):194 - {} - Writing stream tripactions.booking_flight. Max batch size: 10000, Actual batch size: 502, Remaining buffered records: 0
2021-02-16 13:27:30 INFO (/tmp/workspace/100/0) LineGobbler(voidCall):69 - 2021-02-16 13:27:30 [32mINFO[m i.a.i.d.s.SnowflakeSqlOperations(insertRecords):60 - {} - actual size of batch: 502
2021-02-16 13:27:45 INFO (/tmp/workspace/100/0) LineGobbler(voidCall):69 - 2021-02-16 13:27:45 [32mINFO[m i.a.i.d.b.BufferedStreamConsumer(writeStreamsWithNRecords):194 - {} - Writing stream tripactions.booking_flight. Max batch size: 10000, Actual batch size: 1001, Remaining buffered records: 0
2021-02-16 13:27:45 INFO (/tmp/workspace/100/0) LineGobbler(voidCall):69 - 2021-02-16 13:27:45 [32mINFO[m i.a.i.d.s.SnowflakeSqlOperations(insertRecords):60 - {} - actual size of batch: 1001
2021-02-16 13:27:53 INFO (/tmp/workspace/100/0) LineGobbler(voidCall):69 - 2021-02-16 13:27:53 [32mINFO[m i.a.i.d.b.BufferedStreamConsumer(writeStreamsWithNRecords):194 - {} - Writing stream tripactions.booking_flight. Max batch size: 10000, Actual batch size: 798, Remaining buffered records: 0
2021-02-16 13:27:53 INFO (/tmp/workspace/100/0) LineGobbler(voidCall):69 - 2021-02-16 13:27:53 [32mINFO[m i.a.i.d.s.SnowflakeSqlOperations(insertRecords):60 - {} - actual size of batch: 798
2021-02-16 13:28:17 INFO (/tmp/workspace/100/0) LineGobbler(voidCall):69 - 2021-02-16 13:28:17 [32mINFO[m i.a.i.b.FailureTrackingConsumer(close):64 - {} - hasFailed: false.
2021-02-16 13:28:17 INFO (/tmp/workspace/100/0) LineGobbler(voidCall):69 - 2021-02-16 13:28:17 [32mINFO[m i.a.i.d.b.BufferedStreamConsumer(close):164 - {} - executing on success close procedure.
2021-02-16 13:28:17 ERROR (/tmp/workspace/100/0) LineGobbler(voidCall):69 - Exception in thread "main" java.lang.InternalError: a fault occurred in a recent unsafe memory access operation in compiled Java code
2021-02-16 13:28:17 ERROR (/tmp/workspace/100/0) LineGobbler(voidCall):69 - at io.airbyte.integrations.base.IntegrationRunner.consumeWriteStream(IntegrationRunner.java:126)
2021-02-16 13:28:17 ERROR (/tmp/workspace/100/0) LineGobbler(voidCall):69 - at io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:112)
2021-02-16 13:28:17 ERROR (/tmp/workspace/100/0) LineGobbler(voidCall):69 - at io.airbyte.integrations.destination.snowflake.SnowflakeDestination.main(SnowflakeDestination.java:59)
2021-02-16 13:28:17 ERROR (/tmp/workspace/100/0) LineGobbler(voidCall):69 - Suppressed: java.lang.InternalError: a fault occurred in a recent unsafe memory access operation in compiled Java code
2021-02-16 13:28:17 ERROR (/tmp/workspace/100/0) LineGobbler(voidCall):69 - at com.fasterxml.jackson.core.json.ReaderBasedJsonParser._parsePosNumber(ReaderBasedJsonParser.java:1288)
2021-02-16 13:28:17 ERROR (/tmp/workspace/100/0) LineGobbler(voidCall):69 - at com.fasterxml.jackson.core.json.ReaderBasedJsonParser.nextFieldName(ReaderBasedJsonParser.java:962)
2021-02-16 13:28:17 ERROR (/tmp/workspace/100/0) LineGobbler(voidCall):69 - at com.fasterxml.jackson.databind.deser.std.BaseNodeDeserializer.deserializeObject(JsonNodeDeserializer.java:250)
2021-02-16 13:28:17 ERROR (/tmp/workspace/100/0) LineGobbler(voidCall):69 - at com.fasterxml.jackson.databind.deser.std.JsonNodeDeserializer.deserialize(JsonNodeDeserializer.java:68)
2021-02-16 13:28:17 ERROR (/tmp/workspace/100/0) LineGobbler(voidCall):69 - at com.fasterxml.jackson.databind.deser.std.JsonNodeDeserializer.deserialize(JsonNodeDeserializer.java:15)
2021-02-16 13:28:17 ERROR (/tmp/workspace/100/0) LineGobbler(voidCall):69 - at com.fasterxml.jackson.databind.deser.impl.MethodProperty.deserializeAndSet(MethodProperty.java:129)
2021-02-16 13:28:17 ERROR (/tmp/workspace/100/0) LineGobbler(voidCall):69 - at com.fasterxml.jackson.databind.deser.BeanDeserializer.vanillaDeserialize(BeanDeserializer.java:288)
2021-02-16 13:28:17 ERROR (/tmp/workspace/100/0) LineGobbler(voidCall):69 - at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:151)
2021-02-16 13:28:17 ERROR (/tmp/workspace/100/0) LineGobbler(voidCall):69 - at com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:4218)
2021-02-16 13:28:17 ERROR (/tmp/workspace/100/0) LineGobbler(voidCall):69 - at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3214)
2021-02-16 13:28:17 ERROR (/tmp/workspace/100/0) LineGobbler(voidCall):69 - at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3182)
2021-02-16 13:28:17 ERROR (/tmp/workspace/100/0) LineGobbler(voidCall):69 - at io.airbyte.commons.json.Jsons.deserialize(Jsons.java:61)
2021-02-16 13:28:17 ERROR (/tmp/workspace/100/0) LineGobbler(voidCall):69 - at io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer.lambda$writeStreamsWithNRecords$1(BufferedStreamConsumer.java:191)
2021-02-16 13:28:17 ERROR (/tmp/workspace/100/0) LineGobbler(voidCall):69 - at java.base/java.util.stream.Referenc2021-02-16 13:28:17 DEBUG (/tmp/workspace/100/0) DefaultAirbyteSource(close):109 - Closing tap process
this is the last portion of the logs:
at this point the Snowflake destination container died, and the Mysql source container kept running. After some time (30 minutes) i tried to kill the container with 
docker kill
and 
docker stop
but nothing seemed to work so i ended up finding the process number with 
ps
and then do a 
kill -9 <process id>
s
Will look into this today.
@Alberto Costa what are the specs of the machine running airbyte? and are you able to get an idea of the memory used by the process while it’s running using something like 
top
or 
free -m
?
a
Hi @s, i have found out today that the issue is actually about the disk. The process fails when space on the disk full. The mysql source container is in fact storing the data it collects in some files in its /tmp directory. The disk of the virtual machine where docker is running is 50GB. I will try again on friday with a larger disk, but i guess this could be improved at the source: maybe implement a better pagination of the results collected from mysql and delete temporary files when they get passed on to the destination (snowflake in my case)?
s
awesome, this is super helpful context. In what file was the data getting accumulated in 
/tmp
? and are you able to do a 
head -n 100
of that file to give a snippet of its contents?
2 Views
Open in Slack
PreviousNext
Powered by