Hi, it's first time trying to get airbyte to work/...
# replication-troubleshooting
r
Hi, it's first time trying to get airbyte to work/setup. I've created a local docker instance of airbyte and I am using and trying to setup
Copy code
Airbyte Version: 0.39.42-alpha
Source: MongoDb (0.1.15)
Destination: Snowflake (0.4.34)
The issue I ran into is I believe my snowflake connection is dropping mid process or not connecting properly. I've ran test on the connection, via settings, on both the source and destination and they were successful. I'm not too sure what might be the issue, I see that there's a DEADLINE_EXCEEDED in the logs and it seems that it was midway of reading records for a replication task the destination cancelled. When I check the activity of on snowflake it seems to be creating and dropping
AIRBYTE_CONNECTION_TEST
stages. I am using OpenVPN because mongoDB requires a VPN connection to access if that matters.
m
Hello Raymond, for those errors usually I saw users increasing the memory of the Airbyte instance!
r
Hey @Marcos Marx (Airbyte), thanks for the reply. How would I increase the memory for the airbyte instance? I haven't set any restriction and left most of the stuff in the
.env
blank. Unless theres a default value, I would assume its uncapped.
u
Are you using your laptop or a cloud instance?
r
laptop.
m
if you’re docker… it already using the max memory… how much do you have?
r
16Gb
u
😥 I don't think there is a fix besides using a cloud instance with more memory.
u
Maybe create an user with limited permissions to query only specific collections.
r
Okay, thanks for the help. I'll look into seeing if I can get something setup.