Hello - just installed Airbyte yesterday using Dig...
# ask-community-for-troubleshootings
Stratos Giouldasis
10/05/2022, 8:07 AMHello - just installed Airbyte yesterday using DigitalOcean one-click droplet install and tried to connect my DigitalOcean Managed Mongo as a source.
It kept timing out (I allowed connections from droplet)
I searched all over the internet and found out it’s not supported in Airbyte: https://github.com/airbytehq/airbyte/issues/13602
Is that it? no solution basically? I searched this slack channel and found people are using mongo with airbyte
✍️ 1
Stratos Giouldasis
10/05/2022, 8:23 AMUpdate 1:
I used Mongo Atlas as connection (even though DO managed db) but it happily accepted my mongo url (which has it’s replica sets under SRV dns list)
Stratos Giouldasis
10/05/2022, 8:24 AMNow I’m getting this error:
Stratos Giouldasis
10/05/2022, 8:24 AMlogs-8a601afb-b2dd-4a37-9c88-d0d782d3fe65-.txt
Stratos Giouldasis
10/05/2022, 8:26 AMI might be out of memory?
Copy code
2022-10-05 08:22:32 ERROR () LineGobbler(voidCall):82 - OpenJDK 64-Bit Server VM warning: INFO: os::commit_memory(0x00000000e8700000, 154140672, 0) failed; error='Not enough space' (errno=12)Stratos Giouldasis
10/05/2022, 8:39 AMok so it reached 3.17 GB of RAM while fetching and that immediately died when I had 2 GB of RAM droplet
Stratos Giouldasis
10/05/2022, 8:45 AMso for 200MB of data I need a 4GB droplet machine - that’s not very efficient isn’t it?
u
user
10/05/2022, 11:45 AM@[DEPRECATED] Marcos Marx turned this thread into Zendesk ticket 2569 to ensure timely resolution!
s
Saj Dider (Airbyte)
10/05/2022, 2:35 PM@Stratos Giouldasis, you can read more about scaling Airbyte here: https://docs.airbyte.com/operator-guides/scaling-airbyte
s
Stratos Giouldasis
10/05/2022, 4:59 PMwhew - I thought I could get away with 2 cores and 2GB RAM
Thanks @Saj Dider (Airbyte) for answering, I’ll read it through
Stratos Giouldasis
10/05/2022, 4:59 PMTo be honest Airbyte could really improve the onboarding experience if these system requirements were communicated by the app as you use it
Stratos Giouldasis
10/05/2022, 5:00 PMThinking out loud here: it could do like a system health check with some base requirements on the host machine, successfully educating me that I will need to upgrade my machine to be usable
Stratos Giouldasis
10/05/2022, 5:01 PMSince if I didn’t try hard to make it work, I would have quit trying after the first failure in the connection not even knowing it was my fault and blaming the software
Stratos Giouldasis
10/05/2022, 5:01 PMJust my 2 cents ofc.
u
user
10/05/2022, 10:29 PMWe're definitely always trying to improve our product so we appreciate the feedback. I've gone ahead and forwarded it to our product team. Thanks! :)
29 Views