Hi <#C01AHCD885S|>, <@U01AB6V6NMQ> ,<@U02RZ7YQNKY>...
# replication-ask-ai
v
Hi #C01AHCD885S, @John (Airbyte) ,@Chris Sean Airbyte version: 0.50.7 OS Version / Instance: Amazon Linux, AWS EC2 (t3.xlarge) Deployment: Docker compose Source Connector and version: Github v1.0.1 Destination Connector and version: Postgres v0.3.27 We have a couple of Github connections configured, but till now we are not able to reliably sync data due to Airbyte being unstable. Airbyte is using too much memory even when idle and causing the EC2 instance to crash. When we checked the dockers stats the main culprits are airbyte-server and airbyte-worker containers. When Airbyte is started, the memory consumption looks normal (<2GB in total), but after few minutes gradually the memory is consumed and uses ~90% of available 16GB ram. This happens when Airbyte is idle with no sync jobs running !!. There are multiple reports of similar issue being faced by others but no solution till now. It would be great if Airbyte team can look into this issue on priority as it is a blocker. https://github.com/airbytehq/airbyte/issues/9620 https://github.com/airbytehq/airbyte/issues/16652 https://discuss.airbyte.io/t/unusual-ram-usage-by-airbyte-server/2167/4 https://github.com/airbytehq/airbyte/issues/15442 https://discuss.airbyte.io/t/gradual-increase-in-memory-usage/2249/2