Hey guys,
I setup the airbyte open source version ...
# ask-community-for-troubleshootingb
Brent Spencer
10/23/2025, 7:27 PMHey guys,
I setup the airbyte open source version and im running into a issue with from db2 to snowflake is stalling after 21 million records and mssql to snowflake is stalling at 4 million. I checked the logs for db2 and im only seeing infor not any warnings. Let me know if i can provide any logs or other info.
Thanks!
c
Camille Lemaitre
10/24/2025, 9:36 AMDid you check the replication pod logs (not the job log)? A similar issue happened to me and checking the pod logs I was able to see that the replication job ran out of memory.
I updated the connection resource requirements memory limit in the db and it fixed my problem
b
Brent Spencer
10/24/2025, 1:18 PMhow do i check the pod logs?
c
Camille Lemaitre
10/24/2025, 2:33 PMconnecting to the server where you deployed airbyte
b
Brent Spencer
10/24/2025, 2:34 PMim in the linux server and its running docker
c
Camille Lemaitre
10/24/2025, 2:37 PMdid you install with abctl ? it's how I installed it on my server, so I'm able to give you the command I use, but no idea otherwise
b
Brent Spencer
10/24/2025, 2:40 PMyes i used abctl
Brent Spencer
10/24/2025, 2:41 PMit created a Docker image so im wondering if i can recreate it with more memory
c
Camille Lemaitre
10/24/2025, 3:14 PMcheck the running pods
docker exec -it airbyte-abctl-control-plane kubectl get pods -n airbyte-abctlCamille Lemaitre
10/24/2025, 3:16 PMcheck logs from a specific pod (in your case very likely the replication pod of the above connector)
docker exec -it airbyte-abctl-control-plane kubectl top pod <name_of_pod_that_has_issues> -n airbyteCamille Lemaitre
10/24/2025, 3:17 PMyou will see at the end of the logs if that connector crashes because it is running out of memory
b
Brent Spencer
10/24/2025, 3:28 PMMobaXterm_qonJlGNW1f.png
c
Camille Lemaitre
10/24/2025, 3:28 PMyeap, these are all the services/pods lists needed for airbyte to run
b
Brent Spencer
10/24/2025, 3:29 PMi tried checking a few and i get error: Metrics API not available
c
Camille Lemaitre
10/24/2025, 3:29 PMin theory, if your faulty job is running, you should have also replication connectors pods
Camille Lemaitre
10/24/2025, 3:30 PMyou can try this command for logs:
Copy code
docker exec -it airbyte-abctl-control-plane kubectl logs -n airbyte-abctl <replication-job-of-the-problematic-connector> --tail=300b
Brent Spencer
10/24/2025, 7:18 PMso i been testing with the docker stats and found something pretty interesting i think its running out of memory