hello, I'm back. We've upgraded airbyte to version...
# replication-troubleshootinge
Emilja Dankevičiūtė
10/20/2022, 2:04 PMhello, I'm back. We've upgraded airbyte to version “0.40.18" from "0.35." and now a lot of jobs get stuck for over 30 mins. Last log entry is something like.
Copy code
2022-10-20 13:18:21 INFO i.a.c.i.LineGobbler(voidCall):114 -
2022-10-20 13:18:21 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK -----
2022-10-20 13:18:21 INFO i.a.c.i.LineGobbler(voidCall):114 -✍️ 1
u
user
10/20/2022, 2:06 PM@[DEPRECATED] Marcos Marx turned this message into Zendesk ticket 2983 to ensure timely resolution!
e
Emilja Dankevičiūtė
10/20/2022, 2:18 PMalso a lot of jobs get "stuck" with the last entry "2022-10-20 141346 destination > Completed integration: io.airbyte.integrations.destinations..." for over an hour
Emilja Dankevičiūtė
10/20/2022, 2:30 PMOr at
2022-10-20 14:13:47 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):280 - Stopping temporal heartbeating...h
Harshith (Airbyte)
10/20/2022, 3:13 PMHey when you say the sync is still running you mean the pod is still up and is in running state?
e
Emilija Dankevičiūtė
10/20/2022, 3:16 PMhi, I meant airbyte ui showed the sync as still running
Emilija Dankevičiūtė
10/20/2022, 3:17 PMthere were a lot of pods though
Emilija Dankevičiūtė
10/20/2022, 3:17 PMnone of them were in the failed state
Emilija Dankevičiūtė
10/20/2022, 3:22 PMa lot of jobs did seem to have successfully replicated data before "hanging"
h
Harshith (Airbyte)
10/20/2022, 3:23 PMGot it. Seems to me like a resource issue. Do you mind testing with just one sync and then see how the pod status is changing
e
Emilija Dankevičiūtė
10/20/2022, 3:28 PMa small sync ran successfully from start to finish
Emilija Dankevičiūtė
10/20/2022, 3:29 PMI agree about the resources, but how do we calculate the right amount of resources? do you have recommendations?
h
Harshith (Airbyte)
10/20/2022, 3:30 PMHey maybe this doc can help you there https://docs.airbyte.com/operator-guides/scaling-airbyte
6 Views