Hello guys. Anyone had this problem with Recurly s...
# replication-troubleshooting
v
Hello guys. Anyone had this problem with Recurly source? It keeps stuck at this point and takes too long (1h25min) to pass from this step to the normalization step. I'm trying to get invoices and transactions.
✅ 1
m
Maybe your scheduler reach the maximum parallel connections allow and took 1h to finish another process and start normalization. Check your
.env
variables and follow the
docker ps
containers number
v
Great! I checked it but we just have only three processes. They rarely work in parallel and this problem occours only when we trigger the Recurly job. It seems to get stucked always in the same step and when it passes this step the normalization step goes fast (about 3 minutes)
u
Hi Victor! I'm looking into this for you, but will be off for the rest of the week. Hope you enjoy the Thanksgiving celebrations as well and I hope to have some ideas for you early next week!
v
Thank you Nataly! It will be really helpful to me.
n
Could you provide the full logs? Usually in the full logs you can see the sync happening row by row and if it's hitting any rate limits or anything 🤔 are you syncing a lot of data? What is the deployment environment?
v
We are working with the Digital Ocean droplet. These are it's specifications:
At the first Sync was 1.7 GB processed. And it took a lot of time to get the data, but when we set the incremental sync, we still get much time to get a response. Maybe there is some problem with the Recurly API?
I'll send in a while the logs
I'm not able to get the logs. It is taking so much time to load it. I'll try to run again and take the logs
u
Thank you, looking forward to it!
v
Here is the logs for my recurly airbyte connection. It processes 1.7 GB again even with the incremental input set
n
One thing I noticed in your logs is the Airbyte version:
Airbyte version: 0.30.25-alpha
Could you please update to the most recent version? This might be causing issues in your connection.
v
Great!! I'll check that
Thanks
Hello Nataly. I just updated Airbyte and the connector worked
👍 1
Thank you!
n
So glad to hear that!