Hey Folks! I recently built a connector in Airbyte...
# airbyte-apiw
Wass (Airbyte)
05/09/2023, 8:21 PMHey Folks! I recently built a connector in Airbyte to hit the Airbyte API and while it started working successfully, my syncs are all failing now because the
/v1/jobs/{jobId}500b
Bryce Groff (Airbyte)
05/09/2023, 9:09 PMCan you send the link to your speakeasy request to us?
w
Wass (Airbyte)
05/09/2023, 9:10 PMis that jus the URL of the screenshot?
b
Bryce Groff (Airbyte)
05/09/2023, 9:10 PMyeah
w
Wass (Airbyte)
05/09/2023, 9:11 PMt
Terence Cho (Airbyte)
05/09/2023, 10:01 PMCan confirm that the 500s are showing up because of rate limiting. We’ll work on providing better response messaging for when this happens.
Terence Cho (Airbyte)
05/09/2023, 10:03 PMactually, looking into this more, it could be a mixture of rate limiting as well as the a bug that happens in certain cases when job responses are too big
w
Wass (Airbyte)
05/09/2023, 10:06 PMWhat is the rate limit? I will enable a backoff policy in my connector
t
Terence Cho (Airbyte)
05/09/2023, 10:09 PMapologies, i think i was parsing through our logs incorrectly, doesn’t seem like a rate limiting issue. so i think it’s more related to the second point i brought up
Terence Cho (Airbyte)
05/09/2023, 10:18 PMlet me do some more digging into this, still haven’t tracked down the root cause of this
Terence Cho (Airbyte)
05/09/2023, 10:39 PMok i think i found the root cause. essentially there’s an edge case where large job logs may cause this endpoint to fail unexpectedly. we’ll be putting up a fix for this shortly
w
Wass (Airbyte)
05/09/2023, 10:52 PMSweet, thank you @Terence Cho (Airbyte)!