https://linen.dev logo
s

Sreeram Venkitesh

02/22/2022, 2:41 PM
👋 I successfully set up a Stripe Connection lately and run the initial Sync at first try with a manual run set up. However, when I retried lately it seems to be broken even after 3 retries approximately at the same stage. I suspect the issue to be linked to Stripe API blocking requests after too many was sent.
Copy code
source - 2022-02-22 08:22:41 INFO () DefaultAirbyteStreamFactory(internalLog):97 - Backing off _send(...) for 20.0s (airbyte_cdk.sources.streams.http.exceptions.DefaultBackoffException)
source - 2022-02-22 08:23:06 INFO () DefaultAirbyteStreamFactory(internalLog):97 - Caught retryable error '' after 3 tries. Waiting 20 seconds then retrying...
source - 2022-02-22 08:23:06 INFO () DefaultAirbyteStreamFactory(internalLog):97 - Backing off _send(...) for 40.0s (airbyte_cdk.sources.streams.http.exceptions.DefaultBackoffException)
source - 2022-02-22 08:23:51 INFO () DefaultAirbyteStreamFactory(internalLog):97 - Caught retryable error '' after 4 tries. Waiting 40 seconds then retrying...
source - 2022-02-22 08:23:51 INFO () DefaultAirbyteStreamFactory(internalLog):97 - Backing off _send(...) for 80.0s (airbyte_cdk.sources.streams.http.exceptions.DefaultBackoffException)
source - 2022-02-22 08:25:16 INFO () DefaultAirbyteStreamFactory(internalLog):97 - Caught retryable error '' after 5 tries. Waiting 80 seconds then retrying...
source - 2022-02-22 08:25:16 ERROR () DefaultAirbyteStreamFactory(internalLog):95 - Giving up _send(...) after 6 tries (airbyte_cdk.sources.streams.http.exceptions.DefaultBackoffException)
source - 2022-02-22 08:25:16 ERROR () DefaultAirbyteStreamFactory(internalLog):95 - Encountered an exception while reading stream SourceStripe
g

Guillaume Chevalier

02/22/2022, 2:42 PM
Providing a successful run log here
And a full Failed log here
r

Renzo B

02/22/2022, 6:05 PM
Hi @Guillaume Chevalier, are you using incremental load or full refresh? We've an ongoing issue to improve Stripe load performance here. What you suspect is right: • the connector receive rate limited response from stripe • it tries to perform exponential backup (waiting from 5secs to 80sec) • after retrying 6 time the connector stops You could try to reduce the Lookback Window to make less api calls.
e

Edvard Kristiansen

02/22/2022, 6:54 PM
You could try to reduce the Lookback Window to make less api calls.
I’ll try that 🙂 Thanks a lot 🙏