Cal wsoo
12/12/2025, 9:18 AMkapa.ai
12/12/2025, 9:18 AMCal wsoo
12/18/2025, 3:47 AMkapa.ai
12/18/2025, 3:47 AMkapa.ai
12/18/2025, 3:48 AMshould_retry and backoff_time in custom CDK connectors if the API has special rules [[HTTP CDK 1.8](https://docs.airbyte.com/platform/1.8/connector-development/cdk-python/http-streams#rate-limiting)]. In the Connector Builder UI, default behavior (when you don’t configure an error handler) is also to: - Retry on 429 and 5XX, - Up to 5 retries, - With a 5‑second exponential backoff [[Error handling – default](https://docs.airbyte.com/platform/connector-development/connector-builder-ui/error-handling)]. You can explicitly configure backoff strategies per API: - Constant, Exponential, or Wait time from header / until time from header based on API docs and headers like Retry-After [[Backoff strategies 1.8](https://docs.airbyte.com/platform/1.8/connector-development/connector-builder-ui/error-handling#backoff-strategies)]. ### 2. Global rate limiting (HTTP API Budget) For APIs with strict limits (like GA4 or Stripe), you can cap request throughput via API Budget / HTTP API Budget in config-based connectors and in the Connector Builder Global Configuration: - Define call limits per time window (Fixed window, Moving window, or Unlimited) [[Rate limiting API Budget](https://docs.airbyte.com/platform/connector-development/config-based/understanding-the-yaml-file/rate-limit-api-budget); [Global configuration HTTP API Budget](https://docs.airbyte.com/platform/connector-development/connector-builder-ui/global-configuration#http-api-budget)]. - Optionally read limit info from headers like X-RateLimit-Remaining and X-RateLimit-Reset, and specify which status codes (usually 429) indicate a rate‑limit hit [[Rate limiting API Budget](https://docs.airbyte.com/platform/connector-development/config-based/understanding-the-yaml-file/rate-limit-api-budget); [Global configuration HTTP API Budget](https://docs.airbyte.com/platform/connector-development/connector-builder-ui/global-configuration#http-api-budget)]. - When a rate limit status code is hit, Airbyte pauses and retries according to these policies [[Global configuration HTTP API Budget](https://docs.airbyte.com/platform/connector-development/connector-builder-ui/global-configuration#http-api-budget)]. ### 3. Stripe-specific behavior For Stripe, the docs state: - Under normal usage, the connector should not hit Stripe rate limits, and rate‑limited calls are automatically retried. - You’re asked to open an issue if you see rate limit problems that aren’t retried successfully [[Stripe rate limiting](https://docs.airbyte.com/integrations/sources/stripe#rate-limiting)]. ### 4. Practical impact - If GA4/Stripe limits are hit, Airbyte will slow down syncs (due to backoff or API Budget waits) but should still complete as long as limits allow enough throughput. - If limits are very strict vs. data volume, syncs can become longer or fail after repeated retries. If you share the exact GA4 or Stripe rate limit you’re concerned about (e.g., X requests per hour), I can suggest a concrete API Budget / backoff configuration pattern using the mechanisms above.Cal wsoo
12/18/2025, 3:49 AMkapa.ai
12/18/2025, 3:49 AMkapa.ai
12/18/2025, 3:49 AM