you are trying to sync in github metrics to analyz...
# replication-ask-ai
h
you are trying to sync in github metrics to analyze efficiency at your organization. What are the best ways to load in a lot of github data without hitting the api rate limit? I’ve provided the github source connector two personal access tokens, but the rate limit was hit immediately regardless.
k
The GitHub API has a rate limit of 5,000 requests per hour for personal access tokens, and 15,000 requests per hour if the app is owned by a GitHub Enterprise Cloud organization. If you're hitting the rate limit, there are a few strategies you can use to avoid this: 1. Utilize Incremental sync mode: This mode only syncs new or updated data, reducing the number of API requests. 2. Set a higher sync interval: This means the sync will happen less frequently, reducing the number of API requests per hour. 3. Divide the sync into separate connections with a smaller number of streams: This can help manage the number of API requests. If you've provided two personal access tokens and are still hitting the rate limit immediately, it's possible that other applications or processes are also using these tokens, contributing to the limit being reached. You might want to consider generating additional tokens or investigating what else is using your tokens. For more details, you can refer to the [GitHub rate limits documentation](https://docs.github.com/en/rest/overview/rate-limits-for-the-rest-api) and the [Airbyte GitHub source connector documentation](https://docs.airbyte.com/integrations/sources/github#limitations--troubleshooting).