<@U04SE163WC8> we are ingesting google search con...
# replication-ask-ai
s
@kapa.ai we are ingesting google search console data with Airbyte. However there seems to be a limitation of google search console that it only allows 50k per day per query type to download, which we exceed. Is it possible to sort the data based on one column during ingestion with GSC data, so the rows beyond 50k are the long-tailed data.
k
Based on the information provided in the knowledge sources, it appears that the Google Search Console connector in Airbyte is indeed limited by the Google Search Console's API limit of 50,000 rows per day per site per search type. This limit is set by Google and cannot be exceeded by Airbyte. However, there is a suggestion in one of the [Github comments](https://github.com/airbytehq/airbyte/issues/21529) to potentially work around this limitation. The suggestion is to investigate if it's possible to split the queries or make them more granular in order to get more data from the connector. This could potentially involve splitting out the queries by search type to maximize the available rate limit, or using requests that don't involve query or URL dimensions. As for sorting the data based on one column during ingestion, there is no information provided in the knowledge sources about this specific capability in Airbyte's Google Search Console connector. It would be best to reach out to the Airbyte community or support for more specific guidance on this. Please note that any changes to the way data is fetched from the Google Search Console API would likely require modifications to the connector's code, and may not be possible without such changes.