Hi everyone! Is there anyone using the Braintree c...
# replication-troubleshooting
k
Hi everyone! Is there anyone using the Braintree connector here, having the same issue? We would like to use the Braintree connector to store our transactions in our data warehouse since 2019, but due to the search limit (50k on the transaction endpoint: https://developer.paypal.com/braintree/docs/reference/general/searching/search-results/python#search-limit), we only get the last 50k transactions. I could try to contribute on this one but would love some guidance about what to do in the case of a limiting search API. Today the search parameter filters records based on their created time https://github.com/airbytehq/airbyte/blob/master/airbyte-integrations/connectors/source-braintree/source_braintree/streams.py:
Copy code
def get_items(self, start_date: datetime):
    return self._gateway.transaction.search(braintree.TransactionSearch.created_at >= start_date)
Maybe we can iterate over the dates since start_date to get more records (in our case 50k per day would be largely enough), but we could run into some rate limiting issues I guess. Any advice on that?
n
Hi Keurcien! Rate limits are always tricky, I think you've got the right idea though. I hope someone from the community chimes in!
🙏 1