I am doing Mixpanel to Redshift migration, based o...
# replication-troubleshooting
s
I am doing Mixpanel to Redshift migration, based on the logs, I see every 1000 records are being moved as a batch (which is slow). How to increase this number to make data load faster?
@Marcos Marx (Airbyte) Could you please help? Also I need to increase the API rate limit time. Any idea?
u
You can try to use the staging method which should be faster to load the data to Redshift. Today Airbyte hardcode the batchsize to 1000 records