Hi folks, I’m running a Mixpanel connector on an open source instance but unable to sync sucessfully even a days worth of data. It seems the mixpanel connector only retrieves 1000 rows per request, which combined with Mixpanel’s API request limits means we can never experience the throughput needed to catch up with the number of events flowing through our Mixpanel project. Is there any way to increase that row size up from 1000 rows at a time?

What have you set for "Date slicing window"?

Hi @Rajesh Koilpillai, I’ve it set to 1 day. Should I be using larger values?

1 day should be fine, hope the start/end date configuration is set properly as well As per their docs Syncing huge date windows may take longer due to Mixpanel's low API rate-limits (60 reqs per hour).

Thanks; I’m only syncing a couple of days worth of data but it’s yet to complete. I’m aware of the request rate limit; my query relates to the number of rows returned per request - which can be set as high as 100,000 I believe but in Airbyte’s connector it is set to 1000 it seems according to the logs.

@Rajesh Koilpillai @Roman Romanov [GL] we suspect that it has to do with the parameter

page_size

on the Engage class. We are only 80% certain that the throughput issue we are experiencing is related to this. The problems we are experiencing are on the Export Mixpanel end point and we can't find a reference to 1000 on that

export.py

.