Am I missing an option to start pulling data after a period of time or is it always a full data sync? I would like to limit data to after 2016 or I can get the lowest ID within that range. In this particular case, I am using MySQL connection If there is currently no option, do you know if this is planned functionality

Yeah unfortunately this currently isn't very easy, it is possible to manually set the incremental sync cursor to the desired state with a SQL query on Airbyte's database. This thread may be helpful: https://discuss.airbyte.io/t/update-the-cursor-manually-breaks-my-connection/393 For example, running this on Airbyte's database will set the stream state to

"2022-01-25T00:00:00.000000Z"

so the next sync would include data after that:

UPDATE state SET state = jsonb_set(state, '{state, streams, 0, cursor}', '"2022-01-25T00:00:00.000000Z"', false) WHERE connection_id = '592fd59f-2aa9-4852-9d2b-8d12e269faa1';

Thanks for the response, this looks like it could work. I will give it a try!

Reach out if we can help!