Hi,
I'm struggling to fully understand "Cursor fi...
# replication-troubleshootingb
Benedikt Buchert
11/30/2022, 4:45 PMHi,
I'm struggling to fully understand "Cursor field" when doing incremental loading in the context of campaignAnalytics for LinkedIn. In the case of the Screenshot. How is the end_date set? Is that always the day when the connector last ran?
Benedikt Buchert
11/30/2022, 5:31 PMBenedikt Buchert
12/01/2022, 11:39 AMFigured it out but have an additional question.
It seems to be exporting everything on a by day basis. The only issue with incremental refresh I see with end date that it will have outdated data. As it will take the current day and not update that on the next day. Am I correct here? Is there a way to define a refresh window for the data?
Benedikt Buchert
12/08/2022, 2:27 PMJust verified and this is actually the case. I think a refresh window could solve this. So it refreshes the data only for the last x days.
Benedikt Buchert
12/08/2022, 2:30 PMI think end_date is not a really useful to do incremental updates.
Benedikt Buchert
12/09/2022, 7:45 AMAdded a feature request https://github.com/airbytehq/airbyte/issues/20284
12 Views