Hi guys. I have set up a Pinterest-s3 connection on airbyte and selected Incremental Sync operation. On every sync, data between last sync date and current sync date is being replicated. Is there any way to get the last 7 days or 30 days data in every sync?

@[DEPRECATED] Marcos Marx turned this message into Zendesk ticket 2516 to ensure timely resolution!

Hi! I don't believe that is possible, as the incremental sync mode only replicates new or modified data. So unless all data from the last 7 days has been modified, for example, it will not be replicated. More info here: https://docs.airbyte.com/understanding-airbyte/connections/incremental-append/

Hi @Nataly Merezhuk (Airbyte), for Pinterest source

cursor_field

is

date

.So, even if data from the last 7 days has been modified, it will not be replicated. https://docs.airbyte.com/understanding-airbyte/connections/incremental-append/#known-limitations In the above doc, the below query is written-

SELECT * FROM table WHERE cursor_field >= 'last_sync_max_cursor_field_value'

For this to work, the Pinterest connector needs a lookback window, which it currently does not have. An example of a connector that does have one is Facebook Marketing: https://docs.airbyte.com/integrations/sources/facebook-marketing/#facebook-marketing-attribution-reporting If you're interested in this feature, please open a feature request issue in our GitHub!

Got it. thanks, @Nataly Merezhuk (Airbyte).

Happy to help :)

Happy to help :)