Good afternoon from South Korea, airbyte gang. I'...
# replication-troubleshooting
k
Good afternoon from South Korea, airbyte gang. I'm currently having an issue with
Zendesk Support
and `Klaviyo`connectors. It seems like though some streams are set up as
incremental + dedup
it is still pulling all data as if it were a full refresh. Any idea what may be the issue, or what should I be looking for in the logs? The logs don't seem to show any warning nor errors. Just to add some detail: • in the
Klaviyo -> BigQuery
connector
events
stream the cursor field
'timestamp'
seems to be an
INTEGER
whereas all other streams that are working incrementally are of type
TIMESTAMP
, could this be the issue?
j
I'm not an Airbyte expert - but I've seen other people having issues w/
dedup
because they weren't aware that it only works on parent tables.
k
Thank you @Jon M, still incremental shouldn't be taking the full data stream every single time, correct? Especially if the issue is not about duplicates at the moment.
I noticed that the streams failing have integer/string data types (everything else that is a TIMESTAMP seems to be working fine)
u
Hello Kevin Noguera, it's been a while without an update from us. Are you still having problems or did you find a solution?
k
Hello @Saj Dider (Airbyte), I found a solution.