Hey all, noticed some odd behavior in latest Snowf...
# replication-troubleshooting
r
Hey all, noticed some odd behavior in latest Snowflake connector. Currently we have it set to full refresh, and the first sync successfully pulls in all the records. But subsequent syncs bring in 0 records. If we do a data reset, same behavior happens where first sync succeeds with all records, then subsequent syncs don't bring in anything. This almost seems to act like an incremental sync despite us selecting full refresh. Has anyone else ran into this/is this a known issue with the current snowflake connector? Any help or context is appreciated, thank you!
s
We get that too, but it eventually starts syncing if we just leave it. Does your sync 0 records "forever"? Ours usually catches up within a day
r
Looks like it's been couple days, still stuck at 0
What would be the explanation behind it eventually catching up? I haven't dug into the source code too much since I'm not familiar with Kotlin*
s
We only have a partial theory - we've no actual idea why it happens. And we assume it's from the size of our data (2B rows, almost 1GB of data synced every 2 hours). So if you have a smaller amount of data, then we truly have no idea 😅