Hi! I've been struggling to use stripe as a source...
# advice-data-ingestion
m
Hi! I've been struggling to use stripe as a source in incremental mode. I get the last/first record duplicated each time in my output. Each time it runs, it seems to store the unix timestamp (
created
) field for the most recent record in the
Connection State
e.g.:
Copy code
Connection State
{
  "refunds": {
    "created": 1660045125
  }
}
Then next time it runs, it picks up the most recent record from the previous run again. For this example I get the the same record with
created=1660045125
in my output at end of first run, and start of next incremental run. So I end up having duplicates of the last/first record each time the incremental run works. E.g. it's doing something like
where created >= X
rather than
where created > X
. Is this behaviour anyone else has seen? I have to use full refresh as a workaround for now, which is of course much slower. Any help would be great! Is it a bug?