hello everyone 😉 I’m developing connector for API that allows me to specify

lastmodified

as a query param and returns rows without any information about modification time. My 2 concerns: • because I don’t have timestamp information in rows I need to take into consideration potential problems with upstream -> overlapping (e.g. grab 2 days instead of 1 during pull) is my only idea how to minimize - is that correct/‘the way’ with that API? • I want to emit state after all slices are processed - is it idiomatic to yield airbyte state message in

AbstractSource.read

? thanks in advance! have a nice day ☺️

loading...

loading...

Hey @Mariusz Wojakowski these are really interesting questions. Do you mind posting these two questions separately on our Discourse forum? Our team will try to answer there.

ok, thanks!