Hi. I was exploring different ETL tools for my work. We have a need to extract data from a few sources and drop them into S3. One of the APIs is time sensitive. Does airbyte open source have built in logging or state if we want to make sure we have not missed any windows?

If your source has the option to run a incremental sync the state is saved in the airbyte database so you can check the window

so the endpoint has a start and stop date values for input. Would this be saved in the state?

Hi @koryd2718 this depends of the connector, if your source API is part of our connector list I'll be able to give more accurate answer. If it's not you'll have to write a custom connector, on our CDK (connector development kit) definitely offer the logic to handle this kind of use case through state management and incremental data load.