Hello, I have created a connector for a servicesno...
# connector-development
m
Hello, I have created a connector for a servicesnow API. Is there a possibility to retrieve the data by date? that in each execution it brings me the data of the following date, or the possibility of doing backfill for each day. at the moment I have only been able to recover the same data using the same endpoint fetch all data and overwrite would not be a good practice
Copy code
<https://mycompany.service-now.com/api/now/v1/table/incident?sysparm_offset=0&sysparm_limit=1000000&sysparm_query=sys_created_on>>=2020-01-01 08:00^sys_created_on<2021-12-02 08:00^active=ISNOTEMPTY
d
Hey if you looking to build incremental setup in connector you can look at this doc https://docs.airbyte.com/connector-development/cdk-python/incremental-stream
@Harshith (Airbyte) I think that the documentation is not clear.
state_checkpoint_interval = 100
- Where I need to put this parameter? • how I use it? is it only need to put in?
I think you can use stream_slices