@kapa.ai inspectlet API is not Supporting Incremental, getting same set of record each time when sync is given, is there any other approach

If the Inspectlet API does not support incremental sync, you might need to consider other approaches. One of the methods discussed in the Airbyte community is to create a unique field for each record, such as an md5sum hash of the record. Then, you can create a destination connector where data would be written to disk (like json lines), and ensure that these files do not contain entries with incoming unique hashes. However, this approach might not be the most efficient if you have a lot of data to sync, as the cost of checking in the destination if the record exists could be high [[source](https://discuss.airbyte.io/t/885)]. Another approach could be to use a different incremental approach based on binary logs, Write-Ahead-Logs (WAL), or also called Change Data Capture (CDC). This could solve concerns related to missing intermediate modifications to the data [[source](https://docs.airbyte.com/using-airbyte/core-concepts/sync-modes/incremental-append#known-limitations)]. However, it's important to note that these are general approaches and might not be applicable or efficient for your specific use case with the Inspectlet API. It's recommended to understand the API's capabilities and limitations thoroughly before deciding on an approach.