Airbyte is an open-source data integration engine that helps you consolidate your data in your data warehouses, lakes and databases.

Airbyte

<@U02TFM12THU> let me know if that all makes sense!

Hey <@U0245BV73LP>, I think the key here is to implement a `stream_slices` method on `IncrementalLeverHiringStream` to replace interval-based checkpointing by stream slices + enable the use of cache.
I drafted an untested example, let me know if it makes sense.

Thanks <@U02UC3T12PJ>! Would calling `opportunities_stream.read_records(sync_mode=SyncMode.incremental ...`  with incremental affect the  opportunities saved state in the db?

And I guess a few other questions -
1. There’s no `updatedAt` cursor field in the opportunity child streams, so how can I get the incremental state for child streams saved?


&gt; Thanks <@U02UC3T12PJ>! Would calling `opportunities_stream.read_records(sync_mode=SyncMode.incremental ...`  with incremental affect the  opportunities saved state in the db?
If these records are read from the cache I don't think it will affect the state.

&gt; And I guess a few other questions -
&gt; 1. There’s no `updatedAt` cursor field in the opportunity child streams, so how can I get the incremental state for child streams saved?
Do you think the opportunity_id could be used as a cursor field for these child streams?