Hello team! Can someone help me understand how incremental streams interplay with child sub streams, please?
Specifically, I’m using the Lever Hiring connector where there’s an incremental stream called Opportunities. Opportunities has multiple child streams, which stream slices of opportunities at a full refresh.
How can I make those child streams also incremental?
02/09/2022, 4:01 AM
Hey you can take a look at source-gitlab. I hope it helps
02/11/2022, 12:45 AM
Thanks @Harshith (Airbyte) . I took a look at the gitlab source but unfortunately I can't use their method. Gitlabs child streams are themselves incremental. Whereas in lever the child streams are not incremental, rather the parent stream is. My goal is to only call the child streams for the results returned from the parent’s incremental stream.
Does that make sense?