I previously played with a custom singer tap and it worked well. I’m curious about manual reusability and if this is a legitimate workflow.
We have a tap that I tested previously and never productionalized. But it pulls an API endpoint of updated customers, then creates a stream from the list of returned customer ids and calls a customer/<id> endpoint per customer. However sometimes we’d like to provide a ‘backfill’ list of customer ids to fetch rather than just the updated endpoint. Is it possible to implement that behavior? It’d be a sizable list like 1M ids or so