Looking for a little job design advice. I have a s...
# random
n
Looking for a little job design advice. I have a streaming application working well. Occasionally, I'll have files I want to process as a batch. It would mess with watermarks and such to run it through the regular streaming pipeline, so I think I need to set up either a way to submit batch jobs or another streaming application that handles my batch data when submitted. Any tips for this use case?
Currently using the kubernetes operator in case that's helpful to know