Mateusz Lewandowski
03/21/2023, 11:59 PMtable.exec.mini-batch.size as it requires setting mini-batch.allow-latency, and the time needed to process each mini-batch differ a lot. Also I want to have exact 1000 batch size for input only, and not for every operator in the pipeline. I tried to set up a custom watermark strategy to advance watermarks every 1000 items, but it seems these watermarks are ignored for nonwindowed operations (they seem not to perform buffering for plain groupbys).
Can anyone relate to this?Mateusz Lewandowski
03/22/2023, 12:57 PM