מייקי בר יעקב
02/25/2025, 10:12 PMPedro Mázala
02/26/2025, 10:21 AMpollNext ?
You'd also have the possibility to use isEndOfStream on your deserializer.
How are you willing to control the stop of the stream? Specific record?
And why it only works out with parallelism=1 ? Is it only killing the task that ``pollNext`` stops it?Pedro Mázala
02/27/2025, 8:35 AMpollNext ? Perhaps you need to adapt it to amount of splits / parallelism due to each task taking over part of the process. This would be the way only if the data is evenly spread across each parallel task tho