Viacheslav Chernyshev
02/27/2023, 10:29 AMKeyedCoProcessFunction s into the pipeline. As far as I can see, these operators are currently not chainable. Subsequently, they are forced to go through a "network" serialisation barrier here, despite having exactly the same parallelism. I find it a bit unexpected and wonder if there is a way to avoid it. Example job graph:
Source A -> keyBy(A) --+-> KeyedCoProcess -> Sink
/
Source B -> keyBy(B) +
If I have either Source A -> keyBy(A) -> KeyedProcess -> Sink or Source B -> keyBy(B) -> KeyedProcess -> Sink independently, then everything after keyBy is chained as expected and the information is passed without extra serialisation.