Hi, I am doing a POC with Kubernetes operator 1.8 ...
# troubleshooting
s
Hi, I am doing a POC with Kubernetes operator 1.8 and flink 1.18 version with Reactive mode enabled, I added some dummy slow and fast operator to the flink job and i can see there is a back pressure accumulated. but i am not sure why my Flink task managers are not scaled by the operator. Also, can someone explain if autoscalers job is just to add more task manager and then Reactive mode will adjust the parallelism based on the configurations? As per the Operator documentation -
Users configure the target utilization percentage of the operators in the pipeline, e.g. keep the all operators between 60% - 80% busy. The autoscaler then finds a parallelism configuration such that the output rates of all operators match the input rates of all their downstream operators at the targeted utilization.
So does the autoscaler(Part of kubernetes operator) controls the parallelism or the Reactive mode in the Flink job controls it.