Hello Everyone,
How do I set maxParallelism for a sink operator? , I am using flink operator autoscaler feature and just setting global maxParallelism is scaling sink to much higher parallelism. I want to avoid this.
g
Gyula Fóra
09/29/2023, 5:57 AM
If you don’t want to scale your sink there is a config to exclude some vertices from the autoscaler
s
Sumit Nekar
09/29/2023, 5:58 AM
kubernetes.operator.job.autoscaler.vertex.exclude.ids
What will be vertexId here. Vertex Id is assigned by flink at runtime right? How can user get the vertex id
g
Gyula Fóra
09/29/2023, 6:22 AM
You can check this on the Flink ui for example , not the most user friendly feature but we don’t have anything better at the moment
s
Sumit Nekar
09/29/2023, 6:34 AM
sure thanks
Sumit Nekar
11/17/2023, 5:19 AM
is there any better way to exclude some vertices in flink 1.18 or operator 1.6?