I am playing a bit with the autoscaler in the Kube...
# troubleshooting
a
I am playing a bit with the autoscaler in the Kubernetes operator and then I get a NPE πŸ˜„
Copy code
Normal   ScalingReport    5m54s                    Operator  Scaling execution enabled, begin scaling vertices:{ Vertex ID 668b31f59e4cb0a2f303253eadd20e77 | Parallelism 4 -> 2 | Processing capacity Infinity -> Infinity | Target data rate 0.00}{ Vertex ID 24930633dd958a30c94625ffd478ef59 | Parallelism 4 -> 2 | Processing capacity Infinity -> Infinity | Target data rate 0.00}                                                                                                                                                    Warning  AutoscalerError  15s (x49093 over 5d23h)  Operator  java.lang.NullPointerException                                                                                             at org.apache.flink.kubernetes.operator.autoscaler.KubernetesScalingRealizer.realizeParallelismOverrides(KubernetesScalingRealizer.java:52)                                    at org.apache.flink.kubernetes.operator.autoscaler.KubernetesScalingRealizer.realizeParallelismOverrides(KubernetesScalingRealizer.java:40)                                    at org.apache.flink.autoscaler.JobAutoScalerImpl.applyParallelismOverrides(JobAutoScalerImpl.java:166)                                                                         at org.apache.flink.autoscaler.JobAutoScalerImpl.scale(JobAutoScalerImpl.java:111)                                                                                             at org.apache.flink.kubernetes.operator.reconciler.deployment.AbstractFlinkResourceReconciler.applyAutoscaler(AbstractFlinkResourceReconciler.java:209)                        at org.apache.flink.kubernetes.operator.reconciler.deployment.AbstractFlinkResourceReconciler.reconcile(AbstractFlinkResourceReconciler.java:132)                              at org.apache.flink.kubernetes.operator.controller.FlinkSessionJobController.reconcile(FlinkSessionJobController.java:121)                                                     at org.apache.flink.kubernetes.operator.controller.FlinkSessionJobController.reconcile(FlinkSessionJobController.java:58)                                                      at io.javaoperatorsdk.operator.processing.Controller$1.execute(Controller.java:153)                                                                                            at io.javaoperatorsdk.operator.processing.Controller$1.execute(Controller.java:111)                                                                                            at org.apache.flink.kubernetes.operator.metrics.OperatorJosdkMetrics.timeControllerExecution(OperatorJosdkMetrics.java:80)                                                     at io.javaoperatorsdk.operator.processing.Controller.reconcile(Controller.java:110)                                                                                            at io.javaoperatorsdk.operator.processing.event.ReconciliationDispatcher.reconcileExecution(ReconciliationDispatcher.java:136)                                                 at io.javaoperatorsdk.operator.processing.event.ReconciliationDispatcher.handleReconcile(ReconciliationDispatcher.java:117)                                                    at io.javaoperatorsdk.operator.processing.event.ReconciliationDispatcher.handleDispatch(ReconciliationDispatcher.java:91)                                                      at io.javaoperatorsdk.operator.processing.event.ReconciliationDispatcher.handleExecution(ReconciliationDispatcher.java:64)                                                     at io.javaoperatorsdk.operator.processing.event.EventProcessor$ReconcilerExecutor.run(EventProcessor.java:452)                                                                 at ja...
It seems to be that
context.getResource().getSpec().getFlinkConfiguration()
is
null
and leading to NPE.
Copy code
jobmanager.scheduler : adaptive
    job.autoscaler.enabled : "true"
    job.autoscaler.catch-up.duration: 5m

    # https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-release-1.11/docs/custom-resource/autotuning/#memory-autotuning
    job.autoscaler.memory.tuning.enabled: "false"
    job.autoscaler.memory.tuning.maximize-managed-memory: "true"
    job.autoscaler.memory.tuning.overhead: "0.2"

    job.autoscaler.metrics.window: 5m
    job.autoscaler.restart.time: 2m
    job.autoscaler.scaling.enabled : "true"
    job.autoscaler.stabilization.interval : 1m
    job.autoscaler.target.utilization: "0.6"
    job.autoscaler.target.utilization.boundary: "0.2"
A pre-emptive thank you :D