Aniruddh Jhavar
05/15/2024, 6:27 PMflink-kubernetes-operator v1.7.0 on OCP in a namespace which starts with a number for example 2024-flink . When we create a CR we noticed the below error in the operator pod:
[m[33m2024-05-15 16:25:02,838[m [36mi.j.o.p.e.ReconciliationDispatcher[m [1;31m[ERROR][123-flink/flink-test] Error during event processing ExecutionScope{ resource id: ResourceID{name='flink-test', namespace='2024-flink'}, version: 838807} failed.
org.apache.flink.kubernetes.operator.exception.ReconciliationException: java.lang.IllegalArgumentException: hostname can't be null
at org.apache.flink.kubernetes.operator.controller.FlinkDeploymentController.reconcile(FlinkDeploymentController.java:148)
Upon further investigation we found https://issues.apache.org/jira/browse/FLINK-33917 which seemed to be similar to what we faced. Upon updating our operator code with the fix the issue did get resolved or rather the error went away but we saw another error
2024-05-15 16:30:52,455 o.a.f.k.o.o.d.SessionObserver [ERROR][2202prod/flink-ssl] REST service in session cluster timed out
java.util.concurrent.TimeoutException
at java.base/java.util.concurrent.CompletableFuture.timedGet(Unknown Source)
at java.base/java.util.concurrent.CompletableFuture.get(Unknown Source)
at org.apache.flink.kubernetes.operator.service.AbstractFlinkService.listJobs(AbstractFlinkService.java:261)
at org.apache.flink.kubernetes.operator.observer.deployment.SessionObserver.observeFlinkCluster(SessionObserver.java:39)
and this is causing the job-manager and task-manager to fail with below error:
Caused by: java.lang.Exception: Could not retrieve InetSocketAddress from Pekko URL pekko.tcp://flink@session-cluster-quick-start.2024-flink:6123/user/rpc/resourcemanager_*
at org.apache.flink.runtime.rpc.pekko.PekkoUtils.getInetSocketAddressFromRpcURL(PekkoUtils.java:567) ~[?:?]
at org.apache.flink.runtime.rpc.pekko.PekkoRpcSystem.getInetSocketAddressFromRpcUrl(PekkoRpcSystem.java:48) ~[?:?]
Not sure if the operand also requires some kind of update where the URI parser is failing or if there's some other issue? Thanks!