Hi, we have installed `flink-kubernetes-operator v...
# troubleshooting
a
Hi, we have installed
flink-kubernetes-operator v1.7.0
on OCP in a namespace which starts with a number for example
2024-flink
. When we create a CR we noticed the below error in the operator pod:
Copy code
[m[33m2024-05-15 16:25:02,838[m [36mi.j.o.p.e.ReconciliationDispatcher[m [1;31m[ERROR][123-flink/flink-test] Error during event processing ExecutionScope{ resource id: ResourceID{name='flink-test', namespace='2024-flink'}, version: 838807} failed.
org.apache.flink.kubernetes.operator.exception.ReconciliationException: java.lang.IllegalArgumentException: hostname can't be null
	at org.apache.flink.kubernetes.operator.controller.FlinkDeploymentController.reconcile(FlinkDeploymentController.java:148)
Upon further investigation we found https://issues.apache.org/jira/browse/FLINK-33917 which seemed to be similar to what we faced. Upon updating our operator code with the fix the issue did get resolved or rather the error went away but we saw another error
Copy code
2024-05-15 16:30:52,455 o.a.f.k.o.o.d.SessionObserver [ERROR][2202prod/flink-ssl] REST service in session cluster timed out
java.util.concurrent.TimeoutException
at java.base/java.util.concurrent.CompletableFuture.timedGet(Unknown Source)
at java.base/java.util.concurrent.CompletableFuture.get(Unknown Source)
at org.apache.flink.kubernetes.operator.service.AbstractFlinkService.listJobs(AbstractFlinkService.java:261)
at org.apache.flink.kubernetes.operator.observer.deployment.SessionObserver.observeFlinkCluster(SessionObserver.java:39)
and this is causing the job-manager and task-manager to fail with below error:
Copy code
Caused by: java.lang.Exception: Could not retrieve InetSocketAddress from Pekko URL pekko.tcp://flink@session-cluster-quick-start.2024-flink:6123/user/rpc/resourcemanager_*
	at org.apache.flink.runtime.rpc.pekko.PekkoUtils.getInetSocketAddressFromRpcURL(PekkoUtils.java:567) ~[?:?]
	at org.apache.flink.runtime.rpc.pekko.PekkoRpcSystem.getInetSocketAddressFromRpcUrl(PekkoRpcSystem.java:48) ~[?:?]
Not sure if the operand also requires some kind of update where the URI parser is failing or if there's some other issue? Thanks!