Hi, guys. I'm having an issue with the `flink k8s ...
# random
h
Hi, guys. I'm having an issue with the
flink k8s operator
, when I submit a lot of jobs at once to the session cluster at one time, there is a timeout exception in the
FlinkSessionJobStatus.gerError
, but then the k8s will pull the jobs up again. I would like to ask why this timeout issue is there and what to do about it
Copy code
java.util.concurrent.CompletionException: java.lang.RuntimeException: java.lang.RuntimeException: {"type":"org.apache.flink.kubernetes.operator.exception.ReconciliationException","message":"org.apache.flink.util.FlinkRuntimeException: java.util.concurrent.TimeoutException","additionalMetadata":{},"throwableList":[{"type":"org.apache.flink.util.FlinkRuntimeException","message":"java.util.concurrent.TimeoutException","additionalMetadata":{}},{"type":"java.util.concurrent.TimeoutException","additionalMetadata":{}}]}
    at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:314)
    at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:319)
    at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1702)
    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
    at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: {"type":"org.apache.flink.kubernetes.operator.exception.ReconciliationException","message":"org.apache.flink.util.FlinkRuntimeException: java.util.concurrent.TimeoutException","additionalMetadata":{},"throwableList":[{"type":"org.apache.flink.util.FlinkRuntimeException","message":"java.util.concurrent.TimeoutException","additionalMetadata":{}},{"type":"java.util.concurrent.TimeoutException","additionalMetadata":{}}]}
    at org.apache.streampark.flink.kubernetes.v2.operator.FlinkK8sOperator$.start(FlinkK8sOperator.scala:88)
    at org.apache.streampark.flink.kubernetes.v2.operator.FlinkK8sOperator.start(FlinkK8sOperator.scala)
    at org.apache.streampark.console.core.service.impl.JobServiceImpl.lambda$start$0(JobServiceImpl.java:149)
    at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1700)
    ... 3 more
Caused by: java.lang.RuntimeException: {"type":"org.apache.flink.kubernetes.operator.exception.ReconciliationException","message":"org.apache.flink.util.FlinkRuntimeException: java.util.concurrent.TimeoutException","additionalMetadata":{},"throwableList":[{"type":"org.apache.flink.util.FlinkRuntimeException","message":"java.util.concurrent.TimeoutException","additionalMetadata":{}},{"type":"java.util.concurrent.TimeoutException","additionalMetadata":{}}]}
    at org.apache.streampark.flink.kubernetes.v2.operator.FlinkK8sOperator$.start(FlinkK8sOperator.scala:82)
    ... 6 more
g
can you please open a JIRA ticket and include the operator logs + the CR status if possible?
h
Okay, I'm going to open a JIRA to discuss this