Hello Flink community, I have a question about a s...
# troubleshooting
x
Hello Flink community, I have a question about a strange issue I saw when I ran my flink job with Async IO operators . My job(parallelism == 1) will try to reach an flask external endpoint and use the result to query keyspace tables(separate steps), when I run some load tests(about 5 requests per second) on my flink job, I can see about half of the requests failed due to timeout, but some succeeded, and when I rerun it the second time, all the http requests failed due to
timeout
even for the keyspaces look up, which had not happened before. It almost looks like the thread pool is exhausted or the cluster blocked any outbound traffic. The external endpoint should be able to handle at least some traffic, any insights? Thanks!