Hi, I am getting this error when I try to write to...
# troubleshooting
d
Hi, I am getting this error when I try to write to an SQS sink
Copy code
java.lang.RuntimeException: java.util.concurrent.TimeoutException
	at software.amazon.awssdk.http.nio.netty.internal.AwaitCloseChannelPoolMap.close(AwaitCloseChannelPoolMap.java:177)
	at software.amazon.awssdk.http.nio.netty.internal.utils.NettyUtils.runAndLogError(NettyUtils.java:386)
	at software.amazon.awssdk.http.nio.netty.NettyNioAsyncHttpClient.close(NettyNioAsyncHttpClient.java:198)
	at org.apache.flink.connector.kinesis.source.proxy.KinesisAsyncStreamProxy.close(KinesisAsyncStreamProxy.java:64)
	at org.apache.flink.connector.kinesis.source.reader.fanout.FanOutKinesisShardSplitReader.close(FanOutKinesisShardSplitReader.java:93)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:124)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: java.util.concurrent.TimeoutException
	at java.base/java.util.concurrent.CompletableFuture.timedGet(CompletableFuture.java:1886)
	at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2021)
	at software.amazon.awssdk.http.nio.netty.internal.AwaitCloseChannelPoolMap.close(AwaitCloseChannelPoolMap.java:172)
	... 10 more
Some more info
Copy code
"locationInformation": "software.amazon.awssdk.http.nio.netty.internal.utils.NettyClientLogger.error(NettyClientLogger.java:100)",
    "logger": "software.amazon.awssdk.http.nio.netty.NettyNioAsyncHttpClient",
    "message": "Unable to close channel pools",
    "messageSchemaVersion": "1",
    "messageType": "ERROR",
    "threadName": "Source Data Fetcher for Source: Kinesis String Source -> (Sink: Print to Std. Out, Sink: Writer) (1/1)#6",
Flink is manged by AWS and it doesn't give me more information than this. Anyone else ran into issues with sqs sinks? Thank you
h
Hey, this exception is coming from the Kinesis sink instead of the SQS sink. Can I confirm which sinks you are using?
d
I am using kinesis as a consumer and sqs as a sink, stdout is just for debugging.
h
Ah yes sorry this is Kinesis source
Maybe just try without using the kinesis source first?
d
will give it a try
indeed it seems like the sqs sink handled local data fine, so the kinesis stream is causing this error