https://flink.apache.org/ logo
Join Slack
Powered by
Hi all, I am running into following issue in the `...
# troubleshooting
p
Hi all, I am running into following issue in the 
SinkMaterializer
Both the source and sink are kafka topics, and I am using 
kafka
connector for the source and 
upsert-kafka
connector for the sink. Do we know when this can happen? Any help is appreciated.
Copy code
2023-08-29 03:36:46,974 DEBUG org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher [] - Prepare to run FetchTask
2023-08-29 03:36:46,974 WARN  org.apache.flink.runtime.taskmanager.Task                    [] - SinkMaterializer[9] -> Sink: Writer (62/64)#10 (db01459f850309e7e53226dcd6c97a52_2a54602b85383a59e736b0497a33bc7a_61_10) switched from RUNNING to FAILED with failure cause: java.lang.IllegalArgumentException: Row arity: 21, but serializer arity: 22
	at org.apache.flink.table.runtime.typeutils.RowDataSerializer.copy(RowDataSerializer.java:124)
	at org.apache.flink.table.runtime.typeutils.RowDataSerializer.copy(RowDataSerializer.java:48)
	at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.pushToOperator(CopyingChainingOutput.java:80)
	at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:57)
	at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:29)
	at org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:56)
	at org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:29)
	at org.apache.flink.streaming.api.operators.TimestampedCollector.collect(TimestampedCollector.java:51)
	at org.apache.flink.table.runtime.operators.sink.SinkUpsertMaterializer.retractRow(SinkUpsertMaterializer.java:194)
	at org.apache.flink.table.runtime.operators.sink.SinkUpsertMaterializer.processElement(SinkUpsertMaterializer.java:152)
	at org.apache.flink.streaming.runtime.tasks.OneInputStreamTask$StreamTaskNetworkOutput.emitRecord(OneInputStreamTask.java:233)
	at org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.processElement(AbstractStreamTaskNetworkInput.java:134)
	at org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.emitNext(AbstractStreamTaskNetworkInput.java:105)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:545)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:836)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:785)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:935)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:914)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:728)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:550)
	at java.base/java.lang.Thread.run(Unknown Source)

2023-08-29 03:36:46,974 DEBUG org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher [] - Finished running task FetchTask
2023-08-29 03:36:46,974 DEBUG org.apache.flink.runtime.checkpoint.channel.ChannelStateWriterImpl [] - close, dropping checkpoints []
2023-08-29 03:36:46,974 DEBUG org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher [] - Cleaned wakeup flag.
2023-08-29 03:36:46,974 DEBUG org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher [] - Prepare to run FetchTask
2023-08-29 03:36:46,974 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Freeing task resources for SinkMaterializer[9] -> Sink: Writer (62/64)#10 (db01459f850309e7e53226dcd6c97a52_2a54602b85383a59e736b0497a33bc7a_61_10).
2023-08-29 03:36:46,974 DEBUG org.apache.flink.runtime.taskmanager.Task                    [] - Release task SinkMaterializer[9] -> Sink: Writer (62/64)#10 network resources (state: FAILED).
2023-08-29 03:36:46,974 DEBUG org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate [] - SinkMaterializer[9] -> Sink: Writer (62/64)#10 (db01459f850309e7e53226dcd6c97a52_2a54602b85383a59e736b0497a33bc7a_61_10): Releasing SingleInputGate{owningTaskName='SinkMaterializer[9] -> Sink: Writer (62/64)#10 (db01459f850309e7e53226dcd6c97a52_2a54602b85383a59e736b0497a33bc7a_61_10)', gateIndex=0}.
2023-08-29 03:36:46,975 DEBUG org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher [] - Finished running task FetchTask
Open in Slack
PreviousNext
Powered by