Hi all,Im using flink cdc sync mysql to doris,and ...
# troubleshooting
z
Hi all,Im using flink cdc sync mysql to doris,and it raised exception
Copy code
Caused by: org.apache.flink.util.FlinkRuntimeException: Exceeded checkpoint tolerable failure threshold. The latest checkpoint failed due to Asynchronous task checkpoint failed., view the Checkpoint History tab or the Job Manager log to find out why continuous checkpoints failed.
and the task manager raised exception
Size of the state is larger than the maximum permitted memory-backed state. Size=22493170, maxSize=5242880. Consider using a different checkpoint storage, like the FileSystemCheckpointStorage.
should I Expansion the task manager's memory or add some code in my Java thx a lot
d
If you have the resources available you can expand the task managers memory
The other option which you can also try is what was suggested. I think most simple is rocksdb.
Copy code
env.enableCheckpointing(interval);
env.getCheckpointConfig().setCheckpointStorage("file:///path/to/checkpoints");
env.setStateBackend(new RocksDBStateBackend("file:///path/to/checkpoint/rdb", true));
z
It‘ right,this article helped me slove the problem thx https://nightlies.apache.org/flink/flink-docs-master/zh/docs/ops/state/checkpoints/
d
Ok, great.