Pavan
07/02/2024, 12:23 PMstate.checkpoint-storage to use the filesystem, with checkpoints and savepoints configured to an S3 bucket.
While I am able to host Flink, I encounter an error when attempting to submit the new JAR from the dashboard.
The error is as follows:
2024-07-02 12:08:25,507 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Job278686382676784632786 reached terminal state FAILED.
org.apache.flink.runtime.client.JobInitializationException: Could not start the JobMaster.
at org.apache.flink.runtime.jobmaster.DefaultJobMasterServiceProcess.lambda$new$0(DefaultJobMasterServiceProcess.java:97)
at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(Unknown Source)
at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(Unknown Source)
at java.base/java.util.concurrent.CompletableFuture.postComplete(Unknown Source)
at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.CompletionException: java.lang.RuntimeException: java.io.FileNotFoundException: Cannot find meta data file '_metadata' in directory 's3://test/savepoints'. Please try to load the checkpoint/savepoint directly from the metadata file instead of the directory.
at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(Unknown Source)
at java.base/java.util.concurrent.CompletableFuture.completeThrowable(Unknown Source)
... 4 more
Caused by: java.lang.RuntimeException: java.io.FileNotFoundException: Cannot find meta data file '_metadata' in directory 's3://test/savepoints'. Please try to load the checkpoint/savepoint directly from the metadata file instead of the directory.
at org.apache.flink.util.ExceptionUtils.rethrow(ExceptionUtils.java:321)
at org.apache.flink.util.function.FunctionUtils.lambda$uncheckedSupplier$4(FunctionUtils.java:114)
Why I am getting this error for new JAR?
Any assistance in resolving this issue would be greatly appreciated.Pedro Mázala
07/02/2024, 2:01 PMPavan
07/02/2024, 2:40 PM// set state backend
configuration.setString("state.backend", "filesystem");
// set the checkpoint directory, which is required by the RocksDB state backend
configuration.setString("state.checkpoints.dir", properties.getProperty("checkpoints.dir"));
configuration.setString("state.checkpoint-storage", "filesystem");
// set the savepoint directory
configuration.setString("state.savepoints.dir", properties.getProperty("savepoints.dir"));
configuration.setString("execution.savepoint.path", properties.getProperty("savepoint.path"));
configuration.setString("execution.savepoint-restore-mode", "CLAIM");
let me know if I have configured something incorrectly?Pavan
07/02/2024, 2:47 PMSaurabh Singh
07/03/2024, 7:33 AMtest folder already created in the S3 bucket?Pavan
07/03/2024, 12:45 PMPavan
07/03/2024, 12:45 PMexecution.savepoint.path. This tells Flink not to restore from any specific savepoint.
This was configured on my jar hence it was looking for savepoint