Hi all, we have a requirement to test Flink on FIP...
# troubleshooting
a
Hi all, we have a requirement to test Flink on FIPS environment and have come across an issue. While I know there is no plan for adding support for FIPS but there's something I wanted to check. While testing a sample WordCount job through Flink (1.18) UI with Java11 on FIPS environment, the job completes without any issue but when testing the same sample job in Flink (1.19) and Java11/21 both fail with MD5 error during checkpoint trigger (logs in 🧵). I understand that FIPS is probably the reason for the error but wondering what would have changed from Flink 1.18 to 1.19 for checkpointing that causes this exception. Some more context on the configuration, my
state.backend.type
is set to
rocksdb
for both 1.18 and 1.19. But updating the state backend to
hashmap
resolves this error in 1.19 as well. Note: we have to use
rocksdb
due to the the type of job in production. Thanks!
Copy code
2025-01-24 19:05:37,843 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Triggering a manual checkpoint for job 6dd772858e246d271446050897ad8e19.
2025-01-24 19:05:37,903 INFO  org.apache.flink.runtime.checkpoint.CheckpointCoordinator    [] - Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1737745537847 for job 6dd772858e246d271446050897ad8e19.
An OpenSSL error occurred
error:0308010C:digital envelope routines::unsupported
error:03000086:digital envelope routines::initialization error
2025-01-24 19:05:38,216 ERROR org.apache.flink.util.FatalExitExceptionHandler              [] - FATAL: Thread 'jobmanager-io-thread-1' produced an uncaught exception. Stopping the process...
java.lang.InternalError: MD5 not supported
	at java.util.UUID.nameUUIDFromBytes(Unknown Source) ~[?:?]
	at org.apache.flink.runtime.state.SharedStateRegistryKey.forStreamStateHandle(SharedStateRegistryKey.java:51) ~[flink-dist-1.19.1.jar:1.19.1]
...
	at org.apache.flink.runtime.scheduler.ExecutionGraphHandler.lambda$processCheckpointCoordinatorMessage$4(ExecutionGraphHandler.java:139) ~[flink-dist-1.19.1.jar:1.19.1]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[?:?]
	at java.lang.Thread.run(Unknown Source) [?:?]
Caused by: java.security.NoSuchAlgorithmException: Error constructing implementation (algorithm: MD5, provider: SUN, class: sun.security.provider.NativeMD5)
	at java.security.Provider$Service.newInstance(Unknown Source) ~[?:?]
	at sun.security.jca.GetInstance.getInstance(Unknown Source) ~[?:?]
	at sun.security.jca.GetInstance.getInstance(Unknown Source) ~[?:?]
	at java.security.MessageDigest.getInstance(Unknown Source) ~[?:?]
	... 12 more
Caused by: java.security.ProviderException: Error in Native Digest
	at sun.security.provider.NativeDigest.<init>(Unknown Source) ~[?:?]
	at sun.security.provider.NativeMD5.<init>(Unknown Source) ~[?:?]
	... 12 more