Hi Team! I am having trouble running streaming job...
# troubleshooting
e
Hi Team! I am having trouble running streaming job. From nowhere I get this error:
Copy code
2023-08-02 12:13:04
java.lang.IllegalStateException: The library registration references a different set of library BLOBs than previous registrations for this job:
old:[p-275820cb9b5e36c9f3e1e5483e93d0b808fe257e-3978d0a9e10fc353bed49fdce5c5c6a9]
new:[p-275820cb9b5e36c9f3e1e5483e93d0b808fe257e-810951a32f2c50289fad972fb5701863]
	at org.apache.flink.runtime.execution.librarycache.BlobLibraryCacheManager$ResolvedClassLoader.verifyClassLoader(BlobLibraryCacheManager.java:419)
	at org.apache.flink.runtime.execution.librarycache.BlobLibraryCacheManager$ResolvedClassLoader.access$500(BlobLibraryCacheManager.java:359)
	at org.apache.flink.runtime.execution.librarycache.BlobLibraryCacheManager$LibraryCacheEntry.getOrResolveClassLoader(BlobLibraryCacheManager.java:235)
	at org.apache.flink.runtime.execution.librarycache.BlobLibraryCacheManager$LibraryCacheEntry.access$1100(BlobLibraryCacheManager.java:202)
	at org.apache.flink.runtime.execution.librarycache.BlobLibraryCacheManager$DefaultClassLoaderLease.getOrResolveClassLoader(BlobLibraryCacheManager.java:336)
	at org.apache.flink.runtime.taskmanager.Task.createUserCodeClassloader(Task.java:1041)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:624)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:562)
	at java.base/java.lang.Thread.run(Unknown Source)
From this channel I read that this is due to corrupted checkpoints. How to fix it and make sure it never happens? Thank you!
k
do you have any flink classes that you overwrote?
e
Hi! No, I have not
k
i resolved the issue by overwriting `BlobLibraryCacheManager`’s behaviour so that when cached libs do not match, classes are re-loaded!
🔥 1
e
Cool! Where can I see it?
k
sorry, i don’t have the code published as i have directly modified the
flink-runtime
package and basically replaced the default
flink-runtime
package in flink.