I am hosting my flink application using flink kubernetes opeartor. My application has 1 jobmanager and 2 task managers. Using s3 filesystem for checkpointing and savepointing. After deploying application it works fine for 30m-1h. After this it goes to restarting state with below error. Can anyone help me.

INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Freeing task resources for SlidingEventTimeWindows -> Process (2/2)#38618 (59bbe8ba8d5d7045ee7d2aacec66e7c8_98a01397958c5196eb88cd4117e1b3ad_1_38618).
INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Un-registering task and sending final execution state FAILED to JobManager for task SlidingEventTimeWindows -> Process (2/2)#38618 59bbe8ba8d5d7045ee7d2aacec66e7c8_98a01397958c5196eb88cd4117e1b3ad_1_38618.
2023-07-02 06:31:07,254 INFO  org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot 9780cdcf42351473e6f636930c2c4d94.
2023-07-02 06:31:07,256 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Received task Source: Kafka CFTransactions -> Map -> Filter -> Timestamps/Watermarks -> Map -> Process (2/2)#38619 (59bbe8ba8d5d7045ee7d2aacec66e7c8_b5aa0fa462c5d45eec0c56cc48b37e5e_1_38619), deploy into slot with allocation id 9780cdcf42351473e6f636930c2c4d94.
2023-07-02 06:31:07,257 INFO  org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot 9780cdcf42351473e6f636930c2c4d94.
2023-07-02 06:31:07,257 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Source: Kafka CFTransactions -> Map -> Filter -> Timestamps/Watermarks -> Map -> Process (2/2)#38619 (59bbe8ba8d5d7045ee7d2aacec66e7c8_b5aa0fa462c5d45eec0c56cc48b37e5e_1_38619) switched from CREATED to DEPLOYING.
2023-07-02 06:31:07,257 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Loading JAR files for task Source: Kafka CFTransactions -> Map -> Filter -> Timestamps/Watermarks -> Map -> Process (2/2)#38619 (59bbe8ba8d5d7045ee7d2aacec66e7c8_b5aa0fa462c5d45eec0c56cc48b37e5e_1_38619) [DEPLOYING].

2023-07-02 063107,257 WARN org.apache.flink.runtime.taskmanager.Task [] - Source: Kafka CFTransactions -> Map -> Filter -> Timestamps/Watermarks -> Map -> Process (2/2)#38619 (59bbe8ba8d5d7045ee7d2aacec66e7c8_b5aa0fa462c5d45eec0c56cc48b37e5e_1_38619) switched from DEPLOYING to FAILED with failure cause: java.lang.IllegalStateException: The library registration references a different set of library BLOBs than previous registrations for this job: old:[p-954843a2fbeba5331142de719765e1b5e15d2a52-d769e111f8329e90b17813ba49062540] new:[p-954843a2fbeba5331142de719765e1b5e15d2a52-d8de14d66657f4955f18011970565412]

at org.apache.flink.runtime.execution.librarycache.BlobLibraryCacheManager$ResolvedClassLoader.verifyClassLoader(BlobLibraryCacheManager.java:419)
 at org.apache.flink.runtime.execution.librarycache.BlobLibraryCacheManager$ResolvedClassLoader.access$500(BlobLibraryCacheManager.java:359)
 at org.apache.flink.runtime.execution.librarycache.BlobLibraryCacheManager$LibraryCacheEntry.getOrResolveClassLoader(BlobLibraryCacheManager.java:235)
 at org.apache.flink.runtime.execution.librarycache.BlobLibraryCacheManager$LibraryCacheEntry.access$1100(BlobLibraryCacheManager.java:202)
 at org.apache.flink.runtime.execution.librarycache.BlobLibraryCacheManager$DefaultClassLoaderLease.getOrResolveClassLoader(BlobLibraryCacheManager.java:336)
 at org.apache.flink.runtime.taskmanager.Task.createUserCodeClassloader(Task.java:1024)
 at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:612)
 at org.apache.flink.runtime.taskmanager.Task.run(Task.java:550)
 at java.base/java.lang.Thread.run(Unknown Source)

did you find a solution to this?

@Rohil Hatalkar this was due to corrupted savepoints. I deleted all older savepoints and restarted. It worked.