Hey there folks. Flink startup time is something around 3 minutes on my side.
• Standalone cluster
• Source is Kafka
• HA k8s enabled
◦ Write stuff on GCS
• k8s Flink operator
Do you guys use a similar setup and have a shorter startup time?
s
Sricharan
05/27/2024, 5:00 PM
I see less than 1 min or some times if there is any delay in acquiring resources it would take 5 min. I have 2 min checkpoint and had to adjust checkpoint configuration.
g
Gyula Fóra
05/27/2024, 5:46 PM
Usually resource acquisition time is the dominant factor which can be very different between the Kubernetes envs / providers
p
Pedro Mázala
05/28/2024, 8:34 AM
But this time is only considering after pod creation. it means the resources were acquired.
s
Sricharan
05/29/2024, 7:01 AM
Is 3 min the time from INITIALIZATION to RUNNING ?
p
Pedro Mázala
05/29/2024, 7:03 AM
It's not related to checkpoint interval. I'm questioning the time from "deploying" state to "running" state. Before the completition of a chexkpoint