Hi all, is it possible to submit a job change / up...
# troubleshooting
s
Hi all, is it possible to submit a job change / upgrade a Kafka job (when submitting to flink) have zero downtime in some form? Any thoughts how people handle this today?
m
No, there is always some downtime involved
You can of course create something that dynamically updates your business logic, but any Flink upgrade will always require some downtime
s
What are the alternatives? To avoid downtime
m
You can only work on minimizing downtime, by creating something like a secondary cluster on standby with your upgraded stuff and then shutting down your active cluster and starting your new cluster. Or work on a blue/green deployment model
s
Thanks Martijin. So natively there’s no job resilience unless we do bring up a standby
m
There is job resilience, but not without downtime
s
I see! So most of the flink users plan for downtime? Or blue/green deployments?
m
Blue/green deployments or hot/standby clusters are common yes
s
Pretty good resource on this:

https://www.youtube.com/watch?v=Hyt3YrtKQAM&ab_channel=FlinkForward▾

flink 2
s
Thank you this is useful