Hi! I’m running Airbyte on Kubernetes and it seems like Airbyte is spinning up instances using Autoscaling. Does Airbyte come with HPA out of the box or there something spooky going on?
u
user
11/10/2022, 5:43 PM
Hey, Adil! I'm not the most knowledgeable on k8s and our k8s expert is out till next week. I've found this, perhaps it will clear some questions up:
https://airbyte.com/blog/scaling-data-pipelines-kubernetes
I'll be sure to get back to you with more info next week though!
a
Adil Karim
11/10/2022, 5:46 PM
Thank you! After reading about everything in a lot more detail I’ve realised the Cluster Autoscaler in Kubernetes handles this all natively.
Thanks!