Does anyone have any detailed guides on setting Airbyte up with helm and some horizontal scaling?

Sure, I can provide you with some guidance on setting up Airbyte with Helm and scaling it horizontally based on the information provided in the extracts. Setting Up Airbyte with Helm 1. For local testing, you can follow one of the setup guides for Docker Desktop (Mac), Minikube, or Kind. For testing on GKE or EKS, you can create a cluster with the command line or the Cloud Console UI, or install eksctl and run

eksctl create cluster

to create an EKS cluster/VPC/subnets/etc. respectively. For production, Airbyte should function on most clusters v1.19 and above. [Source](https://docs.airbyte.com/deploying-airbyte/on-kubernetes-via-helm) 2. If you don't intend to customize your deployment, you can deploy Airbyte as is with default values using the following command:

bash helm install %release_name% airbyte/airbyte

[Source](https://docs.airbyte.com/deploying-airbyte/on-kubernetes-via-helm) 3. If you want to customize your deployment, create a

values.yaml

file in the local folder and populate it with default configuration override values. An example of

values.yaml

can be found in the charts/airbyte folder of the Airbyte repository. After specifying your own configuration, run the following command:

bash helm install --values path/to/values.yaml %release_name% airbyte/airbyte

[Source](https://docs.airbyte.com/deploying-airbyte/on-kubernetes-via-helm) Scaling Airbyte Horizontally Airbyte allows scaling sync workloads horizontally using Kubernetes. The core components (api server, scheduler, etc) run as deployments while the scheduler launches connector-related pods on different nodes. [Source](https://docs.airbyte.com/deploying-airbyte/on-kubernetes-via-helm) To increase the disk size on Kubernetes / GKE when using the Helm charts, you could modify these

.env

variables:

JOB_MAIN_CONTAINER_MEMORY_REQUEST

and

JOB_MAIN_CONTAINER_MEMORY_LIMIT

. [Source](https://airbytehq.slack.com/archives/C021JANJ6TY/p1675351402355699) For more detailed information, you can refer to the official Airbyte documentation on [Deploying on Kubernetes](https://docs.airbyte.com/deploying-airbyte/on-kubernetes) and [Scaling Airbyte](https://docs.airbyte.com/operator-guides/scaling-airbyte/).