Hi Team i am trying to setup airbyte on Minikube t...
# replication-troubleshootingk
Krishna Elangovan
10/25/2022, 6:34 PMHi Team i am trying to setup airbyte on Minikube to test it out, while doing an
Copy code
kubectl apply -k kube/overlays/stable Copy code
The Job "airbyte-bootloader" is invalid: spec.template: Invalid value: core.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), DeletionTimestamp:<nil>, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"controller-uid":"a9791ea0-5c6b-4896-ab01-23fff164bca1", "job-name":"airbyte-bootloader"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ZZZ_DeprecatedClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:core.PodSpec{Volumes:[]core.Volume(nil), InitContainers:[]core.Container(nil), Containers:[]core.Container{core.Container{Name:"airbyte-bootloader-container", Image:"airbyte/bootloader:0.40.17", Command:[]string(nil), Args:[]string(nil), WorkingDir:"", Ports:[]core.ContainerPort(nil), EnvFrom:[]core.EnvFromSource(nil), Env:[]core.EnvVar{core.EnvVar{Name:"AIRBYTE_VERSION", Value:"", ValueFrom:(*core.EnvVarSource)(0x401169b020)}, core.EnvVar{Name:"DATABASE_HOST", Value:"", ValueFrom:(*core.EnvVarSource)(0x401169b040)}, core.EnvVar{Name:"DATABASE_PORT", Value:"", ValueFrom:(*core.EnvVarSource)(0x401169b060)}, core.EnvVar{Name:"DATABASE_PASSWORD", Value:"", ValueFrom:(*core.EnvVarSource)(0x401169b080)}, core.EnvVar{Name:"DATABASE_URL", Value:"", ValueFrom:(*core.EnvVarSource)(0x401169b0a0)}, core.EnvVar{Name:"DATABASE_USER", Value:"", ValueFrom:(*core.EnvVarSource)(0x401169b0c0)}}, Resources:core.ResourceRequirements{Limits:core.ResourceList(nil), Requests:core.ResourceList(nil)}, VolumeMounts:[]core.VolumeMount(nil), VolumeDevices:[]core.VolumeDevice(nil), LivenessProbe:(*core.Probe)(nil), ReadinessProbe:(*core.Probe)(nil), StartupProbe:(*core.Probe)(nil), Lifecycle:(*core.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*core.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]core.EphemeralContainer(nil), RestartPolicy:"Never", TerminationGracePeriodSeconds:(*int64)(0x40073879f8), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string(nil), ServiceAccountName:"", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", SecurityContext:(*core.PodSecurityContext)(0x400fc68480), ImagePullSecrets:[]core.LocalObjectReference(nil), Hostname:"", Subdomain:"", SetHostnameAsFQDN:(*bool)(nil), Affinity:(*core.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]core.Toleration(nil), HostAliases:[]core.HostAlias(nil), PriorityClassName:"", Priority:(*int32)(nil), PreemptionPolicy:(*core.PreemptionPolicy)(nil), DNSConfig:(*core.PodDNSConfig)(nil), ReadinessGates:[]core.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), Overhead:core.ResourceList(nil), EnableServiceLinks:(*bool)(nil), TopologySpreadConstraints:[]core.TopologySpreadConstraint(nil), OS:(*core.PodOS)(nil)}}: field is immutablek
Kevin Phan
10/25/2022, 6:36 PMhey there! Did you end up figuring this out? I am encountering the same error
u
user
10/25/2022, 6:37 PMHi! Are you using an external database backend?
k
Krishna Elangovan
10/25/2022, 6:39 PMno i am not just the basic whats out on airbyte
k
Kevin Phan
10/26/2022, 4:18 PM@Krishna Elangovan any luck here?
k
Krishna Elangovan
10/26/2022, 4:38 PMNo anyone from airbyte here who could help
Krishna Elangovan
10/26/2022, 8:18 PM@Kevin Phan i used helm charts to install and i am not able to get it running https://docs.airbyte.com/helm-charts/
m
Marcos Marx (Airbyte)
10/27/2022, 1:32 AM@Krishna Elangovan did you try the helm and it didn’t work?
k
Krishna Elangovan
10/27/2022, 1:33 AMthe docs did not have clear documentation on the helm install, I was able to figure that out after some digging,
Krishna Elangovan
10/27/2022, 1:34 AMis there references to add in external dbs for prod setup somewhere
Krishna Elangovan
10/27/2022, 1:34 AM?
Krishna Elangovan
10/27/2022, 1:34 AM@Marcos Marx (Airbyte)
m
Marcos Marx (Airbyte)
10/27/2022, 1:36 AMThe team is improving the Helm Chart, probably the documentation will be updated in a few days! sorry about that 😞
k
Krishna Elangovan
10/27/2022, 1:37 AMis there an external db addition docs somewhere ?
k
Kevin Phan
10/27/2022, 1:13 PMyeah i am getting the same error but using kustomization. Even though i do get that error when deploying, airbyte still runs
m
Marcos Marx (Airbyte)
11/01/2022, 1:21 AM@Kyryl Skobylko can you help here?
👀 1
k
Kyryl Skobylko
11/01/2022, 9:14 AM@Krishna Elangovan, have you modified the resources in kube/resources folder?
Kyryl Skobylko
11/01/2022, 9:15 AMSince right now I applied it to my local cluster and did not get the error provided above
Kyryl Skobylko
11/01/2022, 9:16 AMalso would be nice if any details besides the error message was specified, like:
• Is it cloud or local cluster
• If cloud then what provider is it? (EKS,GKE, Azure K8S service, DigitalOcean, etc.)
• Provide
kubectl --versionKyryl Skobylko
11/01/2022, 9:24 AMRegarding the documentation, as @Marcos Marx (Airbyte) told, helm chart are under heavy development rn, so docs will be updated as soon as there’s a new feature or update to existing features introduced. I’ll do update the docs later this week to reference most used setups, but I believe it already does explain how to use external database with helm charts. (If not, please leave you feedback so we can impove it 🙂 )