Hi , I am installing AIrbyte on AWS EKS and see...
# replication-troubleshooting
a
Hi , I am installing AIrbyte on AWS EKS and see the airbyte-webapp erroring with... though I am using EKS, it seems using docker files
n
Hi Ajay, please make sure to post one thread per question, that really helps our team stay organized. Could you include the full logs?
a
kubectl logs airbyte-webapp-7f49d774c5-cxlm4 Error from server (NotFound): pods "airbyte-webapp-7f49d774c5-cxlm4" not found int-appmesh@devadmin:*~/airbyte*$ kubectl logs airbyte-webapp-7f49d774c5-cxlm4 -n airbyte /docker-entrypoint.sh: /docker-entrypoint.d/ is not empty, will attempt to perform configuration /docker-entrypoint.sh: Looking for shell scripts in /docker-entrypoint.d/ /docker-entrypoint.sh: Launching /docker-entrypoint.d/10-listen-on-ipv6-by-default.sh 10-listen-on-ipv6-by-default.sh: info: Getting the checksum of /etc/nginx/conf.d/default.conf 10-listen-on-ipv6-by-default.sh: info: Enabled listen on IPv6 in /etc/nginx/conf.d/default.conf /docker-entrypoint.sh: Launching /docker-entrypoint.d/20-envsubst-on-templates.sh 20-envsubst-on-templates.sh: Running envsubst on /etc/nginx/templates/default.conf.template to /etc/nginx/conf.d/default.conf /docker-entrypoint.sh: Launching /docker-entrypoint.d/30-tune-worker-processes.sh /docker-entrypoint.sh: Configuration complete; ready for start up 2023/02/02 184226 [emerg] 1#1: host not found in upstream "dev-airbyte.nonprod.smartbizloans.com:8001" in /etc/nginx/conf.d/default.conf:2 nginx: [emerg] host not found in upstream "dev-airbyte.nonprod.smartbizloans.com:8001" in /etc/nginx/conf.d/default.conf:2
n
Hi Ajay! I'd say the best thing to do is to do a fresh install/deployment!
a
Hi Nataly, Did a fresh install in QA.
It is able to recognize AWS load balancer and Route 53 DNS address
Still UI is not coming up
Background : I am installing Airbye on EC2 instance and deploying it on EKS cluster
In order to access UI , I am using AWS DNS and ALB .
Here are my values in .env
WEBAPP_URL=qa-airbyte.int.smartbizloans.com:443 API_URL=/api/v1/ CONNECTOR_BUILDER_API_URL=qa-airbyte.int.smartbizloans.com:8003 INTERNAL_API_HOST=qa-airbyte.int.smartbizloans.com:8001 CONNECTOR_BUILDER_API_HOST=qa-airbyte.int.smartbizloans.com:8003
If I do not use ALB/Route 53 DNS on EKS
What shoud be the values for these variables in .env
For above variables
I am removed all AWS ALB, Route 53 DNS from config
Installed it fresh on Ec2 instance with Deployment on EKS
All processes came up
Port forwarding is failing
kubectl port-forward svc/airbyte-webapp-svc 8000:80 Error from server (NotFound): services "airbyte-webapp-svc" not found
Env Variable values are from .env as :
TRACKING_STRATEGY=segment WEBAPP_URL=airbyte-webapp-svc:80 CONNECTOR_BUILDER_API_URL=/connector-builder-api INTERNAL_API_HOST=airbyte-server-svc:8001 CONNECTOR_BUILDER_API_HOST=airbyte-connector-builder-server-svc:8003 API_URL=/api/v1/
n
Could you take a look at this user's .env settings: https://github.com/airbytehq/airbyte/issues/19787#issuecomment-1335859650
a
I am not clear on these variables , It is deployed on EKS cluster and airbytes software is installed on EC2 host
Copy code
TEMPORAL_HOST=airbyte-temporal:7233
INTERNAL_API_HOST=airbyte-server:8001
CONNECTOR_BUILDER_API_HOST=airbyte-connector-builder-server:80
WEBAPP_URL=http://localhost:8000/
What should I put server name/Host here.
Is it EC2 instance Host or EKS cluster name
I have replaced host wiht ec2 host for above varaiables
Port forwarding is saying service not found
kubectl port-forward svc/airbyte-webapp-svc 8000:80 Error from server (NotFound): services "airbyte-webapp-svc" not found
Hi Nataly, The issue of webapps is resolved. I can see webapps UI
n
Great to hear! What fixed it?
a
Looks like there was a firewall issue on AWS . Fixed by adding ports to security groups . Fixed . Now running into issue when replicating from Mysql - Mysql
n
Thanks for the details!