Muhammad Imtiaz
06/10/2022, 1:27 PM0.35.31-alpha
to 0.39.17-alpha
, by following the guide given here. Essentially, I've pulled the latest code from master branch, provided all the required details in .env
and secrets
file and run kubectl apply -k kube/overlays/stable
.
All pods at the start run successfully i.e. there is no restart. SERVER, TEMPORAL and Worker pod's logs (files attached below) are convincing and they don't show any errors.
But I'm not able to port-forward airbyte-webapp
service locally as It is breaking connections (screenshot attached below). When I see the logs of server-pod
, I see some of the api calls are failing (screenshot attached below).
Port-farward command
kubectl port-forward svc/airbyte-webapp-svc 8088:80 -n dev
PS: I"m using RDS postgres instance and S3 bucket. Airbyte is able to access postgres and S3 bucket.Marcos Marx (Airbyte)
06/10/2022, 1:35 PMMuhammad Imtiaz
06/10/2022, 1:37 PMMuhammad Imtiaz
06/10/2022, 1:47 PMAdam Bloom
06/10/2022, 3:49 PM8000
, not 8088
, so kubectl port-forward svc/airbyte-webapp-svc 8000:80
. You can see this in your screenshots of airbyte webapp - it shows Now ready at <http://localhost:8000/>
Muhammad Imtiaz
06/10/2022, 3:56 PM8088
is my host port in the port-farward command. airbyte-web-svc is running at port 80
.
8000
is the port at which airbyte-server
is running.Adam Bloom
06/10/2022, 3:57 PMMuhammad Imtiaz
06/10/2022, 4:00 PMairbyte-server
pods
Don't know what they are about and how to solve them.
PS: I see no scheduler
pod in version 0.39.17-alpha
. Is there any architectural change?Muhammad Imtiaz
06/13/2022, 5:26 AM0.35.31-alpha
to 0.39.17-alpha
and using S3 bucket for logging. I've used the following S3 settings in .env file, keeping the rest same.
# S3/Minio Log Configuration
S3_LOG_BUCKET=cdpaas-airbyte-qa-logs
S3_LOG_BUCKET_REGION=us-east-2
S3_MINIO_ENDPOINT=
S3_PATH_STYLE_ACCESS=
AWS_ACCESS_KEY_ID=<access-key-id>
AWS_SECRET_ACCESS_KEY=<secret-access-key-id>
When airbyte starts, it uses this bucket and pushes the files into it. But when I run the workflow, it shows the following error, Detailed error's logs are attached below.
I"ve searched this error from open issues and Internet but I've found any help from there.
Quick response will be appreciated.Muhammad Imtiaz
06/13/2022, 5:29 AMHarshith (Airbyte)
06/13/2022, 7:33 AMMuhammad Imtiaz
06/13/2022, 7:39 AMAugustin Lafanechere (Airbyte)
06/14/2022, 1:53 PM