Andrew Popp
01/20/2022, 9:28 PMJOB_KUBE_NAMESPACE
.Yoav Ostrinsky
02/06/2022, 12:01 PMGary K
02/15/2022, 6:44 AMFileNotFoundException: /root/.kube/config
error in the second worker log. I don't have admin control over the GKE cluster that I'm using, so is there any setting expectations I should ask ops to check for? (ie, maybe stuff for mounting api server details??)Daniel Creao
02/25/2022, 7:31 PMBinoy Shah
03/01/2022, 4:06 PMSawyer Waugh
03/01/2022, 4:24 PMGary K
03/03/2022, 4:07 AMAJ
03/24/2022, 5:01 PMAJ
03/24/2022, 5:01 PMJavier Llorente Mañas
03/25/2022, 1:35 PMLuke Alexander
04/06/2022, 10:48 AMPablo Garcia
04/06/2022, 2:50 PM404 Client Error: Not Found for url: https://<internal-url>/api/v1/api/v1/connections/sync
Where https://<internal-url>
is the URL where the webapp is accessible from (exposed by a load balancer). Has anyone try a similar deployment and if so, how did you set up the airbyte connection in airflow? Thanks!Gujjalapati Raju
04/20/2022, 12:18 PMMartin M
04/27/2022, 8:58 AMserver.persistence.enabled
to values.yaml
configuration options. Would love some feedback 🙏Arjen Zwep
05/05/2022, 9:29 AMSubramony M
05/06/2022, 12:08 PMFailed Pod : pod/urce-postgres-sync-a1bbe16a-00b1-41d7-be9e-6904f435a348-0-mtfks 0/4 Init:Error 0 2m53s
Worker pod logs
2022-05-06 11:58:24 INFO i.a.w.p.KubePodProcess(<init>):512 - Creating pod urce-postgres-sync-a1bbe16a-00b1-41d7-be9e-6904f435a348-0-mtfks...
Log4j2Appender says: Creating pod urce-postgres-sync-a1bbe16a-00b1-41d7-be9e-6904f435a348-0-mtfks...
2022-05-06 11:58:26 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):305 - Waiting for init container to be ready before copying files...
Log4j2Appender says: Waiting for init container to be ready before copying files...
2022-05-06 11:58:26 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):309 - Init container present..
Log4j2Appender says: Init container present..
2022-05-06 11:58:29 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$2):161 - Completing future exceptionally...
io.airbyte.workers.WorkerException: Error while getting checking connection.
at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:84) ~[io.airbyte-airbyte-workers-0.36.9-alpha.jar:?]
at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.36.9-alpha.jar:?]
at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.36.9-alpha.jar:?]
at java.lang.Thread.run(Thread.java:833) [?:?]
Caused by: io.airbyte.workers.WorkerException: An error has occurred.
at io.airbyte.workers.process.KubeProcessFactory.create(KubeProcessFactory.java:148) ~[io.airbyte-airbyte-workers-0.36.9-alpha.jar:?]
at io.airbyte.workers.process.AirbyteIntegrationLauncher.check(AirbyteIntegrationLauncher.java:58) ~[io.airbyte-airbyte-workers-0.36.9-alpha.jar:?]
at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:53) ~[io.airbyte-airbyte-workers-0.36.9-alpha.jar:?]
... 3 more
Caused by: io.fabric8.kubernetes.client.KubernetesClientException: An error has occurred.
at io.fabric8.kubernetes.client.KubernetesClientException.launderThrowable(KubernetesClientException.java:103) ~[kubernetes-client-5.12.2.jar:?]
at io.fabric8.kubernetes.client.KubernetesClientException.launderThrowable(KubernetesClientException.java:97) ~[kubernetes-client-5.12.2.jar:?]
at io.fabric8.kubernetes.client.dsl.internal.WatchConnectionManager.lambda$run$2(WatchConnectionManager.java:133) ~[kubernetes-client-5.12.2.jar:?]
at java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:934) ~[?:?]
at java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:911) ~[?:?]
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510) ~[?:?]
at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2162) ~[?:?]
at io.fabric8.kubernetes.client.okhttp.OkHttpWebSocketImpl$BuilderImpl$1.onFailure(OkHttpWebSocketImpl.java:72) ~[kubernetes-client-5.12.2.jar:?]
at okhttp3.internal.ws.RealWebSocket.failWebSocket(RealWebSocket.java:571) ~[okhttp-3.12.12.jar:?]
at okhttp3.internal.ws.RealWebSocket$2.onFailure(RealWebSocket.java:221) ~[okhttp-3.12.12.jar:?]
at okhttp3.RealCall$AsyncCall.execute(RealCall.java:211) ~[okhttp-3.12.12.jar:?]
at okhttp3.internal.NamedRunnable.run(NamedRunnable.java:32) ~[okhttp-3.12.12.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?]
... 1 more
can any one help on this ?Binoy Shah
05/06/2022, 1:59 PMAnton Podviaznikov
05/13/2022, 7:05 PMairbyte-worker
Caused by: io.airbyte.workers.WorkerException: Failure executing: POST at: <https://10.0.0.1/api/v1/namespaces/etl/pods>. Message: Forbidden!Configured service account doesn't have access. Service account may have been revoked. pods is forbidden: User "system:serviceaccount:etl:airbyte-admin" cannot create resource "pods" in API group "" in the namespace "etl": RBAC: <http://role.rbac.authorization.k8s.io|role.rbac.authorization.k8s.io> "airbyte-admin-role" not found.
at io.airbyte.workers.process.KubeProcessFactory.create(KubeProcessFactory.java:138) ~[io.airbyte-airbyte-workers-0.38.3-alpha.jar:?]
at io.airbyte.workers.process.AirbyteIntegrationLauncher.check(AirbyteIntegrationLauncher.java:80) ~[io.airbyte-airbyte-workers-0.38.3-alpha.jar:?]
at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:53) ~[io.airbyte-airbyte-workers-0.38.3-alpha.jar:?]
... 3 more
Caused by: io.fabric8.kubernetes.client.KubernetesClientException: Failure executing: POST at: <https://10.0.0.1/api/v1/namespaces/etl/pods>. Message: Forbidden!Configured service account doesn't have access. Service account may have been revoked. pods is forbidden: User "system:serviceaccount:etl:airbyte-admin" cannot create resource "pods" in API group "" in the namespace "etl": RBAC: <http://role.rbac.authorization.k8s.io|role.rbac.authorization.k8s.io> "airbyte-admin-role" not found.
Any tips?Thomas
05/18/2022, 7:55 PMThomas
05/18/2022, 8:13 PMThomas
05/18/2022, 8:13 PMMing Fang
05/19/2022, 1:32 PMjava.lang.RuntimeException: io.airbyte.workers.WorkerException: Running the launcher replication-orchestrator failed
Tomas Broka
05/19/2022, 5:19 PMnon-root.
Have made the necessary changes to fulfill our cluster policy and all airbyte services have been successfully deployed and running. But now we have another blocker due to run as non-root
policy. I'm adding a new connector from the UI (in order to point the image to our private registry) but the pod that gets deployed in order to add this new connector is failing to start due to non-root
policy
Error: container has runAsNonRoot and image will run as root (pod: "source-mssql-spec-1dfbbc78-d22d-4cc6)
The image is trying to run as root
The image is a copy of airbyte/source-mssql:0.3.22
public image. Anyone has encounter this issue before and was able to resolve?Anton Podviaznikov
05/20/2022, 3:49 PMJOB_MAIN_CONTAINER_MEMORY_REQUEST
but I don't see it applied after I described newly launched pods. Was this the correct env?Erik Wickstrom
05/31/2022, 11:29 PMsource-s3-check-*
is picking up my `worker.nodeSelector`and is getting scheduled on an ARM node and crashing. Is there somewhere else that I should be configuring the nodeSelector
for these pods? (I’m using the helm chart to deploy airbyte)Guy Feldman
06/05/2022, 8:41 PMjava.lang.RuntimeException: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: java.lang.RuntimeException: io.airbyte.workers.exception.WorkerException: Running the launcher replication-orchestrator failed
without container orchestration enabled syncs work but resetting a connection results in the destination not having resources specified, despite the fact that I specified resources in every place I couldUlan Yisaev
06/17/2022, 5:35 PM<http://roles.rbac.authorization.k8s.io|roles.rbac.authorization.k8s.io> "airbyte-admin-role" is forbidden: User "Devuser" cannot get resource "roles" in API group "<http://rbac.authorization.k8s.io|rbac.authorization.k8s.io>"
Please tell me, is it possible to launch Airbyte without creating a separate Service Account? Can we skip this step by making changes to the manifest?Zach Brak
06/21/2022, 1:32 PMSawyer Waugh
06/23/2022, 4:07 PMcontext.yaml
.
If I setup my instance at
airbyte.my-org.onplural.sh
,
and setup the api at
airbyte-api.my-org.onplural.sh
How do I interact with API? I tried to replicate the network calls that I see in Chrome dev tools (~~`api/v1/worspace-id/get-destinations` ) with postman. I keep getting redirects to the ‘sign in with plural’ page
i assume I need to use the other api-specific hostname? and how do i handle authentication - service token from app.plural.com or something else?Fabiano Pena
06/27/2022, 2:23 PMThe connection tests failed.
Internal Server Error: The Access Key Id you provided does not exist in our records. (Service: S3, Status Code: 403, Request ID: 16FBA5BD9BF3F037, Extended Request ID: null)
Does anyone have faced it before?