Hello , I am trying to deploy airbyte into my clus...
# ask-community-for-troubleshootinga
Anand
02/22/2022, 7:47 PMHello , I am trying to deploy airbyte into my cluster following https://docs.airbyte.com/deploying-airbyte/on-kubernetes. I am using my own postgres instance hosted on my cloud. All the service & deployments are up & running except temporal service. Temporal service is continously polling for "waiting for postgresql to start up
+ nc -z 3306
+ '[' 1 -eq 0 ']'
+ echo 'waiting for postgresql to start up'
+ sleep 1"
Above log is showing incorrect port & invalid host.
Note : I am using DATABASE_URL inside overlays/stable-with-resource-limits/.env file and keeping other DATABASE_* properties as blank since my server requires SSL connection. Appreciate any help on this ! Thanks !!!
👀 1
m
Marcos Marx (Airbyte)
02/22/2022, 7:56 PMCan you share the temporal logs?
a
Anand
02/23/2022, 4:24 AM+ DB=postgresql
+ ENABLE_ES=false
+ ES_SCHEMA_SETUP_TIMEOUT_IN_SECONDS=0
+ ES_PORT=9200
+ ES_VERSION=v6
+ ES_SCHEME=http
+ ES_VIS_INDEX=temporal-visibility-dev
+ RF=1
+ DEFAULT_NAMESPACE=default
+ DEFAULT_NAMESPACE_RETENTION=1
+ CASSANDRA_PORT=9042
+ export TEMPORAL_CLI_ADDRESS=100.96.2.65:7233
+ TEMPORAL_CLI_ADDRESS=100.96.2.65:7233
+ export KEYSPACE=temporal
+ KEYSPACE=temporal
+ export VISIBILITY_KEYSPACE=temporal_visibility
+ VISIBILITY_KEYSPACE=temporal_visibility
+ export DBNAME=temporal
+ DBNAME=temporal
+ export VISIBILITY_DBNAME=temporal_visibility
+ VISIBILITY_DBNAME=temporal_visibility
+ export DB_PORT=3306
+ DB_PORT=3306
+ '[' autosetup = autosetup ']'
+ auto_setup
+ wait_for_db
+ '[' postgresql == mysql ']'
+ '[' postgresql == postgresql ']'
+ wait_for_postgres
++ echo
++ awk -F , '{print $1}'
+ server=
+ nc -z 3306
Anand
02/23/2022, 4:25 AMHi marcus
Anand
02/23/2022, 4:36 AMAirbyte server is not able to reach temporal service
Anand
02/23/2022, 4:38 AM2022-02-23 043554 WARN i.a.w.t.TemporalUtils(getTemporalClientWhenConnected):194 - Ignoring exception while trying to request Temporal namespaces:
io.grpc.StatusRuntimeException: UNAVAILABLE: io exception
at io.grpc.stub.ClientCalls.toStatusRuntimeException(ClientCalls.java:262) ~[grpc-stub-1.42.1.jar:1.42.1]
at io.grpc.stub.ClientCalls.getUnchecked(ClientCalls.java:243) ~[grpc-stub-1.42.1.jar:1.42.1]
at io.grpc.stub.ClientCalls.blockingUnaryCall(ClientCalls.java:156) ~[grpc-stub-1.42.1.jar:1.42.1]
at io.grpc.health.v1.HealthGrpc$HealthBlockingStub.check(HealthGrpc.java:252) ~[grpc-services-1.42.1.jar:1.42.1]
at io.temporal.serviceclient.WorkflowServiceStubsImpl.lambda$checkHealth$2(WorkflowServiceStubsImpl.java:282) ~[temporal-serviceclient-1.6.0.jar:?]
at io.temporal.internal.retryer.GrpcSyncRetryer.retry(GrpcSyncRetryer.java:61) ~[temporal-serviceclient-1.6.0.jar:?]
at io.temporal.internal.retryer.GrpcRetryer.retryWithResult(GrpcRetryer.java:51) ~[temporal-serviceclient-1.6.0.jar:?]
at io.temporal.serviceclient.WorkflowServiceStubsImpl.checkHealth(WorkflowServiceStubsImpl.java:275) ~[temporal-serviceclient-1.6.0.jar:?]
at io.temporal.serviceclient.WorkflowServiceStubsImpl.<init>(WorkflowServiceStubsImpl.java:182) ~[temporal-serviceclient-1.6.0.jar:?]
at io.temporal.serviceclient.WorkflowServiceStubs.newInstance(WorkflowServiceStubs.java:51) ~[temporal-serviceclient-1.6.0.jar:?]
at io.temporal.serviceclient.WorkflowServiceStubs.newInstance(WorkflowServiceStubs.java:41) ~[temporal-serviceclient-1.6.0.jar:?]
at io.airbyte.workers.temporal.TemporalUtils.lambda$createTemporalService$0(TemporalUtils.java:61) ~[io.airbyte-airbyte-workers-0.35.32-alpha.jar:?]
at io.airbyte.workers.temporal.TemporalUtils.getTemporalClientWhenConnected(TemporalUtils.java:190) [io.airbyte-airbyte-workers-0.35.32-alpha.jar:?]
at io.airbyte.workers.temporal.TemporalUtils.createTemporalService(TemporalUtils.java:57) [io.airbyte-airbyte-workers-0.35.32-alpha.jar:?]
at io.airbyte.server.ServerApp.getServer(ServerApp.java:184) [io.airbyte-airbyte-server-0.35.32-alpha.jar:?]
at io.airbyte.server.ServerApp.main(ServerApp.java:236) [io.airbyte-airbyte-server-0.35.32-alpha.jar:?]
Caused by: io.grpc.netty.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: airbyte-temporal-svc/100.68.96.22:7233
Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused
at io.grpc.netty.shaded.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) ~[grpc-netty-shaded-1.42.1.jar:1.42.1]
at io.grpc.netty.shaded.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) ~[grpc-netty-shaded-1.42.1.jar:1.42.1]
at io.grpc.netty.shaded.io.netty.channel.unix.Socket.finishConnect(Socket.java:278) ~[grpc-netty-shaded-1.42.1.jar:1.42.1]
at io.grpc.netty.shaded.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) ~[grpc-netty-shaded-1.42.1.jar:1.42.1]
at io.grpc.netty.shaded.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) ~[grpc-netty-shaded-1.42.1.jar:1.42.1]
at io.grpc.netty.shaded.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) ~[grpc-netty-shaded-1.42.1.jar:1.42.1]
at io.grpc.netty.shaded.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:470) ~[grpc-netty-shaded-1.42.1.jar:1.42.1]
at io.grpc.netty.shaded.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) ~[grpc-netty-shaded-1.42.1.jar:1.42.1]
at io.grpc.netty.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[grpc-netty-shaded-1.42.1.jar:1.42.1]
at io.grpc.netty.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[grpc-netty-shaded-1.42.1.jar:1.42.1]
at io.grpc.netty.shaded.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ~[grpc-netty-shaded-1.42.1.jar:1.42.1]
at java.lang.Thread.run(Thread.java:833) ~[?:?]
9 Views