Hi there, my team is seeing intermittent connectio...
# ask-community-for-troubleshooting
l
Hi there, my team is seeing intermittent connection errors to both our source (RDS instance) and destination (Snowflake). For each, the connection tests are successful on about half of the tries. We are running Airbyte on Kubernetes (EKS). Here is the worker stacktrace we are seeing:
Copy code
Log4j2Appender says: Unexpected error while checking connection:
2023-05-17 22:45:26 ERROR i.a.w.g.DefaultCheckConnectionWorker(run):125 - Unexpected error while checking connection:
io.airbyte.workers.exception.WorkerException: Error checking connection status: no status nor failure reason were outputted
	at io.airbyte.workers.WorkerUtils.throwWorkerException(WorkerUtils.java:267) ~[io.airbyte-airbyte-commons-worker-0.44.2.jar:?]
	at io.airbyte.workers.general.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:118) ~[io.airbyte-airbyte-commons-worker-0.44.2.jar:?]
	at io.airbyte.workers.general.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:43) ~[io.airbyte-airbyte-commons-worker-0.44.2.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.2.jar:?]
	at java.lang.Thread.run(Thread.java:1589) ~[?:?]
Log4j2Appender says: Completing future exceptionally...
Log4j2Appender says:
2023-05-17 22:45:26 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$5):198 - Completing future exceptionally...
io.airbyte.workers.exception.WorkerException: Unexpected error while getting checking connection.
	at io.airbyte.workers.general.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:127) ~[io.airbyte-airbyte-commons-worker-0.44.2.jar:?]
	at io.airbyte.workers.general.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:43) ~[io.airbyte-airbyte-commons-worker-0.44.2.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.2.jar:?]
	at java.lang.Thread.run(Thread.java:1589) ~[?:?]
Caused by: io.airbyte.workers.exception.WorkerException: Error checking connection status: no status nor failure reason were outputted
2023-05-17 22:45:26 WARN i.t.i.s.WorkflowExecuteRunnable(throwAndFailWorkflowExecution):134 - Workflow execution failure WorkflowId='7b3b6006-d2c1-4b3d-af4c-db1872bf8af9', RunId=fd19da30-f939-42ca-b82b-f4bdc34fc8cd, WorkflowType='CheckConnectionWorkflow'
io.temporal.failure.ActivityFailure: scheduledEventId=6, startedEventId=7, activityType='RunWithJobOutput', activityId='eecf8568-b1c7-3856-bb15-69f81625bb5c', identity='1@airbyte-staging-worker-6d58f9c954-wfwvw', retryState=RETRY_STATE_MAXIMUM_ATTEMPTS_REACHED
	at java.lang.Thread.getStackTrace(Thread.java:2550) ~[?:?]
	at io.temporal.internal.sync.ActivityStubBase.execute(ActivityStubBase.java:49) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.sync.ActivityInvocationHandler.lambda$getActivityFunc$0(ActivityInvocationHandler.java:78) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.sync.ActivityInvocationHandlerBase.invoke(ActivityInvocationHandlerBase.java:60) ~[temporal-sdk-1.17.0.jar:?]
	at jdk.proxy2.$Proxy89.runWithJobOutput(Unknown Source) ~[?:?]
	at io.airbyte.workers.temporal.check.connection.CheckConnectionWorkflowImpl.run(CheckConnectionWorkflowImpl.java:54) ~[io.airbyte-airbyte-workers-0.44.2.jar:?]
	at CheckConnectionWorkflowImplProxy.run$accessor$ywRkvQZf(Unknown Source) ~[?:?]
	at CheckConnectionWorkflowImplProxy$auxiliary$i7FPOmWz.call(Unknown Source) ~[?:?]
	at io.airbyte.workers.temporal.support.TemporalActivityStubInterceptor.execute(TemporalActivityStubInterceptor.java:79) ~[io.airbyte-airbyte-workers-0.44.2.jar:?]
	at CheckConnectionWorkflowImplProxy.run(Unknown Source) ~[?:?]
	at jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104) ~[?:?]
	at java.lang.reflect.Method.invoke(Method.java:578) ~[?:?]
	at io.temporal.internal.sync.POJOWorkflowImplementationFactory$POJOWorkflowImplementation$RootWorkflowInboundCallsInterceptor.execute(POJOWorkflowImplementationFactory.java:302) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.sync.POJOWorkflowImplementationFactory$POJOWorkflowImplementation.execute(POJOWorkflowImplementationFactory.java:277) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.sync.WorkflowExecuteRunnable.run(WorkflowExecuteRunnable.java:71) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.sync.SyncWorkflow.lambda$start$0(SyncWorkflow.java:116) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.sync.CancellationScopeImpl.run(CancellationScopeImpl.java:102) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.sync.WorkflowThreadImpl$RunnableWrapper.run(WorkflowThreadImpl.java:106) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.worker.ActiveThreadReportingExecutor.lambda$submit$0(ActiveThreadReportingExecutor.java:53) ~[temporal-sdk-1.17.0.jar:?]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:577) ~[?:?]
	at java.util.concurrent.FutureTask.run(FutureTask.java:317) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
	at java.lang.Thread.run(Thread.java:1589) ~[?:?]
	at io.airbyte.workers.WorkerUtils.throwWorkerException(WorkerUtils.java:267) ~[io.airbyte-airbyte-commons-worker-0.44.2.jar:?]
	at io.airbyte.workers.general.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:118) ~[io.airbyte-airbyte-commons-worker-0.44.2.jar:?]
	... 3 more
Do you have any sense as to what the issue may be?
k
A message from kapa.ai
@Leslie Strauss That's a great question, but unfortunately it is too long. Can you ask me again but make it shorter? I'm here to help!
l
@kapa.ai Intermittent connection test failures for both source and destination
k
A message from kapa.ai
Hmm, I don't know enough to give you a confident answer yet. However, you can refer to the [Troubleshooting section](https://docs.airbyte.com/troubleshooting) in the Airbyte documentation for guidance on common issues and their solutions. If you still need help, consider asking your question in the [Airbyte forum](https://discuss.airbyte.io/).
l
These issue were resolved for us by running Airbyte pods on dedicated nodes.