We are still having issues getting any connection to run on Amazon EKS. We think we have isolated the error to

Attempting to start pod = source-postgres-check-30-0-cbfqh

IS there someplace were the namespace is configured?

Hi Jaye, yes, here's the doc: https://docs.airbyte.com/understanding-airbyte/namespaces/#destination-namespace-configuration Let me know if you've got more questions!

thanks @Nataly Merezhuk (Airbyte) but i was looking for docker namespace. We are having issues with it not finding or creating the source pod when a sync tries to run. We are using amazon EKS.

Ah, gotcha! I feel like I've seen similar errors before. Are you using helm chart?

no

Hi, I work with Jaye. we got past the part where we were failing to start the postgres pod. but now we're observing the Temporal worker prematurely timing out (logs below) when the

destination-snowflake-check

pod is still running. the snowflake-check pod takes about 90-120s to start up (and about 3-4m to reach a

Completed

state), but the Temporal worker seemingly times out after 60s. is there any way we can configure this timeout to be longer?

2022-12-14 01:12:13 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process
2022-12-14 01:12:13 INFO i.a.w.p.KubePodProcess(<init>):554 - Waiting until pod is ready...
2022-12-14 01:13:13 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$5):226 - Running sync worker cancellation...
2022-12-14 01:13:13 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$5):230 - Interrupting worker thread...
2022-12-14 01:13:13 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$5):233 - Cancelling completable future...
2022-12-14 01:13:13 WARN i.a.c.t.CancellationHandler$TemporalCancellationHandler(checkAndHandleCancellation):53 - Job either timed out or was cancelled.
2022-12-14 01:13:13 INFO i.a.w.t.TemporalAttemptExecution(get):162 - Stopping cancellation check scheduling...
2022-12-14 01:13:13 ERROR i.a.w.g.DefaultCheckConnectionWorker(run):105 - Unexpected error while checking connection:
io.airbyte.workers.exception.WorkerException: An error has occurred.

Hey Said, thanks for the additional details. I'm looking into if there's an env variable for that, but don't see any right now. I do see there's an issue open regarding Temporal monitoring/restarting when things go haywire: https://github.com/airbytehq/airbyte/issues/14277 I'll look into this more and hope to have some more thoughts on this soon!

Thanks Nataly. This would be less than ideal but if there is a hard coded timeout setting in the Airbyte source code we could build our own Docker image in the interim while that epic is worked on. We'd just need to know what exactly to tweak

Let's do this - could you please make a GitHub issue and include all this info and the logs? As both source Postgres and destination Snowflake are GA connectors, this would be prioritized by the team. I don't see a hardcoded variable unfortunately so I think opening an issue would be the fastest way to resolve this!