Hi We are deploying airbyte with helm chart version 0 45 40 Airbyte #replication-ask-ai

Hi! We are deploying airbyte with helm (chart vers...

Marie Hénaff

08/30/2023, 12:59 PM

Hi! We are deploying airbyte with helm (chart version 0.45.40, airbyte version 0.50.5) Every time we restart the server (maybe it is caused by another pod?) pod, the image tag for connector airbyte/source-facebook-marketing gets rolled back to version 0.4.2 when it was on the latest 1.1.7 Has anyone encountered this issue before?

Marie Hénaff

08/30/2023, 1:17 PM

I noticed that the versions in the

actor_definition_version

table are not ordered by tag DESC and the first row for this connector is this older version of the image. Is it possible that at restart the server doesn't load the latest tag that was configured in the app, but instead loads the first one that comes?

Ella Rohm-Ensing (Airbyte)

08/30/2023, 2:43 PM

Thanks for bringing this up @Marie Hénaff - would you be willing to provide some more info:

Copy code

SELECT * FROM actor_definition_version WHERE actor_definition_id = 'e7778cfc-e97c-4458-9ecb-b4f2bba8946c';

and

Copy code

SELECT * FROM actor WHERE actor_definition_id = 'e7778cfc-e97c-4458-9ecb-b4f2bba8946c';

Ella Rohm-Ensing (Airbyte)

08/30/2023, 2:44 PM

Every time we restart the server (maybe it is caused by another pod?) pod

This is... interesting. Just when restarting the

airbyte-server

pod? Your intuition is right, this should be being handled by the bootloader pod that runs on initial startup

Thibaut B

08/31/2023, 8:21 AM

We encounter the same issue here, any idea how to resolve ?

Thibaut B

08/31/2023, 10:37 AM

I opened this issue: https://github.com/airbytehq/airbyte/issues/30026

Andrea Giardini

08/31/2023, 10:50 AM

SQL output:

actor_definition actor

Andrea Giardini

08/31/2023, 10:52 AM

Trying the upgrade of the source connector again causes the following stacktrace in the server:

Copy code

2023-08-31 10:51:12 ERROR i.a.s.a.ApiHelper(execute):40 - Unexpected Exception
java.lang.IllegalStateException: Get Spec job failed.
        at com.google.common.base.Preconditions.checkState(Preconditions.java:502) ~[guava-31.1-jre.jar:?]
        at io.airbyte.commons.server.converters.SpecFetcher.getSpecFromJob(SpecFetcher.java:18) ~[io.airbyte-airbyte-commons-server-0.50.5.jar:?]
        at io.airbyte.commons.server.handlers.SourceDefinitionsHandler.getSpecForImage(SourceDefinitionsHandler.java:341) ~[io.airbyte-airbyte-commons-server-0.50.5.jar:?]                          at io.airbyte.commons.server.handlers.SourceDefinitionsHandler.updateSourceDefinition(SourceDefinitionsHandler.java:271) ~[io.airbyte-airbyte-commons-server-0.50.5.jar:?]
        at io.airbyte.server.apis.SourceDefinitionApiController.lambda$updateSourceDefinition$8(SourceDefinitionApiController.java:142) ~[io.airbyte-airbyte-server-0.50.5.jar:?]                    at io.airbyte.server.apis.ApiHelper.execute(ApiHelper.java:26) ~[io.airbyte-airbyte-server-0.50.5.jar:?]
        at io.airbyte.server.apis.SourceDefinitionApiController.updateSourceDefinition(SourceDefinitionApiController.java:142) ~[io.airbyte-airbyte-server-0.50.5.jar:?]
        at io.airbyte.server.apis.$SourceDefinitionApiController$Definition$Exec.dispatch(Unknown Source) ~[io.airbyte-airbyte-server-0.50.5.jar:?]
        at io.micronaut.context.AbstractExecutableMethodsDefinition$DispatchedExecutableMethod.invoke(AbstractExecutableMethodsDefinition.java:371) ~[micronaut-inject-3.9.3.jar:3.9.3]
        at io.micronaut.context.DefaultBeanContext$4.invoke(DefaultBeanContext.java:594) ~[micronaut-inject-3.9.3.jar:3.9.3]
        at io.micronaut.web.router.AbstractRouteMatch.execute(AbstractRouteMatch.java:303) ~[micronaut-router-3.9.3.jar:3.9.3]
        at io.micronaut.web.router.RouteMatch.execute(RouteMatch.java:111) ~[micronaut-router-3.9.3.jar:3.9.3]
        at io.micronaut.http.context.ServerRequestContext.with(ServerRequestContext.java:103) ~[micronaut-http-3.9.3.jar:3.9.3]
        at io.micronaut.http.server.RouteExecutor.lambda$executeRoute$14(RouteExecutor.java:659) ~[micronaut-http-server-3.9.3.jar:3.9.3]
        at reactor.core.publisher.FluxDeferContextual.subscribe(FluxDeferContextual.java:49) ~[reactor-core-3.5.0.jar:3.5.0]
        at reactor.core.publisher.InternalFluxOperator.subscribe(InternalFluxOperator.java:62) ~[reactor-core-3.5.0.jar:3.5.0]
        at reactor.core.publisher.FluxSubscribeOn$SubscribeOnSubscriber.run(FluxSubscribeOn.java:194) ~[reactor-core-3.5.0.jar:3.5.0]
        at io.micronaut.reactive.reactor.instrument.ReactorInstrumentation.lambda$init$0(ReactorInstrumentation.java:62) ~[micronaut-runtime-3.9.3.jar:3.9.3]
        at reactor.core.scheduler.WorkerTask.call(WorkerTask.java:84) ~[reactor-core-3.5.0.jar:3.5.0]
        at reactor.core.scheduler.WorkerTask.call(WorkerTask.java:37) ~[reactor-core-3.5.0.jar:3.5.0]
        at io.micronaut.scheduling.instrument.InvocationInstrumenterWrappedCallable.call(InvocationInstrumenterWrappedCallable.java:53) ~[micronaut-context-3.9.3.jar:3.9.3]
        at java.util.concurrent.FutureTask.run(FutureTask.java:317) ~[?:?]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
        at java.lang.Thread.run(Thread.java:1589) ~[?:?]

Thibaut B

08/31/2023, 4:38 PM

Hello @Marie Hénaff we upgraded to last version 0.50.24 and it’s not a problem with that version because we have the latest connectors version inside ^^ Also it seems since 0.50.22 we don’t reproduce locally (tested with Amazon Ads) so probably issue resolved since this version 🙂

Open in Slack

Previous Next