https://linen.dev logo
Join Slack
Powered by
keep getting this one ```2023-05-24 17:25:18 ERROR...
# ask-ai
j
keep getting this one
Copy code
2023-05-24 17:25:18 ERROR i.m.r.Micronaut(handleStartupException):338 - Error starting Micronaut server: Error instantiating bean of type  [io.airbyte.db.check.DatabaseMigrationCheck]

Path Taken: new ApplicationInitializer() --> ApplicationInitializer.configsDatabaseMigrationCheck --> DatabaseMigrationCheck.configsDatabaseMigrationCheck(DSLContext dslContext,[Flyway configsFlyway],String configsDatabaseMinimumFlywayMigrationVersion,Long configsDatabaseInitializationTimeoutMs)
io.micronaut.context.exceptions.BeanInstantiationException: Error instantiating bean of type  [io.airbyte.db.check.DatabaseMigrationCheck]
k
A message from kapa.ai
Hmm, I don't know enough to give you a confident answer yet. However, you can refer to the Airbyte documentation for more information and troubleshooting tips: https://docs.airbyte.io.
m
Can you describe what steps or commands you run to get into this error?
j
hey, yeah.. i changed the run script to use podman-compose, i commented out the docker compose up command, ran it. that gave me the config files: my .env, i just add these:
Copy code
S3_MINIO_ENDPOINT=<http://localhost:9093>
S3_LOG_BUCKET=airbyte-logs
AWS_ACCESS_KEY_ID=sgSqhnxyMWMulZna
AWS_SECRET_ACCESS_KEY=DeuBIZLt61KQTsqSkqaZ22PhxZi5nwpg

STATE_STORAGE_MINIO_ACCESS_KEY=4bvnHIzcKJZPZogU
STATE_STORAGE_MINIO_SECRET_ACCESS_KEY=8yErFV8VDLsDQFiPU84SbsyZoMTbua6c
STATE_STORAGE_MINIO_BUCKET_NAME=airbyte-logs
STATE_STORAGE_MINIO_ENDPOINT=<http://localhost:9093>

WORKER_LOGS_STORAGE_TYPE=MINIO
WORKER_STATE_STORAGE_TYPE=MINIO
i had to change the docker-compose.yaml to have 
journald
logging, and i changed the volume for the worker:
Copy code
volumes:
      - /var/run/docker.sock:/var/run/docker.sock
      - /home/etldev/_volumes/airbyte/:${WORKSPACE_ROOT}
      - ${LOCAL_ROOT}:${LOCAL_ROOT}

etldev@ip-10-235-77-22:~/temp/airbyte$ ls -la /home/etldev/_volumes
total 40
drwxr-xr-x+  9 etldev etldev 4096 May 23 03:03 .
drwxr-xr-x  17 etldev etldev 4096 May 23 23:00 ..
drwxrwxrwx+  2 etldev etldev 4096 May 23 03:03 airbyte
then i ran the run script with podman-compose.
Copy code
etldev@ip-10-235-77-22:~/temp/airbyte$ podman ps
CONTAINER ID  IMAGE                                              COMMAND               CREATED         STATUS             PORTS                                                     NAMES
e4096954f91a  <http://docker.io/library/nginx:1.23.2|docker.io/library/nginx:1.23.2>                     nginx -g daemon o...  3 weeks ago     Up 8 days ago      0.0.0.0:4431->4430/tcp, 0.0.0.0:8081->8080/tcp            nginx.main
7e08fafd4030  <http://docker.io/airbyte/db:0.44.5|docker.io/airbyte/db:0.44.5>                        postgres              57 seconds ago  Up 34 seconds ago                                                            airbyte-db
def26436ad8f  <http://docker.io/airbyte/temporal:0.44.5|docker.io/airbyte/temporal:0.44.5>                                        54 seconds ago  Up 33 seconds ago                                                            airbyte-temporal
a96825d4f07d  <http://docker.io/airbyte/connector-builder-server:0.44.5|docker.io/airbyte/connector-builder-server:0.44.5>                        50 seconds ago  Up 30 seconds ago  0.0.0.0:38653->80/tcp                                     airbyte-connector-builder-server
bddfd7986b3b  <http://docker.io/airbyte/worker:0.44.5|docker.io/airbyte/worker:0.44.5>                                          47 seconds ago  Up 1 second ago    0.0.0.0:40723->9000/tcp                                   airbyte-worker
13e101669431  <http://docker.io/airbyte/server:0.44.5|docker.io/airbyte/server:0.44.5>                                          44 seconds ago  Up 5 seconds ago   0.0.0.0:36599->8001/tcp                                   airbyte-server
a5ba0aadf2d7  <http://docker.io/airbyte/webapp:0.44.5|docker.io/airbyte/webapp:0.44.5>                    nginx -g daemon o...  42 seconds ago  Up 25 seconds ago  0.0.0.0:8888->80/tcp                                      airbyte-webapp
3f08dc15e9da  <http://docker.io/airbyte/cron:0.44.5|docker.io/airbyte/cron:0.44.5>                                            39 seconds ago  Up 24 seconds ago                                                            airbyte-cron
b4d4c62137e7  <http://docker.io/airbyte/proxy:0.44.5|docker.io/airbyte/proxy:0.44.5>                     ./run.sh              36 seconds ago  Up 20 seconds ago  0.0.0.0:8000-8001->8000-8001/tcp, 0.0.0.0:8003->8003/tcp  airbyte-proxy
.env
sorry copied after i was changing stuff, this is what i have:
Copy code
S3_MINIO_ENDPOINT=<http://localhost:9093>
S3_LOG_BUCKET=airbyte-logs
AWS_ACCESS_KEY_ID=4bvnHIzcKJZPZogU
AWS_SECRET_ACCESS_KEY=8yErFV8VDLsDQFiPU84SbsyZoMTbua6c

STATE_STORAGE_MINIO_ACCESS_KEY=4bvnHIzcKJZPZogU
STATE_STORAGE_MINIO_SECRET_ACCESS_KEY=8yErFV8VDLsDQFiPU84SbsyZoMTbua6c
STATE_STORAGE_MINIO_BUCKET_NAME=airbyte-logs
STATE_STORAGE_MINIO_ENDPOINT=<http://localhost:9093>
also get this one after i try to stop and start up again:
Copy code
___    _      __          __
   /   |  (_)____/ /_  __  __/ /____
  / /| | / / ___/ __ \/ / / / __/ _ \
 / ___ |/ / /  / /_/ / /_/ / /_/  __/
/_/  |_/_/_/  /_.___/\__, /\__/\___/
                    /____/
        : airbyte-cron :

  Micronaut (v3.9.1)

^[[6~2023-05-24 17:44:39 ERROR i.m.r.Micronaut(handleStartupException):338 - Error starting Micronaut server: Error instantiating bean of type  [io.airbyte.db.check.DatabaseMigrationCheck]

Path Taken: new ApplicationInitializer() --> ApplicationInitializer.configsDatabaseMigrationCheck --> DatabaseMigrationCheck.configsDatabaseMigrationCheck(DSLContext dslContext,[Flyway configsFlyway],String configsDatabaseMinimumFlywayMigrationVersion,Long configsDatabaseInitializationTimeoutMs)
io.micronaut.context.exceptions.BeanInstantiationException: Error instantiating bean of type  [io.airbyte.db.check.DatabaseMigrationCheck]

Path Taken: new ApplicationInitializer() --> ApplicationInitializer.configsDatabaseMigrationCheck --> DatabaseMigrationCheck.configsDatabaseMigrationCheck(DSLContext dslContext,[Flyway configsFlyway],String configsDatabaseMinimumFlywayMigrationVersion,Long configsDatabaseInitializationTimeoutMs)
        at io.micronaut.context.DefaultBeanContext.resolveByBeanFactory(DefaultBeanContext.java:2367) ~[micronaut-inject-3.9.1.jar:3.9.1]
        at io.micronaut.context.DefaultBeanContext.doCreateBean(DefaultBeanContext.java:2305) ~[micronaut-inject-3.9.1.jar:3.9.1]
        at io.micronaut.context.DefaultBeanContext.doCreateBean(DefaultBeanContext.java:2251) ~[micronaut-inject-3.9.1.jar:3.9.1]
        at io.micronaut.context.DefaultBeanContext.createRegistration(DefaultBeanContext.java:3016) ~[micronaut-inject-3.9.1.jar:3.9.1]
        at io.micronaut.context.SingletonScope.getOrCreate(SingletonScope.java:80) ~[micronaut-inject-3.9.1.jar:3.9.1]
        at io.micronaut.context.DefaultBeanContext.findOrCreateSingletonBeanRegistration(DefaultBeanContext.java:2918) ~[micronaut-inject-3.9.1.jar:3.9.1]
        at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:2879) ~[micronaut-inject-3.9.1.jar:3.9.1]
        at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:2800) ~[micronaut-inject-3.9.1.jar:3.9.1]
        at io.micronaut.context.DefaultBeanContext.getBean(DefaultBeanContext.java:1617) ~[micronaut-inject-3.9.1.jar:3.9.1]
        at io.micronaut.context.AbstractBeanResolutionContext.getBean(AbstractBeanResolutionContext.java:66) ~[micronaut-inject-3.9.1.jar:3.9.1]
        at io.micronaut.context.AbstractInitializableBeanDefinition.resolveBean(AbstractInitializableBeanDefinition.java:2065) ~[micronaut-inject-3.9.1.jar:3.9.1]
        at io.micronaut.context.AbstractInitializableBeanDefinition.getBeanForConstructorArgument(AbstractInitializableBeanDefinition.java:1297) ~[micronaut-inject-3.9.1.jar:3.9.1]
        at io.airbyte.workers.config.$DatabaseBeanFactory$ConfigsDatabaseMigrationCheck8$Definition.build(Unknown Source) ~[io.airbyte-airbyte-workers-0.44.5.jar:?]
        at io.micronaut.context.DefaultBeanContext.resolveByBeanFactory(DefaultBeanContext.java:2354) ~[micronaut-inject-3.9.1.jar:3.9.1]
        at io.micronaut.context.DefaultBeanContext.doCreateBean(DefaultBeanContext.java:2305) ~[micronaut-inject-3.9.1.jar:3.9.1]
        at io.micronaut.context.DefaultBeanContext.doCreateBean(DefaultBeanContext.java:2251) ~[micronaut-inject-3.9.1.jar:3.9.1]
        at io.micronaut.context.DefaultBeanContext.createRegistration(DefaultBeanContext.java:3016) ~[micronaut-inject-3.9.1.jar:3.9.1]
        at io.micronaut.context.SingletonScope.getOrCreate(SingletonScope.java:80) ~[micronaut-inject-3.9.1.jar:3.9.1]
        at io.micronaut.context.DefaultBeanContext.findOrCreateSingletonBeanRegistration(DefaultBeanContext.java:2918) ~[micronaut-inject-3.9.1.jar:3.9.1]
        at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:2879) ~[micronaut-inject-3.9.1.jar:3.9.1]
        at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:2800) ~[micronaut-inject-3.9.1.jar:3.9.1]
m
If you remove all the storage and run the default one, it works?
j
no, i actually only added it because i thought that was the issue
i just deleted all volumes, and used the original 
.env
and im having this:
Copy code
2023-05-24 17:55:28 ERROR i.m.r.Micronaut(handleStartupException):338 - Error starting Micronaut server: Bean definition [io.airbyte.server.apis.SourceDefinitionApiController] could not be loaded: Error instantiating bean of type  [io.airbyte.persistence.job.tracker.JobTracker]

Path Taken: new SourceDefinitionApiController(SourceDefinitionsHandler sourceDefinitionsHandler) --> new SourceDefinitionApiController([SourceDefinitionsHandler sourceDefinitionsHandler]) --> new SourceDefinitionsHandler(ConfigRepository configRepository,Supplier uuidSupplier,[SynchronousSchedulerClient schedulerSynchronousClient],AirbyteRemoteOssCatalog remoteOssCatalog,SourceHandler sourceHandler,AirbyteProtocolVersionRange protocolVersionRange) --> SynchronousSchedulerClient.synchronousSchedulerClient(TemporalClient temporalClient,[JobTracker jobTracker],JobErrorReporter jobErrorReporter,OAuthConfigSupplier oAuthConfigSupplier,RouterService routerService,ConfigInjector configInjector) --> JobTracker.jobTracker(ConfigRepository configRepository,JobPersistence jobPersistence,[TrackingClient trackingClient],ActorDefinitionVersionHelper actorDefinitionVersionHelper)
io.micronaut.context.exceptions.BeanInstantiationException: Bean definition [io.airbyte.server.apis.SourceDefinitionApiController] could not be loaded: Error instantiating bean of type  [io.airbyte.persistence.job.tracker.JobTracker]

Path Taken: new SourceDefinitionApiController(SourceDefinitionsHandler sourceDefinitionsHandler) --> new SourceDefinitionApiController([SourceDefinitionsHandler sourceDefinitionsHandler]) --> new SourceDefinitionsHandler(ConfigRepository configRepository,Supplier uuidSupplier,[SynchronousSchedulerClient schedulerSynchronousClient],AirbyteRemoteOssCatalog remoteOssCatalog,SourceHandler sourceHandler,AirbyteProtocolVersionRange protocolVersionRange) --> SynchronousSchedulerClient.synchronousSchedulerClient(TemporalClient temporalClient,[JobTracker jobTracker],JobErrorReporter jobErrorReporter,OAuthConfigSupplier oAuthConfigSupplier,RouterService routerService,ConfigInjector configInjector) --> JobTracker.jobTracker(ConfigRepository configRepository,JobPersistence jobPersistence,[TrackingClient trackingClient],ActorDefinitionVersionHelper actorDefinitionVersionHelper)
        at io.micronaut.context.DefaultBeanContext.initializeContext(DefaultBeanContext.java:1921) ~[micronaut-inject-3.9.1.jar:3.9.1]
        at io.micronaut.context.DefaultApplicationContext.initializeContext(DefaultApplicationContext.java:249) ~[micronaut-inject-3.9.1.jar:3.9.1]
        at io.micronaut.context.DefaultBeanContext.readAllBeanDefinitionClasses(DefaultBeanContext.java:3326) ~[micronaut-inject-3.9.1.jar:3.9.1]
        at io.micronaut.context.DefaultBeanContext.finalizeConfiguration(DefaultBeanContext.java:3684) ~[micronaut-inject-3.9.1.jar:3.9.1]
        at io.micronaut.context.DefaultBeanContext.start(DefaultBeanContext.java:341) ~[micronaut-inject-3.9.1.jar:3.9.1]
so if i stop and start then i get the db migration error..but if i start fresh i get the job tracker error. both from micronaut
not sure if this is related but i also see: 
2023-05-24 17:55:28 INFO i.a.f.ConfigFileClient(<init>):94 - path /flags does not exist, will return default flag values
m
Are you using the 
sh run-ab-platform
script?
j
bash run-ab-platform.sh
but to shut it down i used 
podman-compose down
spotted this too
Copy code
Temporal CLI address: 10.89.5.29:7233.
2023/05/24 18:10:16 Loading config; env=docker,zone=,configDir=config
2023/05/24 18:10:16 Loading config files=[config/docker.yaml]
{"level":"error","ts":"2023-05-24T18:10:16.925Z","msg":"Unable to read dynamic config file. Continue with default settings but the ERROR MUST BE FIXED before the next upgrade","error":"unable to validate dynamic config: dynamic config: config/dynamicconfig/development.yaml: stat config/dynamicconfig/development.yaml: no such file or directory","logging-call-at":"main.go:140","stacktrace":"<http://go.temporal.io/server/common/log.(*zapLogger).Error|go.temporal.io/server/common/log.(*zapLogger).Error>\n\t/temporal/common/log/zap_logger.go:142\nmain.buildCLI.func2\n\t/temporal/cmd/server/main.go:140\ngithub.com/urfave/cli/v2.(*Command).Run\n\t/go/pkg/mod/github.com/urfave/cli/v2@v2.3.0/command.go:163\ngithub.com/urfave/cli/v2.(*App).RunContext\n\t/go/pkg/mod/github.com/u
m
I saw a previous contribution trying to add support to podman. I not sure if Airbyte works with it. You can try to take a look here: https://github.com/airbytehq/airbyte/pull/22323
j
this is not an issue for me: i have firewalld forwarding to nginx 8080 so im actually able to reach the webapp on the browser - it's just that the server on 8001 is having errors
when i go on the website i get this: 2023/05/24 181818 [error] 8#8: *3 connect() failed (111: Connection refused) while connecting to upstream, client: 10.89.5.36, server: , request: "POST /v1/workspaces/list HTTP/1.1", upstream: "http://10.89.5.33:8001/v1/workspaces/list", host: "airbyte.wketl1.duckdns.org", referrer: "http://airbyte.wketl1.duckdns.org/" 10.89.5.36 - - [24/May/20231818:21 +0000] "GET /manifest.json HTTP/1.1" 401 701 "http://airbyte.wketl1.duckdns.org/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/113.0.0.0 Safari/537.36" 10.89.5.36 - airbyte [24/May/20231818:23 +0000] "POST /v1/workspaces/list HTTP/1.1" 502 559 "http://airbyte.wketl1.duckdns.org/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/113.0.0.0 Safari/537.36"
Copy code
etldev@ip-10-235-77-22:~/temp/airbyte$ curl <http://localhost:8888>
<!DOCTYPE html>
<html lang="en">
  <head>
    <meta charset="utf-8">
    <link rel="icon" href="/favicon.ico">
    <meta name="viewport" content="width=device-width, initial-scale=1">
    <meta name="theme-color" content="#000000">
    <meta
      name="description"
      content="Airbyte is the turnkey open-source data integration platform that syncs data from applications, APIs and databases to warehouses."
    >
    <meta name="airbyte:sec-token" content="c82db11b-64df-413d-aba8-ee66b99c046f">
    <meta name="airbyte:version" content="0.44.5">
    <link rel="apple-touch-icon" href="/apple-touch-icon.png">
    <link rel="manifest" href="/manifest.json">
    <link rel="stylesheet" href="/index.css">
    <title>Airbyte</title>
    <script type="module" crossorigin src="/assets/index-cfe78e87.js"></script>
    <link rel="stylesheet" href="/assets/index-448deb15.css">
  <script data-script="config-overwrites">
                window.TRACKING_STRATEGY = "segment";
                </script></head>
  <body>
    <noscript>
      <img src="/logo.png" alt="" width="90" height="94">
      <div class="card">You need to enable JavaScript to run this app.</div>
    </noscript>
    <div id="root"></div>

  </body>
</html>
d
@Jake Kagan did you get anywhere with this? I'm having this issue when trying to deploy with an External DB. Exactly the same errors on 0.50.33. Literally can't find any solutions to this in the channel or online.
c
@Jake Kagan or @Danilo Drobac - any luck with this issue?
2 Views
Open in Slack
PreviousNext
Powered by