Hi, This error occurred when I upgraded from 0.29....
# ask-community-for-troubleshooting
d
Hi, This error occurred when I upgraded from 0.29.12-alpha to version 0.35.30-alpha and
docker-compose up
. What's the problem? Please help. Thanks.
1
👀 1
h
Hey can you share the complete logs of server/scheduler?
d
Here is the complete logs. Thanks.
Copy code
airbyte-bootloader  | 2022-02-16 09:03:23 ERROR i.a.b.BootloaderApp(assertNonBreakingMigration):186 - Cannot upgrade from version 0.29.12-alpha to version 0.35.30-alpha directly. First you must upgrade to version 0.32.0-alpha. After that upgrade is complete, you may upgrade to version 0.35.30-alpha
airbyte-bootloader  | Exception in thread "main" java.lang.RuntimeException: Cannot upgrade from version 0.29.12-alpha to version 0.35.30-alpha directly. First you must upgrade to version 0.32.0-alpha. After that upgrade is complete, you may upgrade to version 0.35.30-alpha
airbyte-bootloader  |   at io.airbyte.bootloader.BootloaderApp.assertNonBreakingMigration(BootloaderApp.java:187)
airbyte-bootloader  |   at io.airbyte.bootloader.BootloaderApp.load(BootloaderApp.java:110)
airbyte-bootloader  |   at io.airbyte.bootloader.BootloaderApp.main(BootloaderApp.java:139)
airbyte-server      | 2022-02-16 09:03:23 INFO i.a.d.Databases(createPostgresDatabaseWithRetryTimeout):90 - Database available!
airbyte-server      | 2022-02-16 09:03:23 INFO i.a.d.Databases(createPostgresDatabaseWithRetry):48 - Database available!
airbyte-server      | 2022-02-16 09:03:23 INFO i.a.d.i.c.ConfigsDatabaseInstance(lambda$isInitialized$4):62 - The airbyte configs database is initialized
airbyte-server      | 2022-02-16 09:03:23 WARN i.a.d.Databases(createPostgresDatabaseWithRetryTimeout):65 - Waiting for database to become available...
airbyte-server      | 2022-02-16 09:03:23 INFO i.a.d.i.c.ConfigsDatabaseInstance(lambda$static$3):28 - Testing if airbyte_configs has been created and seeded...
airbyte-server      | 2022-02-16 09:03:23 INFO i.a.d.Databases(createPostgresDatabaseWithRetryTimeout):90 - Database available!
airbyte-server      | 2022-02-16 09:03:23 INFO i.a.d.Databases(createPostgresDatabaseWithRetry):48 - Database available!
airbyte-server      | 2022-02-16 09:03:23 INFO i.a.c.EnvConfigs(getEnvOrDefault):710 - Using default value for environment variable CONFIGS_DATABASE_INITIALIZATION_TIMEOUT_MS: '60000'
airbyte-bootloader exited with code 1
airbyte-server      | 2022-02-16 09:03:23 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
airbyte-server      | 2022-02-16 09:03:23 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Database: jdbc:<postgresql://db:5432/airbyte> (PostgreSQL 13.6)
airbyte-server      | 2022-02-16 09:03:23 ERROR i.a.s.ServerApp(main):238 - Server failed
airbyte-server      | java.lang.NullPointerException: Cannot invoke "org.flywaydb.core.api.MigrationInfo.getVersion()" because the return value of "io.airbyte.db.instance.DatabaseMigrator.getLatestMigration()" is null
airbyte-server      |   at io.airbyte.db.instance.MinimumFlywayMigrationVersionCheck.assertMigrations(MinimumFlywayMigrationVersionCheck.java:75) ~[io.airbyte.airbyte-db-lib-0.35.30-alpha.jar:?]
airbyte-server      |   at io.airbyte.server.ServerApp.assertDatabasesReady(ServerApp.java:131) ~[io.airbyte-airbyte-server-0.35.30-alpha.jar:?]
airbyte-server      |   at io.airbyte.server.ServerApp.getServer(ServerApp.java:156) ~[io.airbyte-airbyte-server-0.35.30-alpha.jar:?]
airbyte-server      |   at io.airbyte.server.ServerApp.main(ServerApp.java:236) [io.airbyte-airbyte-server-0.35.30-alpha.jar:?]
airbyte-worker      | 2022-02-16 09:03:24 INFO i.t.s.WorkflowServiceStubsImpl(<init>):184 - Created GRPC client for channel: ManagedChannelOrphanWrapper{delegate=ManagedChannelImpl{logId=1, target=airbyte-temporal:7233}}
airbyte-scheduler   | 2022-02-16 09:03:25 INFO i.a.s.a.SchedulerApp(waitForServer):213 - Waiting for server to become available...
airbyte-server      | 2022-02-16 09:03:26 INFO i.a.c.EnvConfigs(getEnvOrDefault):710 - Using default value for environment variable WORKER_ENVIRONMENT: 'DOCKER'
airbyte-server      | 2022-02-16 09:03:26 INFO i.a.c.EnvConfigs(getEnvOrDefault):710 - Using default value for environment variable JOB_MAIN_CONTAINER_CPU_REQUEST: 'null'
airbyte-server      | 2022-02-16 09:03:26 INFO i.a.c.EnvConfigs(getEnvOrDefault):710 - Using default value for environment variable JOB_MAIN_CONTAINER_CPU_LIMIT: 'null'
airbyte-server      | 2022-02-16 09:03:26 INFO i.a.c.EnvConfigs(getEnvOrDefault):710 - Using default value for environment variable JOB_MAIN_CONTAINER_MEMORY_REQUEST: 'null'
airbyte-server      | 2022-02-16 09:03:26 INFO i.a.c.EnvConfigs(getEnvOrDefault):710 - Using default value for environment variable JOB_MAIN_CONTAINER_MEMORY_LIMIT: 'null'
airbyte-server      | 2022-02-16 09:03:26 INFO i.a.c.EnvConfigs(getEnvOrDefault):710 - Using default value for environment variable JOB_KUBE_TOLERATIONS: ''
airbyte-server      | 2022-02-16 09:03:26 INFO i.a.c.EnvConfigs(getEnvOrDefault):710 - Using default value for environment variable JOB_KUBE_NODE_SELECTORS: ''
airbyte-server      | 2022-02-16 09:03:26 INFO i.a.c.EnvConfigs(getEnvOrDefault):710 - Using default value for environment variable JOB_KUBE_MAIN_CONTAINER_IMAGE_PULL_SECRET: ''
airbyte-server      | 2022-02-16 09:03:26 INFO i.a.c.EnvConfigs(getEnvOrDefault):710 - Using default value for environment variable JOB_KUBE_MAIN_CONTAINER_IMAGE_PULL_POLICY: 'IfNotPresent'
airbyte-server      | 2022-02-16 09:03:26 INFO i.a.c.EnvConfigs(getEnvOrDefault):710 - Using default value for environment variable JOB_KUBE_SOCAT_IMAGE: 'alpine/socat:1.7.4.1-r1'
airbyte-server      | 2022-02-16 09:03:26 INFO i.a.c.EnvConfigs(getEnvOrDefault):710 - Using default value for environment variable JOB_KUBE_BUSYBOX_IMAGE: 'busybox:1.28'
airbyte-server      | 2022-02-16 09:03:26 INFO i.a.c.EnvConfigs(getEnvOrDefault):710 - Using default value for environment variable JOB_KUBE_CURL_IMAGE: 'curlimages/curl:7.77.0'
airbyte-server      | 2022-02-16 09:03:26 INFO i.a.c.EnvConfigs(getEnvOrDefault):710 - Using default value for environment variable WORKER_ENVIRONMENT: 'DOCKER'
airbyte-server      | 2022-02-16 09:03:26 INFO i.a.s.ServerApp(getServer):151 - Checking databases..
airbyte-server      | 2022-02-16 09:03:26 INFO i.a.c.EnvConfigs(getEnvOrDefault):710 - Using default value for environment variable CONFIG_DATABASE_USER: 'docker'
airbyte-server      | 2022-02-16 09:03:26 INFO i.a.c.EnvConfigs(getEnvOrDefault):710 - Using default value for environment variable CONFIG_DATABASE_PASSWORD: '*****'
airbyte-server      | 2022-02-16 09:03:26 INFO i.a.c.EnvConfigs(getEnvOrDefault):710 - Using default value for environment variable CONFIG_DATABASE_URL: 'jdbc:<postgresql://db:5432/airbyte>'
airbyte-server      | 2022-02-16 09:03:26 INFO i.a.s.ServerApp(assertDatabasesReady):128 - Checking configs database flyway migration version..
airbyte-server      | 2022-02-16 09:03:26 INFO i.a.d.i.MinimumFlywayMigrationVersionCheck(assertDatabase):42 - Waiting for database...
airbyte-server      | 2022-02-16 09:03:26 WARN i.a.d.Databases(createPostgresDatabaseWithRetryTimeout):65 - Waiting for database to become available...
airbyte-server      | 2022-02-16 09:03:26 INFO i.a.d.i.BaseDatabaseInstance(lambda$isDatabaseConnected$5):127 - Testing airbyte configs database connection...
airbyte-temporal    | {"level":"info","ts":"2022-02-16T09:03:26.195Z","msg":"Get dynamic config","name":"history.defaultWorkflowTaskTimeout","value":10,"default-value":10,"logging-call-at":"config.go:79"}
airbyte-temporal    | {"level":"info","ts":"2022-02-16T09:03:26.195Z","msg":"Get dynamic config","name":"limit.blobSize.error","value":15728640,"default-value":2097152,"logging-call-at":"config.go:79"}
airbyte-temporal    | {"level":"info","ts":"2022-02-16T09:03:26.195Z","msg":"Get dynamic config","name":"limit.blobSize.warn","value":10485760,"default-value":524288,"logging-call-at":"config.go:79"}
airbyte-temporal    | {"level":"info","ts":"2022-02-16T09:03:26.195Z","msg":"Get dynamic config","name":"limit.memoSize.error","value":2097152,"default-value":2097152,"logging-call-at":"config.go:79"}
airbyte-temporal    | {"level":"info","ts":"2022-02-16T09:03:26.195Z","msg":"Get dynamic config","name":"limit.memoSize.warn","value":2048,"default-value":2048,"logging-call-at":"config.go:79"}
airbyte-temporal    | {"level":"info","ts":"2022-02-16T09:03:26.195Z","msg":"Get dynamic config","name":"history.maximumBufferedEventsBatch","value":100,"default-value":100,"logging-call-at":"config.go:79"}
airbyte-temporal    | {"level":"info","ts":"2022-02-16T09:03:26.195Z","msg":"Get dynamic config","name":"history.mutableStateChecksumGenProbability","value":0,"default-value":0,"logging-call-at":"config.go:79"}
airbyte-temporal    | {"level":"info","ts":"2022-02-16T09:03:26.195Z","msg":"Get dynamic config","name":"system.transactionSizeLimit","value":4194304,"default-value":4194304,"logging-call-at":"config.go:79"}
airbyte-temporal    | {"level":"info","ts":"2022-02-16T09:03:26.202Z","msg":"temporal-sys-tq-scanner-workflow workflow successfully started","service":"worker","logging-call-at":"scanner.go:194"}
airbyte-server      | 2022-02-16 09:03:26 INFO i.a.d.Databases(createPostgresDatabaseWithRetryTimeout):90 - Database available!
airbyte-server      | 2022-02-16 09:03:26 INFO i.a.d.Databases(createPostgresDatabaseWithRetry):48 - Database available!
airbyte-server      | 2022-02-16 09:03:26 INFO i.a.d.i.c.ConfigsDatabaseInstance(lambda$isInitialized$4):62 - The airbyte configs database is initialized
airbyte-server      | 2022-02-16 09:03:26 WARN i.a.d.Databases(createPostgresDatabaseWithRetryTimeout):65 - Waiting for database to become available...
airbyte-server      | 2022-02-16 09:03:26 INFO i.a.d.i.c.ConfigsDatabaseInstance(lambda$static$3):28 - Testing if airbyte_configs has been created and seeded...
airbyte-server      | 2022-02-16 09:03:26 INFO i.a.d.Databases(createPostgresDatabaseWithRetryTimeout):90 - Database available!
airbyte-server      | 2022-02-16 09:03:26 INFO i.a.d.Databases(createPostgresDatabaseWithRetry):48 - Database available!
airbyte-server      | 2022-02-16 09:03:26 INFO i.a.c.EnvConfigs(getEnvOrDefault):710 - Using default value for environment variable CONFIGS_DATABASE_INITIALIZATION_TIMEOUT_MS: '60000'
airbyte-server      | 2022-02-16 09:03:26 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
airbyte-server      | 2022-02-16 09:03:26 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Database: jdbc:<postgresql://db:5432/airbyte> (PostgreSQL 13.6)
airbyte-server      | 2022-02-16 09:03:26 ERROR i.a.s.ServerApp(main):238 - Server failed
airbyte-server      | java.lang.NullPointerException: Cannot invoke "org.flywaydb.core.api.MigrationInfo.getVersion()" because the return value of "io.airbyte.db.instance.DatabaseMigrator.getLatestMigration()" is null
airbyte-server      |   at io.airbyte.db.instance.MinimumFlywayMigrationVersionCheck.assertMigrations(MinimumFlywayMigrationVersionCheck.java:75) ~[io.airbyte.airbyte-db-lib-0.35.30-alpha.jar:?]
airbyte-server      |   at io.airbyte.server.ServerApp.assertDatabasesReady(ServerApp.java:131) ~[io.airbyte-airbyte-server-0.35.30-alpha.jar:?]
airbyte-server      |   at io.airbyte.server.ServerApp.getServer(ServerApp.java:156) ~[io.airbyte-airbyte-server-0.35.30-alpha.jar:?]
airbyte-server      |   at io.airbyte.server.ServerApp.main(ServerApp.java:236) [io.airbyte-airbyte-server-0.35.30-alpha.jar:?]
airbyte-server exited with code 1
airbyte-scheduler   | 2022-02-16 09:03:28 INFO i.a.s.a.SchedulerApp(waitForServer):213 - Waiting for server to become available...
h
Hey as the error says can you go through our documentation here on upgrading https://docs.airbyte.com/operator-guides/upgrading-airbyte#mandatory-intermediate-upgrade
d
Thanks, @Harshith (Airbyte). I solved the problem thanks to you.
a
certificate