Hi folks! I am trying to deploy Airbyte on k8s fo...
# replication-troubleshooting
s
Hi folks! I am trying to deploy Airbyte on k8s for the first time and I am using an external pg db. When starting the airbyte server, i get the following logs in loop and container never starts. I am trying to get the bootstrap to work properly. 2022-10-24 131301 INFO i.a.d.c.DatabaseMigrationCheck(check):46 - Current database migration version 0. 2022-10-24 131301 INFO i.a.d.c.DatabaseMigrationCheck(check):47 - Minimum Flyway version required 0.35.15.001. 2022-10-24 131707 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate 2022-10-24 131707 WARN o.f.c.i.l.s.Slf4jLog(warn):53 - Flyway upgrade recommended: PostgreSQL 14.2 is newer than this version of Flyway and support has not been tested. The latest supported version of PostgreSQL is 13. 2022-10-24 131711 INFO c.z.h.HikariDataSource(close):350 - HikariPool-1 - Shutdown initiated... 2022-10-24 131711 INFO c.z.h.HikariDataSource(close):352 - HikariPool-1 - Shutdown completed. Any idea what’s going wrong here ? Thanks!
k
Hi, probably need to update airbyte-db dependencies, let me create a PR for that
There’ll be a new release soon(30 mins or so) pull updates from helm repo and try again.
@Shivam Kapoor, try to use the new version of helm chart
s
@Shivam Kapoor, let us know if the new version of helm chart solves your issue!
s
Thanks guys, i am on my way to test this, will update 🙂
I am still facing this issue @Kyryl Skobylko @Saj Dider (Airbyte) I have upgraded the helm charts to 0.40.33
k
Btw, those logs are from database pod or server?
s
@Kyryl Skobylko server logs
I am currently using airbyte-server image version 0.40.15. When I try to use an earlier image of airbyte-server like 0.36.2-alpha, then I don’t get this error, but i face a different problem. 2022-10-24 194202 INFO i.a.d.i.BaseDatabaseInstance(lambda$isDatabaseConnected$5):127 - Testing airbyte configs database connection... 2022-10-24 194203 INFO i.a.d.Databases(createPostgresDatabaseWithRetryTimeout):99 - Database available! 2022-10-24 194203 INFO i.a.d.Databases(createPostgresDatabaseWithRetry):57 - Database available! 2022-10-24 194203 INFO i.a.d.i.c.ConfigsDatabaseInstance(lambda$isInitialized$4):65 - The airbyte configs database is not initialized; initializing it with schema 2022-10-24 194209 INFO i.a.d.i.MinimumFlywayMigrationVersionCheck(assertDatabase):42 - Waiting for database... 2022-10-24 194209 INFO i.a.d.i.c.ConfigsDatabaseInstance(lambda$isInitialized$4):65 - The airbyte configs database is not initialized; initializing it with schema 2022-10-24 194215 INFO i.a.d.i.MinimumFlywayMigrationVersionCheck(assertDatabase):42 - Waiting for database... 2022-10-24 194215 INFO i.a.d.i.c.ConfigsDatabaseInstance(lambda$isInitialized$4):65 - The airbyte configs database is not initialized; initializing it with schema 2022-10-24 194221 INFO i.a.d.i.MinimumFlywayMigrationVersionCheck(assertDatabase):42 - Waiting for database... and its stuck in this loop now. No schema or tables are created on the db. The user has the DDL permissions on public schema.
k
hmm can you check the bootloader logs?
🙏 1
Since before any component is deployed there’s a bootloader present first, which does all the magic to the database
and have you tried to use the latest version of airbyte, which is 0.40.17? You can set it by
--set global.image.tag=0.40.17
to your helm isntall/upgrade params
s
ahh..sorry my bad..for some reason the bootloader wasn’t running. The error is gone now 🙂 Thanks
i thought server is supposed to do the bootstrapping
s
Happy to hear it’s working now @Shivam Kapoor. Feel free to post more questions in the channel
🙏 1