Hi all, I'm trying to install airbyte on EKS - far...
# replication-troubleshooting
h
Hi all, I'm trying to install airbyte on EKS - fargate. (I didn't mount a file system to fargate like EFS) Database is Aurora postgres. I've disabled minio and used S3. But server pod doesn't start properly. Any advice?
image.png
Server logs
Copy code
2023-01-27 15:16:58,811 main INFO Loading mask data from '/seed/specs_secrets_mask.yaml

    ___    _      __          __
   /   |  ()__/ /  __  _/ /___
  / /| | / / ___/ __ \/ / / / __/ _ \
 / ___ |/ / /  / // / // / /_/  __/
//  |///  /._/\_, /\_/\__/
                    /____/
        : airbyte-server :
--------------------------------------------------
 Will soon be available at http://localhost:8000/
--------------------------------------------------

  Micronaut (v3.8.2)

2023-01-27 15:17:10 INFO i.m.c.e.DefaultEnvironment(<init>):159 - Established active environments: [k8s, cloud, ec2]
2023-01-27 15:17:14 INFO c.z.h.HikariDataSource(<init>):80 - HikariPool-1 - Starting...
2023-01-27 15:17:14 INFO c.z.h.HikariDataSource(<init>):82 - HikariPool-1 - Start completed.
2023-01-27 15:17:16 INFO i.a.c.t.TemporalUtils(getTemporalClientWhenConnected):224 - Waiting for temporal server...
2023-01-27 15:17:16 WARN i.a.c.t.TemporalUtils(getTemporalClientWhenConnected):235 - Waiting for namespace default to be initialized in temporal...
2023-01-27 15:17:21 INFO i.t.s.WorkflowServiceStubsImpl(<init>):86 - Created WorkflowServiceStubs for channel: ManagedChannelOrphanWrapper{delegate=ManagedChannelImpl{logId=1, target=airbyte-temporal:7233}}
2023-01-27 15:17:29 INFO i.a.c.t.TemporalUtils(getTemporalClientWhenConnected):252 - Temporal namespace default initialized!
2023-01-27 15:17:35 INFO i.a.c.EnvConfigs(getEnvOrDefault):1175 - Using default value for environment variable STATE_STORAGE_MINIO_ENDPOINT: ''
2023-01-27 15:17:35 INFO i.a.c.EnvConfigs(getEnvOrDefault):1175 - Using default value for environment variable GITHUB_STORE_BRANCH: 'master'
2023-01-27 15:17:35 INFO i.a.c.EnvConfigs(getEnvOrDefault):1175 - Using default value for environment variable GITHUB_STORE_BRANCH: 'master'
2023-01-27 15:17:41 INFO i.a.s.c.DatabaseBeanFactory(configsDatabaseMigrationCheck):97 - Configs database configuration: 0.35.15.001 60000
2023-01-27 15:17:41 INFO i.a.s.DatabaseEventListener(onApplicationEvent):35 - Checking configs database flyway migration version...
2023-01-27 15:17:41 WARN i.a.d.c.DatabaseAvailabilityCheck(check):38 - Waiting for database to become available...
2023-01-27 15:17:41 INFO i.a.d.c.DatabaseAvailabilityCheck(lambda$isDatabaseConnected$1):75 - Testing airbyte configs database connection...
2023-01-27 15:17:41 INFO i.a.d.c.DatabaseAvailabilityCheck(check):57 - Database available.
2023-01-27 15:17:41 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
2023-01-27 15:17:41 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Database: jdbc:postgresql://REMOVED (PostgreSQL 13.7)
2023-01-27 15:17:42 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
2023-01-27 15:17:42 INFO i.a.d.c.DatabaseMigrationCheck(check):46 - Current database migration version 0.40.27.001.
2023-01-27 15:17:42 INFO i.a.d.c.DatabaseMigrationCheck(check):47 - Minimum Flyway version required 0.35.15.001.
2023-01-27 15:17:42 INFO i.a.d.c.DatabaseMigrationCheck(check):62 - Verified that database has been migrated to the required minimum version 60000.
2023-01-27 15:17:42 INFO i.a.s.DatabaseEventListener(onApplicationEvent):42 - Checking jobs database flyway migration version...
2023-01-27 15:17:42 WARN i.a.d.c.DatabaseAvailabilityCheck(check):38 - Waiting for database to become available...
2023-01-27 15:17:42 INFO i.a.d.c.DatabaseAvailabilityCheck(lambda$isDatabaseConnected$1):75 - Testing airbyte jobs database connection...
2023-01-27 15:17:42 INFO i.a.d.c.DatabaseAvailabilityCheck(check):57 - Database available.
2023-01-27 15:17:42 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
2023-01-27 15:17:42 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Database: jdbc:postgresql://REMOVED (PostgreSQL 13.7)
2023-01-27 15:17:42 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
2023-01-27 15:17:42 INFO i.a.d.c.DatabaseMigrationCheck(check):46 - Current database migration version 0.40.26.001.
2023-01-27 15:17:42 INFO i.a.d.c.DatabaseMigrationCheck(check):47 - Minimum Flyway version required 0.29.15.001.
2023-01-27 15:17:42 INFO i.a.d.c.DatabaseMigrationCheck(check):62 - Verified that database has been migrated to the required minimum version 60000.
2023-01-27 15:17:42 INFO i.m.r.Micronaut(lambda$start$2):98 - Startup completed in 39899ms. Server Running: http://airbyte-server-b459d5476-qfjz8:8001
2023-01-27 15:17:46 INFO i.m.r.Micronaut(lambda$start$0):115 - Embedded Application shutting down
2023-01-27 15:17:46 INFO c.z.h.HikariDataSource(close):350 - HikariPool-1 - Shutdown initiated...
2023-01-27 15:17:47 INFO c.z.h.HikariDataSource(close):352 - HikariPool-1 - Shutdown completed.
n
Hi, Harun! It looks like currently it's not possible to deploy Airbyte on Fargate, here's the related issue on GitHub: https://github.com/airbytehq/airbyte/issues/5420 Sorry for the inconvenience!