conversation Airbyte #office-hour

Join Slack

# office-hour

Slackbot

04/05/2023, 6:00 PM

message has been deleted

Precious Agboado

04/05/2023, 6:07 PM

message has been deleted

Saj Dider (Airbyte)

04/05/2023, 6:11 PM

Hey @Shreepad Khandve welcome to office hours, feel free to post your question in this thread!

Shreepad Khandve

04/05/2023, 6:14 PM

Im getting following error for docker compose up -d while composing on ec2 instance

service "bootloader" didn't complete successfully: exit 255

Marcos Marx (Airbyte)

04/05/2023, 6:14 PM

What version are you using Shreepad? The latest 0.42.1?

Shreepad Khandve

04/05/2023, 6:15 PM

Yes, i tried with another version as well, 0. 41.0 0.40.32

Saj Dider (Airbyte)

04/05/2023, 6:16 PM

Are there any bootloader logs Shreepad?

docker compose logs -f bootloader

Shreepad Khandve

04/05/2023, 6:16 PM

Yes

Marcos Marx (Airbyte)

04/05/2023, 6:18 PM

https://airbytehq-team.slack.com/archives/C021JANJ6TY/p1679324320554389

Marcos Marx (Airbyte)

04/05/2023, 6:20 PM

docker compose logs -f bootloader > bootloader.txt

Shreepad Khandve

04/05/2023, 6:21 PM

Copy code

airbyte-bootloader  | 2023-04-05 15:15:33 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Schema history table "public"."airbyte_jobs_migrations" already initialized with (0.29.0.001,Baseline from file-based migration v1). Skipping.
airbyte-bootloader  | 2023-04-05 15:15:33 INFO i.a.b.Bootloader(runFlywayMigration):229 - Migrating configs database...
airbyte-bootloader  | 2023-04-05 15:15:33 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
airbyte-bootloader  | 2023-04-05 15:15:33 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Successfully validated 41 migrations (execution time 00:00.013s)
airbyte-bootloader  | 2023-04-05 15:15:33 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Current version of schema "public": 0.41.02.002
airbyte-bootloader  | 2023-04-05 15:15:33 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Schema "public" is up to date. No migration necessary.
airbyte-bootloader  | 2023-04-05 15:15:33 INFO i.a.b.Bootloader(runFlywayMigration):231 - Migrating jobs database...
airbyte-bootloader  | 2023-04-05 15:15:33 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
airbyte-bootloader  | 2023-04-05 15:15:33 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Successfully validated 14 migrations (execution time 00:00.005s)
airbyte-bootloader  | 2023-04-05 15:15:33 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Current version of schema "public": 0.42.0.001
airbyte-bootloader  | 2023-04-05 15:15:33 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Schema "public" is up to date. No migration necessary.
airbyte-bootloader  | 2023-04-05 15:15:33 INFO i.a.b.Bootloader(load):112 - Creating workspace (if none exists)...
airbyte-bootloader  | 2023-04-05 15:15:33 INFO i.a.b.Bootloader(createWorkspaceIfNoneExists):179 - Workspace already exists for the deployment.
airbyte-bootloader  | 2023-04-05 15:15:33 INFO i.a.b.Bootloader(load):115 - Creating deployment (if none exists)...
airbyte-bootloader  | 2023-04-05 15:15:33 INFO i.a.b.Bootloader(createDeploymentIfNoneExists):169 - Running deployment: 626b73e6-5b8f-4593-aea6-ece6c4337ff0
airbyte-bootloader  | 2023-04-05 15:15:33 INFO i.a.b.Bootloader(load):119 - Setting Airbyte version to '0.42.1'...
airbyte-bootloader  | 2023-04-05 15:15:33 INFO i.a.b.Bootloader(load):121 - Set version to '0.42.1'
airbyte-bootloader  | 2023-04-05 15:15:33 INFO i.a.c.i.LocalDefinitionsProvider(getLocalDefinitionCatalog):42 - Loading seed/oss_catalog.json local connector catalog definitions from jar:file:/app/airbyte-bootloader-0.42.1/lib/io.airbyte.airbyte-config-init-0.42.1.jar!/seed/oss_catalog.json
airbyte-bootloader  | 2023-04-05 15:15:33 INFO i.a.c.i.LocalDefinitionsProvider(getLocalDefinitionCatalog):42 - Loading seed/oss_catalog.json local connector catalog definitions from jar:file:/app/airbyte-bootloader-0.42.1/lib/io.airbyte.airbyte-config-init-0.42.1.jar!/seed/oss_catalog.json
airbyte-bootloader  | 2023-04-05 15:15:34 INFO i.a.c.p.ActorDefinitionMigrator(updateConfigsFromSeed):79 - Updating connector definitions from the seed if necessary...
airbyte-bootloader  | 2023-04-05 15:15:34 INFO i.a.c.p.ActorDefinitionMigrator(updateConfigsFromSeed):82 - Connectors in use: [airbyte/source-mysql, airbyte/source-google-ads, <http://docker.io/library/source-yotpo_8mar|docker.io/library/source-yotpo_8mar>, <http://docker.io/airbyte/source-yotpo-reviews-products-fit|docker.io/airbyte/source-yotpo-reviews-products-fit>, airbyte/destination-e2e-test, <http://docker.io/airbyte/source-yotpo-r|docker.io/airbyte/source-yotpo-r>, airbyte/destination-csv, <http://docker.io/airbyte/yotpo|docker.io/airbyte/yotpo>, airbyte/destination-redshift, <http://docker.io/library/source-yotpo_8march|docker.io/library/source-yotpo_8march>, airbyte/source-redshift, <http://docker.io/airbyte/source-yotpo-reviews|docker.io/airbyte/source-yotpo-reviews>, <http://docker.io/airbyte/source-iterate-http|docker.io/airbyte/source-iterate-http>, <http://docker.io/airbyte/source-y_reviews|docker.io/airbyte/source-y_reviews>, airbyte/source-amazon-seller-partner, <http://docker.io/airbyte/source-products|docker.io/airbyte/source-products>, <http://docker.io/airbyte/source-iterate-testing|docker.io/airbyte/source-iterate-testing>, <http://docker.io/airbyte/sourve-iterate-testing|docker.io/airbyte/sourve-iterate-testing>, airbyte/destination-local-json, <http://docker.io/airbyte/source-exchange-rates-tutorial|docker.io/airbyte/source-exchange-rates-tutorial>, airbyte/source-shopify, <http://docker.io/library/sourceyotpo_v3|docker.io/library/sourceyotpo_v3>, <http://docker.io/airbyte/source-products-yotpo|docker.io/airbyte/source-products-yotpo>, airbyte/source-dockerhub, <http://docker.io/airbyte/source-yotpo-products_v1|docker.io/airbyte/source-yotpo-products_v1>, <http://docker.io/airbyte/source-prodco|docker.io/airbyte/source-prodco>, <http://docker.io/airbyte/source-yotpo-reviews-products|docker.io/airbyte/source-yotpo-reviews-products>, <http://docker.io/airbyte/source-yotpo-products]|docker.io/airbyte/source-yotpo-products]>
airbyte-bootloader  | 2023-04-05 15:15:34 WARN i.a.c.p.ActorDefinitionMigrator(lambda$getConnectorRepositoryToInfoMap$3):156 - Duplicated connector version found for <http://docker.io/airbyte/yotpo|docker.io/airbyte/yotpo>: dev (123495cd-7669-48fb-8529-354806ad95f0) vs dev (e60efcdc-2013-4965-bb50-5e1261b04c0c)
airbyte-bootloader  | 2023-04-05 15:15:34 WARN i.a.c.p.ActorDefinitionMigrator(lambda$getConnectorRepositoryToInfoMap$3):156 - Duplicated connector version found for <http://docker.io/airbyte/source-iterate-testing|docker.io/airbyte/source-iterate-testing>: dev (9115cd90-545a-49c5-b049-9c6fba3ad015) vs dev (ff3dfd58-04db-4905-9335-96484cb50192)
airbyte-bootloader  | 2023-04-05 15:15:34 WARN i.a.c.p.ActorDefinitionMigrator(lambda$getConnectorRepositoryToInfoMap$3):156 - Duplicated connector version found for <http://docker.io/airbyte/source-prodco|docker.io/airbyte/source-prodco>: dev (5694c0c7-ea8b-4eec-aad0-483d4c18c8eb) vs dev (60e93cd5-aeb2-429d-8b0f-ac0badb14f56)
airbyte-bootloader  | 2023-04-05 15:15:34 WARN i.a.c.p.ActorDefinitionMigrator(lambda$getConnectorRepositoryToInfoMap$3):156 - Duplicated connector version found for <http://docker.io/airbyte/source-prodco|docker.io/airbyte/source-prodco>: dev (5694c0c7-ea8b-4eec-aad0-483d4c18c8eb) vs dev (19c45007-3913-48e4-9dcb-80cb6bc28293)
airbyte-bootloader  | 2023-04-05 15:15:34 WARN i.a.c.p.ActorDefinitionMigrator(lambda$getConnectorRepositoryToInfoMap$3):156 - Duplicated connector version found for <http://docker.io/airbyte/source-prodco|docker.io/airbyte/source-prodco>: dev (5694c0c7-ea8b-4eec-aad0-483d4c18c8eb) vs dev (3692a0f2-b548-458e-ac2f-5acbf6343011)
airbyte-bootloader  | 2023-04-05 15:15:34 WARN i.a.c.p.ActorDefinitionMigrator(lambda$getConnectorRepositoryToInfoMap$3):156 - Duplicated connector version found for <http://docker.io/airbyte/source-products|docker.io/airbyte/source-products>: dev (01fff8dc-edf1-4cfb-b5b3-3d3c0aa6914b) vs dev (3631b678-9013-409f-94c0-04e3a8684ca7)
airbyte-bootloader  | 2023-04-05 15:15:34 WARN i.a.c.p.ActorDefinitionMigrator(lambda$getConnectorRepositoryToInfoMap$3):156 - Duplicated connector version found for <http://docker.io/airbyte/source-products-yotpo|docker.io/airbyte/source-products-yotpo>: dev (75d9e5fd-6964-4c1f-b4ba-e366d0756be6) vs dev (100e6bef-a84e-4306-8566-1ace7c2b6b32)
airbyte-bootloader  | 2023-04-05 15:15:34 ERROR i.a.b.Application(main):25 - Unable to bootstrap Airbyte environment.
airbyte-bootloader  | java.lang.IllegalArgumentException: Invalid version string: v1
airbyte-bootloader  |   at com.google.common.base.Preconditions.checkArgument(Preconditions.java:145) ~[guava-31.1-jre.jar:?]
airbyte-bootloader  |   at io.airbyte.commons.version.Version.<init>(Version.java:37) ~[io.airbyte-airbyte-commons-0.42.1.jar:?]
airbyte-bootloader  |   at io.airbyte.commons.version.AirbyteVersion.<init>(AirbyteVersion.java:15) ~[io.airbyte-airbyte-commons-0.42.1.jar:?]
airbyte-bootloader  |   at io.airbyte.config.persistence.ActorDefinitionMigrator.lambda$getConnectorRepositoryToInfoMap$3(ActorDefinitionMigrator.java:155) ~[io.airbyte.airbyte-config-config-persistence-0.42.1.jar:?]
airbyte-bootloader  |   at java.util.HashMap.merge(HashMap.java:1391) ~[?:?]
airbyte-bootloader  |   at java.util.stream.Collectors.lambda$toMap$68(Collectors.java:1673) ~[?:?]
airbyte-bootloader  |   at java.util.stream.ReduceOps$3ReducingSink.accept(ReduceOps.java:169) ~[?:?]
airbyte-bootloader  |   at java.util.ArrayList$Itr.forEachRemaining(ArrayList.java:1003) ~[?:?]
airbyte-bootloader  |   at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1921) ~[?:?]
airbyte-bootloader  |   at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509) ~[?:?]
airbyte-bootloader  |   at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?]
airbyte-bootloader  |   at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:921) ~[?:?]
airbyte-bootloader  |   at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]
airbyte-bootloader  |   at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:682) ~[?:?]
airbyte-bootloader  |   at io.airbyte.config.persistence.ActorDefinitionMigrator.getConnectorRepositoryToInfoMap(ActorDefinitionMigrator.java:120) ~[io.airbyte.airbyte-config-config-persistence-0.42.1.jar:?]
airbyte-bootloader  |   at io.airbyte.config.persistence.ActorDefinitionMigrator.updateConfigsFromSeed(ActorDefinitionMigrator.java:84) ~[io.airbyte.airbyte-config-config-persistence-0.42.1.jar:?]
airbyte-bootloader  |   at io.airbyte.config.persistence.ActorDefinitionMigrator.lambda$migrate$0(ActorDefinitionMigrator.java:66) ~[io.airbyte.airbyte-config-config-persistence-0.42.1.jar:?]
airbyte-bootloader  |   at io.airbyte.db.Database.lambda$transaction$0(Database.java:27) ~[io.airbyte.airbyte-db-db-lib-0.42.1.jar:?]
airbyte-bootloader  |   at org.jooq.impl.DefaultDSLContext.lambda$transactionResult0$3(DefaultDSLContext.java:552) ~[jooq-3.17.8.jar:?]
airbyte-bootloader  |   at org.jooq.impl.Tools$3$1.block(Tools.java:5854) ~[jooq-3.17.8.jar:?]
airbyte-bootloader  |   at java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3745) ~[?:?]
airbyte-bootloader  |   at java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3690) ~[?:?]
airbyte-bootloader  |   at org.jooq.impl.Tools$3.get(Tools.java:5851) ~[jooq-3.17.8.jar:?]
airbyte-bootloader  |   at org.jooq.impl.DefaultDSLContext.transactionResult0(DefaultDSLContext.java:600) ~[jooq-3.17.8.jar:?]
airbyte-bootloader  |   at org.jooq.impl.DefaultDSLContext.transactionResult(DefaultDSLContext.java:524) ~[jooq-3.17.8.jar:?]
airbyte-bootloader  |   at io.airbyte.db.Database.transaction(Database.java:27) ~[io.airbyte.airbyte-db-db-lib-0.42.1.jar:?]
airbyte-bootloader  |   at io.airbyte.db.ExceptionWrappingDatabase.transaction(ExceptionWrappingDatabase.java:47) ~[io.airbyte.airbyte-db-db-lib-0.42.1.jar:?]
airbyte-bootloader  |   at io.airbyte.config.persistence.ActorDefinitionMigrator.migrate(ActorDefinitionMigrator.java:64) ~[io.airbyte.airbyte-config-config-persistence-0.42.1.jar:?]
airbyte-bootloader  |   at io.airbyte.config.persistence.ConfigRepository.seedActorDefinitions(ConfigRepository.java:1829) ~[io.airbyte.airbyte-config-config-persistence-0.42.1.jar:?]
airbyte-bootloader  |   at io.airbyte.config.init.ApplyDefinitionsHelper.apply(ApplyDefinitionsHelper.java:70) ~[io.airbyte.airbyte-config-init-0.42.1.jar:?]
airbyte-bootloader  |   at io.airbyte.config.init.ApplyDefinitionsHelper.apply(ApplyDefinitionsHelper.java:44) ~[io.airbyte.airbyte-config-init-0.42.1.jar:?]
airbyte-bootloader  |   at io.airbyte.bootloader.DefaultPostLoadExecutor.execute(DefaultPostLoadExecutor.java:50) ~[io.airbyte-airbyte-bootloader-0.42.1.jar:?]
airbyte-bootloader  |   at io.airbyte.bootloader.Bootloader.load(Bootloader.java:124) ~[io.airbyte-airbyte-bootloader-0.42.1.jar:?]
airbyte-bootloader  |   at io.airbyte.bootloader.Application.main(Application.java:22) ~[io.airbyte-airbyte-bootloader-0.42.1.jar:?]

Marcos Marx (Airbyte)

04/05/2023, 6:23 PM

https://airbytehq-team.slack.com/archives/C021JANJ6TY/p1680701460511279

Marcos Marx (Airbyte)

04/05/2023, 6:24 PM

docker exec -ti airbyte-db psql -U docker airbyte

Marcos Marx (Airbyte)

04/05/2023, 6:25 PM

\d

Marcos Marx (Airbyte)

04/05/2023, 6:25 PM

select * from actor limit 10;

Shreepad Khandve

04/12/2023, 5:16 PM

The above solution worked for me, thanks

Open in Slack

Previous Next