Hi All, While building Airbyte locally using sudo ...
# ask-community-for-troubleshooting
s
Hi All, While building Airbyte locally using sudo SUB_BUILD=PLATFORM ./gradlew build on unix, getting below issue. Can anyone help on this
Copy code
Task :airbyte-db:jooq:generateJobsDatabaseJooq
2022-05-14 07:13:50 INFO o.t.d.DockerMachineClientProviderStrategy(isApplicable):58 - docker-machine executable was not found on PATH ([/usr/local/sbin, /usr/local/bin, /usr/sbin, /usr/bin, /sbin, /bin, /snap/bin])
2022-05-14 07:13:50 ERROR o.t.d.DockerClientProviderStrategy(lambda$getFirstValidStrategy$4):150 - Could not find a valid Docker environment. Please check configuration. Attempted configurations were:
2022-05-14 07:13:50 ERROR o.t.d.DockerClientProviderStrategy(lambda$getFirstValidStrategy$4):152 -     UnixSocketClientProviderStrategy: failed with exception TimeoutException (org.rnorth.ducttape.TimeoutException: java.util.concurrent.TimeoutException). Root cause TimeoutException (null)
2022-05-14 07:13:50 ERROR o.t.d.DockerClientProviderStrategy(lambda$getFirstValidStrategy$4):154 - As no valid configuration was found, execution cannot continue
2022-05-14 07:13:51 ERROR o.j.t.JooqLogger(error):454 - Error while closing database
java.lang.NullPointerException: Cannot invoke "org.jooq.DSLContext.close()" because "this.dslContext" is null
        at io.airbyte.db.instance.FlywayMigrationDatabase.close(FlywayMigrationDatabase.java:102) ~[io.airbyte.airbyte-db-lib-0.38.3-alpha.jar:?]
        at org.jooq.codegen.GenerationTool.run0(GenerationTool.java:857) [jooq-codegen-3.13.4.jar:?]
        at org.jooq.codegen.GenerationTool.run(GenerationTool.java:222) [jooq-codegen-3.13.4.jar:?]
        at org.jooq.codegen.GenerationTool.generate(GenerationTool.java:217) [jooq-codegen-3.13.4.jar:?]
        at org.jooq.codegen.GenerationTool.main(GenerationTool.java:189) [jooq-codegen-3.13.4.jar:?]
2022-05-14 07:13:53 ERROR o.j.t.JooqLogger(error):454 - Cannot read /home/satish/airbyte/source/airbyte/airbyte-db/jooq/build/tmp/generateJobsDatabaseJooq/config.xml. Error : Failed to launch postgres container and run migration
java.lang.RuntimeException: Failed to launch postgres container and run migration
        at io.airbyte.db.instance.FlywayMigrationDatabase.getInternalConnection(FlywayMigrationDatabase.java:68) ~[io.airbyte.airbyte-db-lib-0.38.3-alpha.jar:?]
        at io.airbyte.db.instance.FlywayMigrationDatabase.create0(FlywayMigrationDatabase.java:60) ~[io.airbyte.airbyte-db-lib-0.38.3-alpha.jar:?]
        at org.jooq.meta.AbstractDatabase.create(AbstractDatabase.java:274) ~[jooq-meta-3.13.4.jar:?]
        at org.jooq.meta.AbstractDatabase.create(AbstractDatabase.java:263) ~[jooq-meta-3.13.4.jar:?]
        at org.jooq.meta.AbstractDatabase.setConnection(AbstractDatabase.java:253) ~[jooq-meta-3.13.4.jar:?]
        at org.jooq.codegen.GenerationTool.run0(GenerationTool.java:521) ~[jooq-codegen-3.13.4.jar:?]
        at org.jooq.codegen.GenerationTool.run(GenerationTool.java:222) ~[jooq-codegen-3.13.4.jar:?]
        at org.jooq.codegen.GenerationTool.generate(GenerationTool.java:217) ~[jooq-codegen-3.13.4.jar:?]
        at org.jooq.codegen.GenerationTool.main(GenerationTool.java:189) [jooq-codegen-3.13.4.jar:?]
Caused by: java.lang.IllegalStateException: Could not find a valid Docker environment. Please see logs and check configuration
        at org.testcontainers.dockerclient.DockerClientProviderStrategy.lambda$getFirstValidStrategy$4(DockerClientProviderStrategy.java:157) ~[testcontainers-1.17.1.jar:?]
        at java.util.Optional.orElseThrow(Optional.java:403) ~[?:?]
        at org.testcontainers.dockerclient.DockerClientProviderStrategy.getFirstValidStrategy(DockerClientProviderStrategy.java:149) ~[testcontainers-1.17.1.jar:?]
        at org.testcontainers.DockerClientFactory.getOrInitializeStrategy(DockerClientFactory.java:147) ~[testcontainers-1.17.1.jar:?]
        at org.testcontainers.DockerClientFactory.client(DockerClientFactory.java:188) ~[testcontainers-1.17.1.jar:?]
        at org.testcontainers.DockerClientFactory$1.getDockerClient(DockerClientFactory.java:102) ~[testcontainers-1.17.1.jar:?]
        at com.github.dockerjava.api.DockerClientDelegate.authConfig(DockerClientDelegate.java:108) ~[docker-java-api-3.2.13.jar:?]
        at org.testcontainers.containers.GenericContainer.start(GenericContainer.java:325) ~[testcontainers-1.17.1.jar:?]
        at io.airbyte.db.instance.FlywayMigrationDatabase.createInternalConnection(FlywayMigrationDatabase.java:84) ~[io.airbyte.airbyte-db-lib-0.38.3-alpha.jar:?]
        at io.airbyte.db.instance.FlywayMigrationDatabase.getInternalConnection(FlywayMigrationDatabase.java:66) ~[io.airbyte.airbyte-db-lib-0.38.3-alpha.jar:?]
        ... 8 more

> Task :airbyte-db:jooq:generateJobsDatabaseJooq FAILED
Issue got resolved after docker-machine installed. Thanks
a
Hi Satish, have you successfully built the project? I am also trying to build it locally but it has always failed. May I know what OS are you using?
s
@Alec Dou not yet. Facing issues while making progress. Now struct at
Copy code
> Task :buildDockerImage-container-orchestrator
Building image using context '/home/satish/airbyte/source/airbyte/airbyte-container-orchestrator/build/docker'.

> Task :airbyte-bootloader:test

BootloaderAppTest > testPostLoadExecutionExecutes() FAILED
    java.lang.IllegalStateException: Could not find a valid Docker environment. Please see logs and check configuration
        at org.testcontainers.dockerclient.DockerClientProviderStrategy.lambda$getFirstValidStrategy$4(DockerClientProviderStrategy.java:157)
        at java.base/java.util.Optional.orElseThrow(Optional.java:403)
        at org.testcontainers.dockerclient.DockerClientProviderStrategy.getFirstValidStrategy(DockerClientProviderStrategy.java:149)
        at org.testcontainers.DockerClientFactory.getOrInitializeStrategy(DockerClientFactory.java:147)
        at org.testcontainers.DockerClientFactory.client(DockerClientFactory.java:188)
        at org.testcontainers.DockerClientFactory$1.getDockerClient(DockerClientFactory.java:102)
        at com.github.dockerjava.api.DockerClientDelegate.authConfig(DockerClientDelegate.java:108)
        at org.testcontainers.containers.GenericContainer.start(GenericContainer.java:325)
        at io.airbyte.bootloader.BootloaderAppTest.setup(BootloaderAppTest.java:69)
I am using Ubuntu 22.04 LTS
Need help to resolve Task airbyte bootloadertest BootloaderAppTest > testPostLoadExecutionExecutes() FAILED org.testcontainers.containers.ContainerLaunchException: Container startup failed at app//org.testcontainers.containers.GenericContainer.doStart(GenericContainer.java:345) at app//org.testcontainers.containers.GenericContainer.start(GenericContainer.java:326) at app//io.airbyte.bootloader.BootloaderAppTest.setup(BootloaderAppTest.java:69)