Hi, I am trying to build the datahub project, it i...
# getting-started
f
Hi, I am trying to build the datahub project, it is failing. Can anyone help me !!
b
The build seems to be passing at HEAD currently: https://github.com/linkedin/datahub/actions?query=workflow%3A%22build+%26+test%22+branch%3Amaster+event%3Apush What's the error you're getting?
f
I think I was having problem because my system was configured to java 11
i changed it to java 8 and have started the build again .. although it is taking lot of time
b
Yeah please stick to Java 8 for now. Internally we're migrating to Java 11 but that'd take some time.
f
It again failed with the below errors
#10 1533. Report: #10 1533. 17 packages finished
test
successfully: @datahub/pdsc, @nacho-ui/core, @datahub/utils, @nacho-ui/animations, @nacho-ui/avatars, @nacho-ui/button, @nacho-ui/dropdown, @nacho-ui/pill, @nacho-ui/search, @nacho-ui/table, @datahub/entities, @datahub/metadata-types, @datahub/data-models, @datahub/datasets-core, @datahub/shared, @datahub/user, datahub-web #10 1533. 1 packages have been skipped: @datahub/eslint-plugin #10 1533. #10 1533. Done in 1131.73s. #10 1535. #10 1535. > Task datahub webemberBuild #10 1535. yarn workspace v1.13.0 #10 1535. yarn run v1.13.0 #10 1535. $ ember build --environment=production --environment production #10 1538. Building #10 1542. Environment: production #10 1542. building... #10 1643. WARNING: Detected collisions between .js and .ts files of the same name. This can result in nondeterministic build output; see https://git.io/JvIwo for more information. #10 1643. - datahub-web/components/ivy-tabs-tablist.{js,ts} #10 1643. - datahub-web/helpers/changeset-set.{js,ts} #10 1643. - datahub-web/helpers/changeset.{js,ts} #10 1643. - datahub-web/routes/application.{js,ts} #10 1662. The following modules are incompatible with eyeglass 2.4.2: #10 1662. bootstrap-sass needed eyeglass ^0.7.1 #10 1671. [BABEL] Note: The code generator has deoptimised the styling of /datahub-src/datahub-web/packages/data-portal/node_modules/vis/dist/vis.js as it exceeds the max of 500KB. #10 1674. [BABEL] Note: The code generator has deoptimised the styling of /datahub-src/datahub-web/node_modules/lodash/lodash.js as it exceeds the max of 500KB. #10 1715. cleaning up #10 1715. cleaning up... #10 1717. Built project successfully. Stored in "dist/". #10 1717. File sizes: #10 1717. - dist/@datahub/shared/assets/viz-worker-d8770e232accc1b1ac69fd16cb9e7d36.js: 149 B (141 B gzipped) #10 1717. - dist/assets/ace/worker-json-709ca5937fcc673500fca360753d872f.js: 33.02 KB (9.56 KB gzipped) #10 1717. - dist/assets/auto-import-fastboot-d41d8cd98f00b204e9800998ecf8427e.js: 0 B #10 1717. - dist/assets/datahub-web-727ad63c58edf3345f44843a09744635.js: 787.64 KB (102.01 KB gzipped) #10 1717. - dist/assets/datahub-web-89ef0d64250de2de9c6c6fc36aaefef9.css: 259.75 KB (42.56 KB gzipped) #10 1717. - dist/assets/vendor-01977f529f017827c82b161c41515284.js: 6.61 MB (1.67 MB gzipped) #10 1717. - dist/assets/vendor-fa0eb425240ff4380cab25279bf4f23a.css: 22.08 KB (4.1 KB gzipped) #10 1717. - dist/assets/viz.js/render.browser-d23768af8e984ecedbc558b801de689b.js: 68.1 KB (20.88 KB gzipped) #10 1717. - dist/ember-fetch/fetch-fastboot-03b3b34b6d7058c76581182e1c2bf321.js: 1.03 KB (572 B gzipped) #10 1717. Done in 183.41s. #10 1717. Done in 183.75s. #10 1718. #10 1718. > Task datahub webdistZip #10 1718. > Task datahub frontendunzipAssets #10 1718. > Task datahub frontendmoveAssets #10 1719. > Task datahub frontendcreatePlayBinaryAssetsJar #10 1749. > Task datahub frontendcreatePlayBinaryDistributionJar #10 1760. > Task datahub frontendstagePlayBinaryDist #10 1765. > Task datahub frontendcreatePlayBinaryTarDist FAILED #10 1765. #10 1765. FAILURE: Build failed with an exception. #10 1765. #10 1765. * What went wrong: #10 1765. Execution failed for task 'datahub frontendcreatePlayBinaryTarDist'. #10 1765. > Could not add file '/datahub-src/datahub-frontend/build/stage/datahub-frontend/lib/org.neo4j-neo4j-lucene-upgrade-3.4.11.jar' to TAR '/datahub-src/datahub-frontend/build/distributions/datahub-frontend.tar'. #10 1765. #10 1765. * Try: #10 1765. Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. #10 1765. #10 1765. * Get more help at https://help.gradle.org #10 1765. #10 1765. BUILD FAILED in 29m 24s #10 1765. #10 1765. Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. #10 1765. Use '--warning-mode all' to show the individual deprecation warnings. #10 1765. See https://docs.gradle.org/5.6.4/userguide/command_line_interface.html#sec:command_line_warnings #10 1765. 108 actionable tasks: 108 executed #10 1766. #10 1766. FAILURE: Build failed with an exception. #10 1766. #10 1766. * What went wrong: #10 1766. Could not add entry 'datahub frontendcreatePlayBinaryTarDist' to cache executionHistory.bin (/datahub-src/.gradle/5.6.4/executionHistory/executionHistory.bin). #10 1766. > java.io.IOException: No space left on device #10 1766. #10 1766. * Try: #10 1766. Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. #10 1766. #10 1766. * Get more help at https://help.gradle.org #10 1766. #10 1766. Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. #10 1766. Use '--warning-mode all' to show the individual deprecation warnings. #10 1766. See https://docs.gradle.org/5.6.4/userguide/command_line_interface.html#sec:command_line_warnings #10 1766. #10 1766. BUILD FAILED in 29m 25s ------ failed to solve with frontend dockerfile.v0: failed to build LLB: executor failed running [/bin/sh -c cd datahub-src && ./gradlew datahub frontenddist && cp datahub-frontend/build/distributions/datahub-frontend.zip ../datahub-frontend.zip && cd .. && rm -rf datahub-src && unzip datahub-frontend.zip]: runc did not terminate sucessfully ERROR: Service 'datahub-frontend' failed to build
@bumpy-keyboard-50565 is it possible to run the command
Copy code
COMPOSE_DOCKER_CLI_BUILD=1 DOCKER_BUILDKIT=1 docker-compose -p datahub build
without the tests?
b
If you're doing this for local development, I'd recommend using the dev docker image: https://github.com/linkedin/datahub/blob/master/docs/docker/development.md
f
thank you
b
Copy code
java.io.IOException: No space left on device
You're running low on space it seems
f
Oh!! my bad
so sorry to bother you with this
b
No problem. Updated the developer doc with this error: https://github.com/linkedin/datahub/blob/master/docs/developers.md
f
Hi @bumpy-keyboard-50565 i was just performing
./gradlew build
I am getting the below error
can you help me?
b
Can you do a
./gradlew clean
followed by a
./gradlew build
?
f
sure
still getting the same
java -version openjdk version "1.8.0_265" OpenJDK Runtime Environment (build 1.8.0_265-8u265-b01-0ubuntu2~18.04-b01) OpenJDK 64-Bit Server VM (build 25.265-b01, mixed mode)
okay.. don't spend much time on that .. I did some changes
but with fresh checkout i did a gradlew build i got the below errors
Task datahub webemberWorkspaceTest FAILED
FAILURE: Build failed with an exception. * What went wrong: Execution failed for task 'datahub webemberWorkspaceTest'.
Process 'command '/home/ubuntu/linkedin/datahub/datahub-web/build/yarn/yarn-v1.13.0/bin/yarn'' finished with non-zero exit value 1
* Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.6.4/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 4m 7s 246 actionable tasks: 246 executed
b
P.S. I just did a clean check out and it built fine for me on my Mac.