Hello Team, I made changes to datahub frontend and...
# troubleshoot
m
Hello Team, I made changes to datahub frontend and trying to build the image However, the build takes forever to run with the below information
Copy code
[+] Building 205.1s (25/32)
 => [internal] load build definition from Dockerfile                                                                                                                                                           0.0s
 => => transferring dockerfile: 37B                                                                                                                                                                            0.0s
 => [internal] load .dockerignore                                                                                                                                                                              0.0s
 => => transferring context: 35B                                                                                                                                                                               0.0s
 => [internal] load metadata for <http://docker.io/library/node:16.13.0-alpine3.14|docker.io/library/node:16.13.0-alpine3.14>                                                                                                                                     1.0s
 => [internal] load metadata for <http://docker.io/library/alpine:3.14|docker.io/library/alpine:3.14>                                                                                                                                                 1.0s
 => [auth] library/node:pull token for <http://registry-1.docker.io|registry-1.docker.io>                                                                                                                                                    0.0s
 => [auth] library/alpine:pull token for <http://registry-1.docker.io|registry-1.docker.io>                                                                                                                                                  0.0s
 => [prod-build  1/16] FROM <http://docker.io/library/node:16.13.0-alpine3.14@sha256:60ef0bed1dc2ec835cfe3c4226d074fdfaba571fd619c280474cc04e93f0ec5b|docker.io/library/node:16.13.0-alpine3.14@sha256:60ef0bed1dc2ec835cfe3c4226d074fdfaba571fd619c280474cc04e93f0ec5b>                                                                  0.0s
 => [internal] load build context                                                                                                                                                                              0.2s
 => => transferring context: 471.64kB                                                                                                                                                                          0.2s
 => [base 1/3] FROM <http://docker.io/library/alpine:3.14@sha256:4c869a63e1b7c0722fed1e402a6466610327c3b83bdddb94bd94fb71da7f638a|docker.io/library/alpine:3.14@sha256:4c869a63e1b7c0722fed1e402a6466610327c3b83bdddb94bd94fb71da7f638a>                                                                                      0.0s
 => CACHED [base 2/3] RUN addgroup -S datahub && adduser -S datahub -G datahub                                                                                                                                 0.0s
 => CACHED [base 3/3] RUN apk --no-cache --update-cache --available upgrade     && apk --no-cache add curl     && apk --no-cache add openjdk11-jre --repository=<http://dl-cdn.alpinelinux.org/alpine/edge/com>  0.0s
 => CACHED [prod-build  2/16] RUN apk --no-cache --update-cache --available upgrade     && apk --no-cache add perl openjdk8 openjdk11                                                                          0.0s
 => CACHED [prod-build  3/16] COPY ./datahub-frontend ./datahub-src/datahub-frontend                                                                                                                           0.0s
 => CACHED [prod-build  4/16] COPY ./entity-registry ./datahub-src/entity-registry                                                                                                                             0.0s
 => CACHED [prod-build  5/16] COPY ./buildSrc ./datahub-src/buildSrc                                                                                                                                           0.0s
 => [prod-build  6/16] COPY ./datahub-web-react ./datahub-src/datahub-web-react                                                                                                                                0.1s
 => [prod-build  7/16] COPY ./li-utils ./datahub-src/li-utils                                                                                                                                                  0.0s
 => [prod-build  8/16] COPY ./metadata-models ./datahub-src/metadata-models                                                                                                                                    0.0s
 => [prod-build  9/16] COPY ./metadata-models-validator ./datahub-src/metadata-models-validator                                                                                                                0.0s
 => [prod-build 10/16] COPY ./metadata-utils ./datahub-src/metadata-utils                                                                                                                                      0.0s
 => [prod-build 11/16] COPY ./metadata-service ./datahub-src/metadata-service                                                                                                                                  0.0s
 => [prod-build 12/16] COPY ./metadata-io ./datahub-src/metadata-io                                                                                                                                            0.0s
 => [prod-build 13/16] COPY ./datahub-graphql-core ./datahub-src/datahub-graphql-core                                                                                                                          0.1s
 => [prod-build 14/16] COPY ./gradle ./datahub-src/gradle                                                                                                                                                      0.0s
 => [prod-build 15/16] COPY repositories.gradle gradle.properties gradlew settings.gradle build.gradle ./datahub-src/                                                                                          0.0s
 => [prod-build 16/16] RUN cd datahub-src     && ./gradlew :datahub-web-react:build -x test -x yarnTest -x yarnLint     && ./gradlew :datahub-frontend:dist -PuseSystemNode=true -x test -x yarnTest -x yar  203.3s
 => => # at org.gradle.configuration.internal.DefaultUserCodeApplicationContext.apply(DefaultUserCodeApplicationContext.java:43)
 => => # at org.gradle.api.internal.plugins.DefaultPluginManager.doApply(DefaultPluginManager.java:156)
 => => # ... 190 more
 => => # fullVersion=0.0.0-unknown-SNAPSHOT
 => => # cliMajorVersion=0.0.0-unknown-SNAPSHOT
 => => # version=0.0.0-unknown-SNAPSHOT
Can someone help me here ?
I'm building the image in Mac M1 machine
a
Hi Rakesh, how long is “forever”? It’s not uncommon for the first build to take 5+ minutes, sometimes over ten depending on hardware. Could you try the steps here: https://datahubproject.io/docs/debugging/
m
Hi Paul, Let's ignore the Mac M1 run which takes 22 hrs and still running to build the frontend image Now I created an EC2 instance-Ubuntu and started the build However, the build fails with the below reason
Copy code
#24 224.6 [19:07:26] Generate to src/ (using EXPERIMENTAL preset "near-operation-file") [completed]
#24 224.6 [19:07:26] Generate outputs [completed]
#24 232.1 Creating an optimized production build...
#24 233.6 Browserslist: caniuse-lite is outdated. Please run:
#24 233.6 npx browserslist@latest --update-db
#24 233.6
#24 233.6 Why you should do it regularly:
#24 233.6 <https://github.com/browserslist/browserslist#browsers-data-updating>
#24 235.6 Failed to compile.error Command failed with exit code 1.
#24 235.6
#24 235.6 ./src/App.tsx
#24 235.6 Cannot find module: 'react-helmet'. Make sure this package is installed.
#24 235.6
#24 235.6 You can install this package by running: yarn add react-helmet.
#24 235.6
#24 235.6
#24 235.6
#24 235.6 info Visit <https://yarnpkg.com/en/docs/cli/run> for documentation about this command.
#24 235.7
#24 235.7 > Task :datahub-web-react:yarnBuild FAILED
#24 235.7
#24 235.7 FAILURE: Build failed with an exception.
#24 235.7
#24 235.7 * What went wrong:
#24 235.7 Execution failed for task ':datahub-web-react:yarnBuild'.
#24 235.7 > Process 'command 'yarn'' finished with non-zero exit value 1
#24 235.7
#24 235.7 * Try:
#24 235.7 Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
#24 235.7
#24 235.7 * Get more help at <https://help.gradle.org>
#24 235.7
#24 235.7 Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
#24 235.7 Use '--warning-mode all' to show the individual deprecation warnings.
#24 235.7 See <https://docs.gradle.org/6.9.2/userguide/command_line_interface.html#sec:command_line_warnings>
#24 235.7
#24 235.7 BUILD FAILED in 3m 55s
#24 235.7 3 actionable tasks: 3 executed
------
executor failed running [/bin/sh -c cd datahub-src     && ./gradlew :datahub-web-react:build -x test -x yarnTest -x yarnLint     && ./gradlew :datahub-frontend:dist -PuseSystemNode=${USE_SYSTEM_NODE} -x test -x yarnTest -x yarnLint     && cp datahub-frontend/build/distributions/datahub-frontend.zip ../datahub-frontend.zip     && cd .. && rm -rf datahub-src && unzip datahub-frontend.zip]: exit code: 1
Any help will be appreciated!
a
looks like you’re missing a react module, what command did you run to build?
m
Copy code
DOCKER_BUILDKIT=1 docker build datahub -f datahub/docker/datahub-frontend/Dockerfile -t datahub-frontend-react
I'm making a git pull from the datahub repo
making changes to datahub-frontend and then building the image
a
m
not yet Thanks for sharing
Basically we are making changes in the datahub-web-react folder
changes like: 1. changing logos 2. adding analytics plugins under src/app 3. adding theme under src/conf/theme 4. adding logos under src/images
a
and the
Copy code
./gradlew :datahub-frontend:dist -x yarnTest -x yarnLint
was unhelpful?
m
Basically, I was overriding the package.json which didn't have the react-helmet package it works now !!