Title
#getting-started
a

aloof-fall-4769

09/16/2020, 11:53 PM
Hi All, i was trying out datahub. Am having difficulties while building this project. can anyone help me out? "The import com.linkedin.pegasus2avro cannot be resolved" . And in metadata-events/mxe-schemas there is a script named renaem-namespace.sh which necessarily renames all com.linkedin.* to com.linkedin.pegasus2avro.
m

microscopic-receptionist-23548

09/16/2020, 11:56 PM
11:56 PM
What command are you using to build? Also, if you're just looking to mess with the product, consider using docker
a

aloof-fall-4769

09/17/2020, 12:05 AM
I am successful with quickstart but i want tostart it in a dveloper mode
12:06 AM
Quickstart pulls the images from teh docker
m

microscopic-receptionist-23548

09/17/2020, 12:06 AM
what command are you using to build? should just be
./gradlew build
to build everything. Might take awhile though
a

aloof-fall-4769

09/17/2020, 12:07 AM
I am using "docker-compose up --build" to build
m

microscopic-receptionist-23548

09/17/2020, 12:07 AM
if you want to use docker and develop see this page
12:07 AM
note that this doesn't work for frontend yet
12:07 AM
for frontend ask @breezy-forest-52817 what the flow is
12:08 AM
docker-compose up --build
is not going to be right since at the very last we are using docker buildkit
12:08 AM
if you want to rebuild all docker images in non-dev mode see this
12:09 AM
so the full command would be:
12:09 AM
COMPOSE_DOCKER_CLI_BUILD=1 DOCKER_BUILDKIT=1 docker-compose -p datahub build
a

aloof-fall-4769

09/17/2020, 12:10 AM
Thank you @microscopic-receptionist-23548 .. will try out this command
12:16 AM
I tried ./gradlew build but its failing with below error * What went wrong: Could not determine the dependencies of task ':datahub-dao:compileJava'.
Could not resolve all task dependencies for configuration ':datahub-dao:compileClasspath'.
Could not resolve project :metadata-models-ext. Required by: project :datahub-dao > project :metadata-utils > project
:metadata-events:mxe-utils-avro-1.7
m

microscopic-receptionist-23548

09/17/2020, 12:21 AM
do you have any local edits and are you up to date? I did a fresth checkout into /tmp and a
./gradlew build
and it worked fine
12:21 AM
I'm on commit
c07a3a9b8f450783a8219411227202875fb652a3
if that helps
a

aloof-fall-4769

09/17/2020, 12:21 AM
OKay, let me do the same , i edited the python script
m

microscopic-receptionist-23548

09/17/2020, 12:21 AM
which python script?
a

aloof-fall-4769

09/17/2020, 12:26 AM
Okay, I am getting this as the root cause- Variant 'runtimeElements' capability datahub-master:metadata-models-ext:unspecified: - Incompatible attribute: - Required org.gradle.jvm.version '8' and found incompatible value '11'.
12:27 AM
mysql ingestion script
m

microscopic-receptionist-23548

09/17/2020, 12:27 AM
mysql ingestion script shouldn't be part of the build
12:27 AM
so your edits shouldn't matter 😛
12:28 AM
do you have java 8 installed? we're still on 8
a

aloof-fall-4769

09/17/2020, 12:29 AM
i have installed but its not on classpath, let me change that
12:37 AM
Looks like its working @microscopic-receptionist-23548 thank you so much
m

microscopic-receptionist-23548

09/17/2020, 12:43 AM
ah, glad to hear it
a

aloof-fall-4769

09/17/2020, 1:10 AM
* What went wrong: Execution failed for task ':datahub-web:emberWorkspaceTest'.
Process 'command '/home/lopamudra/DataHub-workspace/datahub-master/datahub-master/datahub-web/build/yarn/yarn-v1.13.0/bin/yarn'' finished with non-zero exit value 1
1:10 AM
in the end it is failing with the above error @microscopic-receptionist-23548
m

microscopic-receptionist-23548

09/17/2020, 1:10 AM
scroll up and it may show the error output, not sure
1:10 AM
@breezy-forest-52817 is more familiar with the frontend
a

aloof-fall-4769

09/17/2020, 1:10 AM
looks like I am too much of a noob 😥
1:11 AM
I think I can fix
1:12 AM
it is looking for chrome launcher
m

microscopic-receptionist-23548

09/17/2020, 1:12 AM
I mean this stuff should just be working out of the box 😞
1:12 AM
oh that might be integration tests running?
a

aloof-fall-4769

09/17/2020, 1:14 AM
yes
1:15 AM
i executed ./gradlew build -x test , still it gave me that error
m

microscopic-receptionist-23548

09/17/2020, 1:15 AM
might be some testing task not called test, sadly
a

aloof-fall-4769

09/17/2020, 1:17 AM
oh!!
1:19 AM
While it is starting, @microscopic-receptionist-23548 have you ever come across the issue of CORS with datahub?
m

microscopic-receptionist-23548

09/17/2020, 1:20 AM
I have no, but @breezy-forest-52817 is going to be more familiar with frontend (I work on backend stuff, CORS is some FE security issue)
a

aloof-fall-4769

09/17/2020, 1:21 AM
I will bother Charlie some other time. Can you help me understand the coding layers of datahub?
1:21 AM
i mean gms is the api end point but its really complex to understand how the api request are flowing
m

microscopic-receptionist-23548

09/17/2020, 1:21 AM
1:22 AM
Let me know if you have more specific questions not answered by the docs (we can then improve the docs 🙂 )
b

bumpy-keyboard-50565

09/17/2020, 3:00 AM
Do you mind to create an issue on CORS? We have that enabled internally but it seem that the OSS version doesn't have it.