https://datahubproject.io logo
Join SlackCommunities
Powered by
Hi All, i was trying out datahub. Am having diffic...
# getting-started
a
Hi All, i was trying out datahub. Am having difficulties while building this project. can anyone help me out? "The import com.linkedin.pegasus2avro cannot be resolved" . And in metadata-events/mxe-schemas there is a script named renaem-namespace.sh which necessarily renames all com.linkedin.* to com.linkedin.pegasus2avro.
m
What command are you using to build? Also, if you're just looking to mess with the product, consider using docker
a
I am successful with quickstart but i want tostart it in a dveloper mode
Quickstart pulls the images from teh docker
m
what command are you using to build? should just be 
./gradlew build
to build everything. Might take awhile though
👀 1
a
I am using "docker-compose up --build" to build
m
if you want to use docker and develop see this page
note that this doesn't work for frontend yet
for frontend ask @breezy-forest-52817 what the flow is
docker-compose up --build
is not going to be right since at the very last we are using docker buildkit
if you want to rebuild all docker images in non-dev mode see this
so the full command would be:
Copy code
COMPOSE_DOCKER_CLI_BUILD=1 DOCKER_BUILDKIT=1 docker-compose -p datahub build
a
Thank you @microscopic-receptionist-23548 .. will try out this command
I tried ./gradlew build but its failing with below error * What went wrong: Could not determine the dependencies of task 'datahub daocompileJava'.
Could not resolve all task dependencies for configuration 'datahub daocompileClasspath'.
> Could not resolve project :metadata-models-ext. Required by: project :datahub-dao > project :metadata-utils > project metadata eventsmxe-utils-avro-1.7
m
do you have any local edits and are you up to date? I did a fresth checkout into /tmp and a 
./gradlew build
and it worked fine
I'm on commit 
c07a3a9b8f450783a8219411227202875fb652a3
if that helps
a
OKay, let me do the same , i edited the python script
m
which python script?
a
Okay, I am getting this as the root cause - Variant 'runtimeElements' capability datahub-mastermetadata models extunspecified: - Incompatible attribute: - Required org.gradle.jvm.version '8' and found incompatible value '11'.
mysql ingestion script
m
mysql ingestion script shouldn't be part of the build
so your edits shouldn't matter 😛
do you have java 8 installed? we're still on 8
a
i have installed but its not on classpath, let me change that
Looks like its working @microscopic-receptionist-23548 thank you so much
m
ah, glad to hear it
a
* What went wrong: Execution failed for task 'datahub webemberWorkspaceTest'.
Process 'command '/home/lopamudra/DataHub-workspace/datahub-master/datahub-master/datahub-web/build/yarn/yarn-v1.13.0/bin/yarn'' finished with non-zero exit value 1
in the end it is failing with the above error @microscopic-receptionist-23548
m
scroll up and it may show the error output, not sure
@breezy-forest-52817 is more familiar with the frontend
a
looks like I am too much of a noob 😥
I think I can fix
it is looking for chrome launcher
m
I mean this stuff should just be working out of the box 😞
oh that might be integration tests running?
a
yes
i executed ./gradlew build -x test , still it gave me that error
m
might be some testing task not called test, sadly
a
oh!!
While it is starting, @microscopic-receptionist-23548 have you ever come across the issue of CORS with datahub?
m
I have no, but @breezy-forest-52817 is going to be more familiar with frontend (I work on backend stuff, CORS is some FE security issue)
a
I will bother Charlie some other time. Can you help me understand the coding layers of datahub?
i mean gms is the api end point but its really complex to understand how the api request are flowing
m
Let me know if you have more specific questions not answered by the docs (we can then improve the docs 🙂 )
b
Do you mind to create an issue on CORS? We have that enabled internally but it seem that the OSS version doesn't have it.
2 Views
Open in Slack
PreviousNext
Powered by