Thread
#getting-started
    a

    aloof-fall-4769

    2 years ago
    Hi All, i was trying out datahub. Am having difficulties while building this project. can anyone help me out? "The import com.linkedin.pegasus2avro cannot be resolved" . And in metadata-events/mxe-schemas there is a script named renaem-namespace.sh which necessarily renames all com.linkedin.* to com.linkedin.pegasus2avro.
    m

    microscopic-receptionist-23548

    2 years ago
    What command are you using to build? Also, if you're just looking to mess with the product, consider using docker
    a

    aloof-fall-4769

    2 years ago
    I am successful with quickstart but i want tostart it in a dveloper mode
    Quickstart pulls the images from teh docker
    m

    microscopic-receptionist-23548

    2 years ago
    what command are you using to build? should just be
    ./gradlew build
    to build everything. Might take awhile though
    a

    aloof-fall-4769

    2 years ago
    I am using "docker-compose up --build" to build
    m

    microscopic-receptionist-23548

    2 years ago
    if you want to use docker and develop see this page
    note that this doesn't work for frontend yet
    for frontend ask @breezy-forest-52817 what the flow is
    docker-compose up --build
    is not going to be right since at the very last we are using docker buildkit
    if you want to rebuild all docker images in non-dev mode see this
    so the full command would be:
    COMPOSE_DOCKER_CLI_BUILD=1 DOCKER_BUILDKIT=1 docker-compose -p datahub build
    a

    aloof-fall-4769

    2 years ago
    Thank you @microscopic-receptionist-23548 .. will try out this command
    I tried ./gradlew build but its failing with below error * What went wrong: Could not determine the dependencies of task ':datahub-dao:compileJava'.
    Could not resolve all task dependencies for configuration ':datahub-dao:compileClasspath'.
    Could not resolve project :metadata-models-ext. Required by: project :datahub-dao > project :metadata-utils > project
    :metadata-events:mxe-utils-avro-1.7
    m

    microscopic-receptionist-23548

    2 years ago
    do you have any local edits and are you up to date? I did a fresth checkout into /tmp and a
    ./gradlew build
    and it worked fine
    I'm on commit
    c07a3a9b8f450783a8219411227202875fb652a3
    if that helps
    a

    aloof-fall-4769

    2 years ago
    OKay, let me do the same , i edited the python script
    m

    microscopic-receptionist-23548

    2 years ago
    which python script?
    a

    aloof-fall-4769

    2 years ago
    Okay, I am getting this as the root cause- Variant 'runtimeElements' capability datahub-master:metadata-models-ext:unspecified: - Incompatible attribute: - Required org.gradle.jvm.version '8' and found incompatible value '11'.
    mysql ingestion script
    m

    microscopic-receptionist-23548

    2 years ago
    mysql ingestion script shouldn't be part of the build
    so your edits shouldn't matter 😛
    do you have java 8 installed? we're still on 8
    a

    aloof-fall-4769

    2 years ago
    i have installed but its not on classpath, let me change that
    Looks like its working @microscopic-receptionist-23548 thank you so much
    m

    microscopic-receptionist-23548

    2 years ago
    ah, glad to hear it
    a

    aloof-fall-4769

    2 years ago
    * What went wrong: Execution failed for task ':datahub-web:emberWorkspaceTest'.
    Process 'command '/home/lopamudra/DataHub-workspace/datahub-master/datahub-master/datahub-web/build/yarn/yarn-v1.13.0/bin/yarn'' finished with non-zero exit value 1
    in the end it is failing with the above error @microscopic-receptionist-23548
    m

    microscopic-receptionist-23548

    2 years ago
    scroll up and it may show the error output, not sure
    @breezy-forest-52817 is more familiar with the frontend
    a

    aloof-fall-4769

    2 years ago
    looks like I am too much of a noob 😥
    I think I can fix
    it is looking for chrome launcher
    m

    microscopic-receptionist-23548

    2 years ago
    I mean this stuff should just be working out of the box 😞
    oh that might be integration tests running?
    a

    aloof-fall-4769

    2 years ago
    yes
    i executed ./gradlew build -x test , still it gave me that error
    m

    microscopic-receptionist-23548

    2 years ago
    might be some testing task not called test, sadly
    a

    aloof-fall-4769

    2 years ago
    oh!!
    While it is starting, @microscopic-receptionist-23548 have you ever come across the issue of CORS with datahub?
    m

    microscopic-receptionist-23548

    2 years ago
    I have no, but @breezy-forest-52817 is going to be more familiar with frontend (I work on backend stuff, CORS is some FE security issue)
    a

    aloof-fall-4769

    2 years ago
    I will bother Charlie some other time. Can you help me understand the coding layers of datahub?
    i mean gms is the api end point but its really complex to understand how the api request are flowing
    m

    microscopic-receptionist-23548

    2 years ago
    Let me know if you have more specific questions not answered by the docs (we can then improve the docs 🙂 )
    b

    bumpy-keyboard-50565

    2 years ago
    Do you mind to create an issue on CORS? We have that enabled internally but it seem that the OSS version doesn't have it.