I have a few questions wrt. this recently created file: https://github.com/linkedin/datahub/blob/master/docker/datahub-ingestion/Dockerfile Is this meant to be a standalone deployment or part of the compose ecosystem? Because as I’m doing something similar at work, I’m trying to use this component. However I’m hitting some issues when building the image. (Examples is that gradle is not pre-installed in the openjdk8, so I switched this out for the gradle one.) Not sure if this is the purpose or if I’m just doing something wrong here. 🙂

@gray-shoe-75895 can probably help here.

Thanks! But I think i’m just building it wrong. I’m checking the github actions and the logs and it works there, so I’ll adjust the way I build to something more similar 🙂 (update: resolved this in the meantime, I’ll just wait on the fix for LinkedIn artifactory issue before I continue with this, or just wait on the push to dockerhub to be green. )

Yep that file is meant to be used as a standalone component, but we'll also be updating the quickstart guide to use it when populating sample data. I'm waiting for the build to turn green and then will be raising a follow up that should resolve a minor dependency issue that wasn't caught in CI. Getting that PR merged will also automatically push to docker hub. For reference in the future, the command to build the image locally is

docker build -f ./docker/datahub-ingestion/Dockerfile .

, but it won't work right now because of the artifactory issues

Jup, saw it cool! 🙂 We kind of wanted to use it in our ingestion repo, which was the reason for me trying this out. But thanks for explanation and the update!

Wanted to close the loop - the image is pushed to Docker hub here https://hub.docker.com/r/linkedin/datahub-ingestion - let me know if you run into any issues 🙂