A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

Hi Team. Today for a few hours the GitHub repo <https://github.com/confluentinc/confluent-docker-utils/tree/master|confluent-docker-utils> went offline, which caused the building of `kafka-setup` to fail. :grimacing:

I made <https://github.com/datahub-project/datahub/pull/8682|this PR> so we no longer have this repo as a dependency, which will make the build slimmer and also more robust. Please check if it makes sense. Thanks! :pray:

<@U03MF8MU5P0> I saw you fixed the `cub` usage issue by introducing a `kafka-ready.sh` script. Would it make sense to remove the pip installation of confluent-docker-utils since it seems also no longer required based on your removal of the `cub` command <https://github.com/datahub-project/datahub/pull/8677/files#diff-49b80548c7d96c9546170eefe1ef5340ef1d1a7e3dd67c4cd9f0655736156526R52|here>?

You can also check my PR above to see if it is a reasonable alternative. :slightly_smiling_face:

You’re probably right, those other packages are likely no longer needed. Happy to approve a PR remove those lines, otherwise will remove them the next time I need to touch that kafka-setup image.

<@U03MF8MU5P0> Thanks for the response! Sure, I opened <https://github.com/datahub-project/datahub/pull/8715|another PR> to remove those lines. Please feel free to check. :slightly_smiling_face: