Hi team, would like to seek your suggestions on how to handle below use case with DataHub 🙇 We use Hive internally for different data platforms, say AWS Data Lake & Azure Data Lake. We’d like to ingest Hive metadata for both data lakes but want to be able to differentiate entities for each data platform despite both are using Hive. And in the UI, users should be able to see tiles for different data platforms in the homepage (not just one Hive tile as in current DataHub). This can be closely translated to data environment in DataHub terminology. It could have been achieved by setting ENV config in the yaml recipes and thus could be part of dataset URN. However, I read that DataHub currently only supports 4 fabric types. What’s the best way we can enhance from the code to achieving this?

Hey @boundless-student-48844 we are working on an evolution of the

dataset key / urn

that allows for adding a platform-instance inside it. This will solve this problem of addressing multiple different installations of hive etc. We are aggressively targeting a release this month for this. Let me know if that addresses your requirement and works with your timeline.

Hey Shirshanka, that’s great to know! Yes a release this month for this is just nice for us! Will look out for it thankyou