Hello newbie question think I read somewhere that the hierar | Getting-started

Channels

Thread

#getting-started

curved-magazine-23582

1 year ago

Hello, newbie question: think I read somewhere that the hierarchy / organization of datasets could be configured in DataHub, but I can't find how/where that could be configured or updated? Could that be done through MCE ingestion?

big-carpet-38439

1 year ago

Hi Ming. How were you hoping to configure it?

curved-magazine-23582

1 year ago

not quite sure yet, but hoping to be flexible, like be grouped / organized in multiple ways, by teams or business domains, or by projects, etc. but maybe those could be achieved by some other DataHub concepts? Anyway interested in learning how datasets could be grouped or organized.

microscopic-receptionist-23548

1 year ago

I believe this is determined by the fabric type enum

https://github.com/linkedin/datahub/blob/master/li-utils/src/main/pegasus/com/linkedin/common/FabricType.pdl

So you probably need to fork datahub and change this enum to get your custom values 😕

Good reason for us to stay away from enums in the future 🙂

curved-magazine-23582

1 year ago

Thanks for the info. will read. one quick question: does fabric type just represent different stages/environments of LinkedIn infrastructures?

microscopic-receptionist-23548

1 year ago

yeah, this is a lot of internal LI terminology.

cool-river-24902

1 year ago

@curved-magazine-23582 Is your question for browsing hierarchy? If that’s the case, you can customize it by providing your own logic building browse paths. Check here: https://github.com/linkedin/datahub/blob/5d083143db46eaf4a52eab2461389f75b4e9c356/[…]/com/linkedin/metadata/builders/search/DatasetIndexBuilder.java The underlying support for browse is via browse path field in the entity’s search index.

curved-magazine-23582

1 year ago

ah, good info, will dig into that as well. Thanks!

View count: 1

Join thread in Slack