A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

Hi people,
Is there a way to mass add the descriptions for the columns and table names within a schema from a csv file or some other kind of document?

~i believe the upcoming townhall <#CUMV92XRQ|announcements> has something relevant about this.~ 
Sorry, seems like the csv enricher is purely for tags and terms and owners.

else, if you're comfortable with writing and running python scripts, there are sample scripts in metadata-ingestion/examples/library that shows how to query existing entities, update and push back the information to datahub.
your use case will be to read from csv, find the entity to update, query for existing information, enrich it and emit it back

okay thank you, I'll research that option!

hey <@U03LYB2ESJ0> I plan to update the CSV enricher to also bulk import descriptions. this should be available very soon!

<@U02DZ51RCK0> that's wonderful news, thank you, will be looking forward for that!

I’ll be sure to let you know when it’s out! Sometime early next week for sure

<@U02DZ51RCK0> I'm a bit confused with the description of the csv-inricher on the web site, could you please help me. It says "This plugin is used to apply glossary terms, tags and owners", but nothing about descriptions that I thought we were talking about. Is it possible to add not only tags and owners and terms, but Descriptions also?

its not updated yet. the latest version only does tags terms and owners

<@U01TCN40JKV> <@U02DZ51RCK0> but is it planned to include descriptions into this?

hey <@U03LYB2ESJ0> sorry I’ve been sick the last couple days and haven’t had time to add descriptions to the plugin. xL is right, currently it’s just tags, terms and owners but the next CLI release will have descriptions

<@U02DZ51RCK0> no rush, thank you! I just wanted to know if it's in the plans. Hope you're feeling better now.

For sure! And yes, thank you for asking :slightly_smiling_face:

Hey <@U03LYB2ESJ0> just wanted you to know that support for descriptions has been added in master (check out <https://github.com/datahub-project/datahub/pull/5346|the PR> if you’re interested), and will be available for use in the next Python release!

Hey <@U02DZ51RCK0> thank you very much for the alert! and sorry for long reply:sweat_smile:

No worries at all! Please let me know how that works for you :slightly_smiling_face: