A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

DatasetUrn's look to be of the form `urn:li:dataset:(urn:li:dataPlatform:{platform},{dataset_name},PROD)`
where platform seems to be an enum, something like hive, hdfs, kafka, mysql, etc.
is it possible to specify other values for `platform?` can i supply whatever value i want? it seems like i can't, i'm getting pegasus errors

i believe the available data platforms are configured here:
<https://github.com/linkedin/datahub/blob/master/gms/impl/src/main/resources/DataPlatformInfo.json>

you can think of the "enum" in DataPlatform as it's primary key -- we do validate that the primary key exists in some instances

However, the primary key set is defined by this json file, so to add new platforms you just need to change the above ^ and restart datahub-gms :slightly_smiling_face: