Hi team! Can I ingest a generic dataset from a schema defined in a yaml file? like you can do with glossary terms... We want to document an existing corporate self service portal where anyone can schedule periodic exports from APIs to data lakes, so we want to catalog which data this platform offers. I say generic dataset because it come from a custom technology and not a specific database.

Ricardo, I tried something similar to ingest data from Quicksight which is not currently supported. I consume metadata from Quicksight API using a python script, and I build a

MetadataChangeEvent

and emit the event using the

DatahubRestEmitter

....

thanks @nice-country-99675