Hey all, is there a way for a user to provide the metadata for a custom data source on datahub through the UI? For example, we're ingesting data from an XML API, and we want to know the types for the incoming columns belonging to tables, if a user could register the metadata for the tables, we could grab this data from datahub directly.

hey Jam! very good question. I guess I have a question first for you - why are you not able to ingest the metadata that you desire? (types) but as of now this isn't supported in DataHub but is something that makes sense!

Currently, the XML API (outside of our control) doesn't have a way to grab the metadata of tables. We've compiled the metadata ourselves and put it into a csv. Ideally, users could register the metadata for any data source into a central location (datahub), and ingestion can be informed from there. This would help in scenarios where crawling the source system is not an option. Is there some pattern we can follow when using datahub to get a similar outcome (have datahub inform ingestion when the data source doesn't provide metadata)?