Hi guys, first I really like the product and really considering suggesting this for our organization. I've been looking everywhere for an elegant solution such as DataHub. I am doing a small PoC and would like to see it loaded with our data. We have Oracle as our main source, and saw it it is not yet supported. As a work-around I would like to ingest some manual extracts, so from a file source. But I have difficulties understanding how to get the file in a shape that the ingestor can understand. I couldn't find anything in your documentation. E.g. We have some metadata already trapped in some tables that could be easily be exported in json or csv, or anything else. What are the required fields, data structure, etc to ingest this?

So currently the ingestion framework can be configured to ingest from files. However, the files must contain well-formed metadata that conforms to the MetadataChangeEvent schema. For your reference: https://datahubproject.io/docs/metadata-ingestion#file-file. This directory contains some files that can serve as examples. In your case, you'll have to produce files that contain MCE json objects and then configure the ingestion framework to ingest from the File as a source

Hi @faint-hair-91313 - let me just add an Oracle ingestion source for you

Thanks @gray-shoe-75895, I cannot test this just yet, as I don't have a final integrated environment set-up.

I see - you'd likely need to construct a script to convert from the form you have to the DataHub model