A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

Hi everyone, is there some sort of mapping function to select `SchemaFieldDataTypeClass`  in `SchemaFieldClass` when creating a dataset?

I have a xml export of an ETL job and trying to ingest table defintions into DataHub from this file. In order to select the right data types for the columns I need some sort of mapping (e.g. VARCHAR -&gt; StringTypeClass).

<https://github.com/datahub-project/datahub/blob/master/metadata-ingestion/src/datahub/ingestion/source/sql/sql_common.py#L267>

This is the mapping we use in our ingestion sources!

Hi <@UV5UEC3LN> can you give me an example of how use the dict `_field_type_mapping` or call `get_column_type` . Whatever I tried resulted in NullTypeClass

Thanks in advance!

`get_column_type` gets used in `get_schema_fields_for_column` , here is an example usage for the hive pipeline:
<https://github.com/datahub-project/datahub/blob/master/metadata-ingestion/src/datahub/ingestion/source/sql/hive.py#L66>