Hi, I'm ingesting Redash with Datahub, And enabl...
# ingestion
m
Hi, I'm ingesting Redash with Datahub, And enable the parse_table_names_from_sql: true as the following the doc https://datahubproject.io/docs/generated/ingestion/sources/redash It works fine to get the table name to the inputs, but the sources it still unknown (It support be databricks hive table, detail in the image) Do we have any options to enable us to get the datasources name as well? Thank you so much.
h
Hi @many-hairdresser-79517 Is the table from screenshot from datasource of type "databricks" ?
m
yes correct @hundreds-photographer-13496 but the datahub display as "external source"
h
Hi @many-hairdresser-79517 I was wondering if you have ingested metadata for databricks separately ? What platform does it show up as ?
m
But What I ask is about the input datasource of the Redash, it just only show the name but not the data source type
h
Right. Would you rather have datasource type as hive or databricks in redash ingestion ?
FYI.. currently redash datasource types are mapped as external if its not a recognized datasource - https://github.com/datahub-project/datahub/blob/master/metadata-ingestion/src/datahub/ingestion/source/redash.py#L55
m
@cold-translator-71509 FYI