Hi All, We are trying to ingest metadata from AWS glue catalog, looker and lookml files & build lineage out of datahub. But datahub is able to pickup lineage information only from looker sources and its not linking the lineage information to glue source. Is there something that we can do to link these two to make the lineage complete?

Hi @witty-actor-87329: are you missing looker -> glue lineage edge?

yes thats right. We maintain our tables structure in AWS glue catalog and for the looker dashboards these are the source. So we want this lineage to be mapped.

got it... so presumably on the Looker side you have a "connection" set up for Looker to pull this from glue

We faced similar issue and the and you can resolve via this parameter in lookml ingestion : connection_to_platform_map: Example : source: type: "lookml" config: base_folder: ./base_models connection_to_platform_map: connection_name_mentioned_in_lookml_file: glue_db_name or similar to this , you can check the urn of the glue dataset to map correctly .

@some-microphone-33485: were you also using Redshift -> Glue?

we are currently using redshift tables -> lookml -> looker charts -> looker dashboards but if you are using redshift spectrum , I believe will work similar way .

got it so in your connection map you mapped "connection_name" -> "redshift"

yes correct , redshift.<name of DB>