Hi datahub team! Currently I'm working to create ...
# ingestion
e
Hi datahub team! Currently I'm working to create a ingest of lookml into datahub. But when I have some view defined as "derived table" because is created with a join of different tables, the linage of data is not show it. In other hand, all the views defined as direct relation of only one table, show its linage. Could you help me to understand how map correctly to show all the relations?
h
Did you try setting
parse_table_names_from_sql
to True in the recipe? Be aware, depending on how complicated your sqls are, you might have a really bad time getting the result you're expecting. The current implementation uses a open-source sql parser, which might or might not support the dialect of SQL that your "backend" database is using. For example, Snowflakes dialect is not supported in full, not sure about Redshift. I had to work around this by implementing a custom parser, that makes EXPLAIN queries to Snowflake, and take it into use in the recipe (
sql_parser
). Furthermore, LookML allows defining templated filters and "liquid parameters" which are most certainly not supported by the default parser. I just ran into this problem myself today, and the current implementation of the lookml ingestor does not handle these parameters at all. FYI @mammoth-bear-12532
e
That's work! Really thanks.
🎉 1
s
thanks a lot @high-hospital-85984