A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

I'm implementing a custom SQL parser (Snowflake dialect) for use with for example the LookML integration. I'm looking at the <https://github.com/linkedin/datahub/blob/52272d65610fe06d7c1a0165a3745f087318f102/metadata-ingestion/src/datahub/utilities/sql_parser.py#L32|get_columns> function, and can't really figure out what the output should be. Is it supposed to return the "schema" of the lookml view, or the source columns from a lineage point of view? Based on the tests it's only the column names, without any possible source table prefix?

Check out the tests, I think it can help -&gt; <https://github.com/linkedin/datahub/blob/master/metadata-ingestion/tests/unit/test_utilities.py>

it returns the columns from the sql query

so if your query is `select a, b, c from mytable` then it should return `a`  and `b` and `c`

Thanks! And digging through the code shows that the name-strings <https://github.com/linkedin/datahub/blob/52272d65610fe06d7c1a0165a3745f087318f102/metadata-ingestion/src/datahub/ingestion/source/lookml.py#L675|end up> in `ViewField` - objects, which in turn are used to generate the schema.