A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

Hey Team good morning! :wave: Lineage question -&gt; What could cause lineage to be set for some datasets but not others if they come from the same source/schema? Details in :thread:

We have some Redshift tables called `subscriptions.table_name` . We are using Glue as the metastore for these tables. How come some of these Redshift tables can be correctly tied to Glue, but others from the same schema are not?

image.png

Question 2: Is there a way to fix this? :slightly_smiling_face:

Hi! This video goes through our Redshift lineage feature and explains how we get the linkages: <https://www.youtube.com/watch?v=3zX1Bf6qYaQ>

To fix this you would need to make sure the datasets align with our requirements outlined in the video