Hello, everyone, how to create these lineages in t...
# ingestion
l
Hello, everyone, how to create these lineages in the demonstration case? Postgres does not have this config (include_table_lineage: true). I want to create lineages automatically with ingest metadata. Thanks for your help https://demo.datahubproject.io/dataset/urn:li:dataset:(urn:li:dataPlatform:postgres,jaffle_shop.dbt_jaffle.orders,PROD)/?is_lineage_mode=true https://datahubproject.io/docs/generated/ingestion/sources/postgres
c
These lineages can be produced automatically from spark or airflow but if if you are not using any of them then you would need to emit these lineages manually using emitter libraries (java, python) or openapi. You can use datahub cli as well to push the lineages. There are example available here
You can check file based lineage as well
l
Thanks😁