Hi Team, We are trying to implement Columnar level lineage for Vertica Source. Can anyone provide where can we get the more information about column level lineage?

Hi Rajasekhar, I wanted to share some information about a configuration option that might be useful for you. It's about including column-level lineage for view-to-view and table-to-view lineage using DataHub's SQL parser.

include_view_column_lineage : Populates column-level lineage for view->view and table->view lineage using DataHub's sql parser, Requires include_view_lineage to be enabled.

Here's a sample configuration you can use:

source:
 type: vertica
 config:
 # Coordinates
 host_port: localhost:5433
 database: DATABASE_NAME

 # Credentials
 username: "${VERTICA_USER}"
 password: "${VERTICA_PASSWORD}"
 
 include_tables: true
 include_views: true
 include_projections: true
 include_models: true
 include_view_lineage: true
 include_projection_lineage: true
 include_view_column_lineage: true

sink:
 type: "datahub-rest"
 config:
 server: "<http://localhost:8080>"

If you need more details, you can check out the documentation here Thanks, Avani

Thanks for the details. I am from Vertica partner team. we have not implemented view_lineage that you have mention with vertica. I am asking is there any docs for us to develop that feature?

@dazzling-judge-80093 Do you have any suggestions here?

hi, @dazzling-judge-80093 Can you please help with above ?