Hello channel. I have a silly question. I want to make lineage with

glue pipelines

that I imported from aws source. I could manage to use

Airflow backend for lineage

but I do not find documentation how to configure

glue

as a job to connect two differents `datasets`(also glue). Anyone has any reference? Thanks in advance!!

Hey @wooden-football-7175! I authored our Glue connector. What kind of lineage are you looking to find and what types of workflows are you ingesting?

Hello Kevin. For example, when I imported metadata from glue, imported all my glue jobs as pipelines. I am wondering to know if for example with airflow lineage I can replace or reference that pipeline automatically inside lineage. example:

dataset --> airflow task --> glue job --> dataset