Hello. I am in the process of implementing a custom ingestion source to fivetran. I have the meta data pulling from the rest API, but now want to generate the data to make lineage work. For example, there are connectors that pull from a mongo schema and push data to another destination. Advice and suggestions are welcome.

Hi @silly-laptop-71099! Super excited to hear you’re working on this - I’m sure there are many folks in the community that would love to see this contributed back to the project!! 😬 In the meantime, I’ll keep an eye on this thread & make sure we get some support from the core team 🙂

I’m kind of testing out the same thing. What exactly did you get stuck with? We are going from mssql/azure sql to bigquery and I think I get everything that is needed from the APIs. The hard part as I see it right now is to map the fivetran source to an actual dataplatform in datahub if it should be really generic. I guess that should be possible if all data platforms used in datahub is named by their standard names and a mapper between fivetrans “own” name of the service and datahubs. eg: azure_sql_db(fivetran) -> sqlserver(datahub) or something Are you trying to go all the way to actually ingest datasets(the connectors) from fivetran as well? So you don’t have to ingest those separately?