A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

<!here> Has anyone used Apache Nifi with Datahub yet? Looking for ways to pull in some of our data pipelines to track lineage.

No but we'd love to integrate with Nifi!!

Using our Airflow connectors as an example, would you be interested in thinking about a reusable integration there?

Sorry I have been on vacation. We use nifi a lot to push data from our saas app databases to our customers dwhs (s3, gcp, blob, sftp). As well as bringing data from our different region platforms into a global dwh.

<@U01GCJKA8P9> Maybe we can build a nifi processor that can be included at one or multiple parts of the nifi flow to emit to datahub.