A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

Here is my ingestion yaml:
```source:
    type: delta-lake
    config:
        base_path: 'my_base_path'
        relative_path: 'my_relative_path'
        s3:
            aws_config:
                aws_access_key_id: xxxxx
                aws_secret_access_key: xxxxxx
                aws_region: us-west-2
sink:
    type: datahub-rest
    config:
        server: '<http://172.17.0.1:8080>'```