Airbyte is an open-source data integration engine that helps you consolidate your data in your data warehouses, lakes and databases.

Airbyte

Interesting read also with its used data stack (he calls it `ngods (new generation open-source data stack)` instead of <https://airbyte.com/glossary/modern-data-stack|Modern Data Stack>).

<https://blog.devgenius.io/modern-data-stack-demo-5d75dcdfba50>

Full Project open on GitHub: <https://github.com/zsvoboda/ngods-stocks>

image.png

The DWH Layers are inspired by Databricks  medallion architecture <https://www.databricks.com/fr/glossary/medallion-architecture>

is Data federation about “moving data between databases” ?

<@U01SHGFT4U9> Where did you get the term "Data Federation" in relation to this article? I missed that :slightly_smiling_face:

But to me: *Data Federation* is equals to *Data Virtualization*, which is the opposite of moving data, but virtualize it.

&gt; Data virtualization goes by a lot of different names: logical data warehouse, Data Federation, virtual database, and decentralized data warehouse.  Data Virtualization/Federation allows you to integrate data from various sources, keeping the data in-place and loading it in-memory, so that you can generate reports and dashboards to create business value from the data

trino.jpg

It’s in the Trino block on the main diagram. I found it confusing :neutral_face:

Ahh, I see; good catch. That's definitely confusing, and I think, Trino is doing the opposite of moving data.