Hi everyone! We’ve developed an Open Source alternative to Looker, it’s very suitable to use it with `airbyte`: you could download the data from the integrations into a database and visualize the data using our project

mlcraft

Github repo: https://github.com/mlcraft-io/mlcraft. Will glad to help you with installation

@Ivan Fokeev going to check out the project, qq, have you thought of dbt integration?

@Noel Gomez you can do transformation via data schemas, we use cube.js, check out their docs https://cube.dev/docs/getting-started-cubejs-schema. It’s turing-complete, you able to do anything with it.

yeah, the issue with doing transformations in this layer is that it is not reusable. My thinking is that you should try to do as much as possible in the DW and limit things in the analytics layer to things like dynamic metrics etc

data schemas remind me of domo datasets and dataflows. the analysts can author entire ETL pipelines within the BI tool without any of the engineering best practices that dbt provides. current in the long process to pull all this into dbt to get better documentation, testing, modularity and readability etc

@Noel Gomez could you, please, explain, what is reusable for you? Data schemas are native javascript scripts, you can reuse code in schemas