https://linen.dev logo
#ask-community-for-troubleshooting
Title
# ask-community-for-troubleshooting
m

Max

05/12/2022, 12:21 PM
Hi guys, I am playing around with Airbyte using docker locally for now and trying to start replications in the terminal. I followed the documentation and I am currently trying to replicate from MySQL to Redshift and run the following docker commands
Copy code
docker run --rm -i -v airbyte/source-mysql read --config /taps_configs/mysql.json --catalog /taps_configs/mysql_cat.json | docker run --rm -i  airbyte/destination-redshift write --config /taps_configs/redshift.json --catalog /taps_configs/mysql_cat.json
It all works fine, data is replicated from source to redshift properly but it ends up in _airbyte_raw_customers, so I want to trigger normalisation - but I am not sure how/where? Would that be in my redshift.json or in the catalog.json maybe that i need to add something like ‘normalization’:true? Thanks!
m

Marcos Marx (Airbyte)

05/12/2022, 2:42 PM
There is a specific command to trigger normalization Max! Take a look in Airbyte docs: https://docs.airbyte.com/operator-guides/transformation-and-normalization/transformations-with-dbt
m

Max

05/12/2022, 3:09 PM
oh I completely missed that - thanks Marcos!
2 Views