Hi all and happy new year. I'm looking for a way ...
# ask-community-for-troubleshooting
d
Hi all and happy new year. I'm looking for a way to split the _airbyte tables into their own dataset separately from the basic normalization tables as they enter bigquery, is there a way to do this currently? The use case would be to make navigation simpler
đź‘€ 1
u
Hi @Donovan Maree, do you mean keeping raw tables in a different dataset than the table outputted by the basic normalization?
d
yes thats correct
u
It's something you can achieve by running a custom transformation with DBT. You can retrieve the generated models for normalization and adapt them to change the destination dataset. We have a guide here about custom transformations.
c
you can configure airbyte to replicate into some “staging” dataset as a destination Then, you should disable basic normalization option. In one of your previous sync, you can download the generated normalization/dbt project and add to github repository while changing the target destination of normalized tables as Augustin linked so you can have your custom results
đź‘Ť 1
In each of the generated .sql files, you can change the value of
schema = "final_dataset",
in the config header to point to a different dataset https://docs.getdbt.com/docs/building-a-dbt-project/building-models/using-custom-schemas