Hello guys. I am new to Airbyte and modern datawar...
# replication-troubleshooting
e
Hello guys. I am new to Airbyte and modern datawarehouse. I am setting up a airbyte-gcp-dbt architecture. I managed to set-up all three services and they are running properly. I am wondering what are the best practices to structure the data that is loaded in the my _raw tables and make the models as efficiently as possible? Basically, what I would like : • Generate staging models automatically (or semi-automatically) in dbt from airbyte connectors (if possible) • Have the tables with columns names and not all JSON objects in my GCP schemas Here are some screenshots of what I am getting at the moment. Thanks a lot and looking forward to have my first models in production šŸ˜
āœļø 1
āœ… 1
If you can redirect me to any useful resources, it would be awesome (I have trouble finding the relevant resources for me)
e
Hello Marcelo. Thanks a lot. It seems that my initial jobs failed in Airbyte because my service account did not have the authorization to create dataset. I am running the sync at the moment. I will read your resources for sure !
u
@[DEPRECATED] Marcos Marx turned this thread into Zendesk ticket 2847 to ensure timely resolution!
s
Hey @Emile Fyon sorry for the late reply. Were you able to get this resolved? Feel free to post more questions here in the channel šŸ™‚