Hi everyone, I love Airbyte so far. I have a use c...
# announcements
j
Hi everyone, I love Airbyte so far. I have a use case where I have a large, inefficient db of data scraped directly from the web, and I would like to use Airbyte to sync to a production db while also performing some transformations on the data - i.e. converting into 3NF. I was looking at the tutorial here and thought this might be possible by pulling out and editing the SQL file generated by DBT. Is there a way to push and execute the modified SQL back to airbyte?
1
l
For the moment, it is not possible to make changes to the generated DBT models and commit them back so Airbyte can use it in its next sync of a certain source/destination combination. But, we’ll work on such integration in the near future!
https://docs.airbyte.io/tutorials/connecting-el-with-t-using-dbt Not part of AirByte staff, but as far as I can tell, it’s not possible to really customize the AirByte transformations at all unless you’re willing/able to take on the task of actually running them post extract and load.
👌 1
🙌 1
👍 1
j
Thanks for the context @Luke Mercado!
j
👍