Howdy y'all! My name is Farman and I'm a software engineer at Mailchimp. I'm doing some vendor research for my team, Data Integrations, and I'm really intrigued by what Airbyte has to offer. I'd like to present a use case and make sure that I understand what Airbyte does so that I can further present this to my stakeholders and use this platform.
So I need to import data from our big query table into a data science tool that uses a GCS bucket. What happens in between is data transformation so that the results we get from our big query table are turned into a format that is easily accessible for the data science tool. Can I leverage airbyte to do all of this? We expect to have similar work and want to be able to "productize" my team. I think this will also be a good use case to contribute to your open source projects but need to make sure I understand all of this. I've read the documentation and worked with it a little bit but can never be too sure by myself, haha.
[DEPRECATED] Augustin Lafanechere
01/11/2022, 6:04 PM
Hi @Farman Pirzada, Airbyte get definitely help you with this use case. You should check out our custom transformation feature and evaluate how to leverage DBT to make the transformation required for your data science data hosted on GCS.