Ethan Brouwer

11/14/2022, 7:42 PM
Hey everyone! I'm really unsure of the best place to put this, but settled on here as I guess I'm shamelessly plugging something I built haha. I built a Terraform Provider for Airbyte. It's somewhat limited, but lets you do most things with Airbyte in a terraform config. https://registry.terraform.io/providers/eabrouwer3/airbyte/0.1.12 Obviously I'm open to Issues and PRs and will try to get to things as I have time. I wrote this to use for a work project, but felt like it makes sense to share with the broader community, and maybe some day add it to the airbyte repo somewhere to be supported by Airbyte itself. Another note, I learned
to write this and wrote it in about a week and a half but it's worked great for what we're doing at my company. Finally, the main reason I did this was because Octavia didn't totally handle everything that I needed. I needed to be able to handle custom connectors and didn't want to have to create those outside the IaC flow. Also, operations like dbt I don't think are supported by octavia-cli. And we're using terraform to deploy EKS and the Airbyte helm chart, so adding the airbyte config to terraform fit really nicely. Anyways, hope this is useful! And lmk if I should put this elsewhere!
Ari Bajo (Airbyte)

Ari Bajo (Airbyte)

11/14/2022, 8:01 PM
Wow! This is an impressive effort! 😍 Going through the code, to see how the implementation differs from Octavia CLI... cc @Riley Brook (Airbyte) @Bryce Groff (Airbyte) in case you plan on working on a Terraform Provider.
Callum McCaffery

Callum McCaffery

11/15/2022, 12:05 PM
This is great stuff! I'm in the middle of creating an ansible equivalent (ish) for Airbyte configuration as part of IaC. Definitely giving this a try!