anyone here make a transition from API development to data engineering? I am going to be doing that and wanted to hear about other people backgrounds, unless there is a more preferable channel for that

I haven’t done that, but one thing I can say is that I do see more people with a software background in DE thanks to things like Airbyte and dbt. While not perfect, dbt has brought software engineering best practices to data pipelines and the people who really take advantage of what is possible. Those who enhance the ecosystem seem to be the ones who come from software development. Look at all these python projects related to dbt https://datacoves.com/dbt-libs

good to know, thanks for sharing this @Noel Gomez!

Me. However I keep doing both. Pipelines, SQL, Java, a bit of Terraform, etc Always was a pure backend engineer

@Alex Koshterek do you do any side projects with that type of work (e.g. Pipelines, SQL, Java, a bit of Terraform, etc)?

nope, all for my everyday job

Did you transition more to data engineering out of need or pure interest? I’m curious to learn about this path as it’s brand new to me and wanted to know other backend developers got to a data engineering-type position

I had an interest and there was a position to fill, so I am here

Hey, same for me, recently jumped from a backend dev background into data engineering. 🙂 My partner did that a few years ago, so if you have questions on how it is on the long run, maybe he can answer some of them. 🙂