interesting article "*The job of a data engineer is not to write ETLs but to generalize and abstract the way those ETLs are made*." https://towardsdatascience.com/data-engineers-shouldnt-write-airflow-dags-b885d57737ce

@Michel was invited on Micro Advice CX Podcast about how better data management can help deliver a great customer experience

an article about how today’s open data ecosystem companies are bringing the Big Data promise to life https://medium.com/sapphire-ventures-perspectives/what-is-the-open-data-ecosystem-and-why-its-here-to-stay-60c06f19011b

found the new article from @Tuan Nguyen! A guide to set up Airbyte, BigQuery, dbt, Metabase, and everything else you need to run a Modern Data Stack using Terraform, in 5 minutes! https://towardsdatascience.com/bootstrap-a-modern-data-stack-in-5-minutes-with-terraform-32342ee10e79

pretty cool to be featured as the first of the 10 hottest big data startups airbyte rocket octavia rocket ! https://www.crn.com/slide-shows/applications-os/the-10-hottest-big-data-startups-o[…]d=IwAR2fgifI912LIEghn3_xI_MBY9lRQQLmp5CotlirLU5afdXbbDggNYjlP5I

an article summarizing what data engineer is with the goal to help you find out whether data engineering is for you, in terms of career https://towardsdatascience.com/is-data-engineering-for-you-990f106f91e7

a long but really interesting analysis by Bessemer about how data infrastructure will evolve in the next few years. It illustrates their investment strategy. We do agree on a lot of things they say, and that's why we're so bullish on what we do at Airbyte https://www.bvp.com/atlas/roadmap-data-infrastructure#Our-guiding-principles-on-how-we-will-invest

awesome talk by our friends at Preset on their open-source community tracker project (using Airbyte, dbt and Superset) :)

https://blog-getdbt-com.cdn.ampproject.org/c/s/blog.getdbt.com/of-the-community-by-the-community-for-the-community/amp/ Congrats to our friends at dbt!

Airbyte on the New Stack => https://thenewstack.io/airbyte-building-data-connectors-made-easy/ octavia rocket

an article explaining why Snowflake is unique https://medium.com/geekculture/the-1-reason-snowflake-is-different-dce334b586d1

our S3 connector has been mentioned a few times 🙂 https://venturebeat.com/2021/07/08/airbytes-aws-s3-connector-brings-open-source-data-integration-to-data-lakes/ https://siliconangle.com/2021/07/07/airbyte-enables-easy-data-integration-multiple-sources-amazon-s3/

it's pretty awesome to see the Oracle team contribute to our documentation and build the deployment docs for Oracle Cloud Infrastructure VM https://docs.airbyte.io/deploying-airbyte/on-oci-vm But also they wrote a quickstart article how to leverage it 🔥 https://medium.com/oracledevs/deploy-airbyte-on-oracle-cloud-infrastructure-and-replicate-a-postgresql-table-to-mysql-f07cf3cbe19c

an article about what the dysfunctions of data engineering are. You'll find a lot of founding concepts in the article: type of data engineers, inversion of responsibility, driving data rather than data-driven. https://medium.com/@mrtrustworthy/from-data-driven-to-driving-data-the-dysfunctions-of-data-engineering-34c34496ed8e

here's a great big guide on data engineering! 👉  The Data Engineering Cookbook The repo got almost 10k stars on Github, it's well written and contains all information you need to know to start you DE journey!

interesting talk by CPO of MongoDB about their GTM strategy with open source and product-led: https://boastcapital.com/transformed-from-sales-led-to-product-led/

our new article on open-sourcing CDC for database replication https://opensource.com/article/21/8/database-replication-open-source

Great video summarising recent Software Engineering studies: Some interesting findings: • TDD itself doesn't led to less bugs, it's the shorter development -> test cycle that TDD often result in. • Regular release cycles prioritise releasing backlog items. Rapid release cycles prioritise releasing new/fresh features.

A great article by SeattleDataGuy about the modern data stack (MDS), a really great summary! https://seattledataguy.substack.com/p/how-are-companies-taking-advantage

An article about how to structure your data team according to the size of your organization and it’s data maturity: https://towardsdatascience.com/how-to-build-your-data-analytics-team-1276d6729ac4?source=linkShare-a7d714669aa6-1629612178

super interesting article by a16z on open-source business models: https://a16z.com/2019/10/04/commercializing-open-source/

Hello everyone, I know that not all data scientists are experts in software engineering. But I do know that when it comes to interpreting data and creating innovative programs, there is no one better than them. With this in mind, we at SmartPredict have created a tool that saves time and allows you to focus on the results rather than on how to get them. Collect your data, compile it on our platform and choose the featue that suits you. You can also choose between Manualflow and Autoflow. The risk of errors is reduced because we have used AutoML 2.0 Register here and get 50 hours of free use. To browse the site and find out who we are, click here.

🤦 of course it chooses the f'n docker screen for the preview...

Great podcast from @Natalie on DataTalk about all the acronyms and buzzwords in data engineering!

https://techblogwriter.co.uk/airbyte/ with our very own Michel!

Cool piece about Airflow & Airbyte: https://towardsdatascience.com/airbyte-worth-the-hype-d2f25d0a7ca5