read_json

support in https://duckdb.org/2023/02/13/announcing-duckdb-070.html

Very interesting read from dbt Jeremy about multi-project dbt deployments https://github.com/dbt-labs/dbt-core/discussions/6725

I wrote a short post yesterday about the data market https://tayloramurphy.substack.com/p/dbt-labs-acquires-transform-whos

thought this was a good article https://mag.revgenius.com/unicorns-dying/

https://www.datafold.com/blog/dbt-audit-helper-vs-data-diff is good. We need to get data-diff on the Hub!

🤣 https://dbt-excel.com/

I need the diff on this vs Snowflake/Bigquery/Redshift implementations http://peter.eisentraut.org/blog/2023/04/04/sql-2023-is-finished-here-is-whats-new

Really enjoyed this weeks dbt roundup. https://roundup.getdbt.com/p/os-layer-not-application-layer-how Abhi gave a great talk at Data Council that had a similar theme.

https://medium.com/@foundinblank/sqlmesh-and-virtual-data-marts-3ee9b2d1e146 is very interesting!

Great article https://seattledataguy.substack.com/p/becoming-a-data-engineering-force

Another good article! Point 5 tho 👀 https://mattpalmer.io/posts/hot-takes/

Cross-posting

I wrote a post on locally optimistic https://locallyoptimistic.com/post/hello-product-data-team-goodbye-ad-hoc-work/

Data Council finally released the videos from the conference in March! I made a quick thread on some of the best ones https://twitter.com/tayloramurphy/status/1656345011049332749

For anyone looking for @taylor’s talk at Data Council directly, it's here: (great talk, recommend it!)

State of data engineering in 2023 - Meltano is featured 😄

While we're at it: https://lakefs.io/blog/the-state-of-data-engineering-2023 Meltano is featured as well 😉

The Meltano Cloud Public Beta launch counts as Data News, right? 😄 I also wrote a Hacker News post where I’ve laid out some of the history of the project and the significance of this milestone from my personal perspective — you can find it through https://news.ycombinator.com/newest!

https://open.spotify.com/episode/3Sk7mOC13d8ypetKuO0eW4?si=elQaHw3PTUalU2-qV6GX4A We could probably put the data engineering podcast in #C01NPCGEL48 every week, but I thought the episode on sqlmesh incredibly interesting. "We inspired ourselves with terraform" definitely caught my attention ➕

I'm curious if any folks here have gotten access to MotherDuck and what they think of it (I'm still waiting for my invite 😅)

https://databeats.community/p/the-commodification-of-data-activation was an interesting read

Hey everyone! Next Monday the 21st of August, 1-1h30 easter, I'll be giving a talk at MDSFest on best practices for getting started in the data world from the perspective of a newcomer -> Things to focus on to drive real value. If you're interested, feel free to tune-in and listen 😄 Even if you don't feel like hearing my voice (completely understandable 😉), I recommend taking a look at the other conferences - there are a plethora to choose from by some of the coolest data practitioners at the moment. See you there!

Found this interesting from Ramp https://engineering.ramp.com/metaflow-production-ml

https://substack.timodechau.com/p/after-the-modern-data-stack-welcome is an interesting article

This is neat https://vdbs.superlinked.com/

Fun read! I’d be curious if anyone else tried this 🙂 https://medium.com/coiled-hq/one-trillion-row-challenge-5bfd4c3b8aef

Anybody here using Talend Open Studio? Feels like not a surprising decision https://www.talend.com/products/talend-open-studio/

📣 Hello all! The Open Source Analytics Conference 2024 is next week! 🚀 Some really cool talks on databases, orchestration, Bi/visualization tools! • When: Nov 19-21 • Where: Online! • More info: osacon.io Hope to see you there!