https://kedro.org/ logo
Join Slack
Powered by
# resources
  • d

    datajoely

    05/07/2025, 8:48 PM
    https://github.com/astral-sh/ty
    🔥 6
    • 1
    • 2
  • о

    Олег Литвинов

    05/14/2025, 5:25 PM
    Hi everyone! Tomorrow at 13:00 CET I’ll be speaking at DataZen about using Kedro to bring structure and reproducibility to messy AI projects. I’ll walk through problems from real projects and stick around after the talk for Q&A — happy to connect and chat. https://datazen.top/8a4c UPD: for those interested in the recording: https://www.youtube.com/live/0979QPTCGtg?si=UrWr8BxlVMziVtjx
    ❤️ 8
    j
    • 2
    • 2
  • j

    Juan Luis

    05/20/2025, 3:53 PM
    https://newsletter.pragmaticengineer.com/p/the-ai-engineering-stack
    👀 1
    d
    w
    • 3
    • 2
  • j

    Juan Luis

    05/21/2025, 7:00 AM
    pretty barebones, written on a whim (3 commits) but interesting concept! https://github.com/okua1/juvio
    g
    d
    • 3
    • 2
  • j

    Juan Luis

    05/22/2025, 7:00 AM
    https://blog.jupyter.org/jupyterlab-4-4-and-notebook-7-4-are-available-aca2782d4f3d
  • n

    Nok Lam Chan

    05/23/2025, 2:20 PM
    https://www.linkedin.com/posts/basnijholt_python-opensource-datascience-ugcPost-7236875858332819456-KsTi
    👍 1
    j
    d
    • 3
    • 4
  • d

    datajoely

    05/27/2025, 1:47 PM
    https://duckdb.org/2025/05/27/ducklake
    duckdb 1
    j
    • 2
    • 5
  • j

    Juan Luis

    05/28/2025, 6:22 AM
    https://invariantlabs.ai/blog/mcp-github-vulnerability 👀
    👀 1
  • d

    datajoely

    05/28/2025, 6:05 PM
    https://www.getdbt.com/product/fusion
    j
    • 2
    • 2
  • n

    Nok Lam Chan

    05/29/2025, 4:22 PM
    I think we share the same view on Jinja template https://www.linkedin.com/posts/toby-mao_jinja-sqlmesh-vscode-activity-733387908401747[…]m=member_desktop&rcm=ACoAAB11enwBho3z6f4K9HCr7RLToPmxcW-lAkY
    🙌🏼 1
    j
    • 2
    • 2
  • j

    Juan Luis

    05/30/2025, 7:00 AM
    https://www.linkedin.com/posts/niels-rogge-a3b7a3127_when-people-ask-me-which-framewo[…]m=member_desktop&rcm=ACoAAAXcavUB6j26_YjUtYinmzmdjTchguHHuG4 💡
    w
    • 2
    • 1
  • d

    datajoely

    06/04/2025, 8:41 AM
    https://github.com/gregwdata/ducklakexl
    l
    • 2
    • 1
  • j

    Juan Luis

    06/09/2025, 5:06 PM
    NannyML, one of the most promising ML observability solutions, is shutting down and joining Soda https://www.linkedin.com/posts/hakimelakhrass_nannyml-is-shutting-down-its-been-45-ac[…]m=member_desktop&rcm=ACoAAAXcavUB6j26_YjUtYinmzmdjTchguHHuG4
    👀 2
    d
    • 2
    • 1
  • n

    Nok Lam Chan

    06/11/2025, 4:39 PM
    https://www.databricks.com/blog/introducing-databricks-free-edition
    👀 2
    🙌 2
    j
    • 2
    • 2
  • j

    Juan Luis

    06/13/2025, 9:56 AM
    TIL that the open source Unity Catalog is now 2 products: Unity Catalog and Unity Catalog AI https://github.com/unitycatalog/unitycatalog/releases I'm a bit confused
    😵‍💫 2
    t
    n
    • 3
    • 3
  • j

    Juan Luis

    06/16/2025, 7:00 AM
    ! hugging face transformers drops support for Tensorflow https://www.linkedin.com/posts/lysandredebut_i-have-bittersweet-news-to-share-yesterd[…]m=member_desktop&rcm=ACoAAAXcavUB6j26_YjUtYinmzmdjTchguHHuG4
    n
    d
    • 3
    • 4
  • j

    Juan Luis

    06/16/2025, 3:30 PM
    "the case for notebooks in prod" 👀 https://www.linkedin.com/posts/eric-riddoch_the-case-for-notebooks-in-prod-part-1-act[…]m=member_desktop&rcm=ACoAAAXcavUB6j26_YjUtYinmzmdjTchguHHuG4
    💡 2
    l
    • 2
    • 1
  • y

    Yetunde

    06/16/2025, 8:37 PM
    We know pain too lolsob https://kubernetes.io/blog/2025/06/16/changes-to-kubernetes-slack/
    j
    • 2
    • 1
  • j

    Juan Luis

    06/27/2025, 1:59 PM
    https://bsky.app/profile/kylebarron.dev/post/3lsgtirm3i22x
    n
    • 2
    • 5
  • k

    Krishnam Gupta

    07/03/2025, 12:24 PM
    New eBook Alert - "Building the Control Layer for Agentic AI with AI Gateway and MCP Servers" Learn how enterprises are deploying scalable, secure, and context-aware GenAI systems on-prem, in VPCs, or hybrid environments. A practical and technical roadmap for AI officers, Data scientists, Platform heads, MLOps engineers, CDOs, CIOs, and architects building production-grade AI infrastructure with AI Gateways and Model Context Protocol (MCP). Key takeaways are - Why AI Gateways are emerging as the central abstraction and orchestration layer in the GenAI stack How MCP allows agents to discover, authenticate, and invoke enterprise tools through machine-readable, context-aware schemas Deep dive into the architecture, protocols, and design principles shaping the next generation of enterprise AI infrastructure Access the free ungated version of the eBook here - https://gdurl.com/0RO8/download
    TFY-Ebook.pdf
  • j

    Juan Luis

    07/10/2025, 2:30 PM
    https://bsky.app/profile/ramikrispin.bsky.social/post/3ltmk54qkdc23
  • n

    Nok Lam Chan

    07/30/2025, 7:15 AM
    https://newsletter.pragmaticengineer.com/p/building-great-sdks
    💯 1
  • l

    Luis Chaves Rodriguez

    07/30/2025, 8:01 AM
    https://hamilton.dagworks.io/en/latest/
    d
    • 2
    • 1
  • m

    Max Pardoe

    07/31/2025, 11:07 AM
    @Max Pardoe has left the channel
  • d

    Deepyaman Datta

    08/19/2025, 2:45 PM
    https://motherduck.com/blog/semantic-layer-duckdb-tutorial/
    👍 1
  • n

    Nok Lam Chan

    08/20/2025, 12:27 PM
    https://cube.dev/docs/product/apis-integrations/queries What's new about the semantic layer? Came across this and have some more thinking
    d
    • 2
    • 1
  • d

    Deepyaman Datta

    09/05/2025, 5:10 AM
    In a bit of self-promotion, wanted to share a talk I gave earlier this summer at SciPy:

    https://www.youtube.com/watch?v=z7vZJ4Aj9aM▾

    Much of the motivation for improving the Python data engineering experience comes from pain points seen from Kedro users (including my own experience from when I was primarily a Kedro user), and the idea that Kedro is well-positioned to be the core of the Python-native "modern data stack." It's very much a community-driven thing; thanks to so many people: @Iñigo Hidalgo @Guillaume Tauzin @Mark Druffel @datajoely @Juan Luis just to name a few. If you'd like the slides: https://deepyaman.github.io/python-is-all-you-need/ Last but not least, if you are using a combination of these technologies (e.g. Kedro + Ibis + pandera, and maybe even dlt or some stuff on the BI end), and would be open in sharing more about how you use them, would love to talk! Please shoot me a message if so. 🙏
    ❤️ 10
  • a

    Andrew Stewart

    09/08/2025, 10:52 PM
    Hey Kedro community! K 🧬 Just published a blog post about using Kedro to structure BioLM protocols: https://blog.biolm.ai/translating-biolm-protocols-into-kedro-workflows/ Over at BioLM, we are using language models to power biological research. Our platform provides models for protein structure prediction, sequence generation, and molecular design. We make frequent use of Jupyter notebooks to compose multi-step modeling workflows, often for user demonstration, but sometimes for reproducibility purposes a notebook can be a bit too "fluid" so we need a more defined workflow. Kedro feels like a natural transitional fit in such cases. We used Kedro to translate a Jupyter notebook (demonstrating antibody engineering with protein structure analysis) into a structured, reproducible pipeline. I think it worked out pretty well! Some key Kedro features we found really useful for this purpose: • Configuration management: Externalized file paths, API parameters, and target definitions into YAML files • Data catalog: Made data dependencies explicit and the dataset previews in Kedro-Viz are great • Checkpoint functionality:
    kedro run --from-nodes
    and
    --from-outputs
    is super helpful for iterative development • Kedro-Viz: Publishing the static Kedro-Viz build via GitHub Actions → GitHub Pages is a great way to share and present workflows (like this: https://biolm.github.io/biolm-kedro/) The workflow processes multiple protein targets (EGFR, PDL1, MBP, IL-7Rα) through BioLM's AI models, generating variant analysis and visualizations. Really showcases how Kedro's modular approach works well for bioinformatics pipelines that involve external API calls and long-running analyses. Would love to hear if others in the community are using Kedro for similar scientific workflows! If anyone is interested in the intersection of biology and AI/ML, we'd love to invite you to our own Slack community at https://biolm.ai/community/ - it's a great space for sharing projects, getting help, and staying updated on bio AI developments!
    ❤️ 10
    🚀 14
    🥳 15
    d
    a
    • 3
    • 5
  • d

    Deepyaman Datta

    09/11/2025, 4:51 PM
    https://materializedview.io/p/mcp-server-could-have-been-json-file 🤔 Edit: Oops, this should have been in #C03QF15L1K9, but I can't delete it now. facepalming
    👍 2
    i
    a
    d
    • 4
    • 5
  • d

    datajoely

    09/20/2025, 7:21 AM
    https://read.technically.dev/p/a-deep-dive-into-mcp-and-its-associated
    👍 1