https://kedro.org/ logo
Join Slack
Powered by
# random
  • j

    Juan Luis

    12/23/2024, 11:26 AM
    TIL: YAML merge keys (
    <<:
    ) were never part of the spec 😳 https://ktomk.github.io/writing/yaml-anchor-alias-and-merge-key.html
    😱 2
  • d

    datajoely

    12/28/2024, 2:35 PM
    https://gitdiagram.com/kedro-org/kedro
    ❤️ 2
  • d

    datajoely

    01/01/2025, 8:26 PM
    https://www.cs.cmu.edu/~pavlo/blog/2025/01/2024-databases-retrospective.html
  • d

    datajoely

    01/02/2025, 3:30 PM
    This is very cool 🦆 https://bsky.app/profile/hamilton.bsky.social/post/3lerfa3ljfc2j
  • d

    datajoely

    01/14/2025, 2:42 PM
    https://blog.sdf.com/p/dbt-labs-has-acquired-sdf
  • d

    datajoely

    01/14/2025, 2:42 PM
    dbt just acquired one of its most interesting competitors, meaning it's now a fight between them and Tobiko
  • d

    datajoely

    01/14/2025, 2:43 PM
    will be verrrryyy interesting if the sdf vision gets wrapped into dbt or it's just a case of catch and kill
    👀 2
    j
    • 2
    • 8
  • y

    Yury Fedotov

    01/14/2025, 3:55 PM
    I'm curious, is anyone here using EdgeDB? I was watching an interview with the founder yesterday, so wanted to understand how popular it is.
    d
    • 2
    • 2
  • d

    datajoely

    01/15/2025, 4:54 PM
    https://github.com/databrickslabs/dqx
    n
    f
    • 3
    • 5
  • d

    datajoely

    01/23/2025, 10:47 AM
    https://gh-sparkling-cherry-6975.fly.dev
    🔥 1
    j
    • 2
    • 1
  • j

    Juan Luis

    01/26/2025, 12:08 PM
    I just started using marimo for real today and it's beautiful https://marimo.io
    👀 3
    ❤️ 4
    l
    • 2
    • 3
  • d

    datajoely

    02/11/2025, 7:59 AM
    Interesting PEP maybe the death of Jinja? https://peps.python.org/pep-0750/
    👌🏼 1
    😢 1
  • j

    Juan Luis

    02/11/2025, 9:06 AM
    speaking of PEPs: https://peps.python.org/pep-0771/ this would be very relevant for Kedro
    🌠 2
  • m

    Merel

    02/14/2025, 2:49 PM
    A bit of shameless self-promotion 🙈 I was interviewed for the AI Insights Podcast and talked about my career so far, Kedro K, working on and maintaining an open-source project and the future of AI. 🎧 Give the episode a listen on Spotify: https://open.spotify.com/episode/17WHl9Yj6qgr44R4OskxUx?si=7xqpbvjeQW-yccjllk2OLA
    👏 6
    👏🏾 1
    👏🏼 1
    🥳 3
  • g

    Galen Seilis

    02/20/2025, 4:35 PM
    I've taken notes on the tutorial series that was produced last year. The notes are on my blog. Feel free to point out any errors or typos. There undoubtably are some. Notes on Kedro Tutorial Videos
    ⭐ 2
    👀 1
    j
    • 2
    • 1
  • d

    Deepyaman Datta

    02/24/2025, 3:47 PM
    Life-changing dev tool I learned about recently: https://github.com/nektos/act Been using it on the https://github.com/dagster-io/community-integrations repo; works like a charm for almost everything there.
    👀 1
    n
    • 2
    • 4
  • p

    Pietro Peterlongo

    03/15/2025, 11:20 AM
    Hi @Juan Luis (and everyone) here you see two Kedro users (a beginner and an experienced one) meeting by chance at an Open Source Saturday meetup in Turin :). w @Giovanni Luddeni
    ❤️ 9
    🎉 6
    K 5
    g
    d
    n
    • 4
    • 3
  • c

    Chris Schopp

    04/03/2025, 1:20 PM
    I am conflicted on naming conventions for columns. Do I use spaces or underscores to separate words? • Underscores make it easier to select/edit the entire column name. • Spaces enable narrower columns due to word wrapping. I prefer longer column names (fewer abbreviations) to improve clarity. What are your thoughts?
    j
    • 2
    • 3
  • d

    Deepyaman Datta

    04/25/2025, 12:26 AM
    I was suddenly reminded by the geospatial hackathon idea in #C03RKAQ0MGQ... If you do geospatial work and haven't tried DuckDB for geospatial data, it's apparently really good. I'm no geospatial expert, but last year we got a chance to see how one expert replaced complex Dask-based workflows with DuckDB and Ibis. https://docs.fused.io/blog/how-digitaltwinsim-models-wireless-networks-with-duckdb-ibis-and-fused/ showcases some of this publicly.
    ❤️ 2
    🌐 1
  • a

    Arnout Verboven

    04/25/2025, 1:07 AM
    💡Cool insight on where Kedro is still introducing performance overhead from a use case I'm working on In almost all cases, either I/O or node execution time will outweigh this overhead by a lot, making it irrelevant but I'm sharing it anyways 😄 In my case, I am running ~800 dynamically created small nodes (the nodes are all interdependent in a very complex relationship graph so I rely on Kedro's orchestration without the need for me to codify the execution order 🙏) Initially my pipeline took 1min40, and the following two changes reduced it to 8sec: • Disabling pluggy tracing (see issue) • Using "list" inputs instead of "dict" inputs in
    node
    Post
    💡 13
    🙌 3
    🎉 4
    d
    c
    +4
    • 7
    • 23
  • j

    Juan Luis

    05/08/2025, 2:55 PM
    vibe coding:
    😂 1
  • d

    Deepyaman Datta

    05/13/2025, 11:33 PM
    If anybody will be at PyCon US this week, come say hi! I'm giving a tutorial tomorrow morning and will be around through Sunday.
    👌 3
  • d

    datajoely

    05/29/2025, 8:50 AM
    https://github.com/mattlianje/pg_pipeline
    j
    • 2
    • 1
  • d

    Deepyaman Datta

    06/04/2025, 11:01 PM
    https://www.reddit.com/r/mlops/comments/19fadaz/comment/lngnp43/ sounds very cool, now I want to learn more about what exactly they've done!
    👀 5
  • j

    Juan Luis

    06/07/2025, 9:24 AM
    with all the problems of the
    .ipynb
    format, it looks like it refuses to die. just got this on Databricks
    d
    n
    • 3
    • 7
  • d

    Deepyaman Datta

    06/16/2025, 4:59 AM
    Randomly noticed this, but Kedro seems to be a featured project on https://lfaidata.foundation/.
    K 7
    😎 2
  • r

    Richard Westenra

    06/17/2025, 9:57 PM
    Hey I'm Richard, I was the original developer working on Kedro-Viz back in the day. When I built the project, I used a package called Dagre to generate the graph layout, but it had an issue with not allowing manual ranking for nodes. There was a PR that added this feature, but the maintainer had seemingly abandoned the project, so I forked the module from the PR. Eventually we moved on to our own graph layout algorithm that the very talented Liam Brummit wrote for us. Anyway I just received an email notification that after all these years, Dagre has a new maintainer who has finally gone back and merged that PR! So even though it's been 4 years since I left the Kedro team, I can finally have closure 😌
    💛 4
    👏 8
    😂 7
    j
    m
    +2
    • 5
    • 5
  • j

    Juan Luis

    06/18/2025, 8:23 AM
    related to https://kedro-org.slack.com/archives/C03QPDQTLBG/p1750106258747589, with our number of peak concurrent users of the last 6 months, Campfire fits in a 2GB, 1CPU machine, which is smaller than the smallest machine on sale in Hetzner 😬 hence costing 48 € per year as opposed to... 2 200+ € per year https://once.com/campfire
  • d

    datajoely

    06/18/2025, 6:24 PM
    Insane, I love it, I think https://www.typedef.ai
    🤯 4
    j
    • 2
    • 12
  • r

    Rashida Kanchwala

    06/19/2025, 9:43 AM
    https://skooloflife.medium.com/99-of-ai-startups-will-be-dead-by-2026-heres-why-bfc974edd968
    👀 1
    👍 1