https://kedro.org/ logo
Join Slack
Powered by
# random
  • g

    Galen Seilis

    02/20/2025, 4:35 PM
    I've taken notes on the tutorial series that was produced last year. The notes are on my blog. Feel free to point out any errors or typos. There undoubtably are some. Notes on Kedro Tutorial Videos
    ⭐ 2
    👀 1
    j
    • 2
    • 1
  • d

    Deepyaman Datta

    02/24/2025, 3:47 PM
    Life-changing dev tool I learned about recently: https://github.com/nektos/act Been using it on the https://github.com/dagster-io/community-integrations repo; works like a charm for almost everything there.
    👀 1
    n
    • 2
    • 4
  • p

    Pietro Peterlongo

    03/15/2025, 11:20 AM
    Hi @Juan Luis (and everyone) here you see two Kedro users (a beginner and an experienced one) meeting by chance at an Open Source Saturday meetup in Turin :). w @Giovanni Luddeni
    ❤️ 9
    🎉 6
    K 5
    g
    d
    n
    • 4
    • 3
  • c

    Chris Schopp

    04/03/2025, 1:20 PM
    I am conflicted on naming conventions for columns. Do I use spaces or underscores to separate words? • Underscores make it easier to select/edit the entire column name. • Spaces enable narrower columns due to word wrapping. I prefer longer column names (fewer abbreviations) to improve clarity. What are your thoughts?
    j
    • 2
    • 3
  • d

    Deepyaman Datta

    04/25/2025, 12:26 AM
    I was suddenly reminded by the geospatial hackathon idea in #C03RKAQ0MGQ... If you do geospatial work and haven't tried DuckDB for geospatial data, it's apparently really good. I'm no geospatial expert, but last year we got a chance to see how one expert replaced complex Dask-based workflows with DuckDB and Ibis. https://docs.fused.io/blog/how-digitaltwinsim-models-wireless-networks-with-duckdb-ibis-and-fused/ showcases some of this publicly.
    ❤️ 2
    🌐 1
  • a

    Arnout Verboven

    04/25/2025, 1:07 AM
    💡Cool insight on where Kedro is still introducing performance overhead from a use case I'm working on In almost all cases, either I/O or node execution time will outweigh this overhead by a lot, making it irrelevant but I'm sharing it anyways 😄 In my case, I am running ~800 dynamically created small nodes (the nodes are all interdependent in a very complex relationship graph so I rely on Kedro's orchestration without the need for me to codify the execution order 🙏) Initially my pipeline took 1min40, and the following two changes reduced it to 8sec: • Disabling pluggy tracing (see issue) • Using "list" inputs instead of "dict" inputs in
    node
    Post
    💡 13
    🙌 3
    🎉 4
    d
    c
    +4
    • 7
    • 23
  • j

    Juan Luis

    05/08/2025, 2:55 PM
    vibe coding:
    😂 1
  • d

    Deepyaman Datta

    05/13/2025, 11:33 PM
    If anybody will be at PyCon US this week, come say hi! I'm giving a tutorial tomorrow morning and will be around through Sunday.
    👌 3
  • d

    datajoely

    05/29/2025, 8:50 AM
    https://github.com/mattlianje/pg_pipeline
    j
    • 2
    • 1
  • d

    Deepyaman Datta

    06/04/2025, 11:01 PM
    https://www.reddit.com/r/mlops/comments/19fadaz/comment/lngnp43/ sounds very cool, now I want to learn more about what exactly they've done!
    👀 5
  • j

    Juan Luis

    06/07/2025, 9:24 AM
    with all the problems of the
    .ipynb
    format, it looks like it refuses to die. just got this on Databricks
    d
    n
    • 3
    • 7
  • d

    Deepyaman Datta

    06/16/2025, 4:59 AM
    Randomly noticed this, but Kedro seems to be a featured project on https://lfaidata.foundation/.
    K 7
    😎 2
  • r

    Richard Westenra

    06/17/2025, 9:57 PM
    Hey I'm Richard, I was the original developer working on Kedro-Viz back in the day. When I built the project, I used a package called Dagre to generate the graph layout, but it had an issue with not allowing manual ranking for nodes. There was a PR that added this feature, but the maintainer had seemingly abandoned the project, so I forked the module from the PR. Eventually we moved on to our own graph layout algorithm that the very talented Liam Brummit wrote for us. Anyway I just received an email notification that after all these years, Dagre has a new maintainer who has finally gone back and merged that PR! So even though it's been 4 years since I left the Kedro team, I can finally have closure 😌
    💛 4
    👏 8
    😂 7
    K 1
    j
    m
    +2
    • 5
    • 5
  • j

    Juan Luis

    06/18/2025, 8:23 AM
    related to https://kedro-org.slack.com/archives/C03QPDQTLBG/p1750106258747589, with our number of peak concurrent users of the last 6 months, Campfire fits in a 2GB, 1CPU machine, which is smaller than the smallest machine on sale in Hetzner 😬 hence costing 48 € per year as opposed to... 2 200+ € per year https://once.com/campfire
  • d

    datajoely

    06/18/2025, 6:24 PM
    Insane, I love it, I think https://www.typedef.ai
    🤯 4
    j
    • 2
    • 12
  • r

    Rashida Kanchwala

    06/19/2025, 9:43 AM
    https://skooloflife.medium.com/99-of-ai-startups-will-be-dead-by-2026-heres-why-bfc974edd968
    👀 1
    👍 1
  • j

    Juan Luis

    07/08/2025, 3:38 PM
    I know you've always wanted to query your Kedro config files with SQL, now you can https://github.com/AKSarav/YamlQL
  • y

    Yury Fedotov

    07/08/2025, 11:44 PM
    Pandera now supports Ibis Could be relevant to the community, I know both pandera and ibis operate nicely with Kedro. I personally haven’t tried
    ibis
    but use
    pandera
    at every tabular data project. https://github.com/unionai-oss/pandera/releases/tag/v0.25.0
    💯 3
    👍 1
    🥳 1
    y
    j
    d
    • 4
    • 3
  • j

    Juan Luis

    07/09/2025, 12:47 PM
    https://django-configurations.readthedocs.io/ interesting new pattern to configure Django applications given that Kedro settings are modeled after Django, would be interesting to evaluate the pros and cons of this approach
    Copy code
    # mysite/settings.py
    
    from configurations import Configuration
    
    class Dev(Configuration):
        DEBUG = True
    d
    • 2
    • 3
  • m

    Max Pardoe

    07/31/2025, 11:07 AM
    @Max Pardoe has left the channel
  • d

    Deepyaman Datta

    08/01/2025, 3:59 PM
    If anybody's interested in learning about data validation at scale, I'll be talking about the new Ibis integration for pandera with with Niels Bantilan, Chief ML Engineer at Union.ai and the creator of pandera next week! Check it out: https://www.linkedin.com/events/7357004656075579392/comments/ Hoping to also give the
    kedro-pandera
    integration some love later this year! 🤞
    🤩 1
    y
    • 2
    • 2
  • j

    Juan Luis

    08/04/2025, 1:18 PM
    first stable release of
    behave
    in 7+ years! https://pypi.org/project/behave/1.3.0/
    👍 2
    frog wow scroll 2
    d
    • 2
    • 1
  • d

    Deepyaman Datta

    09/03/2025, 4:52 PM
    https://www.linkedin.com/posts/tobikodata_big-news-tobiko-data-is-now-part-of-fivetran-activity-7369036541450461187-SQva
    d
    j
    • 3
    • 6
  • l

    Lex Avstreikh

    09/18/2025, 12:54 PM
    Hello everyone ! We are organising the Feature Store Summit; 5th edition, this is an annual online event where we invite some of the most technical speakers from some of the world’s most advanced engineering teams to talk about their infrastructure for AI, ML and all things that needs massive scale and real-time capabilities. This year's speakers: Uber, Pinterest, Zalando, Lyft, Coinbase, Hopsworks and More! Expect to dive into: ⚡ Real-Time Feature Engineering at scale ⚡ Vector Databases & Generative AI in production ⚡ The balance of Batch & Real-Time workflows ⚡ Emerging trends driving the evolution of Feature Stores in 2025 When: 📅 October 14th 🇺🇸 Starting 8:30AM PT 🇪🇺 Starting 5:30PM CET Link; https://www.featurestoresummit.com/register
  • d

    Deepyaman Datta

    09/21/2025, 4:15 AM
    https://www.linkedin.com/posts/eordax_ai-mcp-humor-activity-7374003888187867136-2Go9
    😂 1
    j
    • 2
    • 1
  • j

    Juan Luis

    09/29/2025, 3:54 PM
    wow https://www.linkedin.com/posts/davidyaffe_big-news-fivetran-is-acquiring-dbt-labs-act[…]m=member_desktop&rcm=ACoAAAXcavUB6j26_YjUtYinmzmdjTchguHHuG4
    d
    n
    d
    • 4
    • 6
  • e

    Erwin

    10/01/2025, 2:51 PM
    hello, anyone have a working invitation link? the one is the webisite is expired i think
    r
    n
    • 3
    • 13
  • s

    Shah

    10/02/2025, 10:33 AM
    Hello, Just joined using http://slack.kedro.org. The web interface works, but somehow the desktop application doesn't open the kedro workspace. The icon is there, but non-responsive. I can navigate to other workspaces, except Kedro. Thanks!
    r
    • 2
    • 5
  • m

    Merel

    10/16/2025, 10:12 AM
    Is anyone already using Ty (https://docs.astral.sh/ty/) for python type checking? Curious if it’s already worth trying out and if so how much effort it will be to migrate from mypy.
    d
    • 2
    • 6
  • s

    Shah

    10/21/2025, 8:09 AM
    Hello, A suggestion: Can we have a channel to report bugs/broken links/inappropriate error messages/anything strange? That way the users can help the Kedro team identify them quickly. Thanks ahead!
    m
    • 2
    • 2