https://flink.apache.org/ logo
Join Slack
Powered by
# show-and-tell
  • p

    Pedro Mรกzala

    04/22/2025, 1:39 PM
    Hello there folks! Just posted about ๐ŸชŸ and flink in
    The case for a Custom Window in Flink
    https://pedromazala.substack.com/p/the-case-for-a-custom-window-in-flink
    โค๏ธ 2
    flink 3
  • r

    rmoff

    04/22/2025, 3:02 PM
    Collection of interesting stuff about Flink and beyond from the last month: https://rmoff.net/2025/04/22/interesting-links-april-2025/
    flink 5
    gratitude thank you 1
  • z

    Zhang Hongze

    04/23/2025, 3:44 PM
    Hi Flink Team, Is anyone interested in a native accelerator for Apache Flink? I am Hongze from the Apache Gluten (incubating) community. We are currently working on a native Flink accelerator backed by Meta Velox. The work is in its earliest stage and we are aiming to get a PoC delivered in the next phase. Please let me know if anyone is interested with the topic. Thanks! Could view the project page to check what we have achieved on Apache Spark: https://github.com/apache/incubator-gluten
    s
    p
    r
    • 4
    • 7
  • s

    Sandeep Devarapalli

    04/25/2025, 6:26 PM
    And this is why OLake (Open Source) is fast! Here's something for your weekend read: Exploring OLake's Architecture. If you're diving into real-time data replication or building modern data lakehouse architectures with Apache Iceberg, we've just shared an in-depth look at how OLake actually works behind the scenes. Whether your stack includes MongoDB, PostgreSQL, or MySQL, and you're targeting formats like Apache Iceberg or Parquet, this article has practical insights on designing scalable, efficient data pipelines. OLake is an open-source tool specifically built for high-speed data ingestion. Key Highlights: โšก Speed: Load data 4x to 10x faster compared to traditional ETL tools. ๐Ÿ•’ Real-Time CDC: Minimal-lag Change Data Capture from MongoDB, PostgreSQL, and MySQL. ๐Ÿงฉ Plug-and-Play Architecture: Cleanly separated core, drivers, and writers make extending OLake straightforward. ๐Ÿ“Š Schema Flexibility: Seamlessly handles schema evolution and type changes compatible with Apache Iceberg. ๐Ÿ”„ Reliable Syncs: Built-in state management means your sync operations can resume effortlessly if interrupted. https://olake.io/blog/olake-architecture-deep-dive
  • g

    Giannis Polyzos

    04/26/2025, 1:54 PM

    https://www.youtube.com/watch?v=_qSihYk-pOQ&ab_channel=Ververicaโ–พ

    ๐Ÿ™Œ 5
    ๐ŸŽธ 3
  • r

    rmoff

    04/29/2025, 4:44 PM
    _With apologies for writing a long blog, as I didn't have time to write a shorter one_โ€”here are my notes as I tried to learn about watermarks in Apache Flink SQL: https://rmoff.net/2025/04/25/its-time-we-talked-about-time-exploring-watermarks-and-more-in-flink-sql/ Please let me know if you spot any errors ๐Ÿ™‚
    ๐Ÿ‘ 6
    ๐Ÿ™Œ 1
    ๐Ÿ‘ 1
    p
    j
    • 3
    • 4
  • s

    Spencer Arnold

    05/07/2025, 9:46 AM
    ๐Ÿ“ฃ Early Bird tickets for Flink Forward are now on sale! Ververica is thrilled to announce that Early Bird ticket sales are open for Flink Forwardโ€ฏ2025, taking place October 13โ€“16,โ€ฏ2025 in Barcelona. Secure your spot today and save 30% on conference and training passes! That means that you could get a conference-only ticket for โ‚ฌ699 or a combined conference + training ticket for โ‚ฌ1399! ๐Ÿ‘‰๐Ÿป โ— Early Bird tickets will only be sold until May 31. Grab your discounted ticket before it's too late! Why Attend Flink Forward Barcelona? โ€ข Cuttingโ€‘edge talks: Learn from top engineers and data architects about the latest Apache Flinkยฎ features, best practices, and realโ€‘world use cases. โ€ข Hands-on learning: Dive deep into streaming analytics, stateful processing, and Flinkโ€™s ecosystem with interactive, instructorโ€‘led sessions. โ€ข Community connections: Network with hundreds of Flink developers, contributors, PMC members and users from around the globe. Forge partnerships, share experiences, and grow your professional network. โ€ข Barcelona experience: Enjoy one of Europeโ€™s most vibrant citiesโ€”sunny beaches, worldโ€‘class cuisine, and rich cultural heritageโ€”all just steps from the conference venue. ๐Ÿ“Œ*Grab your Flink Forward Insider ticket today and see you in Barcelona!*
  • n

    Ninad Pradhan

    05/11/2025, 12:23 AM
    Does anyone have a need for tensor rt inference on flink pipeline?
  • n

    Ninad Pradhan

    05/11/2025, 12:24 AM
    Im curious to see if this is common or ever needed. Any thoughts are appreciated?
  • j

    Jaehyeon Kim

    05/12/2025, 9:04 PM
    ๐Ÿš€ Announcing factorhouse-local from the team at Factor House! ๐Ÿš€ Our new GitHub repo offers pre-configured Docker Compose environments to spin up sophisticated data stacks locally in minutes! It provides four powerful stacks: 1๏ธโƒฃ Kafka Dev & Monitoring + Kpow: โ–ช๏ธ Includes: 3-node Kafka, ZK, Schema Registry, Connect, Kpow. โ–ช๏ธ Benefits: Robust local Kafka. Kpow: powerful toolkit for Kafka management & control. โ–ช๏ธ Extras: Key Kafka connectors (S3, Debezium, Iceberg, etc.) ready. Add custom ones via volume mounts! 2๏ธโƒฃ Real-Time Stream Analytics: Flink + Flex: โ–ช๏ธ Includes: Flink (Job/TaskManagers), SQL Gateway, Flex. โ–ช๏ธ Benefits: High-perf Flink streaming. Flex: enterprise-grade Flink workload management. โ–ช๏ธ Extras: Flink SQL connectors (Kafka, Faker) ready. Easily add more via pre-configured mounts. 3๏ธโƒฃ Analytics & Lakehouse: Spark, Iceberg, MinIO & Postgres: โ–ช๏ธ Includes: Spark+Iceberg (Jupyter), Iceberg REST Catalog, MinIO, Postgres. โ–ช๏ธ Benefits: Modern data lakehouses for batch/streaming & interactive exploration. 4๏ธโƒฃ Apache Pinot Real-Time OLAP Cluster: โ–ช๏ธ Includes: Pinot cluster (Controller, Broker, Server). โ–ช๏ธ Benefits: Distributed OLAP for ultra-low-latency analytics. โœจ Spotlight: Kpow & Flex โ–ช๏ธ Kpow simplifies Kafka dev: deep insights, topic management, data inspection, and more. โ–ช๏ธ Flex offers enterprise Flink management for real-time streaming workloads. ๐Ÿ’ก Boost Flink SQL with factorhouse/flink! Our factorhouse/flink image simplifies Flink SQL experimentation! โ–ช๏ธ Pre-packaged JARs: Hadoop, Iceberg, Parquet. โ–ช๏ธ Effortless Use with SQL Client/Gateway: Custom class loading (CUSTOM_JARS_DIRS) auto-loads JARs. โ–ช๏ธ Simplified Dev: Start Flink SQL fast with provided/custom connectors, no manual JAR hassle-streamlining local dev. Explore quickstart examples in the repo! ๐Ÿ”— Dive in: https://github.com/factorhouse/factorhouse-local
    โค๏ธ 5
    p
    • 2
    • 3
  • r

    rmoff

    05/20/2025, 5:26 PM
    Good talk from OpenAI at Current in London about their use of Flink. Thread: https://bsky.app/profile/rmoff.net/post/3lpmfuimlqk2r
  • r

    rmoff

    05/20/2025, 6:07 PM
    New blog: https://rmoff.net/2025/05/20/exploring-joins-and-changelogs-in-flink-sql/
  • e

    Elvira Szabo

    05/22/2025, 12:44 PM
    Hi Apache Flink Community! flink As you might know 'Flink Forward Barcelona 2025' is accepting session proposals for 3 days more! Until the 25th you can submit you Apache Flink story on this link! https://sessionize.com/flink-forward-2025-barcelona/ If you have any questions feel free to reach out to me! Good luck for those, who already submitted their session!
    ๐Ÿ™Œ 2
  • g

    Giannis Polyzos

    06/04/2025, 9:36 AM
    Hello folks ๐Ÿ‘‹ For those interested we will be running our first webinar around Fluss to talk about the latest release, what's next and a live Q&A - if you are interested to better understand how Fluss (soon to be Apache) makes Apache Flink more efficient ๐Ÿฟ๏ธ ๐Ÿฆฆ After 6 months of open sourcing the project ๐Ÿ’ป, we are opening our small community to the world ๐Ÿš€, so feel free to join us in our slack channel and talk Fluss and Flink ๐Ÿค For those that don't know Fluss: https://github.com/alibaba/fluss https://www.ververica.com/webinars/fluss-0.7-a-new-stream-of-possibilities?utm_campai[โ€ฆ]tm_medium=social&utm_source=linkedin&hss_channel=lcp-5385380
    ๐Ÿš€ 6
    โœ… 1
    a
    • 2
    • 1
  • r

    rmoff

    06/05/2025, 9:23 AM
    The Current New Orleans 2025 Call for Papers is open until 15th June. We're looking for talks on technologies including Apache Flink.
    ๐Ÿ™Œ 1
    flink 2
  • l

    Lukasz Krawiec

    06/05/2025, 2:57 PM
    Hello community! Sharing a blog on how our team used Apache Flink to enhance our experimentation platform with statistically significant real-time A/B test monitoring. ๐Ÿงช https://medium.com/expedia-group-tech/preventing-revenue-loss-with-real-time-a-b-test-monitoring-605698817457
    flink 3
    ๐Ÿ†’ 1
    p
    • 2
    • 3
  • j

    Jaehyeon Kim

    06/09/2025, 10:11 PM
    ๐Ÿš€ The journey continues! Part 4 of my "๐†๐ž๐ญ๐ญ๐ข๐ง๐  ๐’๐ญ๐š๐ซ๐ญ๐ž๐ ๐ฐ๐ข๐ญ๐ก ๐‘๐ž๐š๐ฅ-๐“๐ข๐ฆ๐ž ๐’๐ญ๐ซ๐ž๐š๐ฆ๐ข๐ง๐  ๐ข๐ง ๐Š๐จ๐ญ๐ฅ๐ข๐ง" series is here: "๐…๐ฅ๐ข๐ง๐ค ๐ƒ๐š๐ญ๐š๐’๐ญ๐ซ๐ž๐š๐ฆ ๐€๐๐ˆ - ๐’๐œ๐š๐ฅ๐š๐›๐ฅ๐ž ๐„๐ฏ๐ž๐ง๐ญ ๐๐ซ๐จ๐œ๐ž๐ฌ๐ฌ๐ข๐ง๐  ๐Ÿ๐จ๐ซ ๐’๐ฎ๐ฉ๐ฉ๐ฅ๐ข๐ž๐ซ ๐’๐ญ๐š๐ญ๐ฌ"! Having explored the lightweight power of Kafka Streams, we now level up to a full-fledged distributed processing engine: ๐—”๐—ฝ๐—ฎ๐—ฐ๐—ต๐—ฒ ๐—™๐—น๐—ถ๐—ป๐—ธ. This post dives into the foundational DataStream API, showcasing its power for stateful, event-driven applications. In this deep dive, you'll learn how to: โ€ข Implement sophisticated event-time processing with Flink's native ๐–๐š๐ญ๐ž๐ซ๐ฆ๐š๐ซ๐ค๐ฌ. โ€ข Gracefully handle late-arriving data using Flinkโ€™s elegant ๐’๐ข๐๐ž ๐Ž๐ฎ๐ญ๐ฉ๐ฎ๐ญ๐ฌ feature. โ€ข Perform stateful aggregations with custom ๐€๐ ๐ ๐ซ๐ž๐ ๐š๐ญ๐ž๐…๐ฎ๐ง๐œ๐ญ๐ข๐จ๐ง and ๐–๐ข๐ง๐๐จ๐ฐ๐…๐ฎ๐ง๐œ๐ญ๐ข๐จ๐ง. โ€ข Consume Avro records and sink aggregated results back to Kafka. โ€ข Visualize the entire pipeline, from source to sink, using ๐Š๐ฉ๐จ๐ฐ and ๐…๐š๐œ๐ญ๐จ๐ซ ๐‡๐จ๐ฎ๐ฌ๐ž ๐‹๐จ๐œ๐š๐ฅ. This is post 4 of 5, demonstrating the control and performance you get with Flink's core API. If you're ready to move beyond the basics of stream processing, this one's for you! Read the full article here: https://jaehyeon.me/blog/2025-06-10-kotlin-getting-started-flink-datastream/ In the final post, we'll see how Flink's Table API offers a much more declarative way to achieve the same result. Your feedback is always appreciated! ๐Ÿ”— ๐‚๐š๐ญ๐œ๐ก ๐ฎ๐ฉ ๐จ๐ง ๐ญ๐ก๐ž ๐ฌ๐ž๐ซ๐ข๐ž๐ฌ: 1. Kafka Clients with JSON 2. Kafka Clients with Avro 3. Kafka Streams for Supplier Stats
    ๐ŸŽ‰ 3
  • j

    Jaehyeon Kim

    06/11/2025, 9:18 PM
    ๐ŸŒŠ ๐ƒ๐ข๐ฏ๐ž ๐ƒ๐ž๐ž๐ฉ ๐ข๐ง๐ญ๐จ ๐‘๐ž๐š๐ฅ-๐“๐ข๐ฆ๐ž ๐ƒ๐š๐ญ๐š ๐’๐ญ๐ซ๐ž๐š๐ฆ๐ข๐ง๐  & ๐€๐ง๐š๐ฅ๐ฒ๐ญ๐ข๐œ๐ฌ โ€“ ๐‹๐จ๐œ๐š๐ฅ๐ฅ๐ฒ! ๐ŸŒŠ Ready to master the world of Kafka, Flink, data pipelines, and real-time analytics without the headache of complex cloud setups or resource contention? ๐Ÿš€ Introducing the ๐๐„๐– ๐…๐š๐œ๐ญ๐จ๐ซ ๐‡๐จ๐ฎ๐ฌ๐ž ๐‹๐จ๐œ๐š๐ฅ ๐‹๐š๐›๐ฌ โ€“ your personal sandbox for building and experimenting with sophisticated data streaming architectures, all on your local machine! We've designed these hands-on labs to take you from foundational concepts to building complete, reactive applications: ๐Ÿ”— ๐„๐ฑ๐ฉ๐ฅ๐จ๐ซ๐ž ๐ญ๐ก๐ž ๐…๐ฎ๐ฅ๐ฅ ๐’๐ฎ๐ข๐ญ๐ž ๐จ๐Ÿ ๐‹๐š๐›๐ฌ: https://github.com/factorhouse/examples/tree/main/fh-local-labs ๐‡๐ž๐ซ๐ž'๐ฌ ๐ฐ๐ก๐š๐ญ ๐ฒ๐จ๐ฎ ๐œ๐š๐ง ๐ ๐ž๐ญ ๐ก๐š๐ง๐๐ฌ-๐จ๐ง ๐ฐ๐ข๐ญ๐ก: ๐Ÿ’ง ๐‹๐š๐› 1 - ๐’๐ญ๐ซ๐ž๐š๐ฆ๐ข๐ง๐  ๐ฐ๐ข๐ญ๐ก ๐‚๐จ๐ง๐Ÿ๐ข๐๐ž๐ง๐œ๐ž: โ—ฆ Master producing and consuming Avro data using Schema Registry. Ensure data integrity and build robust, schema-aware Kafka streams. ๐Ÿ”— ๐‹๐š๐› 2 - ๐๐ฎ๐ข๐ฅ๐๐ข๐ง๐  ๐ƒ๐š๐ญ๐š ๐๐ข๐ฉ๐ž๐ฅ๐ข๐ง๐ž๐ฌ ๐ฐ๐ข๐ญ๐ก ๐Š๐š๐Ÿ๐ค๐š ๐‚๐จ๐ง๐ง๐ž๐œ๐ญ: โ—ฆ Discover the power of Kafka Connect! Learn to stream data from sources to sinks (e.g., databases, files) efficiently, often without writing a single line of code. ๐Ÿง  ๐‹๐š๐›๐ฌ 3, 4, 5 - ๐…๐ซ๐จ๐ฆ ๐„๐ฏ๐ž๐ง๐ญ๐ฌ ๐ญ๐จ ๐ˆ๐ง๐ฌ๐ข๐ ๐ก๐ญ๐ฌ: โ—ฆ Unlock the potential of your event streams! Dive into building real-time analytics applications using powerful stream processing techniques. Transform raw data into actionable intelligence, instantly. ๐Ÿž๏ธ ๐‹๐š๐›๐ฌ 6, 7, 8, 9, 10 - ๐’๐ญ๐ซ๐ž๐š๐ฆ๐ข๐ง๐  ๐ญ๐จ ๐ญ๐ก๐ž ๐ƒ๐š๐ญ๐š ๐‹๐š๐ค๐ž: โ—ฆ Build modern data lake foundations. Learn to ingest Kafka data into highly efficient and queryable formats like Parquet and Apache Iceberg, setting the stage for powerful batch and ad-hoc analytics. ๐Ÿ’ก ๐‹๐š๐›๐ฌ 11, 12 - ๐๐ซ๐ข๐ง๐ ๐ข๐ง๐  ๐‘๐ž๐š๐ฅ-๐“๐ข๐ฆ๐ž ๐€๐ง๐š๐ฅ๐ฒ๐ญ๐ข๐œ๐ฌ ๐ญ๐จ ๐‹๐ข๐Ÿ๐ž: โ—ฆ See your data in motion! Construct reactive client applications and dashboards that respond to live data streams, providing immediate insights and visualizations. ๐–๐ก๐ฒ ๐๐ข๐ฏ๐ž ๐ข๐ง๐ญ๐จ ๐ญ๐ก๐ž๐ฌ๐ž ๐ฅ๐š๐›๐ฌ? โ€ข ๐ƒ๐ž๐ฆ๐ฒ๐ฌ๐ญ๐ข๐Ÿ๐ฒ ๐‚๐จ๐ฆ๐ฉ๐ฅ๐ž๐ฑ๐ข๐ญ๐ฒ: Break down intricate data streaming concepts into manageable, hands-on steps. โ€ข ๐’๐ค๐ข๐ฅ๐ฅ ๐”๐ฉ: Gain practical experience with essential tools like Kafka, Flink, Spark, Kafka Connect, Iceberg, and Pinot. โ€ข ๐„๐ฑ๐ฉ๐ž๐ซ๐ข๐ฆ๐ž๐ง๐ญ ๐…๐ซ๐ž๐ž๐ฅ๐ฒ: Test, iterate, and innovate on data architectures locally before deploying to production. โ€ข ๐€๐œ๐œ๐ž๐ฅ๐ž๐ซ๐š๐ญ๐ž ๐‹๐ž๐š๐ซ๐ง๐ข๐ง๐ : Fast-track your journey to becoming proficient in real-time data engineering. Stop just dreaming about real-time data โ€“ start building it! Clone the repo, pick your adventure, and transform your understanding of modern data systems.
  • r

    rmoff

    06/16/2025, 12:53 PM
    Interesting blog post about how Grab are using Flink SQL: https://engineering.grab.com/the-complete-stream-processing-journey-on-flinksql
  • s

    sap1ens

    06/16/2025, 3:49 PM
    Iโ€™ve been saying this for a while: data streaming needs to be polyglot. Iโ€™m addressing this with Iron Functions: a WebAssembly-based runtime that enables writing ApacheFlink transformations in several languages like TypeScript, Rust, and Go. Iโ€™ve just published a detailed post about creating User-Defined Functions (UDFs) with Iron Functions, covering: โ€ข Developer experience and language support โ€ข Sandboxing โ€ข Portability There are several demos showcasing different languages and how easy it is to package an Iron Functions project as a UDF JAR. I also deployed these UDFs to managed Flink platforms like Confluent and DeltaStream. https://irontools.dev/blog/polyglot-flink-udfs/
    flink 3
    k
    p
    w
    • 4
    • 5
  • j

    Jaehyeon Kim

    06/16/2025, 10:00 PM
    ๐Ÿš€ The journey concludes! I'm excited to share the final installment, Part 5 of my "๐†๐ž๐ญ๐ญ๐ข๐ง๐  ๐’๐ญ๐š๐ซ๐ญ๐ž๐ ๐ฐ๐ข๐ญ๐ก ๐‘๐ž๐š๐ฅ-๐“๐ข๐ฆ๐ž ๐’๐ญ๐ซ๐ž๐š๐ฆ๐ข๐ง๐  ๐ข๐ง ๐Š๐จ๐ญ๐ฅ๐ข๐ง" series: "๐…๐ฅ๐ข๐ง๐ค ๐“๐š๐›๐ฅ๐ž ๐€๐๐ˆ - ๐ƒ๐ž๐œ๐ฅ๐š๐ซ๐š๐ญ๐ข๐ฏ๐ž ๐€๐ง๐š๐ฅ๐ฒ๐ญ๐ข๐œ๐ฌ ๐Ÿ๐จ๐ซ ๐’๐ฎ๐ฉ๐ฉ๐ฅ๐ข๐ž๐ซ ๐’๐ญ๐š๐ญ๐ฌ ๐ข๐ง ๐‘๐ž๐š๐ฅ ๐“๐ข๐ฆ๐ž"! After mastering the fine-grained control of the DataStream API, we now shift to a higher level of abstraction with the ๐—™๐—น๐—ถ๐—ป๐—ธ ๐—ง๐—ฎ๐—ฏ๐—น๐—ฒ ๐—”๐—ฃ๐—œ. This is where stream processing meets the simplicity and power of SQL! We'll solve the same supplier statistics problem but with a concise, declarative approach. This final post covers: โ€ข Defining a ๐“๐š๐›๐ฅ๐ž over a streaming ๐ƒ๐š๐ญ๐š๐’๐ญ๐ซ๐ž๐š๐ฆ to run queries. โ€ข Writing declarative, ๐’๐๐‹-๐ฅ๐ข๐ค๐ž ๐ช๐ฎ๐ž๐ซ๐ข๐ž๐ฌ for windowed aggregations. โ€ข Seamlessly ๐›๐ซ๐ข๐๐ ๐ข๐ง๐  ๐›๐ž๐ญ๐ฐ๐ž๐ž๐ง ๐ญ๐ก๐ž ๐“๐š๐›๐ฅ๐ž ๐š๐ง๐ ๐ƒ๐š๐ญ๐š๐’๐ญ๐ซ๐ž๐š๐ฆ ๐€๐๐ˆ๐ฌ to handle complex logic like late-data routing. โ€ข Using Flink's built-in Kafka connector with the avro-confluent format for declarative sinking. โ€ข Comparing the declarative approach with the imperative DataStream API to achieve the same business goal. โ€ข Demonstrating the practical setup using ๐…๐š๐œ๐ญ๐จ๐ซ ๐‡๐จ๐ฎ๐ฌ๐ž ๐‹๐จ๐œ๐š๐ฅ and ๐Š๐ฉ๐จ๐ฐ for a seamless Kafka development experience. This is the final post of the series, bringing our journey from Kafka clients to advanced Flink applications full circle. It's perfect for anyone who wants to perform powerful real-time analytics without getting lost in low-level details. Read the article: https://jaehyeon.me/blog/2025-06-17-kotlin-getting-started-flink-table/ Thank you for following along on this journey! I hope this series has been a valuable resource for building real-time apps with Kotlin. ๐Ÿ”— ๐’๐ž๐ž ๐ญ๐ก๐ž ๐Ÿ๐ฎ๐ฅ๐ฅ ๐ฌ๐ž๐ซ๐ข๐ž๐ฌ ๐ก๐ž๐ซ๐ž: 1. Kafka Clients with JSON 2. Kafka Clients with Avro 3. Kafka Streams for Supplier Stats 4. Flink DataStream API for Supplier Stats
  • r

    rmoff

    06/19/2025, 2:50 PM
    cool blog from Simon Aubury: https://simonaubury.substack.com/p/when-plans-change-at-500-feet-complex-event-processing[โ€ฆ]n-data-with-apache-flink-52b6381d6a20?triedRedirect=true
  • r

    rmoff

    06/25/2025, 2:05 PM
    New blog: https://rmoff.net/2025/06/24/writing-to-apache-iceberg-on-s3-using-flink-sql-with-glue-catalog/
    ๐ŸงŠ 1
    โค๏ธ 1
    flink 4
  • j

    Jingke He

    06/26/2025, 5:53 AM
    ๐ŸŽ‰ Exciting News for Apache Flink Developers! Get ready to dive into the future of real-time computing at #FlinkForward Asia 2025 in Singapore on July 3rd! This one-day event will explore the transformative theme "The Future of AI is Real-Time" with 20+ expert-led talks covering ๐Ÿ”ฅ Real-time AI ๐Ÿ”ฅ Real-time Lakehouse ๐Ÿ”ฅ Real-time Analytics ๐Ÿ’ก Featuring cutting-edge projects like Apache Flink 2.0, Flink Agents, Apache Paimon, Flink CDC, and Fluss, youโ€™ll hear insights from leading companies that are adopting streaming technology, including Alibaba, GoTo, Confluent, Shopee, TikTok, Lalamove, Grab, LinkedIn, Ververica, Lazada, and Salesforce. Whether you're attending in person or virtually, this is the ultimate opportunity to connect with the Flink community and shape the future of stream processing! ๐Ÿ‘‰ Register Now: https://asia.flink-forward.org/singapore-2025 ๐Ÿ“บ Canโ€™t attend onsite? Watch Live Streaming: โ€ข YouTube: https://www.youtube.com/live/pzT6vCCmwq8 โ€ข LinkedIn: https://www.linkedin.com/events/7339127785510051844/comments/ โ€ข Alibaba Cloud: https://resource.alibabacloud.com/webinar/detail.html?id=8851
    gratitude thank you 3
  • a

    Andrรฉ Santos

    07/02/2025, 1:35 PM
    hey! just wrote this blog post some days ago regarding the HTTP full cache lookups https://www.datanutshell.com/posts/flink_http_full_cache_connector
    r
    • 2
    • 2
  • g

    Giannis Polyzos

    07/03/2025, 5:41 AM
    It's official .. yet another big milestone ๐ŸŽ‰ Apache Fluss the streaming storage layer that skyrockets ๐Ÿš€ Apache Flink is donated to ASF https://github.com/apache/fluss https://fluss.apache.org/ Check it out and donโ€™t forget to give Apache Fluss some โค๏ธ via โญ on Github
    ๐Ÿ™Œ๐Ÿป 1
    ๐Ÿ™Œ 13
    ๐ŸŽ‰ 3
    r
    • 2
    • 2
  • j

    Jaehyeon Kim

    07/09/2025, 9:01 PM
    ๐€๐ง๐ง๐จ๐ฎ๐ง๐œ๐ข๐ง๐  ๐…๐š๐œ๐ญ๐จ๐ซ ๐‡๐จ๐ฎ๐ฌ๐ž ๐‹๐จ๐œ๐š๐ฅ ๐ฏ2.0: ๐€ ๐”๐ง๐ข๐Ÿ๐ข๐ž๐ & ๐๐ž๐ซ๐ฌ๐ข๐ฌ๐ญ๐ž๐ง๐ญ ๐ƒ๐š๐ญ๐š ๐๐ฅ๐š๐ญ๐Ÿ๐จ๐ซ๐ฆ! We're excited to launch a major update to our local development suite. While retaining our powerful Apache Kafka and Apache Pinot environments for real-time processing and analytics, this release introduces our biggest enhancement yet: a new Unified Analytics Platform. ๐Š๐ž๐ฒ ๐‡๐ข๐ ๐ก๐ฅ๐ข๐ ๐ก๐ญ๐ฌ ๐ข๐ง ๐ญ๐ก๐ข๐ฌ ๐‘๐ž๐ฅ๐ž๐š๐ฌ๐ž: ๐Ÿš€ ๐”๐ง๐ข๐Ÿ๐ข๐ž๐ ๐€๐ง๐š๐ฅ๐ฒ๐ญ๐ข๐œ๐ฌ ๐๐ฅ๐š๐ญ๐Ÿ๐จ๐ซ๐ฆ: We've merged our Flink (streaming) and Spark (batch) environments. No more separate stacks! Develop end-to-end pipelines on a single Apache Iceberg lakehouse, simplifying management and eliminating data silos. ๐Ÿง  ๐‚๐ž๐ง๐ญ๐ซ๐š๐ฅ๐ข๐ณ๐ž๐ ๐‚๐š๐ญ๐š๐ฅ๐จ๐  ๐ฐ๐ข๐ญ๐ก ๐‡๐ข๐ฏ๐ž ๐Œ๐ž๐ญ๐š๐ฌ๐ญ๐จ๐ซ๐ž: The new system of record for the platform. It saves not just your tables, but your analytical logicโ€”permanent SQL views and custom functions (UDFs)โ€”making them instantly reusable across all Flink and Spark jobs. ๐Ÿ’พ ๐„๐ง๐ก๐š๐ง๐œ๐ž๐ ๐…๐ฅ๐ข๐ง๐ค ๐‘๐ž๐ฅ๐ข๐š๐›๐ข๐ฅ๐ข๐ญ๐ฒ: Flink checkpoints and savepoints are now persisted directly to MinIO (S3-compatible storage), ensuring robust state management and reliable recovery for your streaming applications. ๐ŸŒŠ ๐‚๐ƒ๐‚-๐‘๐ž๐š๐๐ฒ ๐ƒ๐š๐ญ๐š๐›๐š๐ฌ๐ž: The included PostgreSQL instance is pre-configured for Change Data Capture (CDC), allowing you to easily prototype real-time data synchronization from an operational database to your lakehouse. This update provides a more powerful, streamlined, and stateful local development experience across the entire data lifecycle. Ready to dive in? โญ๏ธ Explore the project on GitHub: https://github.com/factorhouse/factorhouse-local ๐Ÿงช Try our hands-on labs: https://github.com/factorhouse/examples/tree/main/fh-local-labs
    ๐Ÿ™Œ 1
  • b

    B S Mohammed Ashfaq

    07/14/2025, 4:08 PM
    Hey Flink community! I've been exploring Flink and created beginner-friendly examples using Kafka, SQL, etc. Just wanted to share them here in case it's useful: https://github.com/Ashfaqbs/Apache-Flink Would love feedback and collaboration!
    ๐Ÿ™Œ 3
  • b

    B S Mohammed Ashfaq

    07/16/2025, 1:26 AM
    Hi again Flink community ๐Ÿ‘‹ In addition to the beginner-friendly Flink examples I shared earlier, I recently built an Apache Flink MCP Server ๐Ÿ”ง It's a bridge between AI assistants and Apache Flink clusters using the Model Context Protocol (MCP) โ€” now you can monitor and debug Flink jobs using natural language. โœ… Real-time cluster monitoring โœ… Natural language job debugging โœ… Instant metrics and exception access โœ… TaskManager resource monitoring Instead of navigating complex UIs, just ask questions like: โ€œWhatโ€™s wrong with my cluster?โ€ GitHub: https://github.com/Ashfaqbs/Apache-Flink-MCP-Server Would love feedback and suggestions! Also, Iโ€™m interested in contributing this to the wider Flink ecosystem โ€” any advice on the best way to do that? ๐Ÿ™ Thanks in advance!
    ๐Ÿ™ 1
    l
    • 2
    • 1
  • j

    Jeanne CHEN

    07/17/2025, 7:09 AM
    Hi Flink community ๐Ÿ‘‹ Join us on July 24, 2025, for the Apache Iceberg Meetup! Dive into the latest trends in streaming and data analytics with industry leaders from AutoMQ and Decodable - exploring how Apache Iceberg is reshaping data lakehouses. ๐Ÿ“… Time: July 24th, 9:00am PDT | 12:00pm EDT | 5:00pm BST ๐Ÿ“บ Format: Live ๐Ÿ‘ฅ Save your seat: https://lu.ma/akwa6uzh Sign up now, and weโ€™ll send the YouTube live stream link directly to your inbox before the event. Donโ€™t miss insights on: โœ… Building Kafka on S3, by Xinyu Zhou, Co-Founder & CTO at AutoMQ. โœ… Incremental Change Processing with Flink & Iceberg, by Sharon Xie, Head of Product at Decodable. Register today to secure your spot!