🚀
Introducing Cobble-Flink — a unified storage layer for Apache Flink.
Cobble-Flink brings together a state backend and SQL source/sink connectors, powered by the Cobble storage engine. It makes both streaming state and sink output available for fast sharing, querying, and reuse across jobs, while improving performance and preserving the familiar, native Flink experience.
Highlights:
•
Performant stateful streaming — up to
2x throughput in Nexmark and
2.2x throughput in the Flink state benchmark, compared with RocksDB.
•
Disaggregated state — available starting from
Flink 1.17, helping reduce resource usage and speed up restarts, with remote compaction to further offload CPU work from processing jobs.
•
Source and sink support — store intermediate results, and scan or look up persisted state and sink output from other Flink jobs.
•
Web Monitor — inspect records, explore state by column, and track changes across snapshots.
•
New: async state support for Flink 2.x
🎬 Here’s a short walkthrough:
F0CB7285PME
📖
Docs and getting started:
Just add the dependency to get started—make your data easier to work with, with high-performance storage for Flink.
cobble-project.github.io/cobble-flink/latest
These capabilities are powered by the Cobble storage core. We also welcome ideas for integrating it with other engines and applications:
github.com/cobble-project/cobble
The project is evolving quickly. Give it a try—we’d love to hear your feedback and suggestions!