Hi everyone, I’m excited to share Otter-Streams, ...
# show-and-tell
n
Hi everyone, I’m excited to share Otter-Streams, an open-source SDK and framework I’ve been building to make real-time machine learning inference first-class in Apache Flink. Otter Streams focuses on: • Streaming-native ML inference (low-latency, under evaluation and testing) • Clean abstractions for model loading, feature handling, and inference • Seamless integration with Flink DataStreams • Support for embedding inference logic directly into Flink pipelines (no external serving hop) The goal is to simplify how we run online ML inference at scale, while staying idiomatic to Flink’s execution and state model. Documentation: https://martourez21.github.io/otter-streams/ GitHub Repository: https://github.com/martourez21/otter-streams I’d really appreciate: • Feedback on the API and design • Suggestions for improvements or missing features • Ideas from folks running ML in production on Flink I’m also very open to *open-source collaboration*—issues, discussions, PRs, or design feedback are all welcome.