š—¦š˜š—æ:::š—Ÿš—®š—Æ š—¦š˜š˜‚š—±š—¶š—¼ - Real-time Stream Pr...
# show-and-tell
n
š—¦š˜š—æ:::š—Ÿš—®š—Æ š—¦š˜š˜‚š—±š—¶š—¼ - Real-time Stream Processing on a Telecoms use case I just ran a full š—§š—²š—¹š—²š—°š—¼š—ŗ š—”š—²š˜š˜„š—¼š—æš—ø š—¤š˜‚š—®š—¹š—¶š˜š˜† š— š—¼š—»š—¶š˜š—¼š—æš—¶š—»š—“ pipeline live inside Str:::Lab Studio - and here's what it looked like. š—Ŗš—µš—®š˜'š˜€ š—æš˜‚š—»š—»š—¶š—»š—“ š—¶š—» š˜š—µš—¶š˜€ š—±š—²š—ŗš—¼: A synthetic RAN (Radio Access Network) pipeline - 200 cell towers streaming telemetry at šŸ®šŸ¬šŸ¬ š—²š˜ƒš—²š—»š˜š˜€/š˜€š—²š—° across 6 regions. 9 parallel Flink jobs. 9 Kafka topics. All observable in real time. š—§š—µš—² š—½š—¶š—½š—²š—¹š—¶š—»š—² š—°š—¼š˜ƒš—²š—æš˜€: • Tower enrichment - decoding raw integers into regions, tower types, signal quality tiers and SLA classes • 1-minute tumbling window KPI aggregation per region • Rolling Signal Quality Index using HOP windows (30s slide / 5min range) • Packet loss + high-latency alert filtering • Handover anomaly detection • SESSION window outage risk scoring (closes after 60s of tower silence) • 5-minute capacity planning metrics • SLA breach event scoring • Live continuous SELECT into the Results tab for NOC monitoring š—Ŗš—µš—®š˜ š˜†š—¼š˜‚'š—æš—² š˜€š—²š—²š—¶š—»š—“ š—¶š—» š˜š—µš—² š—šš—œš—™: • JVM Heap per job - memory consumption tracked live across all 9 running jobs, showing how each pipeline branch carves out its own heap footprint • Live metric graphs - throughput, backpressure indicators and event rates per pipeline, updating in real time as the datagen floods 200 rec/s through the cluster • Checkpointing metrics - checkpoint duration, size and alignment times for each job with EXACTLY_ONCE mode enabled and state persisted to
/tmp/flink-checkpoints
• Job node live events - per-operator stats on the execution graph: records in/out, watermark lag, and busy/idle ratios at the subtask level All of this running locally. No cloud. No infra setup beyond Docker. š—Ŗš—®š—»š˜ š˜š—¼ š˜š—æš˜† š—¶š˜ š˜†š—¼š˜‚š—æš˜€š—²š—¹š—³? The full pipeline SQL is in the repo under example directory. Spin up the stack, paste the queries, and watch your cluster come alive. • š—£š—æš—¼š—·š—²š—°š˜ š—±š—¼š—°š˜€: https://str-lab.io/docs • š——š—¼š—°š—øš—²š—æ š—¶š—ŗš—®š—“š—²: codedstreams/strlabstudio - Docker Image • š—šš—¶š˜š—›š˜‚š—Æ š—æš—²š—½š—¼: coded-streams/strlabstudio š˜š˜§ š˜µš˜©š˜Ŗš˜“ š˜­š˜°š˜°š˜¬š˜“ š˜¶š˜“š˜¦š˜§š˜¶š˜­ š˜µš˜° š˜ŗš˜°š˜¶: 1. Give the repo a star on GitHub - it genuinely helps the project grow 2. Leave a review on docker hub so others can find it. 3. Drop a comment below - questions, feedback, or what pipeline you'd want to run next More demos coming .šŸ˜Ž
k
Looks pretty good! Is there a video version of the GIF?
n
yes there is a video. I am planning on doing a video demo on connecting the studio to a cluster environment, create a demo pipeline and also use the pipeline builder to build a pipeline without using a SQL
permit me to share the video in your inbox