Hey, I’m trying to measure ingestion lag and came across two metrics: •

availabilityLagMsMap

from

/consumingSegmentsInfo

→ reports ~200–400 ms for me. •

endToEndRealtimeIngestionDelayMs

from Prometheus → shows a “saw-tooth” pattern, peaking around 5 seconds. Can someone explain the difference between these two metrics, why they report different values, and whether the saw-tooth pattern is expected?

I would suggest using the offset as a metric to track lag will be better

pinot_server_realtimeIngestionOffsetLag_Value

Severs are not emitting

pinot_server_realtimeIngestionOffsetLag_Value

. I'm using version 1.4.0 , do you know if there is a configuration to enable tracking?