Hi :wave: - What is the best way to monitor a tabl...
# general
s
Hi 👋 - What is the best way to monitor a table to know if its not updating with new records? Is there a log I can watch that would tell me if the data growing stale?
r
I would recommend using the Grafana dashboard. IIRC it has a Table Ingestion Rate graph
s
Thanks! I'll check this out
r
I've customized my dashboard with a Table Ingestion Delay graph that reports on a per table granularity
s
Do you have a link for docs on how to set this up?
r
The dashboard I started off with is (or at least was) available in the pinot docs
s
It sounds like exactly what I'm looking for
Okay I'll check pinot docs
s
We got prometheus setup. Do you recall the metric name you are using for the two graphs you look at? The ones that build these two
Table Ingestion Rate graph
and
Table Ingestion Delay graph
?
@robert zych 👀
r
I'd recommend using the
pinot_server_realtimeIngestionDelayMs_Value
metric
pinot_server_realtimeRowsConsumed_Count
is also good
s
I don't have that one for some reason 😞
I have that second one
r
Which version of Pinot are you using?
s
v1.2.0
r
same
REALTIME_INGESTION_DELAY_MS
I assumed you were talking about a realtime table. Is that correct?
s
Yes thats correct
I'm so confused why we don't have some of these
Will keep looking. Thanks for your help again 🙂