Hello🙌
Would like to track the average message waiting period of message in pinot input topic. Do we have any metric for that ?
s
Subbu Subramaniam
10/05/2021, 4:33 PM
You will need kafka support for this. You need to get the ingestion time (into kafka) of the message, and then use that to compute the elapsed time from that to ingestion into pinot.
Subbu Subramaniam
10/05/2021, 4:34 PM
Pinot provides support for
RowMetadata
class where the underlying plugin can populate this information
Subbu Subramaniam
10/05/2021, 4:35 PM
For each query, pinot indicates the largest time difference faced amongst all segments, in the metadata sent out by broker.