Hi - when Pinot consumes from Kafka , is there a S...
# general
b
Hi - when Pinot consumes from Kafka , is there a Sink used? i.e. like kafka has sink connectors to PG. If not, what is a good way to measure/assess the time delay between when data comes to kafka and the time when it shows up in pinot. With PG we can do this my measuring the consumer lag on the sink. Wondering if something can be done with pinot as well. We're getting about 20k msgs in kafka and want them in pinot with sub ms delay but would like a way to measure it
👍 1
m
Pinot exposes an ingestion delay metric. However, it uses the producer side timestamp, so that includes delay external to Pinot as well
👍 2