Few doubts regarding Streaming data :
1. Pinot supports data ingestion via streaming (Kafka) or batch(Hadoop) process. is there any direct API available for pushing data into Pinot?
2. Does pinot have a segment compaction process like Hbase compaction? Creating a lot of small segments will not affect query performance?
m
Mayank
05/03/2021, 3:01 PM
There offline push is via http post. There isn’t a write api right now if that’s what you are asking.
Mayank
05/03/2021, 3:01 PM
Segment compaction is under progress and will be available shortly
👍 1
v
Vengatesh Babu
05/03/2021, 3:50 PM
Based on my understanding, Pinot Streaming Processor can pull data from Kafka, kinesis, etc.
but Pinot doesn't have a rest layer that accepts data requests(POST) directly. is there any plan to support write REST API in the future?
m
Mayank
05/03/2021, 3:51 PM
We have discussed, but there's no concrete timeline right now. May I ask what's your use case that would need the write-api?