Hey a quick question - Is there an Http API to do batch inserts into Pinot? Can we skip Kafka ingestion for ingesting real time batches of data using a direct API?
Yeah I was looking for something more lightweight which can be plugged into a production app without needing much effort. An Http Api call seems like one.
m
Mark Needham
03/29/2022, 1:33 PM
fair enough. The ingestion job is effectively wrapping together creating segment(s), uploading them to Pinot's deep store, and then having those segments downloaded to Pinot Servers
Mark Needham
03/29/2022, 1:33 PM
it does call the HTTP API to do some of those steps
k
kaivalya apte
03/29/2022, 1:45 PM
yeah - to use those APIs it might require similar amount of work that I am trying to save 🙂