Real-Time data ingestion? I am trying to implement...
# general
a
Real-Time data ingestion? I am trying to implement a real-time data ingestion from the automation-gateway.com to Druid. It turned out that the batch interface does not work, I am sending small batches of about 10-1000 rows, but those frequently. The batch interface is too slow for that. By using Kafka it works fine, but I don‘t want to have Kafka in the middle - one more, in that case unnecessary, component. Is there an API interface in Druid to ingest in real-time data?
j
Hi Andreas, Afaik OS Druid does not have such an interface. Imply has a Saas Druid offering -- Polaris -- that has a REST "Push API" ... which actually uses Kafka behind the covers, but you don't have to deal with the Kafka infrastructure. Thanks. John
a
Thank you John!