This message was deleted.

You can setup batch ingestion . Also make sure you have enough worker capacity to handle both streaming and batch ingestion. is my understanding is correct? https://druid.apache.org/docs/latest/ingestion/index.html#batch

Just understand kafka ingestion is ‘always on’, new records in the topic will be ingested asap. Batch ingestions work in a different way, you set them when you need to ingest a set of files; or you can use something like Airflow to trigger batch jobs periodically. Have you tried ‘load data’ tab to run a batch ingestion from S3 or HDFS?