Hi Team, I have a scenario to load my local files in a particular folder to pinot offline table. Suppose that, files will increase for every one hour or so. How do I create a segments for those files in timely basis for every hour ? Is there any automatic process for creating segments for hour or so ?

Hi yes you can use Minion SegmentGenerationAndPushTask https://docs.pinot.apache.org/basics/components/minion#segmentgenerationandpushtask

Thanks, I'll go through it

Hi You can deploy minion in local using the command mentioned in the previous doc. Then simply go to the controller to submit the task. The following APIs are available https://docs.pinot.apache.org/basics/components/minion#manual-schedule