Apache Pinot

Hi All, if we increase kafka partition later as per requirement how pinot will behave and do we we need to change some config to tackle this situation in pinot to avoid any issues or it is fine pinot will create new segments as soon as  the new partitions will be added to kafka topics?

Hi, that's not an issue at all. Pinot automatically detects new partitions in the topic. It checks for new partitions whenever `RealtimeSegmentValidationManager` perioidic job runs and start consumers for new partitions. You can configure the interval for this job using `controller.realtime.segment.validation.frequencyPeriod` in controller configuration;

You can also trigger this task manually using
`curl -X GET "<http://localhost:9000/periodictask/run?taskname=RealtimeSegmentValidationManager&amp;tableName=your-table-name>" -H "accept: application/json"`

Where you need to replace host:port with your controller host:port
and `your-table-name` with appropriate value

Thanks much Kartik this is really helpful