@Kishore G, this is for production

@Luiz Gabriel Lima Pinheiro The ingestion job spec is not something you upload to Pinot. Your ingestion job runs outside of Pinot cluster for production use cases. For example. you may want to run it in spark/hadoop: https://docs.pinot.apache.org/basics/data-import/batch-ingestion

Thank you @Mayank!

there is an option to run inside the cluster as well.. thats where minions come

Yes, you can refer to the details here @Luiz Gabriel Lima Pinheiro https://docs.pinot.apache.org/operators/operating-pinot/pinot-managed-offline-flows

Interesting...