https://pinot.apache.org/ logo
l

Luiz Gabriel Lima Pinheiro

07/14/2021, 4:09 PM
@Kishore G, this is for production
m

Mayank

07/14/2021, 6:10 PM
@Luiz Gabriel Lima Pinheiro The ingestion job spec is not something you upload to Pinot. Your ingestion job runs outside of Pinot cluster for production use cases. For example. you may want to run it in spark/hadoop: https://docs.pinot.apache.org/basics/data-import/batch-ingestion
l

Luiz Gabriel Lima Pinheiro

07/15/2021, 4:40 PM
Thank you @Mayank!
I thought it would be run inside the cluster.
k

Kishore G

07/15/2021, 5:12 PM
there is an option to run inside the cluster as well.. thats where minions come
m

Mayank

07/15/2021, 5:23 PM
Yes, you can refer to the details here @Luiz Gabriel Lima Pinheiro https://docs.pinot.apache.org/operators/operating-pinot/pinot-managed-offline-flows
l

Luiz Gabriel Lima Pinheiro

07/15/2021, 8:57 PM
Interesting...