For batch ingestion standalone mode where is the work being performed?
m
Mayank
07/09/2021, 8:00 PM
Local node where the pinot-admin command was launched.
b
Bruce Ritchie
07/09/2021, 8:08 PM
Good to know, thanks. So for parallel ingestion of offline table data using spark to create the segments would be the recommended approach I assume. I need to ingest 5+TB of parquet data (30b rows)