what’s difference between `segmentUriPush` and `se...
# troubleshooting
p
what’s difference between
segmentUriPush
and
segmentMetadataPush
?
p
oh i see, thank u.
another question: Example i has a offline table config like this
Copy code
"segmentPartitionConfig": {
      "columnPartitionMap": {
        "campaign_id": {
          "functionName": "Modulo",
          "numPartitions": 2
        }
      }
    }
And the ingest job in spark cluster. So i must build the partition on spark job also, or i dont need pre partition on spark-job ?
o
Your source files must be partitioned by defined configuration in your table config. For example; raw data (s3) => spark job(analyze data, and partition by campaign_id) => analyzed and partitioned data(s3) => pinot-spark-batch-ingestion-job => segments(s3)