Hi, all ! I trying to batch ingestion from multiple parquet files from directory. Job made all segments in mounted directory , but didn't push it to Pinot. Before this - my table had already one old single segment from previous job and data was pushed successfull. My configuration of cluster - docker [controller, broker, server1, server2. server3] 16CPU / 64RAM / 1TB SSD / Ubuntu Server. Job Spec:

executionFrameworkSpec:
  name: standalone
  segmentGenerationJobRunnerClassName: org.apache.pinot.plugin.ingestion.batch.standalone.SegmentGenerationJobRunner
  segmentTarPushJobRunnerClassName: org.apache.pinot.plugin.ingestion.batch.standalone.SegmentTarPushJobRunner
  segmentUriPushJobRunnerClassName: org.apache.pinot.plugin.ingestion.batch.standalone.SegmentUriPushJobRunner

jobType: SegmentCreationAndTarPush

inputDirURI: '/var/imports/insights_ch1_fff_seg/'
includeFileNamePattern: "glob:**/*.parquet"
outputDirURI: '/tmp/pinot-segments/insights_ch1_fff_sm'
overwriteOutput: true

pushJobSpec:
  pushFileNamePattern: 'glob:**/*.tar.gz'
  pushParallelism: 2
  pushAttempts: 2

recordReaderSpec:
  dataFormat: parquet
  className: org.apache.pinot.plugin.inputformat.parquet.ParquetRecordReader

pinotFSSpecs:
  - scheme: file
    className: org.apache.pinot.spi.filesystem.LocalPinotFS

tableSpec:
  tableName: insights_ch1_4
  schemaURI: '<http://pinot-controller:9000/tables/insights_ch1_4/schema>'
  tableConfigURI: '<http://pinot-controller:9000/tables/insights_ch1_4>'

pinotClusterSpecs:
  - controllerURI: '<http://pinot-controller:9000>'

Made segs on mounted dir after working of job: (screenshot) Command for running job:

docker exec -e JAVA_OPTS="-Xms16g -Xmx40g" -it pinot-controller \
  bin/pinot-admin.sh LaunchDataIngestionJob -jobSpecFile /config/insights_ch1_4_job.yaml

I'm not see a log from stdout - only when it falls. Xmx40g (when it was 24g - job failed by out of heap space). What is wrong ?