Jonathan Baxter
07/28/2025, 9:05 PMKerberosAuthException: failure to login: javax.security.auth.login.LoginException: java.lang.NullPointerException: invalid null input: nameMayank
Jonathan Baxter
07/28/2025, 9:09 PMexecutionFrameworkSpec:
name: 'standalone'
segmentGenerationJobRunnerClassName: 'org.apache.pinot.plugin.ingestion.batch.standalone.SegmentGenerationJobRunner'
segmentTarPushJobRunnerClassName: 'org.apache.pinot.plugin.ingestion.batch.standalone.SegmentTarPushJobRunner'
segmentUriPushJobRunnerClassName: 'org.apache.pinot.plugin.ingestion.batch.standalone.SegmentUriPushJobRunner'
segmentMetadataPushJobRunnerClassName: 'org.apache.pinot.plugin.ingestion.batch.standalone.SegmentMetadataPushJobRunner'
jobType: SegmentCreationAndMetadataPush
inputDirURI: '<gs://etsy-pinot-data/backfill/keyword_research_search_data/2025/07/23>'
includeFileNamePattern: 'glob:**/*.parquet'
outputDirURI: '<gs://etsy-pinot-data/keyword_research_search_data/backfilled>'
# overwriteOutput: Overwrite output segments if existed.
overwriteOutput: true
pinotFSSpecs:
- scheme: gs
className: org.apache.pinot.plugin.filesystem.GcsPinotFS
configs:
projectId: 'etsy-syseng-gke-sandbox'
gcpKey: '/tmp/pinot-gcp-key.json'
tableSpec:
tableName: 'keyword_research_search_data_OFFLINE'
#schemaURI: '<http://pinot-dev.pinot-controller.c.etsy-syseng-gke-prod.etsycloud.com/schemas/keyword_research_search_data>'
schemaURI: '<http://pinot-controller.syseng.etsy-syseng-gke-sandbox.etsycloud.com/schemas/keyword_research_search_data>'
tableConfigURI: '<http://pinot-controller.syseng.etsy-syseng-gke-sandbox.etsycloud.com/tables/keyword_research_search_data_OFFLINE>'
segmentNameGeneratorSpec:
type: simple
pinotClusterSpecs:
- controllerURI: '<http://pinot-controller.syseng.etsy-syseng-gke-sandbox.etsycloud.com>'
pushJobSpec:
# pushAttempts: number of attempts for push job, default is 1, which means no retry.
# pushAttempts: 3
# pushParallelism: 2
# pushRetryIntervalMillis: retry wait Ms, default to 1 second.
# pushRetryIntervalMillis: 1000
segmentUriPrefix: 'gs://'
segmentUriSuffix: 'etsy-pinot-data/keyword_research_search_data/backfilled'
pushFileNamePattern: 'glob:*'Jonathan Baxter
07/28/2025, 9:12 PMJonathan Baxter
07/28/2025, 9:13 PMingestFromURI endpoint pointing at one file and get the same errorJonathan Baxter
07/28/2025, 9:15 PMJonathan Baxter
07/28/2025, 9:19 PMpinot-admin.sh LaunchDataIngestionJob command from a k8 server pod and whoami from the container outputs this
whoami: cannot find name for user ID 1000Mayank
Jonathan Baxter
07/29/2025, 12:19 AMJonathan Baxter
07/29/2025, 12:50 AMJonathan Baxter
07/29/2025, 12:50 AMMayank
Jonathan Baxter
07/29/2025, 11:46 AMJonathan Baxter
07/29/2025, 11:53 AMuseParquetAvroRecordReader or useParquetNativeRecordReader I could have skipped this condition that ends up hitting hadoop codeMayank