Hello running into an issue when trying to implement a realt Apache Pinot #troubleshooting

Hello, running into an issue when trying to implem...

Matthew Kerian

10/20/2022, 6:45 PM

Hello, running into an issue when trying to implement a realtime table. Table is created successfully however is not ingesting. Logs show some errors:

Copy code

2022/10/20 18:38:57.780 WARN [AbstractDataCache] [HelixController-pipeline-task-pinot-1-(2a076887_TASK)] stat is null for key: /pinot-1/INSTANCES/Server_pinot-server-9.pinot-server-headless.pinot.svc.cluster.local_8098/CURRENTSTATES/1400000600f604bd/table_REALTIME
2022/10/20 18:38:57.781 WARN [ZkBaseDataAccessor] [HelixController-pipeline-task-pinot-1-(2a076887_TASK)] Fail to read record for paths: {/pinot-1/INSTANCES/Server_pinot-server-9.pinot-server-headless.pinot.svc.cluster.local_8098/CURRENTSTATES/1400000600f604bd/table_REALTIME=-101}
2022/10/20 18:38:57.781 WARN [AbstractDataCache] [HelixController-pipeline-task-pinot-1-(2a076887_TASK)] znode is null for key: /pinot-1/INSTANCES/Server_pinot-server-9.pinot-server-headless.pinot.svc.cluster.local_8098/CURRENTSTATES/1400000600f604bd/tble_REALTIME
2022/10/20 18:39:52.048 WARN [TopStateHandoffReportStage] [HelixController-pipeline-default-pinot-1-(c50faee9_DEFAULT)] Event c50faee9_DEFAULT : Cannot confirm top state missing start time. Use the current system time as the start time.
2022/10/20 18:39:52.136 WARN [TopStateHandoffReportStage] [HelixController-pipeline-default-pinot-1-(05e06be1_DEFAULT)] Event 05e06be1_DEFAULT : Cannot confirm top state missing start time. Use the current system time as the start time.

Curious of any debugging steps I can take here.

Matthew Kerian

10/20/2022, 8:28 PM

Copy code

2022/10/20 19:30:25.811 WARN [ConsumerConfig] [pool-7-thread-2] The configuration 'realtime.segment.flush.threshold.size' was supplied but isn't a known config.
2022/10/20 19:30:25.811 WARN [ConsumerConfig] [pool-7-thread-2] The configuration 'realtime.segment.flush.desired.size' was supplied but isn't a known config.
2022/10/20 19:30:25.811 WARN [ConsumerConfig] [pool-7-thread-2] The configuration 'stream.kafka.decoder.class.name' was supplied but isn't a known config.
2022/10/20 19:30:25.811 WARN [ConsumerConfig] [pool-7-thread-2] The configuration 'streamType' was supplied but isn't a known config.

Additional errors. All the kafka related config options have this error. The segment status is good

Rong R

10/20/2022, 10:15 PM

these are warnings. can you share more on the config and maybe search for error message in log related to the table?

Matthew Kerian

10/20/2022, 11:07 PM

Ah I was in the wrong server cluster. Sorry about that

Open in Slack

Previous Next