This message was deleted.
# generals
Slackbot
05/31/2023, 3:28 AMThis message was deleted.
✅ 1
b
Bibek Sahoo
05/31/2023, 3:32 AMWhat is the source here (batch/Streaming Ingestion), we should look at the ingestion log to see what the job is doing.
s
Srinivas Narava
05/31/2023, 3:32 AMok.
Srinivas Narava
05/31/2023, 5:40 AM Copy code
"statusCode":"SUCCESS","status":"SUCCESS","runnerStatusCode":"WAITING"Srinivas Narava
05/31/2023, 5:40 AMContainer logs:
Srinivas Narava
05/31/2023, 5:41 AM Copy code
org.apache.hadoop.io.serializer.SerializationFactory: Serialization class not found:
java.lang.ClassNotFoundException: Class org.apache.hadoop.io.serializer.avro.AvroSpecificSerialization not foundSrinivas Narava
05/31/2023, 5:42 AMIngestion logs:
Srinivas Narava
05/31/2023, 5:42 AM Copy code
2023-05-30T17:37:15,506 INFO [forking-task-runner-7] org.apache.druid.indexing.overlord.ForkingTaskRunner - Logging task index_hadoop_dsp_media_and_bids_ninhfnmn_2023-05-30T17:37:15.483Z output to: /data1/tmp/druid-task/index_hadoop_dsp_media_and_bids_ninhfnmn_2023-05-30T17:37:15.483Z/log
2023-05-30T22:39:42,082 INFO [forking-task-runner-7-[index_hadoop_dsp_media_and_bids_ninhfnmn_2023-05-30T17:37:15.483Z]] org.apache.druid.indexing.overlord.ForkingTaskRunner - Process exited with status[0] for task: index_hadoop_dsp_media_and_bids_ninhfnmn_2023-05-30T17:37:15.483Z
2023-05-30T22:39:42,082 INFO [forking-task-runner-7] org.apache.druid.storage.hdfs.tasklog.HdfsTaskLogs - Writing task log to: /dod_prod/indexing-logs/index_hadoop_dsp_media_and_bids_ninhfnmn_2023-05-30T17_37_15.483Z
2023-05-30T22:39:42,100 INFO [forking-task-runner-7] org.apache.druid.storage.hdfs.tasklog.HdfsTaskLogs - Wrote task log to: /dod_prod/indexing-logs/index_hadoop_dsp_media_and_bids_ninhfnmn_2023-05-30T17_37_15.483Z
2023-05-30T22:39:42,100 INFO [forking-task-runner-7] org.apache.druid.storage.hdfs.tasklog.HdfsTaskLogs - Writing task reports to: /dod_prod/indexing-logs/index_hadoop_dsp_media_and_bids_ninhfnmn_2023-05-30T17_37_15.483Z.reports.json
2023-05-30T22:39:42,112 INFO [forking-task-runner-7] org.apache.druid.storage.hdfs.tasklog.HdfsTaskLogs - Wrote task reports to: /dod_prod/indexing-logs/index_hadoop_dsp_media_and_bids_ninhfnmn_2023-05-30T17_37_15.483Z.reports.json
2023-05-30T22:39:42,113 INFO [forking-task-runner-7] org.apache.druid.indexing.overlord.ForkingTaskRunner - Removing task directory: /data1/tmp/druid-task/index_hadoop_dsp_media_and_bids_ninhfnmn_2023-05-30T17:37:15.483Z
2023-05-30T22:39:42,116 INFO [WorkerTaskManager-NoticeHandler] org.apache.druid.indexing.worker.WorkerTaskManager - Task [index_hadoop_dsp_media_and_bids_ninhfnmn_2023-05-30T17:37:15.483Z] completed with status [SUCCESS].Srinivas Narava
05/31/2023, 5:43 AMany inputs? plez
b
Bibek Sahoo
05/31/2023, 5:45 AMPlease share the complete log, As per log the task is successful, might be it is waiting for segment handoff.
Complete task log and check for the tasks status on the overlord, it should show you if the task is in segment handoff period.
s
Srinivas Narava
05/31/2023, 5:46 AMok thanks Bibek