This message was deleted.
# troubleshootings
Slackbot
05/18/2023, 8:36 AMThis message was deleted.
j
John Kowtko
05/18/2023, 2:20 PMHi Sunny, can you post your two ingestion specs for review?
s
Sunny Osaje
05/18/2023, 2:59 PMSure! Her is the One with Photo column "{
"type": "kafka",
"spec": {
"ioConfig": {
"type": "kafka",
"consumerProperties": {
"bootstrap.servers": "192.168.134.30:39092"
},
"topic": "d.photo",
"inputFormat": {
"type": "json"
},
"taskDuration": "PT148H",
"taskCount": 3,
"replicas": 2,
"pollTimeout": 600,
"useEarliestOffset": true
},
"tuningConfig": {
"type": "kafka"
},
"dataSchema": {
"dataSource": "photo_details",
"timestampSpec": {
"column": "RECORDID",
"format": "posix"
},
"dimensionsSpec": {
"dimensions": [
"CID",
"NIN",
"PHONE_NUMBER",
"PHOTO"
]
},
"granularitySpec": {
"queryGranularity": "none",
"rollup": false,
"segmentGranularity": "hour"
}
}
}
}"
Sunny Osaje
05/18/2023, 3:04 PMHere is the spec without photo column "{
"type": "kafka",
"spec": {
"ioConfig": {
"type": "kafka",
"consumerProperties": {
"bootstrap.servers": "10.233.60.111:9092"
},
"topic": "g.d.demo",
"inputFormat": {
"type": "json"
},
"taskDuration": "PT1H",
"taskCount": 3,
"replicas": 2,
"pollTimeout": 600,
"useEarliestOffset": true
},
"tuningConfig": {
"type": "kafka"
},
"dataSchema": {
"dataSource": "demo_details",
"timestampSpec": {
"column": "!!!_no_such_column_!!!",
"missingValue": "2010-01-01T000000Z"
},
"dimensionsSpec": {
"dimensions": [
"CID",
"NIN",
"PHONE_NUMBER",
"PHOTO"
]
},
"granularitySpec": {
"queryGranularity": "none",
"rollup": false,
"segmentGranularity": "hour"
},
"transformSpec": {}
}
}
}"
j
Jon King
05/18/2023, 6:56 PM@Sunny Osaje Is the RECORDID column a date string?
s
Sunny Osaje
05/18/2023, 7:01 PMNo the RECORDID is a date string
j
Jon King
05/18/2023, 7:03 PMDo you have any errors from the logs around the failures?
s
Sunny Osaje
05/18/2023, 7:06 PMYes here is the error of the one that just failed "{
"id": "index_kafka_nidb_photo_02_d616f6b830a2e55_ckoeidki",
"groupId": "index_kafka_nidb_photo_02",
"type": "index_kafka",
"createdTime": "2023-05-18T150737.899Z",
"queueInsertionTime": "1970-01-01T000000.000Z",
"statusCode": "FAILED",
"status": "FAILED",
"runnerStatusCode": "WAITING",
"duration": 13631352,
"location": {
"host": "10.233.82.55",
"port": 8102,
"tlsPort": -1
},
"dataSource": "nidb_photo_02",
"errorMsg": "java.util.concurrent.ExecutionException: java.lang.RuntimeException: org.apache.druid.java.util.comm..."
}"
j
Jon King
05/18/2023, 7:09 PMHmm.. Can you try adding `"missingValue": "2010-01-01T000000Z"`` to the timestampSpec?
j
John Kowtko
05/18/2023, 7:30 PMIf you can provide the task log of the failed task that that might help as well.
g
Gian Merlino
05/19/2023, 3:05 AMwhat is the
PHOTO2 Views