Hi All, I have a defined schema : “name”: “prop...
# generalk
kauts shukla
10/20/2021, 8:43 AMHi All, I have a defined schema : “name”: “properties”, “dataType”: “JSON”, i’m consuming messages from Kafka. In table value is coming as NULL whereas in kafka topic data is coming as expected : {“type”“event”,“ip”“127.0.0.1",“created_at”1634102442620,“properties”{“city”“abc”,“clinic”“”,“symptomId”“”,“treatmentId”“”}}. Any help here why is it happening ????
m
Mayank
10/20/2021, 2:56 PM
Will need to see the table config and schema (at least the JSON specific part). Also are you planning to query this column? If so, perhaps use JSON indexing? https://docs.pinot.apache.org/basics/indexing/json-index#when-to-use-json-index
n
Neha Pawar
10/20/2021, 3:31 PM
Not sure if the data type json works with the json index. You're better off setting the properties_str column as STRING, and add ingestion config on properties_str column as transformFunction: jsonFormat(properties)
k
kauts shukla
10/21/2021, 5:43 AM@User / @User: Followed Pinot documentation https://docs.pinot.apache.org/basics/data-import/complex-type, my ask is being resolved now. Thanks.