Fair amount of complexity here, @Qingyu Li I'm pretty sure that you're going to want to flatten any nested fields once they're in your Druid datasource schema, but there may be a way to access nested JSON via Druid SQL, I haven't tried that.
Mike Sherman
01/15/2024, 4:55 PM
◦ For the flattening of nested fields, you might need to write custom logic. There is no specific package that directly converts Avro schema to Druid ingestion JSON, especially for nested fields. You'll need to traverse the Avro schema and create a mapping logic to convert it into a flattened structure suitable for Druid.
q
Qingyu Li
01/16/2024, 9:24 AM
Thanks for the Answer Mike👍 I'll write a logic then.