This message was deleted.
# general
s
This message was deleted.
l
This is not multiple JSON, it is a single JSON Array. You need a response with a single JSON per line and it’ll load as expected.
v
there are two ways of approaching this. If these jsons arrays are as small as above you could ingest as a nested column https://druid.apache.org/docs/latest/querying/nested-columns.html. The other option is to use nifi to split a json. I did a write up using the github api which returns json arrays https://dev.to/vnarayaj/analysing-github-stars-extracting-and-analyzing-data-from-github-using-apache-nifir-apache-kafkar-and-apache-druidr-280
l
If the dataset is not static and you’re not already using NiFi + Kafka to follow the previous suggestion, I’d add a super slim webservice only as an adapter: calling it triggers a call to the actual API (prob with some auth involved) and converts the result from a json array into a newline delimited json. Finito. If it’s a static dataset (or you can afford to manually do it every now and then) you could just download the thing, convert into newline delimited json and load it from file.
c
Thanks all