This message was deleted.
# troubleshooting
s
This message was deleted.
c
i can repro this, i think it might be an issue with using the sampler and the kafka input format
if you want to use the web-console data loader (which uses the sampler api), i think you’ll need to just set the format as “regex” to get everything you want, and then change it to kafka input format at the last step (and add any additional dimensions/transforms/aggregations/whatever else if using stuff from the header or elsewhere)
z
@Clint Wylie thanks for troubleshooting, that was helpful to know its not only my end when I went click back in the console to try and parse the data. I will experiment around with the ingestionSpec and see how to extract the dimensions for kafka headers without using the "parse data" section.
g
It's a sampler issue, which is only used by the UI, so you could always submit the JSON supervisor spec directly (without data loader UI)
i.e. from the ingestion tab, here
1
c
https://github.com/apache/druid/pull/13900 is fix for sampler side of things