Hi all, the avro decoder bundled with pinot doesn'...
# pinot-devd
Dan DC
07/12/2022, 3:43 PMHi all, the avro decoder bundled with pinot doesn't handle poison pills and I was wondering if there was any reason for this. I need to handle common deserialization exceptions and it be nice to get this out of the box instead of I having to write and bundle a plugin
Dan DC
07/12/2022, 3:45 PMI haven't looked at all the other decoders but at least json and cvs seem to be this case as well
Dan DC
07/12/2022, 3:46 PMDoes it makes sense to fix this from your point of view? The behaviour could be controlled by a config prop
k
Kishore G
07/12/2022, 3:46 PM
yes.. we should have a way to ignore bad records
d
Dan DC
07/12/2022, 3:48 PMCool, I'm going to raise an issue in github and start working on it
👍 1
Dan DC
07/12/2022, 3:57 PMDan DC
07/13/2022, 2:05 PMI'll limit the scope of this issue to the confluent avro decoder class