This message was deleted.

Perhaps maxParseExceptions is what you are looking for? https://druid.apache.org/docs/latest/development/extensions-core/kafka-supervisor-reference.html#:~:text=no%2C%20default%[…]ParseExceptions,-Integer

Another approach is to cleanse your data upstream? Using a tool like ksqlDB you can filter bad records / good records into separate topics. And then just ingest from the good topic. (and if you want clean up the records in the bad topic)

@Adarsh Sanjeev My Spec already has the maxParseExceptions field set ... still I am facing the issue ..

What version are you using? Did you see this thread? https://www.druidforum.org/t/how-to-tell-druid-to-skip-bad-kafka-records-during-ingestion-with-schema-registry/7186/3 Looks as if there was a regression that I think was fixed recently.

the version is 0.25

some additional thoughts here: https://apachedruidworkspace.slack.com/archives/C0303FDCZEZ/p1677634477234209?thread_ts=1677215359.488029&cid=C0303FDCZEZ let's continue with this thread, since it's in the correct channel 🙂