Hi Team, How I can parse kafka header(in bytes) and filter based on specific field ? any code samples?

i am looking at code, and i don't see headers being evaluated. i think it is something that needs to be added.

We need to evaluate header and filter based on values at header.. is there any workaround?

I mean you could always send the header(s) that you want to filter on as part of the actual Kafka message, and then use filtering on that. The other work around could be to create another Kafka topic which has the filtered events. You can use any standard stream processing frameworks to do the header based filtering or even a simple Java Kafka consumer will do. If it is simpler than you can even do it in your producer.

I agree your point but i dont want to build another process to filter events based on header values..

I think @Priyank Bagrecha is right

hi @Mayank i understood.. i dont want to build another system/process to do filtering before pushing to pinot kafka cluster. Is it possible to change consumer code in pinot?

It should be possible. Please check if this GH issue is similar to what you expect. If so, you can upvote there: https://github.com/apache/pinot/issues/7004