Hi team, does Kafka ingestion support zstd decompression?
m
Mayank
06/12/2025, 1:41 PM
Do you mean the incoming stream is compressed, or do you mean in committed segments? I think the kafka consumer has built-in support for former.
d
Dong Zhou
06/12/2025, 5:47 PM
Yes, the incoming stream is compressed with zstd.
You mean if I set the topic compression type to be zstd, and producer compression type also to be zstd.
And the realtime table is still set to use KafkaJSONMessageDecoder. I should be good to go?