When streaming data via Kafka to a realtime table,...
# general
j
When streaming data via Kafka to a realtime table, does it have to be 1 record per message or is there a way to put multiple records in a single message?
x
one record per msg only
Kafka is made for streaming ;)
k
I guess you could use a JSON column to effectively store multiple records per message.
k
You can also use flatten udf to convert one message into multiple records
j
The flattening "one record into many" documentation states this isn't natively supported yet -- is that still correct? I'd have to write my own decoder/reader?