This message was deleted.
# generals
Slackbot
10/27/2023, 3:25 PMThis message was deleted.
d
David K
10/27/2023, 3:55 PMIn what capacity?
David K
10/27/2023, 3:56 PMThere isn’t any support AFAIK, but I am curious as to how you think it should support Arrow?
y
Yu Wei Sung
10/27/2023, 4:46 PMit is in memory analysis platform reading data from datalake. do you mean if arrow supports reading data from pulsar as consumer?
Yu Wei Sung
10/27/2023, 4:46 PMthat’s question to arrow.
a
Amanda
10/27/2023, 5:05 PM@David K We were thinking that Pulsar could possibly send messages as an Arrow type. Currently we are sending messages via message type JSON schema, but we would like to send messages in arrow format. I do not think it is possible for Pulsar to support that currently, but wondering if anyone had any insight on it.
d
David K
10/27/2023, 5:23 PMYou can always use the byte[] schema type to send the messages as raw bytes. Then your application is responsible for the serialization / deserialization of the bytes into Arrow format
d
Dave Fisher
10/27/2023, 7:36 PMYes, I know of someone sending Arrow Flight with BYTES schema.
🙂 1
👀 1
23 Views