Pinot Client Rust Hi there. I wrote in the other day about multi-value column ingestion jobs, and at the request of @Mayank, I created the issue: https://github.com/apache/pinot/issues/8635. The reason I was trying to create a table with ingestion of all possible types is because I am writing a rustlang client modelled after https://github.com/startreedata/pinot-client-go. Here is the repo, if anyone is interested: https://github.com/yougov/pinot-client-rust

Hi Ryan, I am looking into this issue. Can you also send me the link to discussion with Mayank. Or just high level points.

Everything and more about that issue is on the issue itself, including schema, ingestion job, and data

cool. I'll update you in some time. The rust-client will be amazing! Thanks a lot for the contribution!

The client provides a DataRow type for SQL responses, which is strongly typed. It does this by first deserializing the result table to json, and then rationalizing the types based on the schema. Alternatively, a row can be deserialized to any struct implementing

serde::Deserialize

, which it does by converting each row to a json map of column name to value, and then passing that to the final deserializer. Ultimately there's a question of whether result table deserialization might be better supported (faster/lower memory) by implementing a custom serde deserializer, but for now I just inserted myself as a middle man and manipulated the row structure into one already supported for arbitrary deserialization.

We are also planning to introduce binary responses so that serialization/deserialization time can be reduced. Sort of like proto/thrift response instead of json from broker.

Interesting. Good to know.