https://pinot.apache.org/ logo
#general
Title
# general
f

Facundo Bianco

04/06/2022, 6:14 PM
Hi All, do you know how Pinot stores data between brackets? (not JSON). Let me explain: I have this data
Copy code
id,timestamp,application
1,1649268351,"{'app_name': 'foo', 'version': '1.0.0', 'app_id': None, 'business': 'ponzico'}"
And when I load that info I got
Copy code
| id | timestamp  |    application    |
|----|------------|-------------------|
| 1  | 1649268351 | foo,1.0.0,ponzico |
(In table-schema.json row "_application_" is configured as "STRING".) There is a way to query "_application_" row based on one of the values inside? (ie
SELECT * FROM testing WHERE application.app_name = "foo"
). Thanks in advance!
k

Kishore G

04/06/2022, 6:59 PM
whats the decoder you are using?
f

Facundo Bianco

04/06/2022, 7:01 PM
It's a parquet file
n

Neha Pawar

04/06/2022, 7:02 PM
this is not how it is expected to be stored. can you share your schema and table config too?
k

Kishore G

04/07/2022, 3:38 AM
Also, assuming the ingestion works properly, JSON index can help with querying a specific value inside the json
s

saurabh dubey

04/08/2022, 5:13 PM
@User With the given parquet data, table schema where 'application' is of type JSON, we were unable to reproduce this on the latest pinot build. The field correctly gets stored as json, as expected. Can you share your table schema, ingestion job spec yaml and any other details that might be of relevance and help in debugging this? cc: @User
👍 1