Hi team, is there a way to “look” inside a segment...
# general
p
Hi team, is there a way to “look” inside a segment on disk? Want to do some analysis on a bunch of columns.
m
You can look at the Metadata.properties file inside the segment directory, that should give you a lot of stats about columns
p
Yes that actually contains a lot of useful info. However, I wish to look at an actual column to figure out what all values it contains to do some cardinality analysis.
m
You can do where $segmentName = xxx in your query to select the segment, and then project the column.
Or you can download segment locally and use One of the segment converter tools in pinot-admin
p
You can do where $segmentName = xxx in your query to select the segment, and then project the column.
Ah didn’t think of this facepalm Thanks this should work @Mayank