Hi All,
How can we persist the data in Pinot table...
# generalt
T Dev Kumar
06/18/2025, 8:56 AMHi All,
How can we persist the data in Pinot table for long term? I have using upsert table.
My requirement is Pinot should not delete the record, if only one record is exist for a primary key.
Thanks
m
Mayank
06/18/2025, 1:43 PM
You can specify retention as per your requirement. Also ensure deepstore is configured.
r
robert zych
06/18/2025, 5:47 PMTo make persisting data more cost effective for the long term you can enable compaction on your upsert enabled realtime table
t
T Dev Kumar
06/20/2025, 5:33 AMHi,
I'm trying to set "segmentCompactionConfig" in REALTIME table config json, but it's not showing in Pinot GUI table config section. Using pinot 1.3.0 version
"segmentCompactionConfig": {
"enabled": true,
"delayInSeconds": 1200,
"bufferTimeInSeconds": 120,
"peerDownloadScheme": "file"
}
Pls help me on this setup