Hi Everyone , I have a requirement to condense sm...
# pinot-perf-tuning
s
Hi Everyone , I have a requirement to condense smaller segments into large ones but i do not have a time based partition nor a time column in my tables ( ALL my tables are OFFLINE tables ) I am trying to configure Merge/Rollup Segments (https://docs.pinot.apache.org/operators/cli#merge-rollup-segments) to somehow achieve it My question is 1. Can we use merge on offline table segments ( with segments on s3 ) 2. How do i use SegmentProcessorFramework ?
x
yes, the purpose for this SegmentProcessorFramework is to have the interface to read N segments and create M segments.