Hi team! I'm having trouble with `eraseDimensionVa...
# general
p
Hi team! I'm having trouble with
eraseDimensionValues
in my MergeRollupTask config. I have it set to erase the
hostname
dimension during rollup, but the values aren't being removed - they still appear in the offline table after the task runs. My config:
Copy code
"MergeRollupTask": {
  "1hour.eraseDimensionValues": "hostname",
  "1hour.mergeType": "rollup",
  "1hour.bucketTimePeriod": "1h",
  "1hour.bufferTimePeriod": "3h"
}
The hostname dimension has
defaultNullValue: "ERASED"
in my schema. Questions: 1. Is
eraseDimensionValues
available in the current release, or is it still experimental? 2. Should I expect the hostname column to be completely removed, or replaced with the default null value? 3. Are there any logs I should check to confirm the task is processing this config correctly? My setup: RT data → offline table with MergeRollupTask running on the offline table. Thanks!
Ok, I was running 1.3.0 and after using latest image looks like it's working
maybe the documentation should be updated? Looks like there is a PR ready https://github.com/pinot-contrib/pinot-docs/pull/405
thanks 1
x
I think this will be included in the 1.4 release
👍 1