Hello, I want row based TTL on a particular table....
# general
p
Hello, I want row based TTL on a particular table. Could anyone suggest any solution. Thanks.
m
Is this for GDPR purge? If so, you can use minion purge task
p
yes , I tried purgeTask but facing some issues.
I have set below configurations and Minion is also running.
Caught exception while executing task: Task_PurgeTask_2a125daa-00a1-4203-9e85-a8ddffa2332c_1765368600051_0 java.lang.IllegalArgumentException: At least one of record purger and modifier should be non-null controller.conf : controller.task.scheduler.enabled=true controller.minion.tasks.retention.enabled=true controller.retention.frequencyInSeconds=420 minion.conf : pinot.minion.task.scheduler.enabled=true pinot.minion.task.scheduler.frequencyInSeconds=60 pinot.minion.task.list=RetentionTask table_config.json task{ "PurgeTask":{ "schedule": "0 */5 * * * ?", "recordPurgerClassName": "org.apache.pinot.plugin.minion.tasks.purge.TimeBasedPurgerFactory", "recordPurgerConfigPrefix": "recordPurger", "recordPurger.timeColumnName": "insert_time", "recordPurger.retentionTimeValue": "5", "recordPurger.retentionTimeUnit": "MINUTES" } }