Hey folks, so I want to enable minion RealtimeToOf...
# troubleshooting
s
Hey folks, so I want to enable minion RealtimeToOfflineSegmentsTask, but it doesn't want to do the scheduler the task doesn't show up in the minion task manager got an error:
Copy code
{
  "code": 404,
  "error": "Task scheduler is disabled"
}
Here's my task config:
Copy code
"task": {
  "taskTypeConfigsMap": {
    "RealtimeToOfflineSegmentsTask": {
      "mergeType": "rollup",
      "bucketTimePeriod": "10s",
      "bufferTimePeriod": "10s",
      "roundBucketTimePeriod": "10s",
      "schedule": "0/5 * * * * ?",
      "maxNumRecordsPerSegment": "100000",
      "recordTimestamp.aggregationType": "max",
      "rollupPreAggregationColumns": "ad_org_id",
      "targetTableName": "ad_org_OFFLINE"
      }
    }
  },
I read from the documentation that the scheduler will run if we enable
controller.task.scheduler.enabled=true
, but the default is
false
, how can I change the setting? is there something wrong with my installation?
r
If you're using the helm chart, then you can add
controller.task.scheduler.enabled=true
to
controller.extra.configs
s
I'm using docker-compose.yml for the installation do I add the controller.task.scheduler.enabled=true in the environment like this?:
Copy code
environment:
      JAVA_OPTS: "-Dplugins.dir=/opt/pinot/plugins -Dpinot.controller.task.scheduler.enabled=true -Xms1G -Xmx8G -XX:+UseG1GC -XX:MaxGCPauseMillis=200 -Xloggc:gc-controller.log "
r
no,
JAVA_OPTS
should begin at
-Xms
s
so I can't change it there? where do I change it then? but based on this documentation, it can starts with
-Dplugins.dir=/opt/pinot/plugins
: https://docs.pinot.apache.org/basics/getting-started/running-pinot-in-docker
r
interesting. I haven't used docker-compose.yaml in a while. your config might work
s
can I just add the `controller.task.scheduler.enabled=true`in the POST cluster/configs inside Pinot Controller API(the Swagger Rest api)