Hello guys i m have some issue with RealtimeToOfflineSegment

Question

Hello guys i m have some issue with RealtimeToOfflineSegments task So i create 2 hybrids table from same days 1 for QC env and 1 for UAT env In the tables managements It s seem `RealtimetoOfflines` task in QC env has been stop but i cannot find any errors log Another the question is the realtime segments will be remove after convert to Offline Segments Table

Xiang Fu · Answer

have you checked logs in minion

Phúc Huỳnh · Answer

here is the logs of minion pods

Phúc Huỳnh · Answer

sometime my zookeepers pods rollout because vm preemptible in gcloud

Xiang Fu · Answer

ic maybe have 3 pinot zookeepers for HA

Phúc Huỳnh · Answer

i already setup 3 zookeepers for HA

Xiang Fu · Answer

ok

Xiang Fu · Answer

so if there is no task logs on minion then it means the minion tasks are not scheduled

Xiang Fu · Answer

can you check controller log and look for `RealtimetoOffline` log

Phúc Huỳnh · Answer

only 1 logs grep by realtime

Xiang Fu · Answer

hmm is this task scheduled can you check minion apis through controller swagger ui

Phúc Huỳnh · Answer

Minion apis is Task in swagger

Phúc Huỳnh · Answer

Could u answer question 2 ```Another the question is the realtime segments will be remove after convert to Offline Segments Table ```

Xiang Fu · Answer

I don t think so This task requires a hybrid table and it will create segments and push to offline table You can set a fairly low retention for realtime table but longer for offline table

Xiang Fu · Answer

Xiang Fu · Answer

have you found the issue

Phúc Huỳnh · Answer

hmm i m try but cannot find related log

Xiang Fu · Answer

i see can you try to tail the controller log and call the ` tasks schedule` POST endpoint using swagger ui