Harold Lim
02/02/2021, 6:07 PMWill Briggs
02/02/2021, 6:36 PMHarold Lim
02/02/2021, 7:03 PMXiang Fu
Harold Lim
02/02/2021, 9:25 PMXiang Fu
Neha Pawar
Harold Lim
02/02/2021, 11:41 PMNeha Pawar
curl -i -X GET "http://<controller host>:<controller port>/tables/<your table name>/consumingSegmentsInfo"
Harold Lim
02/02/2021, 11:46 PMNeha Pawar
Harold Lim
02/02/2021, 11:47 PMNeha Pawar
curl -i -X GET "http://<controller host>:<controller port>/tables/<your table name>/idealstate"
Harold Lim
02/02/2021, 11:49 PMHTTP/1.1 200 OK
Pinot-Controller-Host: pinot-controller-0.pinot-controller-headless.pinot-quickstart.svc.cluster.local
Pinot-Controller-Version: Unknown
Access-Control-Allow-Origin: *
Content-Type: application/json
Content-Length: 1615
{"OFFLINE":null,"REALTIME":{"prometheus__0__0__20210130T1836Z":{"Server_pinot-server-0.pinot-server-headless.pinot-quickstart.svc.cluster.local_8098":"ONLINE"},"prometheus__0__10__20210201T1730Z":{"Server_pinot-server-0.pinot-server-headless.pinot-quickstart.svc.cluster.local_8098":"ONLINE"},"prometheus__0__11__20210201T1751Z":{"Server_pinot-server-0.pinot-server-headless.pinot-quickstart.svc.cluster.local_8098":"ONLINE"},"prometheus__0__1__20210131T0716Z":{"Server_pinot-server-0.pinot-server-headless.pinot-quickstart.svc.cluster.local_8098":"ONLINE"},"prometheus__0__2__20210131T0737Z":{"Server_pinot-server-0.pinot-server-headless.pinot-quickstart.svc.cluster.local_8098":"ONLINE"},"prometheus__0__3__20210131T0759Z":{"Server_pinot-server-0.pinot-server-headless.pinot-quickstart.svc.cluster.local_8098":"ONLINE"},"prometheus__0__4__20210131T0821Z":{"Server_pinot-server-0.pinot-server-headless.pinot-quickstart.svc.cluster.local_8098":"ONLINE"},"prometheus__0__5__20210131T0842Z":{"Server_pinot-server-0.pinot-server-headless.pinot-quickstart.svc.cluster.local_8098":"ONLINE"},"prometheus__0__6__20210131T0904Z":{"Server_pinot-server-0.pinot-server-headless.pinot-quickstart.svc.cluster.local_8098":"ONLINE"},"prometheus__0__7__20210131T0926Z":{"Server_pinot-server-0.pinot-server-headless.pinot-quickstart.svc.cluster.local_8098":"ONLINE"},"prometheus__0__8__20210131T0948Z":{"Server_pinot-server-0.pinot-server-headless.pinot-quickstart.svc.cluster.local_8098":"ONLINE"},"prometheus__0__9__20210131T1009Z":{"Server_pinot-server-0.pinot-server-headless.pinot-quickstart.svc.cluster.local_8098":"ONLINE"}}}
Neha Pawar
Harold Lim
02/02/2021, 11:54 PMNeha Pawar
Subbu Subramaniam
02/03/2021, 12:14 AMNeha Pawar
Subbu Subramaniam
02/03/2021, 12:16 AMNeha Pawar
"Got unexpected status: {} in segment ZK metadata for segment: {}"
and do nothingSubbu Subramaniam
02/03/2021, 12:17 AMNeha Pawar
Subbu Subramaniam
02/03/2021, 12:19 AMNeha Pawar
Subbu Subramaniam
02/03/2021, 12:21 AM{}
and not the actual segment name in the log message?Neha Pawar
Subbu Subramaniam
02/03/2021, 12:22 AMNeha Pawar
Subbu Subramaniam
02/03/2021, 12:28 AMcontroller.realtime.segment.validation.frequencyInSeconds
Harold Lim
02/03/2021, 12:32 AMNeha Pawar
KY
02/03/2021, 12:35 AMNeha Pawar
KY
02/03/2021, 12:48 AMNeha Pawar
Matt
02/03/2021, 1:19 AMNeha Pawar
Matt
02/03/2021, 1:39 AMNeha Pawar
Subbu Subramaniam
02/03/2021, 1:56 AM__12
. Add metadata for that segment by copying the metadata for previous segment. Set the endoffset
of segment 11
to the start offset of the new segment.
2. Add the segment 12
in OFFLINE state in idealstate
3. Wait for realtime segment fixer to kick in.
Before you update the metadata, you may want to post the prev metadata so that either neha or I can help create the new metadata.
DISCLAIMER: This has never been tried beforeKY
02/03/2021, 2:37 AMSubbu Subramaniam
02/03/2021, 4:19 AMHarold Lim
02/03/2021, 4:29 AMMatt
02/03/2021, 4:09 PMMayank
Will Briggs
02/03/2021, 4:23 PMKY
02/03/2021, 4:28 PMHarold Lim
02/03/2021, 4:30 PMSubbu Subramaniam
02/03/2021, 4:52 PMMatt
02/05/2021, 5:06 PMHarold Lim
02/05/2021, 5:08 PMSubbu Subramaniam
02/05/2021, 5:26 PMMatt
02/05/2021, 5:27 PMSubbu Subramaniam
02/09/2021, 4:50 PMSajjad Moradi
02/09/2021, 5:21 PMSubbu Subramaniam
02/09/2021, 5:28 PMSajjad Moradi
02/09/2021, 6:04 PMreleaseSegment
function consequently call .close()
of the lucene index which releases the lock files.