Hi Folks, I was trying out the below command to up...
# troubleshooting
s
Hi Folks, I was trying out the below command to upload a segment from a realtime table to OFFLINE table (Without using minion):
Copy code
bin/pinot-admin.sh UploadSegment -controllerHost localhost -controllerPort 9000 -segmentDir ${PINOT_ROOT}/pinot/server/data/index/transcript_REALTIME/transcript__0__4__20210720T0957Z -tableName transcript_OFFLINE

Executing command: UploadSegment -controllerProtocol http -controllerHost localhost -controllerPort 9000 -segmentDir ${PINOT_ROOT}/pinot/server/data/index/transcript_REALTIME/transcript__0__4__20210720T0957Z
Compressing segment: v3
Uploading segment tar file: /var/folders/fp/dgy2h98d2639nyd4q_v2bwt40000gn/T/segmentUploader4462261101415652801.tmp/v3.tar.gz
Sending request: <http://localhost:9000/v2/segments?tableName=transcript_OFFLINE> to controller: 192.168.0.105, version: Unknown
With this I am able to see the segment under the OFFLINE table, and query the table for data as well. However the segment Meta Data seems to be improper/corrupt and I see the error(refer attached pic) Am I missing something here ? Please let me know Thanks PS: I have a hybrid table setup, and am exploring uploading of segments directly from realtime to offline tables as part of a POC.
x
I think this is a realtime segment, should be uploaded to realtime table
j
Directly uploading realtime segment into offline table might not work as it has certain naming conventions
s
Thanks Jackie, as what I see from the code the uploadSegment command does not have the provision to change the segment name while uploading.
j
That is true. Segment name is fixed within the segment