https://pinot.apache.org/ logo
Join Slack
Powered by
When Uploading segments to controller using Segmen...
# troubleshooting
y
When Uploading segments to controller using Segment Uri Push, It is putting the segments in path
Copy code
fake_job_for_testing_time_based_OFFLINE/fake_job_for_testing_time_based_OFFLINE_18597_18597_0
whereas when trying to delete the segments, it is calling exists on path
Copy code
fake_job_for_testing_time_based/fake_job_for_testing_time_based_OFFLINE_18597_18597_0
which logs
Copy code
Failed to find local segment file for segment
I am on version 0.6.0
k
Looks like a bug or maybe you are passing wrong table during upload?
y
Copy code
fake_job_for_testing_time_based
I use this table during upload. in tableSpec
I see the data getting populated correctly in the table.
k
@Xiang Fu ^^
x
what's the download uri looks like in segment metadata?
y
Copy code
<schema://abcd/fake_job_for_testing_time_based/fake_job_for_testing_time_based_OFFLINE_18597_18597_0>
x
do you have more logs or stacktrace for the error? which scheme you are using? http or gs or s3/
y
I have created my own filesystem.
What is the correct path for storing offline segments ? 
fake_job_for_testing_time_based
or 
fake_job_for_testing_time_based_OFFLINE
@Xiang Fu https://github.com/apache/incubator-pinot/pull/6438/files Would something like this be needed or am I missing something ?
x
hmmm
for your push job, did you set push uri prefix and suffix?
I think it should be 
fake_job_for_testing_time_based
i need to check why it puts _OFFLINE for the table name
y
Copy code
Uploading a segment fake_job_for_testing_time_based_OFFLINE_18607_18607_10 to table: null, push type URI, (Derived from segment metadata)
I am getting this log. I have set a prefix 
scheme://
and empty suffix.
Open in Slack
PreviousNext
Powered by