Is all of this going to be in pinot 0.5.0?
# troubleshootinge
Elon
09/09/2020, 6:30 PMIs all of this going to be in pinot 0.5.0?
t
Ting Chen
09/09/2020, 6:33 PMAll except [Deepstore by-pass]Add a Deepstore bypass integration test with minor bug fixes. #5857 by chenboat was merged 7 days ago
e
Elon
09/09/2020, 6:36 PMOh great, so if we take latest master and apply this one then we should have everything?
Elon
09/09/2020, 6:36 PMOr do you recommend we just take 0.5.0 and patch this pr?
t
Ting Chen
09/09/2020, 6:37 PMthe latest master has all PRs. Depending on what you need, 0.5.0 has been more thoroughly tested and certified.
👍 1
Ting Chen
09/09/2020, 6:38 PMThe integration tests in the PR above also has the necessary config:
Ting Chen
09/09/2020, 6:39 PM(1) a per table config to turn on deepstore by-pass:
segmentsValidationAndRetentionConfig.setPeerSegmentDownloadScheme("http"); // or httpsTing Chen
09/09/2020, 6:39 PM(2) a server config to let the server download segments from deep store.
Ting Chen
09/09/2020, 6:40 PMpinot.server.instance.segment.store.uriTing Chen
09/09/2020, 6:43 PMand
pinot.server.storage.factory.class.xxxxe
Elon
09/09/2020, 6:45 PMSounds great, thanks so much @Ting Chen! I think to be safe we will take 0.5.0 and apply #5857 and follow your advice for the table configs. We use gcs pinot fs. Does that sound like it would work?
t
Ting Chen
09/09/2020, 6:50 PMat this point, this feature should be still considered experimental -- I have done my best to test in an integration test with all Pinot components.
Ting Chen
09/09/2020, 6:50 PMyou may also need to test integrating with GCS.
e
Elon
09/09/2020, 6:50 PMSure! Will let you know how it goes. Appreciate all the help!
t
Ting Chen
09/09/2020, 6:51 PMyes please let me know and I am be happy to help along the way.
👍 1