https://pinot.apache.org/ logo
n

Nick Bowles

02/19/2021, 9:35 PM
Ok so an update on using the minions to ingest, after small changes I see this in the logs. The tar.gz file exists in the bucket, but it looks like it tries to push anyways to the path
/segments/blah.tar.gz
. Not sure if this is a path on the controller, or if it’s supposed to be the bucket. Any ideas?
x

Xiang Fu

02/19/2021, 9:41 PM
looks like this is the push job type issue. Default push is segment tar push
Copy code
Trying to push Pinot segment with push mode tar from <gs://bucket/segments/mytable_OFFLINE_REDACTED_10.tar.gz>
we should change it to metadata push or uri push, let me double check
n

Nick Bowles

02/19/2021, 9:43 PM
Where is it trying to push to? I don’t see any changes to what’s in the deep storage bucket configured on the controller so not sure.
and thanks!
x

Xiang Fu

02/19/2021, 9:44 PM
can you add a config to ingestion job:
Copy code
push.mode=metadata
in parallel to input.uri, etc
n

Nick Bowles

02/19/2021, 9:45 PM
When it’s set to metadata, what is the behavior vs the default of segment tar push?
I would think the default would push the tar to the output bucket I have set on the controller
x

Xiang Fu

02/19/2021, 9:46 PM
metadata/uri mode will not try to save segment in controller
segment tar push expects a controller deep store to save all the tar file
I still need to investigate why tar push mode failure
n

Nick Bowles

02/19/2021, 9:49 PM
Do I maybe need to define that deep store somewhere in the batchConfigMap or the minion?
Thanks for clarifying
x

Xiang Fu

02/19/2021, 10:04 PM
I think if your minion is started with deepstore credential then should be fine
otherwise, the batchConfig should contain the credentials
uri push is lightweight on client(minion) side, controller will download segment and extract segment metadata
metadata push is light weight on controller side, client(minion) will download the segment based on uri and extract metadata, then upload metadata to controller, no controller deep store download involved
n

Nick Bowles

02/19/2021, 10:09 PM
This is great info. Thank you so much I really appreciate it.
x

Xiang Fu

02/19/2021, 10:11 PM
You are welcome! I’m also going to add this into pinot docs
n

Nick Bowles

02/19/2021, 10:19 PM
I can try and add that this weekend or at least get some of the writing out of the way.
x

Xiang Fu

02/19/2021, 10:22 PM
sounds good! Many thanks!