https://pinot.apache.org/ logo
#getting-started
Title
# getting-started
t

Tiger Zhao

09/01/2021, 5:39 PM
Is there a way to specify the SegmentPush job to only push a single segment instead of a directory?
n

Neha Pawar

09/01/2021, 5:57 PM
one way i can think of is setting “includePattern” in the yml file. you can find that config in the doc
t

Tiger Zhao

09/01/2021, 6:02 PM
includePattern seems to only work for ingest during segment creation. For push, is it correct to set outputDirURI to exactly the segment to push?
n

Neha Pawar

09/01/2021, 6:08 PM
ah you are talking about push only. Yes looking at the code, it should work if you directly give segment path.
are you seeing different behaviour?
t

Tiger Zhao

09/01/2021, 6:10 PM
I just tried it by setting outputDirURI to that and it seems to work. Just wanted to confirm that is a valid use case. Thanks!
👍 1
On another note, I have a question about how the push works. I'm currently using the Metadata push method. If I split up the creation and push steps, I believe the push job has to download the segment, and then generate the metadata right? If I use SegmentCreationAndMetadataPush, is it more efficient in that it can just directly create the segment and generate the metadata in one go? So it would save an extra download of the segment?
n

Neha Pawar

09/01/2021, 6:25 PM
yes that is correct, separating the 2 phases will create an extra download
👍 1