Is there a way to specify the SegmentPush job to o...
# getting-startedt
Tiger Zhao
09/01/2021, 5:39 PMIs there a way to specify the SegmentPush job to only push a single segment instead of a directory?
n
Neha Pawar
09/01/2021, 5:57 PM
one way i can think of is setting “includePattern” in the yml file. you can find that config in the doc
t
Tiger Zhao
09/01/2021, 6:02 PMincludePattern seems to only work for ingest during segment creation. For push, is it correct to set outputDirURI to exactly the segment to push?
n
Neha Pawar
09/01/2021, 6:08 PM
ah you are talking about push only. Yes looking at the code, it should work if you directly give segment path.
Neha Pawar
09/01/2021, 6:08 PM
are you seeing different behaviour?
t
Tiger Zhao
09/01/2021, 6:10 PMI just tried it by setting outputDirURI to that and it seems to work. Just wanted to confirm that is a valid use case. Thanks!
👍 1
Tiger Zhao
09/01/2021, 6:12 PMOn another note, I have a question about how the push works. I'm currently using the Metadata push method. If I split up the creation and push steps, I believe the push job has to download the segment, and then generate the metadata right?
If I use SegmentCreationAndMetadataPush, is it more efficient in that it can just directly create the segment and generate the metadata in one go? So it would save an extra download of the segment?
n
Neha Pawar
09/01/2021, 6:25 PM
yes that is correct, separating the 2 phases will create an extra download
👍 1