Is there a way to specify the SegmentPush job to only push a single segment instead of a directory?
09/01/2021, 5:57 PM
one way i can think of is setting “includePattern” in the yml file. you can find that config in the doc
09/01/2021, 6:02 PM
includePattern seems to only work for ingest during segment creation. For push, is it correct to set outputDirURI to exactly the segment to push?
09/01/2021, 6:08 PM
ah you are talking about push only. Yes looking at the code, it should work if you directly give segment path.
are you seeing different behaviour?
09/01/2021, 6:10 PM
I just tried it by setting outputDirURI to that and it seems to work. Just wanted to confirm that is a valid use case. Thanks!
On another note, I have a question about how the push works. I'm currently using the Metadata push method. If I split up the creation and push steps, I believe the push job has to download the segment, and then generate the metadata right?
If I use SegmentCreationAndMetadataPush, is it more efficient in that it can just directly create the segment and generate the metadata in one go? So it would save an extra download of the segment?
09/01/2021, 6:25 PM
yes that is correct, separating the 2 phases will create an extra download