Hey All, I’m sinking stream results to S3, the names of the files are in the format:
part-14f0a382-e12f-4f96-b26e-670d18cd1168-0-1334
part-14f0a382-e12f-4f96-b26e-670d18cd1168-1-1484
part-14f0a382-e12f-4f96-b26e-670d18cd1168-2-1449
part-14f0a382-e12f-4f96-b26e-670d18cd1168-3-1486
We have the job parallelism as 4 and thats the reason 4 files are being saved to S3. What does the numbers - 1334, 1484,1449,1486 indicate. Are they the checkpoint ids?