This message was deleted.

I'm mainly dealing with hourly batch ingestion.. I wanted to know if creating a task with the same spec as the previously shutdown or failed task will result in duplicate records.. this is the main motivation for my question about how exactly task failures and shutdowns are handled during batch ingestion..

Tasks should be all or nothing. Ie, if one fails or is shut down mid-run, it should not write data, iiuc.

awesome.. thanks..

yw! Please do what you can to verify, and let us know if you see otherwise!