Chetan Anand
04/06/2022, 8:25 AMoutputDirURI
in the ingestionJobSpec
can be same as the controller.data.dir
? We are assuming yes. Config files, table config and job spec attached.Nicolas Kovacs
04/06/2022, 8:26 AMChetan Anand
04/06/2022, 8:26 AMNicolas Kovacs
04/06/2022, 8:26 AMChetan Anand
04/06/2022, 8:27 AMChetan Anand
04/06/2022, 12:57 PMcontroller.data.dir
is pointed to <gs://REDACTED/controller/data>
and the `controller.local.tmp.dir`is pointed to some /tmp/dir
on the pod instead of the persistent disk directory /PDmountdir/some/dir
. I don't know how exactly these changes fixed it though