Hello! Does anybody know if I can configure the nu...
# replication-troubleshooting
l
Hello! Does anybody know if I can configure the number of job attempts on a connection basis? I'm running a job that syncs a large amount of data and, even though the first attempt manages to save some state and later fails, the second attempt will start from the previous state (same with third attempt). I think this makes sense for other connections but would like to explicitly set up the number of attempts for particular connections.
e
Hi. it sounds like you want to have X attempts? not sure I agree with having more than 3. if it fails so many times- it is best to try to run different jobs that take different data from the source and run on parallel if something fails there is a reason for that which needs to be addressed - could be from the source also though still needs to be addressed
u
Today this is not possible. There is a env variable to configure the global attempts: https://github.com/airbytehq/airbyte/blob/c8b48b42b6ed73732a2ca43d8eba0d629bc2b267/.env#L67-L74 but this can be a good feature request for the feature as advance connection configuration
✅ 2