I'm not sure how the CLI fits into this, but it sounds like you want to use

timeout

more than retries. The retries value is about how many times the test case re-runs on failure.