I’m seeing an issue that some LLM call hang forever. For example, I’m testing both gpt-4o and gemini. gpt-4o returned while gemini hang there. Is there any parameter that controls the timeout of LLM calls?
i
ian
10/11/2024, 4:26 AM
hmm, by default there is a 5 min timeout that Gemini should respect. Is that not working?