Powered by
For single prompt , prompt size I would suggest to...
# 💬・general
o
Omar Ashraf | Community Lead
08/03/2026, 8:34 PM
For single prompt , prompt size I would suggest to keep it under 5k its the safe zone , 5k-8K it will work but higher latency higher retry rate, above that I would not really recommend it specially with long calls.
Previous
Next