https://retellai.com/?utm_source=discord&utm_medium=seo logo
Hey everyone, we’re currently working on building ...
# 💬・general
n
Hey everyone, we’re currently working on building an inbound agent that includes company information like working hours, FAQs, and services. Our prompt is currently around 2500 tokens, and we expect it to grow further as we add function calling and refine the system prompt. Could you please share at what point prompt size typically starts impacting latency in a noticeable way? Also, what would you recommend as an ideal prompt length range for maintaining good performance?