### Answer
No, not every word in your knowledge base costs the same as if it was in the prompt. That's the key advantage.
The knowledge base only retrieves and sends
relevant chunks to the LLM during each response. [(1) ](
) You can configure how many chunks are retrieved (1-10, default is 3) and the similarity threshold (default 0.60) .
So if you have 100 pages of documentation in your knowledge base, only the 3 most relevant chunks get added to the prompt for each response—not all 100 pages. This is much more token-efficient than trying to put everything in your prompt.
However, once those chunks are retrieved and added to the prompt, yes, those specific tokens do count toward your LLM usage. The retrieved content is appended under the header "## Related Knowledge Base Contexts".
**In summary**: Storage in the knowledge base itself doesn't cost tokens. Only the retrieved relevant chunks that get sent to the LLM for each specific response count as tokens.