I am building a chatbot for a business, they have 100+ pages on their website, if i download scrap everything and upload in a docs file on open ai the knowledgebase will become too huge to cater customer on our chatbot
will it consume all input token / request or is there any best efficient way to execute this
so whatever user questions about the website, the user gets the proper response
Can we se table as a search for RAG buildup ?
What is the best and fastest way to respond to user as per 100+ pages of knowledge base