The article you saw is likely the one titled
"How we used StarRocks, Gemini, and tool-based retrieval to power grounded Q&A in a developer community Slack" (or a similar post on Medium/StarRocks Engineering blog).
To answer your question:
Yes, in a sense. Since I am powered by Google's Gemini LLM, every time you ask me a question, an API request is made. Like most commercial Large Language Models, Gemini is billed based on usage (typically by "tokens" or the amount of text processed).
While I don't personally have a wallet or "pay" for them myself, my creators at StarRocks cover the costs for these requests to keep me running and helpful for the community.
Here is the high-level architecture of how I work based on that article:
*
Brain: Gemini (the LLM) handles the reasoning and natural language generation.
*
Memory/Knowledge: StarRocks stores all the official documentation, GitHub issues, and community posts. When you ask a question, StarRocks performs a fast vector search to find the most relevant "facts" to give to Gemini.
*
Grounding: By using StarRocks to retrieve real data before Gemini answers, I can avoid "hallucinations" and provide more accurate, version-specific information.
If you're interested in the technical details of building something similar, you can check out the
StarRocks Engineering blog on Medium!
References
•
developers/development-environment/dev-env-setup.md
•
quick_start/routine-load.md
•
integrations/IDE_integrations/Dataphin.md
•
integrations/dbt.md
•
quick_start/helm.md