Thanks — I see you’re asking whether there’s a reliable benchmark or comparison of different TTS services. Good news: LiveKit provides resources you can use to compare TTS providers on voice quality, latency, and cost, and there’s a hands‑on example for direct A/B testing. What you can use right away • The TTS Comparison example lets you switch between providers (Rime, ElevenLabs, Cartesia, PlayAI) during a live session so you can directly compare voice quality and latency in the same call: https://docs.livekit.io/recipes/tts_comparison/ • The TTS models overview lists recommended voices and voice IDs you can test via LiveKit Inference: https://docs.livekit.io/agents/models/tts/ • A pricing and model comparison is available so you can evaluate cost vs performance (example pricing ranges shown for each provider): https://livekit.io/pricing/inference What benchmarks these resources cover • Voice quality and expressiveness (recommended voices and sample IDs to test). • Real-time performance and latency (LiveKit targets low perceived latency; some providers like Deepgram, Google, Rime, and Cartesia are highlighted for speed/streaming). • Cost per character so you can weigh cost-performance tradeoffs across vendors. If you want a focused, repeatable benchmark I can help you set up one. To build a useful comparison, tell me: 1. Which TTS providers you want included (or use the default set: Rime, ElevenLabs, Cartesia, PlayAI). 2. Which metrics matter most to you (e.g., time-to-first-byte, end-to-end latency in an STT→LLM→TTS pipeline, naturalness MOS, or cost per million characters). 3. Whether you prefer a quick interactive A/B test (live session) or an automated scripted benchmark (multiple runs, measured latency and file outputs). Tell me your choices and I’ll outline a simple test plan and the exact steps (or automation script) to run it. Sources: TTS Comparison | LiveKit Documentation | Build voice, video, and physical AI | LiveKit | Text-to-speech (TTS) models overview | LiveKit Documentation | examples/bank-ivr | livekit/livekit_composite | DeepWiki | Live Conversations with AI using ChatGPT and WebRTC