which tts and stt models work for only the ts sdk ...
# ask-ai
s
which tts and stt models work for only the ts sdk and python sdk
t
Thanks for reaching out, Saeed. I'm an AI assistant and I'm here to help. Give me a moment while I research this topic.
Thanks — you're asking which TTS and STT models work only with the TypeScript (TS) SDK and which work only with the Python SDK. • There are no models or plugins documented as TS-only. • Many STT and TTS providers are Python-only. STT vendors available only in the Python SDK include: Amazon Transcribe, AssemblyAI, Azure AI Speech, Azure OpenAI, Baseten, Cartesia (note: Cartesia TTS is cross‑SDK), Clova, ElevenLabs (STT listed for Python), fal, Gladia, Google Cloud, Mistral AI, Nvidia, Sarvam, Soniox, Speechmatics, Spitch. Deepgram and OpenAI STT are available in both Python and TS. • TTS vendors available only in the Python SDK include: Amazon Polly, Azure AI Speech, Azure OpenAI, Baseten, Gemini, Google Cloud, Groq, Hume, Inworld, LMNT, MiniMax, Nvidia, Sarvam, Smallest AI, Speechify, Spitch. The following TTS plugins are available in both Python and TS: Cartesia, Deepgram, ElevenLabs, Neuphonic, OpenAI, Resemble AI, and Rime. If you want, I can: • Produce a compact table of exactly which providers you plan to use, or • Help you pick a cross‑SDK option (e.g., OpenAI or Deepgram) and show example setup for TS or Python. Which would you prefer? Sources: Speech-to-text (STT) models | LiveKit Docs | Groq STT plugin guide | LiveKit Docs | Text-to-speech (TTS) models | LiveKit Docs | Models | LiveKit Docs | Agents (Node.js) | livekit/livekit_composite | DeepWiki
s
what tts and stt do you recommend to work with out of the box for the js/ts sdk
t
Regarding TTS and STT that work out of the box for the JavaScript/TypeScript SDK: Recommendation (best balance of compatibility and ease) • STT: OpenAI or Deepgram — both are supported by the JS/TS SDK and are easy to integrate. • TTS: OpenAI, Deepgram, ElevenLabs, or Resemble AI — these TTS plugins are available in both Python and JS/TS and provide straightforward integration. Why these: • OpenAI and Deepgram are available in both SDKs, so you get cross‑platform parity and fewer surprises. • ElevenLabs and Resemble AI are proven for high‑quality TTS and are supported by the JS/TS SDK. • These options avoid plugin gaps that many other providers have (many providers are Python‑only). Next step I can help with: • A minimal TS example for configuring STT or TTS with OpenAI or Deepgram, or • A short comparison (latency, pricing considerations, voice quality) between two choices — which would you like?