We're Hosting Orpheus– Real-Time, Emotional AI Voice for $1/HR(gabber.dev)
gabber.dev
We're Hosting Orpheus– Real-Time, Emotional AI Voice for $1/HR
https://gabber.dev/
6 comments
What is the latest/greatest
when it comes to voice models? Orpheus is what people have the most success with?
I only concentrate on the WebRTC side, not aware of all the offerings.
I only concentrate on the WebRTC side, not aware of all the offerings.
Orpheus is good. It's a very simple architecture, basically just llama3b trained to produce audio (SNAC) tokens instead of text tokens. This is nice because it benefits from the Llama open-source ecosystem which is very active. It being LLM based is also nice because it streams output and with some engineering effort supports continuation via prompt-filling (so streaming input can work).
The other one people have been excited about is Sesame. Both are very expressive and have much more room for optimization (both on the inference efficiency side quants, finetunes, distillation, etc) and on the quality side (throw more data at it). Exciting times!
The other one people have been excited about is Sesame. Both are very expressive and have much more room for optimization (both on the inference efficiency side quants, finetunes, distillation, etc) and on the quality side (throw more data at it). Exciting times!
Orpheus is the first "good" open-source model. The big players thus far have all be research labs (Cartesia, OpenAI, Play, Eleven), but with Orpheus and Sesame (another one, not quite production ready), the market is changing
Are you going to be hosting the multi-lingual?
Yup, we will be working on this in the next week or two.
We’re hosting [Orpheus TTS](https://github.com/canopy-ai/orpheus-tts) in production, which gives you:
- ~200ms TTS streaming latency
- Expressive voices that sound like humans
- Emotion tags like <laugh>, <sigh>, <cry>
- Significantly lower cost (~$1/hr) compared to ElevenLabs or [Play.ht](http://Play.ht) ($5+/hr)
- Integrate with WebSocket API or Realtime WebRTC SDK
Gabber also handles:
- Memory (long-term + session-based)
- LLM orchestration (use your own or ours)
- Tool calling
With this release, real-time AI voice is finally fast, affordable, and expressive enough to unlock use cases that just weren’t viable before. With cheaper, easier access to high-quality voice, you can now build what you actually want—whether it’s an AI companion, a voice-native coach, a video game NPC, or something entirely your own.
If you're curious about how we’re hosting Orpheus at scale or want to talk memory, GPU infra, SDKs—happy to share.