Lessons from testing GPT and Gemini native audio models for voice agents(deepsense.ai)
deepsense.ai
Lessons from testing GPT and Gemini native audio models for voice agents
https://deepsense.ai/blog/realtime-voice-ai-in-the-enterprise-overcoming-latency-with-native-audio-models/
2 comments
interesting that you went with a voice-to-voice realtime pipeline for latency reduction. speech-swift (which I maintain) could complement this by adding on-device speaker diarization, enhancing your voice agent's ability to distinguish between speakers without cloud dependency. https://soniqo.audio/guides/diarize