PolyAI has introduced Dialog-RSN-1, a dialog model that perceives the caller’s audio directly instead of reading a transcript. It fuses turn-taking, speech recognition, function calling and response generation into one audio-native model, and is already handling live production calls.

Key Takeaways

Dialog-RSN-1 is audio-aware on the input side only; TTS stays separate, so the output voice remains controllable.

It runs as a request-based LLM probed on demand, not an always-on stream that pins a GPU.

Turn-taking is the model’s first output token: EMPTY, ONGOING or COMPLETE.