Imagine picking up a microphone and seeing an avatar of yourself on a screen speaking the words that are coming out of your mouth in real time. As you speak into the microphone, your avatar moves and reacts emotionally to the sound of your voice, while perfectly lip-synching your words.
Now, enter another NPC avatar controlled by ChatGPT. It reacts to the sound of your voice and speaks back to you, also with perfect lip sync and emotional and nonverbal cues. The conversation is tight, with no noticeable delays in the AI’s responses and very little lag between your voice and your avatar. Together, you discuss any topic that the LLM is primed for – in this case, how to escape an alien invasion while wearing red shirts!
Speech Graphics demonstrated this remarkable experience on the show floor at GDC 2025, where visitors to the booth were welcomed to slip into the AI-sphere and take over control of the human side of the conversation.
Seeing how their voice could affect the events unfolding on the screen was so entertaining and immersive, they would go on talking for minutes before realizing how far down the rabbit hole they had gone! The scenario was on a spaceship, during an alien attack, with a riff on the unlucky red-shirt crew members and whether they should go fight or run and hide.
