An AI mod called Mantella for Skyrim VR allows players to have natural language conversations with characters using their voice.
The mod integrates speech-to-text, OpenAI's ChatGPT large language model, and text-to-speech to enable real-time conversations with NPCs in the game.
NPCs in Skyrim VR using the Mantella mod have the ability to remember past conversations, be aware of in-game context, and even notice items carried by players.
Though there are some bugs and lag issues, the Mantella mod provides a glimpse into the future of interactive immersive gaming and opens up possibilities for storytelling and personal connections.