Skyrim Modder Uses Language AI To Make NPCs More Immersive Than Ever
The modder Art From The Machine is currently testing a new project aimed at using ChatGPT to generate responses for the various NPCs in Skyrim VR, making the game world more immersive than ever before. The upcoming mod also makes use of xVASynth for text-to-speech and Whisper for speech-to-text interaction. With all three of these technologies in the game, NPCs are able to produce dynamically generated responses, answering questions and remembering interactions.
Some footage from the project made its way to YouTube in March, Art From The Machine providing a fairly substantial progress update earlier this week. “I am working on a Skyrim mod which allows for conversations with NPCs via ChatGPT, xVASynth (text-to-speech), and Whisper (speech-to-text). This update introduces Skyrim scripting which allows for lip syncing of voices and NPC awareness of in-game events,” the modder explains in the official description.
RELATED: The Best Player Houses In Skyrim
The video showcases Ulfberth War-Bear, a worker at Warmaiden's in Whiterun, among several other NPCs. While the responses are of course a bit stilted, the mod carries incredible potential when it comes to creating dynamic interactions with NPCs. As soon as Art From The Machine finishes working on the brand new memory system, these will be able to remember past events and conversations, responding to players accordingly.
The mod is currently in active development, Art From The Machine planning to add more features and carry out extensive bug testing before releasing the project to the public. When this finally comes to fruition, the results will certainly be interesting to experience. The potential impact of such a system on the games industry remains to be seen, but
Read more on thegamer.com
