Microsoft and Hellblade Developer Ninja Theory Built an AI Called Muse Designed to Generate Ideas for a Game's Design — and It’s Already Making 'Complex' Gameplay Sequences
Microsoft has announced a new generative AI model designed for gameplay ideation.
The company detailed what it calls the first World and Human Action Model (WHAM). The WHAM, Katja Hofmann, Senior Principal Research Manager and lead of the Microsoft Research Game Intelligence team, said in a blog post, is a generative AI model of a video game that can generate game visuals, controller actions, or both.
Microsoft calls this generative AI model Muse, which was developed by the Microsoft Research Game Intelligence and Teachable AI Experiences (Tai X) teams in collaboration with Hellblade developer Ninja Theory. It’s open sourcing the weights and sample data and making the executable available for the WHAM Demonstrator — a concept prototype that provides a visual interface for interacting with WHAM models and multiple ways of prompting the models.
The company provided a number of gameplay clips showing what Muse is capable of. Currently, the model can generate “complex gameplay sequences that are consistent over several minutes” just by prompting the model with 10 initial frames (one second) of human gameplay and the controller actions of the whole play sequence.
The game used to train Muse was Ninja Theory’s 2020 multiplayer game Bleeding Edge. “We worked closely with our colleagues at Ninja Theory and with Microsoft compliance teams to ensure that the data was collected ethically and used responsibly for research purposes,” Hofmann insisted.
“It’s been amazing to see the variety of ways Microsoft Research has used the Bleeding Edge environment and data to explore novel techniques in a rapidly moving AI industry,” said Gavin Costello, technical director at Ninja Theory.
“From the hackathon that started it all, where we first integrated AI into Bleeding Edge, to building AI agents that could behave more like human players, to the World and Human Action Model being able to dream up entirely new sequences of Bleeding Edge gameplay under human guidance, it’s been eye-opening to
Read more on ign.com
