A neural network is 'playing' Doom by generating frames one by one and it's pretty trippy, man
«But can it run Doom?» is an adage that has managed to travel through almost every piece of tech on the market. From controlling the game with a toaster to running Doom on a pregnancy test (please wash your hands after), it has almost become a benchmark of geeky creativity.
A joint effort from researchers at Google Research, Google DeepMind, and Tel Aviv University has managed to get the classic shooter running on nothing but a neural network (via Futurism). This essentially generates a frame, based on a model that is trained on the real game. You can check out a video of it running in real-time right here but there are natural limitations to it.
For the unaware, a neural network is an AI structure modelled after the human brain that uses machine learning to process commands and prompts. They are notably used in predictive models, due to their ability to grasp concepts more broadly than traditional AI.
A large part of making them better is called «training», where it iterates on a small level, using wide sets of data. When a network is «trained» on something, that is to say it is pulling in the data from it and using it in some way. In the example of generative AI, trained models will largely be quite similar to their source material until those data sets are wide enough.
Though it's obviously very impressive to run something this complex through a neural model, it's worth noting that the game is played at a slow pace in the video, with plenty of cuts—clearly grabbing the most fluid and realistic moments of the game. This isn't to diminish the work but to place it in context. You can't go out and just play through Doom right now with the support of a neural network. It is a test and not much more than that right now.
Without touching on any ethical discussions of (specifically generative) AI use in games, the accompanying paper acknowledges the experiment's limitations and makes an argument for the future of the tech. Due to the neural network's limited memory,
Read more on pcgamer.com
