NVIDIA’s AI has already changed gaming, and it’s still just heating up

techradar.com:

Since the introduction of GeForce RTX 20-Series GPUs and their onboard Tensor Cores, NVIDIA has been pushing forward the capabilities of AI in gaming. More features and more games are taking advantage of AI to deliver their game worlds and quality graphics. And with the latest NVIDIA ACE technology, it’s clear NVIDIA has plans to make AI even more integral to gaming than before.

The push into AI kicked off with NVIDIA DLSS, Deep Learning Super Sampling, which lets players enjoy high-fidelity visuals without the typical hit to frame rates that comes alongside them. NVIDIA achieved this by using higher-quality graphics as AI training data so that the Tensor Cores could take low-resolution gameplay and understand how to bridge the gap. Now, DLSS is multiplying resolution and frame rate with AI. 

By the same token, NVIDIA Freestyle and RTX Remix provide tools for improving the visuals of games with AI. Freestyle lets users apply filters or even upconvert rendering into HDR for non-HDR games in realtime to enhance their experience. Meanwhile, RTX Remix can do for in-game assets what DLSS did for output resolution, letting modders take in asset files and smartly convert them to higher-quality assets to produce quick remasters of classic games.

While DLSS, NVIDIA Freestyle, and RTX Remix all alter the visual experience of games, NVIDIA ACE is set to change the way people interact with games themselves.

NVIDIA ACE is putting an AI toolset behind in-game NPCs (Non-player characters). Just as the power of large language models have brought chatbots to life in profound ways, NVIDIA ACE can provide a new level of dynamism for NPCs, letting gamers find more engagement throughout their games. 

NVIDIA ACE’s Riva speech and Audio2Face animation models allow seamless interaction between players and NPCs. Riva takes spoken prompts from players and transcribes them for the game. AI-powered NPCs respond in natural language that can be processed by Audio2Face to sync facial animations with