Powercolor's Edge AI aims to significantly reduce GPU power consumption without a big hit in frame rates

pcgamer.com:

Many PC enthusiasts don't like the fact that the best top-end GPUs use lots of power and try all kinds of ways of reducing the consumption, such as undervolting, frame rate caps, or lowering the max power limit. Graphics card vendor PowerColor is experimenting with a slightly different approach by using an NPU to manage the power usage in games, without impacting performance, in a system called Edge AI.

A demonstration of the work in progress was on display at PowerColor's Computex stand. While we didn't get a chance to see it in action (there was a huge amount to try and see at the event), tech site IT Home and X user Harukaze5719 managed to grab some pictures of the setup and see it running on two computers running Final Fantasy XV.

PowerColor's engineers hotwired an external NPU to an AMD graphics card, in one of the computers, and programmed it to manage the GPU's power consumption while rendering. At the moment, there's no indication of exactly what's going on behind the scenes but NPUs (neural processing units) are specialised processors for handling the math operations involved in AI routines.

What I suspect is going on is that the NPU is running a neural network that takes metrics such as the GPU's load, voltage, and temperature, as well as aspects from the game being rendered, and alters the GP voltage in such a way that the power consumption is significantly reduced on average.

In the Final Fantasy XV demonstration, the PC without an NPU ran the game at 118 fps, with the graphics card using 338 W to achieve this. The other setup, with the NPU-GPU combo, was hitting 107 fps at 261 W of power. That's a 23% reduction in energy consumption for a 9% drop in frame rate.

PowerColor's demo stand actually claims that Edge AI improves performance but it obviously forgot that if you're going to showcase a new bit of technology, then you kind of want to check that it does what you're saying it does before you wave it about in public. But even with that minor marketing