AMD has shared some interesting data regarding the capabilities of its RDNA 3 GPU & XDNA NPU hardware in consumer-centric AI workloads.
There's no doubt that AMD has been ahead of the curve in offering AI capabilities to a wider PC audience through the implementation of XDNA NPU on its Ryzen APUs. The first NPU launched back in 2023 with the Phoenix "Ryzen 7040" APUs and recently got updated with the Hawk Point "Ryzen 8040" series. Besides the NPU, AMD's RDNA 3 GPU architecture has also incorporated a large sum of dedicated AI cores that can handle these workloads and the company is trying to solidify its momentum with its ROCm software suite.
During the latest "Meet The Experts" webinar, AMD discussed how its Radeon Graphics suite such as the RDNA 3 series provides gamers, creators, & developers with a range of optimized workloads which include:
Starting with the AMD RDNA 3 graphics architecture, the latest GPUs featured on Radeon RX 7000 GPUs and Ryzen 7000/8000 CPUs provide over 2x gen-over-gen AI performance uplifts.
These GPU products offer up to 192 AI accelerators which are optimized for FP16 workloads, are optimized in multiple ML frameworks such as Microsoft DirectML, Nod.AI Shark & ROCm, & feature large pools of dedicated VRAM which is essential for handling large data sets (up to 48 GB) & also feature faster bandwidth which is boosted by Infinity Cache technology.
According to AMD, the majority of AI use cases on the PC platform include LLM's and Diffusion models which are mainly dependent on FP16 compute and memory capabilities of the hardware they are
Read more on wccftech.com