AMD Unveils Instinct MI300 APUs In MI300A & MI300X Flavors: CDNA 3 GPU, Up To 24 Zen 4 Cores, 192 GB HBM3, 153 Billion Transistors

wccftech.com:

AMD has officially unveiled its Instinct MI300 APUs which combine Zen 4 CPU cores with CDNA 3 GPU cores with up to 153 Billion transistors & 192 GB HBM3 memory.

All three chipmakers, AMD, Intel, and NVIDIA, are currently in the race to offer the world's first CPU and CPU combo. Intel's offering was going to be Falcon Shores which was going to combine an x86 CPU with a leading-edge GPU but those plans didn't come to fruition and the Chipzilla has delayed the project for the foreseeable future.

Meanwhile, NVIDIA's answer comes in the form of the Grace and Hopper Superchips which combine the Grace ARM CPU package with the Hopper H200 GPU on the same board but that's still a far cry from AMD's chiplet-based and on-package integration of Zen 4 CPU and CDNA 3 GPU cores.

Introducing the World’s Most Advanced Accelerator for Generative AI.

AMD revealed new details of the AMD Instinct MI300 Series accelerator family, including the introduction of the AMD Instinct MI300X accelerator, the world’s most advanced accelerator for generative AI. The MI300X is based on the next-gen AMD CDNA 3 accelerator architecture and supports up to 192 GB of HBM3 memory to provide the compute and memory efficiency needed for large language model training and inference for generative AI workloads.

With the large memory of AMD Instinct MI300X, customers can now fit large language models such as Falcon-40, a 40B parameter model on a single, MI300X accelerator5. AMD also introduced the AMD Instinct™ Platform, which brings together eight MI300X accelerators into an industry-standard design for the ultimate solution for AI inference and training. The MI300X is sampling to key customers starting in Q3. AMD also announced that the AMD Instinct MI300A, the