Intel bets on a secret weapon to beat AMD in some AI workloads — AVX-512 instructions will help Xeon beat Epyc in specific scenarios but Intel will have to work much, much harder to worry AMD
Intel’s 5th-Gen Xeon Scalable processors, built on the Emerald Rapids architecture, can benefit from a huge raw performance boost when running AVX-512 workloads.
An Intel Xeon Platinum 8592+ CPU can almost double its average performance while also increasing power efficiency when running AVX-512 instructions in a handful of specific workloads, according to benchmarking site Phoronix.
AVX-512 is an instruction set that increases the performance of a CPU by running the same instructions across different data points – known as single instruction multiple data (SIMD).
Its main goal is to speed up data compression, cryptographic calculations and image processing tasks. It was criticized in the past due to poor power efficiency, however, and excessive heat generation. But recent generations of Intel Xeon CPUs don’t tend to display these side effects, rendering it a viable way to harness the full potential of the server-oriented processors.
Performance gain activated
Phoronix ran two 64-core Intel Xeon Platinum 8592+ CPUs on Ubuntu 23.10 with the Linux 6.5 kernel in the Intel Eagle Stream reference server. This system was fitted with 1TB DDR5 RAM as wel as a 3TB SSD.
In various benchmarks – including Embree, OpenVKL and Y-Cruncher – turning AVX-512 doubled the performance of the CPU. On the OpenVINO benchmark, in particular, enabling AVX-512 saw performance shoot up by up to more-than three times.
OpenVINO is a toolkit Intel devised around neural networks; in particular, OpenVINO allows developers to quickly create applications for a variety of AI-centric tasks including emulating vision, speech recognition, and natural language processing.
The CPU also experienced no major power usage or heat generation concerns, according to Phoronix, which highlighted the benefits of AVX-512 in today’s day and age, despite concerns when the tech first burst onto the scene.
Although Intel’s latest 5th-gen Xeon CPU may be one of the best processors for servers, based on raw performance it hasn’t hit the dizzying heights set by AMD’s 96-core counterpart – the Ryzen Threadripper Pro 7995WX. This CPU holds the world record in a number of categories, comfortably pipping anything Intel has to offer at the time of writing.
More from TechRadar Pro
Intel’s 5th-Gen Xeon Scalable processors, built on the Emerald Rapids architecture, can benefit from a huge raw performance boost when running AVX-512 workloads. An Intel Xeon Platinum 8592+ CPU can almost double its average performance while also increasing power efficiency when running AVX-512 instructions in a handful of specific workloads,…
