News Categories

Intel to challenge enterprise AI performance with the Gaudi3 AI accelerator

By Ken Wong - on 10 Apr 2024, 12:58pm

Intel to challenge enterprise AI performance with the Gaudi3 AI accelerator

The Gaudi3 AI accelerator. Image source: Intel.

At the Intel Vision 2024 event, Intel launched its Gaudi3 accelerator to power the latest enterprise generative AI (GenAI) workloads. 

Intel CEO Pat Gelsinger said:

Intel is bringing AI everywhere across the enterprise from the PC to the data centre to the edge. Our latest Gaudi, Xeon and Core Ultra platforms are delivering a cohesive set of flexible solutions tailored to meet the changing needs of our customers and capitalise on the immense opportunities ahead.

Image source: Intel.

When compared to Gaudi2, Intel said that the Gaudi3 would offer four times higher compute for BF16 performance, twice as fast networking performance, and 1.5X higher bandwidth capacity. BF16 refers to brain floating point, a format developed at Google and used for machine learning. Overall, Gaudi3 would offer better performance for businesses looking to deploy GenAI at scale.

And it is coming soon to tech manufacturers, to rival NVIDIA’s H100 and AMD’s MI300 GPUs. In fact, Intel went so far as to say that Gaudi3 offered 50% on average better inference and 40% on average better power efficiency than NVIDIA’s H100 chip, and at a fraction of the cost.

Image source: Intel.

Intel says its Gaudi 3 will be available to manufacturers, including Dell, HPE, Lenovo and Supermicro, in the second quarter of 2024. But the company is already shipping samples to customers and Intel also shared the customer momentum for Gaudi-based solutions with companies like NielsenIQ, an Advent International portfolio company using Gaudi3 to enhance its GenAI capabilities by training domain-specific LLMs on its consumer buying behaviour database. This allows the company to improve its client service offerings while meeting privacy standards

Join HWZ's Telegram channel here and catch all the latest tech news!
Our articles may contain affiliate links. If you buy through these links, we may earn a small commission.