Intel has a new rival to Nvidia’s uber-popular H100 AI GPU — meet Gaudi3 with a whopping 128GB RAM

Shortly after Nvidia’s latest GPU launch, Intel has teased the Gaudi3 processor – an AI accelerator with built-in memory that can rival the H100 – one of the best graphics cards.

The 5nm Gaudi3, the successor to the 7nm deep learning training processor Gaudi2, has four times the brain floating 16 (BF16) power, twice the network power and 1.5 times the bandwidth of high-bandwidth memory, according to Serve the House.

The component, expected to launch in 2024, will come equipped with up to 128 GB of HBM3e RAM, the publication estimates, which would overwhelm its predecessor’s 96 GB of HBM2e onboard memory and lead to serious performance gains in AI learning and training .

New Intel chips to compete with Nvidia

It’s essentially Intel’s answer to the GH200 superchip, which packs 141GB of HBM3e memory that comes with Nvidia’s latest GPU. With Gaudi2 in the same ballpark as the H100, it’s likely that Gaudi3 will offer performance levels in the same region as the H200.

Intel teased the capabilities of its Gaudi3 chip alongside the Intel Max Series 1550 graphics card, which is built into the new online Aurora supercomputer. This is the second one ever exascale supercomputer, and will likely be the most powerful of all time once fully tuned.

It is widely expected to surpass the Frontier supercomputer once it is fully up to speed, reaching performance levels of up to two exaFLOPs – about two billion billion calculations per second.

This, according to the company, is much more powerful at handling AI training workloads than comparable systems equipped with AMD and Nvidia GPUs.

The Intel Max 1550 GPU recorded a score of 48.4 samples per second when put through the CosmicTagger single GPU training throughput benchmark, with AMD’s MI250 and Nvidia’s A100 scoring 31.2 and 14.7 respectively.

This is comparable to the numbers from the CosmicTagger single node training benchmark, where Intel’s GPU scores 280 samples per second versus 120 and 54.9 for AMD and Nvidia’s GPUs respectively.

While no comparable benchmarking numbers are available for Nvidia’s H100 or H200 GPUs, these results make the Intel Max 1550 a more than competent candidate for powering systems that perform AI training and inference workloads.

More from Ny Breaking

Today’s best Black Friday deals

Gigabyte G5: now $799.99 at Best Buy (was $1,099.99)
This Gigabyte G5 combines a 12th generation Intel CPU with an Nvidia GeForce RTX 4060, helping you reach the crucial threshold of 8 GB of VRAM. You also get 16GB of system memory and 512GB of storage, which is pretty good for this price. View deal

Gigabyte G5 RTX 4060: $1,099 $799 @ Best Buy
Save $300 on the Gigabyte G5 with Nvidia’s powerful GeForce RTX 4060 GPU inside. Gigabyte produces some of the best gaming laptops in the industry and the G5 aims to take your gameplay to the next level. While we haven’t tested this laptop, Gigabyte G5 reviews from happy owners praise its performance and price.

Functions: 15.6-inch 1080p 144Hz display, Intel Core i7-12650H 12-core CPU, 16 GB RAM, RTX 4060 GPU, 512 GB SSD. View offer

Related Post