Gaming PC

Inspur Launches Gaudi 2-Based AI Server for Chinese Market

Intel has quietly launched its Gaudi 2 processor for artificial intelligence (AI) workloads in compliance with the latest export regulations for China. The new version has reduced scale-up interconnects and is already being used in Inspur’s NF5698G7 server. This machine is primarily designed for training and inference using Large Language Models (LLMs). This will help fill some of the shortages in computing GPUs like Nvidia’s A100 and H100, as well as the China-bound cut-outs.

Intel has two Gaudi 2 versions offered in the 600W OCP model form factor.called normal version Gaudi 2 HL-225H has 24 100Gbps RDMA (RoCE v2) interconnects, while a reduced version of the product is Gaudi 2 HL-225B There are 21 100Gbps RDMA (RoCE v2) scale-up interconnects. The reduced number of scale-up interfaces will lead to lower performance of AI servers based on this version of Gaudi 2, but bearing in mind the huge demand for AI capabilities in China, Inspur’s NF5698G7 finally prevailed. There is likely to be.

Related Articles

Leave a Reply

Your email address will not be published. Required fields are marked *

Back to top button