Recently, Intel has achieved a remarkable milestone as its Gaudi 3 AI accelerator has been successfully incorporated into Dell's PowerEdge XE7740 server. This server is designed with the capacity to house eight Gaudi 3 PCIe accelerator cards. Notably, it offers a more budget-friendly option, consuming roughly half the power compared to the mainstream GPUs currently available in the market.

Tailored explicitly for large-scale generative AI applications, the Gaudi 3 boasts impressive specifications. It is equipped with 64 tensor processor cores and 8 matrix multiplication engines. Additionally, it comes with a substantial 128GB of HBM2e memory and 24 200Gb Ethernet interfaces. This powerful combination enables the Gaudi 3 to deliver outstanding performance in both inference and training tasks. As a result, it provides enterprises with highly efficient and cost-effective AI solutions, helping them stay competitive in the rapidly evolving technological landscape.