To empower hyperscale enterprises and AI innovators in building next-generation semi-custom AI infrastructures, NVIDIA has introduced the NVHBM technology, further expanding the NVIDIA NVLink Fusion technology portfolio. As a next-generation high-bandwidth memory technology, NVHBM significantly enhances the memory performance and efficiency of XPUs. By integrating the memory controller into the 3D HBM stack instead of the XPU, this technology achieves up to a 30% increase in memory bandwidth compared to standard HBM4E, while reducing HBM power consumption by 15% and freeing up to 25% of area on the XPU compute die.
