With the ever-increasing scale of AI models, the capacity of HBM (High Bandwidth Memory) may find it challenging to keep pace with future requirements. Consequently, the industry is now setting its sights on GPU-powered storage architectures as a promising technological avenue. In the previous year, NVIDIA teamed up with SK Hynix and Kioxia to propel the development of AI-focused SSDs (Solid State Drives), with the intention of partially substituting HBM with tailored SSDs as an extended solution for GPU memory. This year, SK Hynix has once again joined forces with SanDisk to introduce the next-generation memory solution, HBF (High Bandwidth Flash), tailored for the AI inference era, in a bid to tackle this very challenge.
