Sreeramaneni, a Micron researcher specializing in HBM design architecture, warns that the issue of the 'memory wall' remains severe and is continuing to worsen. He points out that the computing performance of AI accelerators has improved threefold every two years, while the bandwidth growth of HBM during the same period has been less than twofold, exacerbating the memory shortage. He emphasizes that new designs that break the boundaries between computing and storage are key ways to overcome this bottleneck.
