The most recent standard for server DRAM modules, known as "MRDIMM," has reached the concluding phases of its development process. Leading the charge in its advancement are industry giants such as Samsung Electronics, SK Hynix, and Micron. Unlike HBM, which integrates with GPUs, MRDIMM functions as the primary memory that the CPU accesses directly. It is specifically tailored for artificial intelligence and high-performance computing tasks. What sets MRDIMM apart is its capability to operate two memory channels simultaneously, substantially boosting data processing speed. The first-generation MRDIMM can achieve a data transfer rate of up to 8800MT/s, with peak bandwidth seeing an increase of nearly 40%. This effectively addresses the problem of diminishing memory bandwidth per core.
