Amazon Web Services (AWS) recently announced the official availability of its Amazon EC2 M9g and M9gd instances, powered by its fifth-generation, custom-built Arm processor, Graviton5. Graviton5 is currently AWS's most powerful and energy-efficient custom CPU, with the core count increased from 96 cores in Graviton4 to 192 cores. It adopts a 4-chipset design, with each chipset containing 48 cores and integrating a dedicated DRAM memory controller and PCIe 6.0 I/O controller. The four chipsets are interconnected through custom interconnect technology, providing a bandwidth of up to 420GB/s. The L3 cache has been increased to 192MB, and branch prediction capabilities have also been significantly enhanced, delivering up to a 30% performance improvement when running complex code such as real-world databases. Built on TSMC's 3nm process technology, the M9g instances, compared to the M8g instances based on Graviton4, deliver a 25% improvement in general-purpose computing performance, a 35% boost in web application performance, a 35% increase in machine learning inference performance, and a 30% enhancement in database performance.
