iFLYTEK and Huawei have achieved a groundbreaking advancement in the realm of domestic computing power. The collaborative teams from both companies have pioneered the implementation of large-scale cross-node expert parallel cluster inference for the Mixture of Experts (MoE) model on domestic computing power clusters. This represents the industry's first novel solution leveraging domestic computing power, marking a notable milestone following DeepSeek's announcement of its MoE model training and inference solution. Through intensive collaborative innovation across software and hardware, the joint team has delved into the hardware's potential at multiple critical technical levels, successfully completing verification, deployment, and achieving substantial performance enhancements.
