Today, the official account of Moonshot AI Kimi issued a response to Elon Musk’s like of their latest technical report, stating, “Your rockets are pretty well-built too!” On March 16, Moonshot AI Kimi unveiled a technical report that introduced a redesign of the residual connections within the core architecture of large models. This innovation allows each layer to selectively concentrate on the outputs of preceding layers. Tests revealed that the training efficiency of the 48B model improved by 1.25 times. Following the publication of the paper, Musk commended it as “impressive.”
