On the evening of March 16, Tesla CEO Elon Musk praised the latest technological achievement of Chinese AI company Moonshot AI (Kimi) on a social platform, calling it "impressive." This achievement introduces an "attention residual" mechanism, which improves the underlying information transfer structure of large models and enhances training efficiency, drawing widespread attention from both academia and industry.
