Moonshot AI Unveils Open-Source Model Kimi K3
1 week ago / Read about 0 minute
Author:小编   

On July 17th, Moonshot AI made an official announcement regarding the launch of its Kimi K3 model. This cutting-edge model is equipped with an impressive 2.8 trillion parameters, leveraging the KDA hybrid linear attention mechanism alongside attention residual techniques. It offers native support for visual comprehension and boasts an expansive context window capable of handling up to 1 million tokens. Positioned as the world's inaugural open-source model within the 3 trillion parameter realm, Kimi K3 is meticulously crafted to excel in sophisticated intelligent applications, including long-context programming, knowledge-intensive tasks, and complex reasoning scenarios.