On October 16, news surfaced that Kunlun Wanwei had officially rolled out its innovative video-generated game model, Matrix-Game 4.0, the previous day. In a move to foster collaboration and transparency, the company also open-sourced both the project code and model weights, with a comprehensive technical report being unveiled today. Notably, Kunlun Wanwei’s founder, Zhou Yahui, played a pivotal role in the model's development.
Matrix-Game 4.0 stands out for its seamless integration of a game engine and a video generation model, working in tandem to deliver a real-time gaming experience. Remarkably, it achieves this at a crisp 480p resolution and a smooth 60 FPS on just a single NVIDIA RTX 5090 consumer-grade graphics card. Moreover, the end-to-end latency from player input to on-screen response is impressively kept under 150 milliseconds.
At present, all pertinent resources for Matrix-Game 4.0 are readily accessible on popular platforms like GitHub and Hugging Face, inviting developers and enthusiasts alike to explore and contribute.