Mianbi Intelligence Unveils Edge-Side Large Model MiniCPM 4.0
2 day ago / Read about 0 minute
Author:小编   

Mianbi Intelligence has announced the launch of its latest edge-side large model, MiniCPM 4.0. Leveraging its proprietary CPM.cu inference framework, MiniCPM 4.0 boasts a remarkable 220x speedup in extreme scenarios and a substantial 5x speedup in typical use cases. Furthermore, it supports multi-framework deployments, encompassing both vLLM and SGLang, ensuring versatility and compatibility across various platforms.