On January 8, during the Alibaba Cloud Tongyi Smart Hardware Exhibition, Alibaba Cloud introduced a cutting-edge multimodal interaction development kit. This innovative kit seamlessly integrates three of Tongyi's foundational large models: QianWen, WanXiang, and BaiLing. Pre-installed with more than a dozen Agents and MCP tools across lifestyle, leisure, and work efficiency domains, the kit offers a comprehensive suite of functionalities.

It boasts the ability to perceive through listening and seeing, engage in cognitive processing, and interact dynamically with the physical environment. These capabilities render it highly suitable for integration into a wide array of AI-powered hardware devices, including AI glasses, educational gadgets, companion toys, and intelligent robots.

Moreover, the kit is designed to be compatible with over 30 mainstream terminal chip platforms, ensuring broad accessibility and versatility. It achieves remarkable performance metrics, with end-to-end voice interaction latency as low as 1 second and video interaction latency reduced to just 1.5 seconds. Additionally, the kit is seamlessly integrated into the Alibaba Cloud BaiLian platform ecosystem, facilitating the seamless expansion of application capabilities and fostering a thriving ecosystem for AI hardware development.