NetEase Youdao Rolls Out ThinkFlow to Expedite Engineering Deployment of Large-Scale Models
11 hour ago / Read about 0 minute
Author:小编   

NetEase Youdao has formally introduced ThinkFlow, an enterprise-grade platform designed for aggregating large-scale models. Leveraging standardized API interfaces, ThinkFlow seamlessly consolidates more than 20 widely-used large-scale models, such as DeepSeek, Kimi, and Qwen, into a single, cohesive scheduling system. This integration effectively resolves the challenges associated with adapting interfaces individually and managing keys separately, which were previously fragmented. ThinkFlow offers comprehensive visualization of Token consumption throughout the entire process, along with detailed cost dashboards. This approach shifts AI investment from indiscriminate spending to efficient, lean operations. Moreover, it centrally secures all API keys to bolster security measures. The platform incorporates advanced features like intelligent routing, load balancing, and real-time monitoring mechanisms, ensuring minimal disruption to business frontends. These capabilities provide vital support for high-availability environments, such as those in the finance and government sectors. The foundational architecture of ThinkFlow has been rigorously tested and validated across various internal scenarios at NetEase. It facilitates a smooth transition for enterprises from lightweight innovation verification to extensive production environments, substantially cutting down on trial-and-error expenses and migration risks. Presently, the platform is accessible to enterprise users and will persist in integrating newly released models.