The latest iteration of Doubao 2.1 Pro (0915) has been rolled out, seamlessly integrating its API into Volcano Ark while concurrently updating the Doubao work terminal. This upgrade is centered around four key areas: multimodal coding, Agent-based professional task execution, 3D and specialized graphic-text multimodal comprehension, and Token efficiency. Notably, the multimodal programming capability has drawn considerable interest. This model boasts the ability to interpret design sketches, blueprints, screen recordings, and subsequently write and refine code accordingly. In real-world testing scenarios, the model successfully accomplished a variety of tasks, such as crafting an interactive 3D travel guide for Shanxi, constructing a miniature model of the Little Prince's B612 planet, building a 3D model from five perspectives of a castle, developing an iPhone Duo folding concept demo complete with built-in mini-games, transforming architectural floor plans into 3D models, simulating a courtyard across four seasons in 3D, converting hand-drawn sketches into multi-themed personal workstations, and creating a 3D pixel-style animation of a pelican riding a bicycle. Moreover, the model exhibits a profound understanding of intricate code repositories, with significantly bolstered Agent capabilities, minimized hallucinations, and markedly enhanced multimodal comprehension. When compared to its predecessor, the Token consumption for image and video reasoning has been reduced by over 30%. The advancement in multimodal programming technology empowers AI to more precisely grasp human expressions like sketches and screen recordings, thereby propelling AI programming towards production-level deployment and marking a substantial transition from humans comprehending machines to machines understanding humans.
