AutoNavi Unveils ABot-Recon: A Streaming 3D Reconstruction Model with Twofold Enhancements in Accuracy and Speed, and Significant Reduction in Video Memory Consumption
5 hour ago / Read about 0 minute
Author:小编   

In the context of autonomous driving and embodied AI technologies advancing into open-world scenarios, traditional 3D reconstruction methods are finding it difficult to meet real-time requirements in specific, enclosed environments. Meanwhile, conventional streaming 3D reconstruction techniques are grappling with a 'memory bottleneck.' To tackle these challenges, Alibaba's AutoNavi team has introduced ABot-Recon, the pioneering 10,000-frame-level streaming 3D reconstruction model that operates without long-range dependencies. This model utilizes a dual-engine framework consisting of 'local pose prediction + residual optimization.' By leveraging just 12 consecutive frames as a dynamic context window, it ensures a consistent level of computational complexity.

ABot-Recon showcases innovation in prediction mechanisms, error management, and resource utilization. According to testing results, it exhibits reduced trajectory errors, accelerated inference speeds, and a notable decrease in video memory usage—down to a mere one-third of that required by comparable mainstream models. This enables the model to run on consumer-grade graphics cards. Furthermore, the model achieves 10,000-frame-level 3D reconstruction using only monocular RGB video, eliminating the need for depth sensors or pre-calibrated camera parameters.

At present, the inference code and training weights for ABot-Recon have been made publicly available, along with a designated experience area for users to explore and interact with the technology.

  • C114 Communication Network
  • Communication Home
7 X 24 Track global technological trends
Hot Topic