Search
Tongyi's Open-Source Vision Perception Multi-modal RAG Reasoning Framework: VRAG-RL
5 day ago /
Read about 0 minute
Author：小编
The Natural Language Intelligence team at Tongyi Lab has introduced the VRAG-RL framework, an open-source tool that leverages reinforcement learning and multi-modal techniques to tackle the intricate task of retrieving and reasoning about key information from complex visual documents. This framework utilizes vision perception actions to refine information extraction, employs a multi-expert sampling strategy, and incorporates a fine-grained reward mechanism to boost performance. Furthermore, it accelerates training through the utilization of the GRPO algorithm. Experimental results showcase VRAG-RL's proficiency in various visual tasks, facilitating multi-round interactions and precise reasoning.
-
C114 Communication Network -
Communication Home
7 X 24 Track global technological trends
