Peking University's Cheng Xiang's Team Develops the First Real-World Injection-Based Communication and Multimodal Perception Intelligent Fusion Dataset, SynthSoM, Markedly Elevating the Performance Be
2025-06-05 / Read about 0 minute
Author:小编   

In the forthcoming era, mobile communication networks will become deeply entrenched in the fabric of society and the economy, catalyzing transformative shifts across industries and daily life. Nonetheless, the current disjoint between communication and multimodal perception in networked embodied agents poses a limitation on their intelligence capabilities. To bridge this gap, Professor Cheng Xiang's team from Peking University's School of Electronics Engineering has introduced the groundbreaking machine synesthesia (SoM) architecture and concept, facilitating the seamless intelligent fusion of AI-native communication and multimodal perception. By harnessing large models and wireless base station simulations, the team has achieved breakthroughs in core technologies, paving a novel avenue for the advancement of networked intelligence. Given the formidable challenges posed by the scarcity and quality of communication and multimodal perception intelligent fusion datasets essential for training, this research holds paramount significance.