Converge challenge: multimodal learning for 6G wireless communications

Chen, Jichao; Borges Teixeira, Filipe; Ribeiro, Francisco Manuel; Alkhateeb, Ahmed; Ricardo, Manuel; Pessoa, Luis Manuel; Slock, Dirk
ICASSP 2026, IEEE International Conference on Acoustics, Speech, and Signal Processing, 4-8 May 2026, Barcelona, Spain

High-frequency mmWave and sub-THz systems enable ultra-high data rates but suffer from severe path loss and blockage sensitivity. Visual sensing can enhance reliability by providing environmental awareness for proactive beam management, yet progress has been limited by the lack of synchronized real-world multimodal datasets. This CONVERGE challenge addresses this gap with a novel indoor mmWave dataset and three tasks: Blockage Prediction, UE Localiza-tion, and Channel Prediction. These tasks are designed to benchmark cross-modal learning and promote collaboration between the wireless and computer vision communities.


DOI
Type:
Conférence
City:
Barcelona
Date:
2026-05-04
Department:
Systèmes de Communication
Eurecom Ref:
8684
Copyright:
© 2026 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.

PERMALINK : https://www.eurecom.fr/publication/8684