Evaluating the impact of data granularity on deep Q-network based smart traffic signal control

Sauvage, Michel; Leroy, Clément; Cochon Jaffres, Pierrick; Härri, Jérôme
ITSC 2025, IEEE Intelligent Transportation Systems Conference, 18-21 November 2025, Gold Coast, Australia

Deep Q-Networks (DQN) are a promising technology for AI-driven traffic signal control (TSC), but their training requires complex input data. Modeling can be conducted at either microscopic or macroscopic levels. While microscopic modeling captures detailed traffic dynamics, it requires extensive parameter calibration. In contrast, macroscopic modeling offers faster setup and reduced computational cost with less precision. To evaluate the trade-offs, the study compare models trained on both data types under two DQN configurations: one with fixed decision intervals, and another allowing decisions every second with enforced pauses after phase changes. All traffic data used in this study is synthetically generated using the SUMO traffic simulator, ensuring full control over experimental conditions and flow scenarios. Results show that macroscopic data enables faster convergence and comparable, if not better, performance. Although the microscopic model offers finer control, it suffers from instability when combined with coarse decision intervals. These findings highlight that high-fidelity data is not strictly necessary to train effective traffic signal control policies, which is particularly advantageous for large-scale urban simulations and city-scale digital twins.


Type:
Conference
City:
Gold Coast
Date:
2025-11-18
Department:
Communication systems
Eurecom Ref:
8485
Copyright:
© 2025 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.

PERMALINK : https://www.eurecom.fr/publication/8485