TY - JOUR
T1 - Tucker factorization-based tensor completion for robust traffic data imputation
AU - Lyu, Cheng
AU - Lu, Qing Long
AU - Wu, Xinhua
AU - Antoniou, Constantinos
N1 - Publisher Copyright:
© 2024
PY - 2024/3
Y1 - 2024/3
N2 - Missing values are prevalent in spatio-temporal traffic data, undermining the quality of data-driven analysis. While prior works have demonstrated the promise of tensor completion methods for imputation, their performance remains limited for complicated composite missing patterns. This paper proposes a novel imputation framework combining tensor factorization and rank minimization, which is effective in capturing key traffic dynamics and eliminates the need for exhaustive rank tuning. The framework is further supplemented with time series decomposition to account for trends, spatio-temporal correlations, and outliers, with the intention of improving the robustness of imputation results. A Bregman ADMM algorithm is designed to solve the resulting multi-block nonconvex optimization efficiently. Experiments on four real-world traffic state datasets suggest that the proposed framework outperforms state-of-the-art imputation methods, including the context of complex missing patterns with high missing rates, while maintaining reasonable computation efficiency. Furthermore, the robustness of our model in extreme missing data scenarios, as well as under perturbation in hyperparameters, has been validated. These results also underscore the potential benefits of incorporating temporal modeling for more reliable imputation.
AB - Missing values are prevalent in spatio-temporal traffic data, undermining the quality of data-driven analysis. While prior works have demonstrated the promise of tensor completion methods for imputation, their performance remains limited for complicated composite missing patterns. This paper proposes a novel imputation framework combining tensor factorization and rank minimization, which is effective in capturing key traffic dynamics and eliminates the need for exhaustive rank tuning. The framework is further supplemented with time series decomposition to account for trends, spatio-temporal correlations, and outliers, with the intention of improving the robustness of imputation results. A Bregman ADMM algorithm is designed to solve the resulting multi-block nonconvex optimization efficiently. Experiments on four real-world traffic state datasets suggest that the proposed framework outperforms state-of-the-art imputation methods, including the context of complex missing patterns with high missing rates, while maintaining reasonable computation efficiency. Furthermore, the robustness of our model in extreme missing data scenarios, as well as under perturbation in hyperparameters, has been validated. These results also underscore the potential benefits of incorporating temporal modeling for more reliable imputation.
KW - Bregman ADMM
KW - Changepoint detection
KW - Data imputation
KW - Tensor completion
KW - Tucker factorization
UR - http://www.scopus.com/inward/record.url?scp=85184994971&partnerID=8YFLogxK
U2 - 10.1016/j.trc.2024.104502
DO - 10.1016/j.trc.2024.104502
M3 - Article
AN - SCOPUS:85184994971
SN - 0968-090X
VL - 160
JO - Transportation Research Part C: Emerging Technologies
JF - Transportation Research Part C: Emerging Technologies
M1 - 104502
ER -