TY - JOUR
T1 - The Impact of Data on the Stability of Learning-Based Control
AU - Lederer, Armin
AU - Capone, Alexandre
AU - Beckers, Thomas
AU - Umlauft, Jonas
AU - Hirche, Sandra
N1 - Publisher Copyright:
© 2021 A. Lederer, A. Capone, T. Beckers, J. Umlauft & S. Hirche.
PY - 2021
Y1 - 2021
N2 - Despite the existence of formal guarantees for learning-based control approaches, the relationship between data and control performance is still poorly understood. In this paper, we propose a Lyapunov-based measure for quantifying the impact of data on the certifiable control performance. By modeling unknown system dynamics through Gaussian processes, we can determine the interrelation between model uncertainty and satisfaction of stability conditions. This allows us to directly asses the impact of data on the provable stationary control performance, and thereby the value of the data for the closed-loop system performance. Our approach is applicable to a wide variety of unknown nonlinear systems that are to be controlled by a generic learning-based control law, and the results obtained in numerical simulations indicate the efficacy of the proposed measure.
AB - Despite the existence of formal guarantees for learning-based control approaches, the relationship between data and control performance is still poorly understood. In this paper, we propose a Lyapunov-based measure for quantifying the impact of data on the certifiable control performance. By modeling unknown system dynamics through Gaussian processes, we can determine the interrelation between model uncertainty and satisfaction of stability conditions. This allows us to directly asses the impact of data on the provable stationary control performance, and thereby the value of the data for the closed-loop system performance. Our approach is applicable to a wide variety of unknown nonlinear systems that are to be controlled by a generic learning-based control law, and the results obtained in numerical simulations indicate the efficacy of the proposed measure.
KW - Gaussian processes
KW - data-driven control
KW - data-efficient learning
KW - safe learning-based control
UR - http://www.scopus.com/inward/record.url?scp=85108720390&partnerID=8YFLogxK
M3 - Conference article
AN - SCOPUS:85108720390
SN - 2640-3498
VL - 144
SP - 623
EP - 635
JO - Proceedings of Machine Learning Research
JF - Proceedings of Machine Learning Research
T2 - 3rd Annual Conference on Learning for Dynamics and Control, L4DC 2021
Y2 - 7 June 2021 through 8 June 2021
ER -