Abstract
Solving chance-constrained stochastic optimal control problems is a significant challenge in control. This is because no analytical solutions exist for up to a handful of special cases. A common and computationally efficient approach for tackling chance-constrained stochastic optimal control problems consists of a deterministic reformulation, where hard constraints with an additional constraint-tightening parameter are imposed on a nominal prediction that ignores stochastic disturbances. However, in such approaches, the choice of constraint-tightening parameter remains challenging, and guarantees can mostly be obtained assuming that the process noise distribution is known a priori. Moreover, the chance constraints are often not tightly satisfied, leading to unnecessarily high costs. This work proposes a data-driven approach for learning the constraint-tightening parameters online during control. To this end, we reformulate the choice of constraint-tightening parameter for the closed loop as a binary regression problem. We then leverage a highly expressive Gaussian process, model for binary regression to approximate the smallest constraint-tightening parameters that satisfy the chance constraints. By tuning the algorithm parameters appropriately, we show that the resulting constraint-tightening parameters satisfy the chance constraints up to an arbitrarily small margin with high probability. Our approach yields constraint-tightening parameters that tightly satisfy the chance constraints in numerical experiments, resulting in a lower average cost than three other state-of-the-art approaches.
| Original language | English |
|---|---|
| Pages (from-to) | 736-750 |
| Number of pages | 15 |
| Journal | IEEE Transactions on Automatic Control |
| Volume | 70 |
| Issue number | 2 |
| DOIs | |
| State | Published - 2025 |
Keywords
- Autonomous systems
- Gaussian processes (GPs)
- data-driven control
- machine learning
- online learning
- optimal control
- reinforcement learning
- statistical learning
- stochastic processes
- uncertain systems
Fingerprint
Dive into the research topics of 'Online Constraint Tightening in Stochastic Model Predictive Control: A Regression Approach'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver