Online Constraint Tightening in Stochastic Model Predictive Control: A Regression Approach

Alexandre Capone, Tim Brdigam, Sandra Hirche

Research output: Contribution to journalArticlepeer-review

1 Scopus citations

Abstract

Solving chance-constrained stochastic optimal control problems is a significant challenge in control. This is because no analytical solutions exist for up to a handful of special cases. A common and computationally efficient approach for tackling chance-constrained stochastic optimal control problems consists of a deterministic reformulation, where hard constraints with an additional constraint-tightening parameter are imposed on a nominal prediction that ignores stochastic disturbances. However, in such approaches, the choice of constraint-tightening parameter remains challenging, and guarantees can mostly be obtained assuming that the process noise distribution is known a priori. Moreover, the chance constraints are often not tightly satisfied, leading to unnecessarily hi gh costs. This work proposes a data-driven approach for learning the constraint-tightening parameters online during control. To this end, we reformulate the choice of constraint-tightening parameter for the closed-loop as a binary regression problem. We then leverage a highly expressive (gp) model for binary regression to approximate the smallest constraint-tightening parameters that satisfy the chance constraints. By tuning the algorithm parameters appropriately, we show that the resulting constraint-tightening parameters satisfy the chance constraints up to an arbitrarily small margin with high probability. Our approach yields constraint-tightening parameters that tightly satisfy the chance constraints in numerical experiments, resulting in a lower average cost than three other state-of-the-art approaches.

Original languageEnglish
Pages (from-to)1-15
Number of pages15
JournalIEEE Transactions on Automatic Control
DOIs
StateAccepted/In press - 2024

Keywords

  • Autonomous systems
  • Closed loop systems
  • Computational modeling
  • Costs
  • data-driven control
  • machine learning
  • online learning
  • Optimal control
  • optimal control
  • reinforcement learning
  • statistical learning
  • stochastic processes
  • Stochastic processes
  • Symbols
  • uncertain systems,
  • Uncertainty

Fingerprint

Dive into the research topics of 'Online Constraint Tightening in Stochastic Model Predictive Control: A Regression Approach'. Together they form a unique fingerprint.

Cite this