Skip to main navigation Skip to search Skip to main content

Online Constraint Tightening in Stochastic Model Predictive Control: A Regression Approach

  • Carnegie Mellon University
  • Technical University of Munich

Research output: Contribution to journalArticlepeer-review

7 Scopus citations

Abstract

Solving chance-constrained stochastic optimal control problems is a significant challenge in control. This is because no analytical solutions exist for up to a handful of special cases. A common and computationally efficient approach for tackling chance-constrained stochastic optimal control problems consists of a deterministic reformulation, where hard constraints with an additional constraint-tightening parameter are imposed on a nominal prediction that ignores stochastic disturbances. However, in such approaches, the choice of constraint-tightening parameter remains challenging, and guarantees can mostly be obtained assuming that the process noise distribution is known a priori. Moreover, the chance constraints are often not tightly satisfied, leading to unnecessarily high costs. This work proposes a data-driven approach for learning the constraint-tightening parameters online during control. To this end, we reformulate the choice of constraint-tightening parameter for the closed loop as a binary regression problem. We then leverage a highly expressive Gaussian process, model for binary regression to approximate the smallest constraint-tightening parameters that satisfy the chance constraints. By tuning the algorithm parameters appropriately, we show that the resulting constraint-tightening parameters satisfy the chance constraints up to an arbitrarily small margin with high probability. Our approach yields constraint-tightening parameters that tightly satisfy the chance constraints in numerical experiments, resulting in a lower average cost than three other state-of-the-art approaches.

Original languageEnglish
Pages (from-to)736-750
Number of pages15
JournalIEEE Transactions on Automatic Control
Volume70
Issue number2
DOIs
StatePublished - 2025

Keywords

  • Autonomous systems
  • Gaussian processes (GPs)
  • data-driven control
  • machine learning
  • online learning
  • optimal control
  • reinforcement learning
  • statistical learning
  • stochastic processes
  • uncertain systems

Fingerprint

Dive into the research topics of 'Online Constraint Tightening in Stochastic Model Predictive Control: A Regression Approach'. Together they form a unique fingerprint.

Cite this