Bilevel optimization for feature selection in the data-driven newsvendor problem

Breno Serrano, Stefan Minner, Maximilian Schiffer, Thibaut Vidal

Research output: Contribution to journalArticlepeer-review

1 Scopus citations

Abstract

We study the feature-based newsvendor problem, in which a decision-maker has access to historical data consisting of demand observations and exogenous features. In this setting, we investigate feature selection, aiming to derive sparse, explainable models with improved out-of-sample performance. Up to now, state-of-the-art methods utilize regularization, which penalizes the number of selected features or the norm of the solution vector. As an alternative, we introduce a novel bilevel programming formulation. The upper-level problem selects a subset of features that minimizes an estimate of the out-of-sample cost of ordering decisions based on a held-out validation set. The lower-level problem learns the optimal coefficients of the decision function on a training set, using only the features selected by the upper-level. We present a mixed integer linear program reformulation for the bilevel program, which can be solved to optimality with standard optimization solvers. Our computational experiments show that the method accurately recovers ground-truth features already for instances with a sample size of a few hundred observations. In contrast, regularization-based techniques often fail at feature recovery or require thousands of observations to obtain similar accuracy. Regarding out-of-sample generalization, we achieve improved or comparable cost performance.

Original languageEnglish
Pages (from-to)703-714
Number of pages12
JournalEuropean Journal of Operational Research
Volume315
Issue number2
DOIs
StatePublished - 1 Jun 2024

Keywords

  • Bilevel optimization
  • Feature selection
  • Mixed integer programming
  • Newsvendor

Fingerprint

Dive into the research topics of 'Bilevel optimization for feature selection in the data-driven newsvendor problem'. Together they form a unique fingerprint.

Cite this