A new variable importance measure for random forests with missing data

Alexander Hapfelmeier, Torsten Hothorn, Kurt Ulm, Carolin Strobl

Research output: Contribution to journalArticlepeer-review

151 Scopus citations

Abstract

Random forests are widely used in many research fields for prediction and interpretation purposes. Their popularity is rooted in several appealing characteristics, such as their ability to deal with high dimensional data, complex interactions and correlations between variables. Another important feature is that random forests provide variable importance measures that can be used to identify the most important predictor variables. Though there are alternatives like complete case analysis and imputation, existing methods for the computation of such measures cannot be applied straightforward when the data contains missing values. This paper presents a solution to this pitfall by introducing a new variable importance measure that is applicable to any kind of data-whether it does or does not contain missing values. An extensive simulation study shows that the new measure meets sensible requirements and shows good variable ranking properties. An application to two real data sets also indicates that the new approach may provide a more sensible variable ranking than the widespread complete case analysis. It takes the occurrence of missing values into account which makes results also differ from those obtained under multiple imputation.

Original languageEnglish
Pages (from-to)21-34
Number of pages14
JournalStatistics and Computing
Volume24
Issue number1
DOIs
StatePublished - Jan 2014

Keywords

  • Missing data
  • Missing values
  • Permutation importance
  • Random forests
  • Variable importance measures

Fingerprint

Dive into the research topics of 'A new variable importance measure for random forests with missing data'. Together they form a unique fingerprint.

Cite this