Skip to main navigation Skip to search Skip to main content

Computing maximum likelihood estimates in recursive linear models with correlated errors

  • University of Chicago
  • Maastricht University School of Business and Economics
  • University of Washington

Research output: Contribution to journalArticlepeer-review

51 Scopus citations

Abstract

In recursive linear models, the multivariate normal joint distribution of all variables exhibits a dependence structure induced by a recursive (or acyclic) system of linear structural equations. These linear models have a long tradition and appear in seemingly unrelated regressions, structural equation modelling, and approaches to causal inference. They are also related to Gaussian graphical models via a classical representation known as a path diagram. Despite the models' long history, a number of problems remain open. In this paper, we address the problem of computing maximum likelihood estimates in the subclass of 'bow-free' recursive linear models. The term 'bow-free' refers to the condition that the errors for variables i and j be uncorrected if variable i occurs in the structural equation for variable j. We introduce a new algorithm, termed Residual Iterative Conditional Fitting (RICF), that can be implemented using only least squares computations. In contrast to existing algorithms, RICF has clear convergence properties and yields exact maximum likelihood estimates after the first iteration whenever the MLE is available in closed form.

Original languageEnglish
Pages (from-to)2329-2348
Number of pages20
JournalJournal of Machine Learning Research
Volume10
StatePublished - 2009
Externally publishedYes

Keywords

  • Linear regression
  • Maximum likelihood estimation
  • Path diagram
  • Recursive semi-markov model
  • Residual iterative conditional fitting
  • Structural equation model

Fingerprint

Dive into the research topics of 'Computing maximum likelihood estimates in recursive linear models with correlated errors'. Together they form a unique fingerprint.

Cite this