Abstract
We introduce a natural conjugate prior for the transition matrix of a reversible Markov chain. This allows estimation and testing. The prior arises from random walk with reinforcement in the same way the Dirichlet prior arises from Pólya's urn. We give closed form normalizing constants, a simple method of simulation from the posterior and a characterization along the lines of W. E. Johnson's characterization of the Dirichlet prior.
Original language | English |
---|---|
Pages (from-to) | 1270-1292 |
Number of pages | 23 |
Journal | Annals of Statistics |
Volume | 34 |
Issue number | 3 |
DOIs | |
State | Published - Jun 2006 |
Externally published | Yes |
Keywords
- Bayesian analysis
- Conjugate priors
- Hypothesis testing
- Reversible Markov chains