Efficient MCMC Schemes for Robust Model Extensions using Encompassing Dirichlet Process Mixture Models

Steven MacEachern and Peter Mueller

October 1999

The manuscript is available in postscript and pdf format.

We propose that one consider sensitivity analysis by embedding standard parametric models in model extensions defined by replacing a parametric probability model with a nonparametric extension. The nonparametric model could replace the entire probability model, or some level of a hierarchical model. Specifically, we define nonparametric extensions of a parametric probability model using Dirichlet process (DP) priors. Similar approaches have been used in the literature to implement formal model fit diagnostics (Carota, Parmigiani and Polson, 1996). In this paper we discuss at an operational level how such extensions can be implemented. Assuming that inference in the original parametric model is implemented by Markov chain Monte Carlo (MCMC) simulation, we show how minimal additional code can turn the same program into an implementation of MCMC in the larger encompassing model, allowing formal sensitivity analysis with respect to prior and likelihood assumptions. If the base measure of the DP is assumed conjugate to the appropriate component of the original probablity model, then implementation is straightforward. The main focus of this paper is to discuss general strategies allowing implementation of models without this conjugacy.