Massively Parallel Sequential Monte Carlo for Bayesian Inference

58 Pages Posted: 25 Nov 2011

See all articles by John Geweke

John Geweke

University of Technology Sydney - Economics Discipline Group

Garland Durham

Quantos Analytics

Date Written: November 14, 2011


his paper reconsiders sequential Monte Carlo approaches to Bayesian inference in the light of massively parallel desktop computing capabilities now well within the reach of individual academics. It first develops an algorithm that is well suited to parallel computing in general and for which convergence results have been established in the sequential Monte Carlo literature but that tends to require manual tuning in practical application. It then introduces endogenous adaptations in the algorithm that obviate the need for tuning, using a new approach based on the structure of parallel computing to show that convergence properties are preserved and to provide reliable assessment of simulation error in the approximation of posterior moments. The algorithm is generic, requiring only code for simulation from the prior distribution and evaluation of the prior and data densities, thereby shortening development cycles for new models. Through its use of data point tempering it is robust to irregular posteriors, including multimodal distributions. The sequential structure of the algorithm leads to reliable and generic computation of marginal likelihood as a by-product. The paper includes three detailed examples taken from state-of-the-art substantive research applications. These examples illustrate the many desirable properties of the algorithm. and demonstrate that it can reduce computing time by several orders of magnitude.

Keywords: graphics processing unit, particle filter, posterior simulation, single instruction multiple data

Suggested Citation

Geweke, John and Durham, Garland, Massively Parallel Sequential Monte Carlo for Bayesian Inference (November 14, 2011). Available at SSRN: or

John Geweke (Contact Author)

University of Technology Sydney - Economics Discipline Group ( email )

645 Harris Street
Sydney, NSW 2007
0295149797 (Phone)


Garland Durham

Quantos Analytics ( email )

Louisville, CO 80027
United States


Here is the Coronavirus
related research on SSRN

Paper statistics

Abstract Views
PlumX Metrics