A Bayesian Analysis of Linear Regression Models with Highly Collinear Regressors

30 Pages Posted: 11 Oct 2018

See all articles by M. Hashem Pesaran

M. Hashem Pesaran

University of Southern California - Department of Economics; University of Cambridge - Trinity College (Cambridge)

Ron Smith

Birkbeck College

Date Written: October 6, 2018


Exact collinearity between regressors makes their individual coefficients not identified. But, given an informative prior, their Bayesian posterior means are well defined. Just as exact collinearity causes non-identification of the parameters, high collinearity can be viewed as weak identification of the parameters, which is represented, in line with the weak instrument literature, by the correlation matrix being of full rank for a finite sample size T, but converging to a rank deficient matrix as T goes to infinity. The asymptotic behaviour of the posterior mean and precision of the parameters of a linear regression model are examined in the cases of exactly and highly collinear regressors. In both cases the posterior mean remains sensitive to the choice of prior means even if the sample size is sufficiently large, and that the precision rises at a slower rate than the sample size. In the highly collinear case, the posterior means converge to normally distributed random variables whose mean and variance depend on the prior means and prior precisions. The distribution degenerates to fixed points for either exact collinearity or strong identification. The analysis also suggests a diagnostic statistic for the highly collinear case. Monte Carlo simulations and an empirical example are used to illustrate the main findings.

A previous version of this paper can be found at: http://ssrn.com/abstract=3076052

Keywords: Bayesian Identification, Multicollinear Regressions, Weakly Identified Regression Coefficients, Highly Collinear Regressors.

JEL Classification: C11, C18

Suggested Citation

Pesaran, M. Hashem and Smith, Ron P., A Bayesian Analysis of Linear Regression Models with Highly Collinear Regressors (October 6, 2018). USC-INET Research Paper No. 18-17 (Revised), Available at SSRN: https://ssrn.com/abstract=3264842 or http://dx.doi.org/10.2139/ssrn.3264842

M. Hashem Pesaran (Contact Author)

University of Southern California - Department of Economics

3620 South Vermont Ave. Kaprielian (KAP) Hall 300
Los Angeles, CA 90089
United States

University of Cambridge - Trinity College (Cambridge) ( email )

United Kingdom

Ron P. Smith

Birkbeck College ( email )

Malet Street
London WC1E 7HX
United Kingdom
+44 207 631 6413 (Phone)
+44 207 631 6416 (Fax)

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Abstract Views
PlumX Metrics