The Calibration of Probabilistic Economic Forecasts
31 Pages Posted: 20 Jan 2009
Date Written: November 1, 2008
Abstract
A probabilistic forecast is the estimated probability with which a future event will satisfy a specified criterion. One interesting feature of such forecasts is their calibration, or the match between predicted probabilities and actual outcome probabilities. Calibration has been evaluated in the past by grouping probability forecasts into discrete categories. Here we show that we can do so without discrete groupings; the kernel estimators that we use produce efficiency gains and smooth estimated curves relating predicted and actual probabilities. We use such estimates to evaluate the empirical evidence on calibration error in a number of economic applications including recession and inflation prediction, using both forecasts made and stored in real time and pseudoforecasts made using the data vintage available at the forecast date. We evaluate outcomes using both first-release outcome measures as well as later, thoroughly-revised data. We find strong evidence of incorrect calibration in professional forecasts of recessions and inflation. We also present evidence of asymmetries in the performance of inflation forecasts based on real-time output gaps.
Keywords: calibration, probability forecast, real-time data, inflation, recession
Suggested Citation: Suggested Citation
Do you have a job opening that you would like to promote on SSRN?
Recommended Papers
-
Why Has U.S. Inflation Become Harder to Forecast?
By James H. Stock and Mark W. Watson
-
The Reliability of Inflation Forecasts Based on Output Gap Estimates in Real Time
-
The Reliability of Inflation Forecasts Based on Output Gap Estimates in Real Time
-
Phillips Curve Inflation Forecasts
By James H. Stock and Mark W. Watson
-
Has Output Become More Predictable? Changes in Greenbook Forecast Accuracy
By Peter Tulip
-
Estimating the Implicit Inflation Target: An Application to U.S. Monetary Policy
By Daniel Leigh
-
Measuring Inflation Persistence: A Structural Time Series Approach
By Gerdie Everaert and Maarten Dossche
-
Measuring Inflation Persistence: A Structural Time Series Approach
By Maarten Dossche and Gerdie Everaert
-
How Accurate are Real-Time Estimates of Output Trends and Gaps?