Semiparametric Estimation of Markov Decision Processes with Continuous State Space
62 Pages Posted: 30 Nov 2010
Date Written: August 2010
Abstract
We propose a general two-step estimation method for the structural parameters of popular semiparametric Markovian discrete choice models that include a class of Markovian Games and allow for continuous observable state space. The estimation procedure is simple as it directly generalizes the computationally attractive methodology of Pesendorfer and Schmidt-Dengler (2008) that assumed finite observable states. This extension is non-trivial as the value functions, to be estimated nonparametrically in the first stage, are defined recursively in a non-linear functional equation. Utilizing structural assumptions, we show how to consistently estimate the infinite dimensional parameters as the solution to some type II integral equations, the solving of which is a well-posed problem. We provide sufficient set of primitives to obtain root-T consistent estimators for the finite dimensional structural parameters and the distribution theory for the value functions in a time series framework.
JEL Classification: C14, C32
Suggested Citation: Suggested Citation
Do you have negative results from your research you’d like to share?
Recommended Papers
-
Estimating Dynamic Models of Imperfect Competition
By Patrick Bajari, C. Lanier Benkard, ...
-
Estimating Dynamic Models of Imperfect Competition
By Patrick Bajari, C. Lanier Benkard, ...
-
Sequential Estimation of Dynamic Discrete Games
By Victor Aguirregabiria and Pedro Mira
-
By Ariel Pakes and Paul Mcguire
-
Simple Estimators for the Parameters of Discrete Dynamic Games (with Entry/Exit Examples)
By Ariel Pakes, Michael Ostrovsky, ...
-
Simple Estimators for the Parameters of Discrete Dynamic Games (with Entry/Exit Samples)
By Ariel Pakes, Michael Ostrovsky, ...
-
A Dynamic Analysis of the Market for Wide-Bodied Commercial Aircraft
-
Multiple Equilibria and Deterrence in Airline Markets
By Federico Ciliberto and Zhou Zhang
-
Computable Markov-Perfect Industry Dynamics: Existence, Purification, and Multiplicity
-
Computable Markov-Perfect Industry Dynamics: Existence, Purification, and Multiplicity