A General Theory of Markovian Time Inconsistent Stochastic Control Problems
55 Pages Posted: 20 Oct 2010
Date Written: September 17, 2010
Abstract
We develop a theory for stochastic control problems which, in various ways, are time inconsistent in the sense that they do not admit a Bellman optimality principle. We attach these problems by viewing them within a game theoretic framework, and we look for Nash subgame perfect equilibrium points. For a general controlled Markov process and a fairly general objective functional we derive an extension of the standard Hamilton-Jacobi-Bellman equation, in the form of a system of on-linear equations, for the determination for the equilibrium strategy as well as the equilibrium value function. All known examples of time inconsistency in the literature are easily seen to be special cases of the present theory. We also prove that for every time inconsistent problem, there exists an associated time consistent problem such that the optimal control and the optimal value function for the consistent problem coincides with the equilibrium control and value function respectively for the time inconsistent problem. We also study some concrete examples.
Keywords: Time consistency, time inconsistent control, dynamic programming, time inconsistency, stochastic control, hyperbolic discounting, meanvariance, Bellman equation, Hamilton-Jacobi-Bellman
Suggested Citation: Suggested Citation
Do you have a job opening that you would like to promote on SSRN?
Recommended Papers
-
Dynamic Mean-Variance Asset Allocation
By Suleyman Basak and Georgy Chabakauri
-
Dynamic Mean-Variance Asset Allocation
By Suleyman Basak and Georgy Chabakauri
-
A Geometric Approach to Multiperiod Mean Variance Optimization of Assets and Liabilities
By Markus Leippold, Paolo Vanini, ...
-
A Mean-Variance Benchmark for Intertemporal Portfolio Theory
-
Dynamic Hedging in Incomplete Markets: A Simple Solution
By Suleyman Basak and Georgy Chabakauri
-
Dynamic Hedging in Incomplete Markets: A Simple Solution
By Suleyman Basak and Georgy Chabakauri
-
Implications of Sharpe Ratio as a Performance Measure in Multi-Period Settings
By Jaksa Cvitanic, Tan Wang, ...
-
Some Solvable Portfolio Problems with Quadratic and Collective Objectives
-
Evaluating Portfolio Policies: A Duality Approach
By Martin B. Haugh, Leonid Kogan, ...