Market Self-Learning of Signals, Impact and Optimal Trading: Invisible Hand Inference with Free Energy (Or, How We Learned to Stop Worrying and Love Bounded Rationality)

57 Pages Posted: 26 May 2018

See all articles by Igor Halperin

Igor Halperin

Fidelity Investments, Inc.

Ilya Feldshteyn

New York University (NYU) - NYU Tandon School of Engineering

Date Written: May 7, 2018

Abstract

We present a simple model of a non-equilibrium self-organizing market where asset prices are partially driven by investment decisions of a bounded-rational agent. The agent acts in a stochastic market environment driven by various exogenous "alpha" signals, agent's own actions (via market impact), and noise. Unlike traditional agent-based models, our agent aggregates all traders in the market, rather than being a representative agent. Therefore, it can be identified with a bounded-rational component of the market itself, providing a particular implementation of an Invisible Hand market mechanism. In such setting, market dynamics are modeled as a fictitious self-play of such bounded-rational market-agent in its adversarial stochastic environment. As rewards obtained by such self-playing market agent are not observed from market data, we formulate and solve a simple model of such market dynamics based on a neuroscience-inspired Bounded Rational Information Theoretic Inverse Reinforcement Learning (BRIT-IRL). This results in effective asset price dynamics with a non-linear mean reversion - which in our model is generated dynamically, rather than being postulated. We argue that our model can be used in a similar way to the Black-Litterman model. In particular, it represents, in a simple modeling framework, market views of common predictive signals, market impacts and implied optimal dynamic portfolio allocations, and can be used to assess values of private signals. Moreover, it allows one to quantify a "market-implied" optimal investment strategy, along with a measure of market rationality.

Our approach is numerically light, and can be implemented using standard off-the-shelf software such as TensorFlow.

Keywords: Optimal trading, Reinforcement Learning, Invisible Hand, Inverse Reinforcement Learning, self-organization, non-equilibrium dynamics, mean reversion

JEL Classification: C01, C02, C22, C44, C50, C51, C57, C58, G10, G11, G12, G14

Suggested Citation

Halperin, Igor and Feldshteyn, Ilya, Market Self-Learning of Signals, Impact and Optimal Trading: Invisible Hand Inference with Free Energy (Or, How We Learned to Stop Worrying and Love Bounded Rationality) (May 7, 2018). Available at SSRN: https://ssrn.com/abstract=3174498 or http://dx.doi.org/10.2139/ssrn.3174498

Igor Halperin (Contact Author)

Fidelity Investments, Inc. ( email )

United States

Ilya Feldshteyn

New York University (NYU) - NYU Tandon School of Engineering ( email )

6 MetroTech Center
Brooklyn, NY 11201
United States

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
1,503
Abstract Views
5,034
Rank
27,239
PlumX Metrics