Exploration and Exploitation: An Essay on (Machine) Learning, Algorithms, and Information Provision

42 Pages Posted: 16 Dec 2015 Last revised: 7 Apr 2016

See all articles by Deven R. Desai

Deven R. Desai

Georgia Institute of Technology - Scheller College of Business

Date Written: December 15, 2015

Abstract

Legal and regulatory understandings of information provision miss the importance of the exploration-exploitation dynamic. This Essay argues that is a mistake and seeks to bring this perspective to the debate about information provision and competition. A general, ongoing problem for an individual or an organization is whether to stay with a familiar solution to a problem or try new options that may yield better results. Work in organizational learning describes this problem as the exploration-exploitation dilemma. Understanding and addressing that dilemma has become a key part of an algorithmic approach to computation, machine learning, as it is applied to information provision. In simplest terms, even if one achieves success with one path, failure to try new options means one will be stuck in a local equilibrium while others find paths that yield better results and displace one’s original success. This dynamic indicates that an information provider has to provide new options and information to users, because a provider must learn and adapt to users’ changing interests in both the type of information they desire and how they wish to interact with information. Put differently, persistent concerns about the way in which news reaches users (the so-called “filter bubble” concern) and the way in which online shopping information is found (a competition concern) can be understood as market failures regarding information provision. The desire seems to be to ensure that new information reaches people, because that increases the potential for new ideas, new choices, and new action. Although these desired outcomes are good, current criticisms and related potential solutions misunderstand the nature of information users and especially information provision, and miss an important point. Both information users and providers sort and filter as a way to enable better learning, and learning is an ongoing process that requires continual changes to succeed. From an exploration- exploitation perspective, a user or an incumbent may remain isolated or offer the same information provision but neither will learn. In that case, whatever short-term success either enjoys is likely to face leapfrogging by those who experiment through exploration and exploitation.

Keywords: machine learnng, filter bubble, exploration, exploitation, competition, net neutrality, information cascades, herding, information provision, search, social media, competition, news, media, echo chamber

JEL Classification: K21, D83, D89, L99, C45

Suggested Citation

Desai, Deven R., Exploration and Exploitation: An Essay on (Machine) Learning, Algorithms, and Information Provision (December 15, 2015). 47 Loyola University Chicago Law Journal, 541 (2015); Georgia Tech Scheller College of Business Research Paper No. WP44. Available at SSRN: https://ssrn.com/abstract=2704406

Deven R. Desai (Contact Author)

Georgia Institute of Technology - Scheller College of Business ( email )

800 West Peachtree St.
Atlanta, GA 30308
United States

HOME PAGE: http://scheller.gatech.edu/directory/faculty/desai/index.html

Register to save articles to
your library

Register

Paper statistics

Downloads
182
rank
158,430
Abstract Views
1,211
PlumX Metrics