Partially Observed Markov Decision Processes with Binomial Observations

Operations Research Letters 41 (2013) 201–206

6 Pages Posted: 15 Feb 2014

See all articles by Tal Ben-Zvi

Tal Ben-Zvi

Stevens Institute of Technology

Abraham Grosfeld-Nir

Academic College of Tel-Aviv Yafo

Date Written: February 14, 2014

Abstract

We consider partially observed Markov decision processes with control limits. We analytically show how the finite-horizon control limits are non-monotonic in (a) the time remaining and (b) the probability of obtaining a conforming unit. We also prove that the infinite-horizon control limit can be calculated by solving a finite set of linear equations.

Keywords: POMDP, Binomial yield, Control limit

Suggested Citation

Ben-Zvi, Tal and Grosfeld-Nir, Abraham, Partially Observed Markov Decision Processes with Binomial Observations (February 14, 2014). Operations Research Letters 41 (2013) 201–206. Available at SSRN: https://ssrn.com/abstract=2396052

Tal Ben-Zvi (Contact Author)

Stevens Institute of Technology ( email )

Hoboken, NJ 07030
United States

Abraham Grosfeld-Nir

Academic College of Tel-Aviv Yafo ( email )

29 Melchet
Tel-Aviv, 61560
Israel

Here is the Coronavirus
related research on SSRN

Paper statistics

Downloads
35
Abstract Views
393
PlumX Metrics