This paper presents a successive approximation method for solving systems of nested functional equations which arise, e.g., when considering Markov renewal programs in which policies that are maximal gain or optimal under more selective discount — and average overtaking optimality criteria are to be found. In particular, a successive approximation method is given to find the optimal bias vector and bias-optimal policies. Applications with respect to a number of additional stochastic control models are pointed out.
Our method is based on systems of simultaneously generated (single-equation) value-iteration schemes.
Federgruen, Awi, and P. J. Schweitzer. "Successive approximation methods for solving nested functional equations in Markov decision problems." Mathematics of Operations Research 9, no. 3 (August 1984): 319-344.
Each author name for a Columbia Business School faculty member is linked to a faculty research page, which lists additional publications by that faculty member.
Each topic is linked to an index of publications on that topic.