BACK to VOLUME 40 NO.6

Kybernetika 40(6):681-690, 2004.

Approximation and Estimation in Markov Control Processes Under a Discounted Criterion

J. Adolfo Minjárez-Sosa


Abstract:

We consider a class of discrete-time Markov control processes with Borel state and action spaces, and $\Re^{k}$-valued i.i.d. disturbances with unknown density $\rho.$ Supposing possibly unbounded costs, we combine suitable density estimation methods of $\rho$ with approximation procedures of the optimal cost function, to show the existence of a sequence $\{\hat{f}_{t}\}$ of minimizers converging to an optimal stationary policy $f_{\infty}.$


Keywords: Markov control processes; density estimation; discounted cost criterion;


AMS: 93E10; 90C40;


download abstract.pdf


BIB TeX

@article{kyb:2004:6:681-690,

author = {Minj\'{a}rez-Sosa, J. Adolfo},

title = {Approximation and Estimation in Markov Control Processes Under a Discounted Criterion },

journal = {Kybernetika},

volume = {40},

year = {2004},

number = {6},

pages = {681-690}

publisher = {{\'U}TIA, AV {\v C}R, Prague },

}


BACK to VOLUME 40 NO.6