Selected Topics on Continuous-time Controlled Markov Chains and Markov Games

Selected Topics on Continuous-time Controlled Markov Chains and Markov Games
Author :
Publisher : World Scientific
Total Pages : 292
Release :
ISBN-10 : 9781848168497
ISBN-13 : 1848168497
Rating : 4/5 (97 Downloads)

Book Synopsis Selected Topics on Continuous-time Controlled Markov Chains and Markov Games by : Tomas Prieto-Rumeau

Download or read book Selected Topics on Continuous-time Controlled Markov Chains and Markov Games written by Tomas Prieto-Rumeau and published by World Scientific. This book was released on 2012 with total page 292 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book concerns continuous-time controlled Markov chains, also known as continuous-time Markov decision processes. They form a class of stochastic control problems in which a single decision-maker wishes to optimize a given objective function. This book is also concerned with Markov games, where two decision-makers (or players) try to optimize their own objective function. Both decision-making processes appear in a large number of applications in economics, operations research, engineering, and computer science, among other areas. An extensive, self-contained, up-to-date analysis of basic optimality criteria (such as discounted and average reward), and advanced optimality criteria (e.g., bias, overtaking, sensitive discount, and Blackwell optimality) is presented. A particular emphasis is made on the application of the results herein: algorithmic and computational issues are discussed, and applications to population models and epidemic processes are shown. This book is addressed to students and researchers in the fields of stochastic control and stochastic games. Moreover, it could be of interest also to undergraduate and beginning graduate students because the reader is not supposed to have a high mathematical background: a working knowledge of calculus, linear algebra, probability, and continuous-time Markov chains should suffice to understand the contents of the book.


Selected Topics on Continuous-time Controlled Markov Chains and Markov Games Related Books

Chains of Time
Language: en
Pages: 319
Authors: R. B. Woodstone
Categories: Young Adult Fiction
Type: BOOK - Published: 2020-07-05 - Publisher:

DOWNLOAD EBOOK

Across race and time, a magical battle for freedom... 1859 Mkembro, West Africa "I know what's going to happen," says Amara as she wakes on the morning of her w
Dragon in Chains
Language: en
Pages: 418
Authors: Daniel Fox
Categories: Fiction
Type: BOOK - Published: 2009-01-27 - Publisher: Del Rey

DOWNLOAD EBOOK

From award-winning author Daniel Fox comes a ravishingly written epic of revolution and romance set in a world where magic is found in stone and in water, in dr
Selected Topics on Continuous-time Controlled Markov Chains and Markov Games
Language: en
Pages: 292
Authors: Tomas Prieto-Rumeau
Categories: Mathematics
Type: BOOK - Published: 2012 - Publisher: World Scientific

DOWNLOAD EBOOK

This book concerns continuous-time controlled Markov chains, also known as continuous-time Markov decision processes. They form a class of stochastic control pr
Probability, Markov Chains, Queues, and Simulation
Language: en
Pages: 778
Authors: William J. Stewart
Categories: Computers
Type: BOOK - Published: 2009-07-26 - Publisher: Princeton University Press

DOWNLOAD EBOOK

Probability, Markov Chains, Queues, and Simulation provides a modern and authoritative treatment of the mathematical processes that underlie performance modelin
Discrete-Time Markov Chains
Language: en
Pages: 354
Authors: G. George Yin
Categories: Mathematics
Type: BOOK - Published: 2005-10-04 - Publisher: Springer Science & Business Media

DOWNLOAD EBOOK

This book focuses on two-time-scale Markov chains in discrete time. Our motivation stems from existing and emerging applications in optimization and control of