Relative Optimization of Continuous-Time and Continuous-State Stochastic Systems

Relative Optimization of Continuous-Time and Continuous-State Stochastic Systems
Author :
Publisher : Springer Nature
Total Pages : 376
Release :
ISBN-10 : 9783030418465
ISBN-13 : 3030418464
Rating : 4/5 (65 Downloads)

Book Synopsis Relative Optimization of Continuous-Time and Continuous-State Stochastic Systems by : Xi-Ren Cao

Download or read book Relative Optimization of Continuous-Time and Continuous-State Stochastic Systems written by Xi-Ren Cao and published by Springer Nature. This book was released on 2020-05-13 with total page 376 pages. Available in PDF, EPUB and Kindle. Book excerpt: This monograph applies the relative optimization approach to time nonhomogeneous continuous-time and continuous-state dynamic systems. The approach is intuitively clear and does not require deep knowledge of the mathematics of partial differential equations. The topics covered have the following distinguishing features: long-run average with no under-selectivity, non-smooth value functions with no viscosity solutions, diffusion processes with degenerate points, multi-class optimization with state classification, and optimization with no dynamic programming. The book begins with an introduction to relative optimization, including a comparison with the traditional approach of dynamic programming. The text then studies the Markov process, focusing on infinite-horizon optimization problems, and moves on to discuss optimal control of diffusion processes with semi-smooth value functions and degenerate points, and optimization of multi-dimensional diffusion processes. The book concludes with a brief overview of performance derivative-based optimization. Among the more important novel considerations presented are: the extension of the Hamilton–Jacobi–Bellman optimality condition from smooth to semi-smooth value functions by derivation of explicit optimality conditions at semi-smooth points and application of this result to degenerate and reflected processes; proof of semi-smoothness of the value function at degenerate points; attention to the under-selectivity issue for the long-run average and bias optimality; discussion of state classification for time nonhomogeneous continuous processes and multi-class optimization; and development of the multi-dimensional Tanaka formula for semi-smooth functions and application of this formula to stochastic control of multi-dimensional systems with degenerate points. The book will be of interest to researchers and students in the field of stochastic control and performance optimization alike.


Relative Optimization of Continuous-Time and Continuous-State Stochastic Systems Related Books

Relative Optimization of Continuous-Time and Continuous-State Stochastic Systems
Language: en
Pages: 376
Authors: Xi-Ren Cao
Categories: Technology & Engineering
Type: BOOK - Published: 2020-05-13 - Publisher: Springer Nature

DOWNLOAD EBOOK

This monograph applies the relative optimization approach to time nonhomogeneous continuous-time and continuous-state dynamic systems. The approach is intuitive
Foundations of Average-Cost Nonhomogeneous Controlled Markov Chains
Language: en
Pages: 128
Authors: Xi-Ren Cao
Categories: Technology & Engineering
Type: BOOK - Published: 2020-09-09 - Publisher: Springer Nature

DOWNLOAD EBOOK

This Springer brief addresses the challenges encountered in the study of the optimization of time-nonhomogeneous Markov chains. It develops new insights and new
Stochastic Models in Reliability, Network Security and System Safety
Language: en
Pages: 515
Authors: Quan-Lin Li
Categories: Computers
Type: BOOK - Published: 2019-10-21 - Publisher: Springer Nature

DOWNLOAD EBOOK

This book is dedicated to Jinhua Cao on the occasion of his 80th birthday. Jinhua Cao is one of the most famous reliability theorists. His main contributions in
Continuous-Time Markov Decision Processes
Language: en
Pages: 240
Authors: Xianping Guo
Categories: Mathematics
Type: BOOK - Published: 2009-09-18 - Publisher: Springer Science & Business Media

DOWNLOAD EBOOK

Continuous-time Markov decision processes (MDPs), also known as controlled Markov chains, are used for modeling decision-making problems that arise in operation
Numerical Methods for Stochastic Control Problems in Continuous Time
Language: en
Pages: 480
Authors: Harold Kushner
Categories: Mathematics
Type: BOOK - Published: 2013-11-27 - Publisher: Springer Science & Business Media

DOWNLOAD EBOOK

Stochastic control is a very active area of research. This monograph, written by two leading authorities in the field, has been updated to reflect the latest de