Description : The intent of this book is to present recent results in the control theory for the long run average continuous control problem of piecewise deterministic Markov processes (PDMPs). The book focuses mainly on the long run average cost criteria and extends to the PDMPs some well-known techniques related to discrete-time and continuous-time Markov decision processes, including the so-called ``average inequality approach'', ``vanishing discount technique'' and ``policy iteration algorithm''. We believe that what is unique about our approach is that, by using the special features of the PDMPs, we trace a parallel with the general theory for discrete-time Markov Decision Processes rather than the continuous-time case. The two main reasons for doing that is to use the powerful tools developed in the discrete-time framework and to avoid working with the infinitesimal generator associated to a PDMP, which in most cases has its domain of definition difficult to be characterized. Although the book is mainly intended to be a theoretically oriented text, it also contains some motivational examples. The book is targeted primarily for advanced students and practitioners of control theory. The book will be a valuable source for experts in the field of Markov decision processes. Moreover, the book should be suitable for certain advanced courses or seminars. As background, one needs an acquaintance with the theory of Markov decision processes and some knowledge of stochastic processes and modern analysis.
Description : This Festschrift is dedicated to Robert J Elliott on the occasion of his 70th birthday It brings together a collection of chapters by distinguished and eminent scholars in the fields of stochastic processes, filtering and control, as well as their applications to mathematical finance It presents cutting edge developments in these fields and is a valuable source of references for researchers, graduate students and market practitioners in mathematical finance and financial engineering Topics include the theory of stochastic processes, differential and stochastic games, mathematical finance, filtering and control.
Description : This book consists of a series of new, peer-reviewed papers in stochastic processes, analysis, filtering and control, with particular emphasis on mathematical finance, actuarial science and engineering. Paper contributors include colleagues, collaborators and former students of Robert Elliott, many of whom are world-leading experts and have made fundamental and significant contributions to these areas. This book provides new important insights and results by eminent researchers in the considered areas, which will be of interest to researchers and practitioners. The topics considered will be diverse in applications, and will provide contemporary approaches to the problems considered. The areas considered are rapidly evolving. This volume will contribute to their development, and present the current state-of-the-art stochastic processes, analysis, filtering and control. Contributing authors include: H Albrecher, T Bielecki, F Dufour, M Jeanblanc, I Karatzas, H-H Kuo, A Melnikov, E Platen, G Yin, Q Zhang, C Chiarella, W Fleming, D Madan, R Mamon, J Yan, V Krishnamurthy. Contents:Stochastic Analysis:On the Connection Between Discrete and Continuous Wick Calculus with an Application to the Fractional Black-Scholes Model (C Bender and P Parczewski)Malliavin Differentiability of a Class of Feller-Diffusions with Relevance in Finance (C-O Ewald, Y Xiao, Y Zou and T K Siu)A Stochastic Integral for Adapted and Instantly Independent Stochastic Processes (H-H Kuo, A Sae-Tang and B Szozda)Independence of Some Multiple Poisson Stochastic Integrals with Variable-Sign Kernels (N Privault)Differential and Stochastic Games:Strategies for Differential Games (W H Fleming and D Hernández-Hernández)BSDE Approach to Non-Zero-Sum Stochastic Differential Games of Control and Stopping (I Karatzas and Q Li)Mathematical Finance:On Optimal Dividend Strategies in Insurance with a Random Time Horizon (H Albrecher and S Thonhauser)Counterparty Risk and the Impact of Collateralization in CDS Contracts (T R Bielecki, I Cialenco and I Iyigunler)A Modern View on Merton's Jump-Diffusion Model (G H L Cheang and C Chiarella)Hedging Portfolio Loss Derivatives with CDS's (A Cousin and M Jeanblanc)New Analytic Approximations for Pricing Spread Options (J van der Hoek and M W Korolkiewicz)On the Polynomial–Normal Model and Option Pricing (H Li and A Melnikov)A Functional Transformation Approach to Interest Rate Modelling(S Luo, J Yan and Q Zhang)S&P 500 Index Option Surface Drivers and Their Risk Neutral and Real World Quadratic Covariations (D B Madan)A Dynamic Portfolio Approach to Asset Markets and Monetary Policy (E Platen and W Semmler)Mean-Variance Portfolio Selection Under Regime-Switching Diffusion Asset Models: A Two-Time-Scale Limit (G Yin and Y Talafha)Filtering and Control:Existence and Uniqueness of Solutions for a Partially Observed Stochastic Control Problem (A Bensoussan, M Çakanyildirim, M Li and S P Sethi)Continuous Control of Piecewise Deterministic Markov Processes with Long Run Average Cost (O L V Costa and F Dufour)Stochastic Linear-Quadratic Control Revisited (T E Duncan)Optimization of Stochastic Uncertain Systems: Entropy Rate Functionals, Minimax Games and Robustness (F Rezaei, C D Charalambous and N U Ahmed)Gradient Based Policy Optimization of Constrained Markov Decision Processes (V Krishnamurthy and F J Vázquez Abad)Parameter Estimation of a Regime-Switching Model Using an Inverse Stieltjes Moment Approach (X Xi, M R Rodrigo and R S Mamon)An Optimal Inventory-Price Coordination Policy (H Zhang and Q Zhang) Readership: Researchers and professionals in stochastic processes, analysis, filtering and control. Keywords:Stochastic Processes;Filtering;Stochastic Control;Stochastic Analysis;Mathematical Finance;Actuarial Sciences;EngineeringKey Features:This is a festschrift of Professor Robert J Elliott, who is a world leader in the areas of stochastic processes, filtering, control as well as their applicationsIncludes contributions of many world-leading scholars in the fieldsContain many original and fundamental results in the fields rare in competing titles
Description : Mark H.A. Davis introduced the Piecewise-Deterministic Markov Process (PDMP) class of stochastic hybrid models in an article in 1984. Today it is used to model a variety of complex systems in the fields of engineering, economics, management sciences, biology, Internet traffic, networks and many more. Yet, despite this, there is very little in the way of literature devoted to the development of numerical methods for PDMDs to solve problems of practical importance, or the computational control of PDMPs. This book therefore presents a collection of mathematical tools that have been recently developed to tackle such problems. It begins by doing so through examples in several application domains such as reliability. The second part is devoted to the study and simulation of expectations of functionals of PDMPs. Finally, the third part introduces the development of numerical techniques for optimal control problems such as stopping and impulse control problems.
Description : Piecewise-deterministic Markov processes form a class of stochastic models with a sizeable scope of applications: biology, insurance, neuroscience, networks, finance... Such processes are defined by a deterministic motion punctuated by random jumps at random times, and offer simple yet challenging models to study. Nevertheless, the issue of statistical estimation of the parameters ruling the jump mechanism is far from trivial. Responding to new developments in the field as well as to current research interests and needs, Statistical inference for piecewise-deterministic Markov processes offers a detailed and comprehensive survey of state-of-the-art results. It covers a wide range of general processes as well as applied models. The present book also dwells on statistics in the context of Markov chains, since piecewise-deterministic Markov processes are characterized by an embedded Markov chain corresponding to the position of the process right after the jumps.
Description : This sequel to volume 19 of Handbook on Statistics on Stochastic Processes: Modelling and Simulation is concerned mainly with the theme of reviewing and, in some cases, unifying with new ideas the different lines of research and developments in stochastic processes of applied flavour. This volume consists of 23 chapters addressing various topics in stochastic processes. These include, among others, those on manufacturing systems, random graphs, reliability, epidemic modelling, self-similar processes, empirical processes, time series models, extreme value therapy, applications of Markov chains, modelling with Monte Carlo techniques, and stochastic processes in subjects such as engineering, telecommunications, biology, astronomy and chemistry. particular with modelling, simulation techniques and numerical methods concerned with stochastic processes. The scope of the project involving this volume as well as volume 19 is already clarified in the preface of volume 19. The present volume completes the aim of the project and should serve as an aid to students, teachers, researchers and practitioners interested in applied stochastic processes.
Description : In this volume, leading experts in mathematical manufacturing research and related fields review and update recent advances of mathematics in stochastic manufacturing systems and attempt to bridge the gap between theory and applications. The topics covered include scheduling and production planning, modeling of manufacturing systems, hierarchical control for large and complex systems, Markov chains, queueing networks, numerical methods for system approximations, singular perturbed systems, risk-sensitive control, stochastic optimization methods, discrete event systems, and statistical quality control.