Description : Markov process theory is basically an extension of ordinary calculus to accommodate functions whos time evolutions are not entirely deterministic. It is a subject that is becoming increasingly important for many fields of science. This book develops the single-variable theory of both continuous and jump Markov processes in a way that should appeal especially to physicists and chemists at the senior and graduate level. A self-contained, prgamatic exposition of the needed elements of random variable theory Logically integrated derviations of the Chapman-Kolmogorov equation, the Kramers-Moyal equations, the Fokker-Planck equations, the Langevin equation, the master equations, and the moment equations Detailed exposition of Monte Carlo simulation methods, with plots of many numerical examples Clear treatments of first passages, first exits, and stable state fluctuations and transitions Carefully drawn applications to Brownian motion, molecular diffusion, and chemical kinetics
Description : Recursive Estimation and Control for Stochastic Systems Han-Fu Chen This self-contained volume presents both the discrete-time and continuous-time systems, and incorporates not only well-known results in these fields but also many of the latest research findings. It shows how to analyze the convergence of recursive estimates through a combination of the probabilistic and ordinary differential equation methods and establishes the connection between the Gauss-Markov estimate and the Kalman filter through stochastic observability, and more. 1985 (0 471-81566-7) 378 pp. Nonparametric Density Estimation The L1 View Luc Devroye and Laszlo Gyorfi The first systematic, single-source examination that develops from first principles the "natural" theory for density estimation and shows why the classical L2 theory masks some fundamental properties of density estimates. Linking different subareas of statistics, including simulation, pattern recognition, detection theory, and minimax theory, it shows how to construct, use, and analyze density estimates. Relevant recent literature is tied in with the classical works of Parzen, Rosenblatt, and others. 1985 (0 471-81646-9) 368 pp. Elements of Applied Stochastic Processes Second Edition U. Narayan Bhat An applied introduction to stochastic models, this expanded and revised account develops basic concepts and techniques and applies them to problems arising in queueing, reliability, inventory and computer communications, social and behavioral processes, business management, and time series analysis. 1984 (0 471-87826-X) 736 pp.
Description : This book provides a rigorous but elementary introduction to the theory of Markov Processes on a countable state space. It should be accessible to students with a solid undergraduate background in mathematics, including students from engineering, economics, physics, and biology. Topics covered are: Doeblin's theory, general ergodic properties, and continuous time processes. Applications are dispersed throughout the book. In addition, a whole chapter is devoted to reversible processes and the use of their associated Dirichlet forms to estimate the rate of convergence to equilibrium. These results are then applied to the analysis of the Metropolis (a.k.a simulated annealing) algorithm. The corrected and enlarged 2nd edition contains a new chapter in which the author develops computational methods for Markov chains on a finite state space. Most intriguing is the section with a new technique for computing stationary measures, which is applied to derivations of Wilson's algorithm and Kirchoff's formula for spanning trees in a connected graph.
Description : Self-contained treatment covers both theory and applications. Topics include the fundamental role of homogeneous infinite Markov chains in the mathematical modeling of psychology and genetics. 1980 edition.
Description : Markov processes are processes that have limited memory. In particular, their dependence on the past is only through the previous state. They are used to model the behavior of many systems including communications systems, transportation networks, image segmentation and analysis, biological systems and DNA sequence analysis, random atomic motion and diffusion in physics, social mobility, population studies, epidemiology, animal and insect migration, queueing systems, resource management, dams, financial engineering, actuarial science, and decision systems. Covering a wide range of areas of application of Markov processes, this second edition is revised to highlight the most important aspects as well as the most recent trends and applications of Markov processes. The author spent over 16 years in the industry before returning to academia, and he has applied many of the principles covered in this book in multiple research projects. Therefore, this is an applications-oriented book that also includes enough theory to provide a solid ground in the subject for the reader. Presents both the theory and applications of the different aspects of Markov processes Includes numerous solved examples as well as detailed diagrams that make it easier to understand the principle being presented Discusses different applications of hidden Markov models, such as DNA sequence analysis and speech analysis.
Description : This book was first published in 2006. Written by two of the foremost researchers in the field, this book studies the local times of Markov processes by employing isomorphism theorems that relate them to certain associated Gaussian processes. It builds to this material through self-contained but harmonized 'mini-courses' on the relevant ingredients, which assume only knowledge of measure-theoretic probability. The streamlined selection of topics creates an easy entrance for students and experts in related fields. The book starts by developing the fundamentals of Markov process theory and then of Gaussian process theory, including sample path properties. It then proceeds to more advanced results, bringing the reader to the heart of contemporary research. It presents the remarkable isomorphism theorems of Dynkin and Eisenbaum and then shows how they can be applied to obtain new properties of Markov processes by using well-established techniques in Gaussian process theory. This original, readable book will appeal to both researchers and advanced graduate students.