""All chapters are followed by exercises that render this text-book attractive for teachers…"" —Zentralblatt MATH ""Kirkwood…has published another significant mathematics monograph."" ""Suitable for audiences who strive to grasp the fundamental concepts of various types of Markov processes or to prepare for learning advanced stochastic processes… the monograph can serve as a textbook since it provides essential examples and exercise problems applied in economics, finance, engineering, physics, and biology."" —S-T. Kim, North Carolina A&T State University ""All chapters are followed by exercises that render this text-book attractive for teachers…"" —Zentralblatt MATH ""Kirkwood…has published another significant mathematics monograph."" ""Suitable for audiences who strive to grasp the fundamental concepts of various types of Markov processes or to prepare for learning advanced stochastic processes… the monograph can serve as a textbook since it provides essential examples and exercise problems applied in economics, finance, engineering, physics, and biology."" —S-T. Kim, North Carolina A&T State University