Key features:
- Provides a common unifying framework for discrete-time stochastic systems corrupted with both independent random perturbations and with Markovian jumps which are usually treated separately in the control literature;
- Covers preliminary material on probability theory, independent random variables, conditional expectation and Markov chains;
- Proposes new numerical algorithms to solve coupled matrix algebraic Riccati equations;
- Leads the reader in a natural way to the original results through a systematic presentation;
- Presents new theoretical results with detailed numerical examples.
The monograph is geared to researchers and graduate students in advanced control engineering, applied mathematics, mathematical systems theory and finance. It is also accessible to undergraduate students with a fundamental knowledge in the theory of stochastic systems.