Aimed as a textbook for graduate students in applied probability and statistics, the book provides all the necessary background on Poisson processes, Markov chains, jump processes, martingales and re-generative methods. It is our hope that the provided background may encourage researchers and practitioners from other fields, like biology, genetics and medicine, who wish to become acquainted with the matrix-exponential method and its applications.