This text is an introduction to the theory of stochastic processes at the undergraduate or beginning graduate level. Its primary objective is to initiate the student to the art of stochastic modeling. Mathematical definitions, theorems, proofs, and a number of classroom examples help the student to fully grasp the content of the main results, and problems of varying difficulty are proposed at the end of each chapter. The material is accessible to students who know the basics of probability theory, but a review of probability is included to make the text largely self-contained. It brings students to the borders of current research covering more advanced topics such as Martingales, eigenvalue, Gibbs fields and Monte Carlo techniques.

Preface * 1 Probability Review * 2 Discrete Time Markov Models * 3 Recurrence and Ergodicity * 4 Long Run Behavior * 5 Lyapunov Functions and Martingales * 6 Eigenvalues and Nonhomogeneous Markov Chains * 7 Gibbs Fields and Monte Carlo Simulation * 8 Continuous-Time Markov Models 9 Poisson Calculus and Queues * Appendix * Bibliography * Author Index * Subject Index